Class FileBasedOpenLineageLogStoreConnector

All Implemented Interfaces:
OpenLineageLogStore, AuditLoggingComponent, SecureConnectorExtension, VirtualConnectorExtension, IntegrationConnector, LineageIntegratorOMISConnector, OpenLineageEventListener

public class FileBasedOpenLineageLogStoreConnector extends OpenLineageLogStoreConnectorBase
FileBasedOpenLineageLogStoreConnector provides a connector implementation for a file based open lineage log. The open lineage log is stored in a directory and each open lineage event record is stored as a file with a filename built from the record's unique identifier (runId), time and status. The record is stored in a subdirectory that is made from the namespace and job.