Skip to content

File-based Open Lineage Log Store Integration Connector

Connector details

Overview

The File-based OpenLineage Log Store integration connector stores open lineage events to the file system.

Figure 1

Figure 1: Operation of the File-based OpenLineage log store integration connector

Configuration

This connector uses the Lineage Integrator OMIS running in the Integration Daemon.

This is its connection definition to use on the administration commands that configure the API Integrator OMIS.

Connection configuration

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
{
   "connection" : 
                { 
                    "class" : "Connection",
                    "qualifiedName" : "Egeria:IntegrationConnector:Lineage:FileBasedOpenLineageLogStore Connection",
                    "connectorType" : 
                    {
                        "class" : "ConnectorType",
                        "connectorProviderClassName" : "org.odpi.openmetadata.adapters.connectors.integration.lineage.FileBasedOpenLineageLogStoreProvider"
                    },
                    "endpoint" :
                    {
                        "class" : "Endpoint",
                        "address" : "{{folderName}}"
                    }
                }
}
  • Replace {{folderName}} with the path name of the folder where the files will be located.
Back to top