Class OpenLineageCataloguerIntegrationConnector

All Implemented Interfaces:
AuditLoggingComponent, SecureConnectorExtension, VirtualConnectorExtension, IntegrationConnector, LineageIntegratorOMISConnector, OpenLineageEventListener

public class OpenLineageCataloguerIntegrationConnector extends LineageIntegratorConnector implements OpenLineageEventListener
OpenLineageCataloguerIntegrationConnector is an integration connector to register an OpenLineage listener with the Lineage Integrator OMIS and to catalog any processes that are not already known to the open metadata ecosystem.
  • Field Details

  • Constructor Details

    • OpenLineageCataloguerIntegrationConnector

      public OpenLineageCataloguerIntegrationConnector()
      Default constructor
  • Method Details

    • start

      public void start() throws ConnectorCheckedException
      Indicates that the connector is completely configured and can begin processing.
      Specified by:
      start in interface IntegrationConnector
      start in class ConnectorBase
      ConnectorCheckedException - there is a problem within the connector.
    • refresh

      public void refresh() throws ConnectorCheckedException
      Requests that the connector does a comparison of the metadata in the third party technology and open metadata repositories. Refresh is called when the integration connector first starts and then at intervals defined in the connector's configuration as well as any external REST API calls to explicitly refresh the connector.
      Specified by:
      refresh in interface IntegrationConnector
      ConnectorCheckedException - there is a problem with the connector. It is not able to refresh the metadata.
    • processOpenLineageRunEvent

      public void processOpenLineageRunEvent(OpenLineageRunEvent event, String rawEvent)
      Called each time an open lineage run event is published to the Lineage Integrator OMIS. The integration connector is able to work with the formatted event using the Egeria beans or reformat the open lineage run event using the supplied open lineage backend beans or another set of beans.
      Specified by:
      processOpenLineageRunEvent in interface OpenLineageEventListener
      event - run event formatted using Egeria supplied beans (null if egeria can not format the event)
      rawEvent - json payload received for the event