Package org.odpi.openmetadata.adapters.connectors.lineageinsight.openlineage
package org.odpi.openmetadata.adapters.connectors.lineageinsight.openlineage
Lovelace services that analyse a historical store of OpenLineage events (as written by the file-based
OpenLineage log store integration connector) and refine the metadata that the OpenLineage cataloguer
maintains as events arrive: the run profile of each process, the data scope of each data asset and a
summary of the data quality results reported for each data asset.
-
ClassDescriptionLovelaceOpenLineageAnalysisServiceBase is the common base for the Lovelace services that analyse a historical OpenLineage log store.LovelaceOpenLineageDataQualitySummaryService analyses the data quality assertions and tests reported in an OpenLineage log store and records, for each dataset (and for each job's tests), the pass rate of each quality dimension over the analysis window.LovelaceOpenLineageDataQualitySummaryServiceProvider is the connector provider for the LovelaceOpenLineageDataQualitySummaryService governance action service.LovelaceOpenLineageDataScopeService analyses the series of writes to each dataset in an OpenLineage log store and refines the DataScope classification of the dataset's asset.LovelaceOpenLineageDataScopeServiceProvider is the connector provider for the LovelaceOpenLineageDataScopeService governance action service.LovelaceOpenLineageRunProfilerService analyses the series of runs of each job in an OpenLineage log store and records the run profile - how often the job runs, how regularly, how long it takes, how often it fails and how much data it handles - in the RunMetrics classification of the job's process.LovelaceOpenLineageRunProfilerServiceProvider is the connector provider for the LovelaceOpenLineageRunProfilerService governance action service.OpenLineageAnalysisActionTarget provides the action targets supported by the OpenLineage analysis Lovelace services.OpenLineageAnalysisRequestParameter provides the request parameters supported by the OpenLineage analysis Lovelace services.OpenLineageLogStoreReader walks the directory tree written by the file-based OpenLineage log store integration connector ({directory}/{namespace}/{job}/{runId}-{timestamp}-{eventType}.openlineageevent), parses each run event and accumulates it into an OpenLineageRunHistory.OpenLineageRunHistory is the in-memory model of a window of OpenLineage events read from a log store.A data quality assertion evaluated against a dataset.The writes, reads and assertions seen for a dataset.The runs seen for a job.Identity of a job or dataset in OpenLineage.A read of a dataset by a run.The events seen for a single run of a job.A test reported by the test run facet.A write to a dataset by a run.