Package org.odpi.openmetadata.adapters.connectors.integration.openlineage.postgres

Class PostgresOpenLineageEventDigest

java.lang.Object

org.odpi.openmetadata.adapters.connectors.integration.openlineage.postgres.PostgresOpenLineageEventDigest

public class PostgresOpenLineageEventDigest
extends Object

PostgresOpenLineageEventDigest extracts the rows that an OpenLineage run event contributes to the digest tables of a PostgreSQL OpenLineage log store (see PostgresOpenLineageLogStoreSchema). It holds no database code, so the extraction can be tested on its own.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final record	PostgresOpenLineageEventDigest.AssertionRow	A data quality assertion reported on an input dataset.
static final record	PostgresOpenLineageEventDigest.DatasetRow	A dataset read (I) or written (O) by the run.
static final record	PostgresOpenLineageEventDigest.RunRow	Contribution of the event to its run.
static final record	PostgresOpenLineageEventDigest.TestRow	A test reported in the run's test facet.

Method Summary

Modifier and Type	Method	Description
static PostgresOpenLineageEventDigest	digest(OpenLineageRunEvent event)	Return the digest of an event, or null if the event can not be stored because it has no job name, run identifier or readable event time.
List<PostgresOpenLineageEventDigest.AssertionRow>	getAssertions()	Return the data quality assertions.
List<PostgresOpenLineageEventDigest.DatasetRow>	getDatasets()	Return the datasets read and written.
Date	getEventTime()	Return the time of the event.
String	getEventType()	Return the event type (empty if the event had none).
OpenLineageEgeriaGovernanceActionRunFacet	getGovernanceAction()	Return the egeria governance action run facet, if the event has one.
String	getJobName()	Return the job name.
String	getJobNamespace()	Return the job namespace (empty if the event had none).
String	getProducer()	Return the producer of the event.
PostgresOpenLineageEventDigest.RunRow	getRun()	Return the contribution of the event to its run.
String	getRunId()	Return the run identifier.
List<PostgresOpenLineageEventDigest.TestRow>	getTests()	Return the tests.
static Date	parseTimestamp(String timestamp)	Parse an ISO-8601 timestamp from an OpenLineage event.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

digest

public static PostgresOpenLineageEventDigest digest(OpenLineageRunEvent event)

Return the digest of an event, or null if the event can not be stored because it has no job name, run identifier or readable event time.

Parameters:

event - event formatted using the Egeria beans

Returns:

digest or null

parseTimestamp

public static Date parseTimestamp(String timestamp)

Parse an ISO-8601 timestamp from an OpenLineage event. Timestamps without a zone are treated as UTC.

Parameters:

timestamp - string timestamp

Returns:

date or null if the timestamp is missing or unparsable

getEventTime

public Date getEventTime()

Return the time of the event.

Returns:

date

getEventType

public String getEventType()

Return the event type (empty if the event had none).

Returns:

START, RUNNING, COMPLETE, FAIL, ABORT, OTHER or empty

getRunId

public String getRunId()

Return the run identifier.

Returns:

string

getJobNamespace

public String getJobNamespace()

Return the job namespace (empty if the event had none).

Returns:

string

getJobName

public String getJobName()

Return the job name.

Returns:

string

getProducer

public String getProducer()

Return the producer of the event.

Returns:

URI as a string, or null

getGovernanceAction

public OpenLineageEgeriaGovernanceActionRunFacet getGovernanceAction()

Return the egeria governance action run facet, if the event has one.

Returns:

facet or null

getRun

public PostgresOpenLineageEventDigest.RunRow getRun()

Return the contribution of the event to its run.

Returns:

run row

getDatasets

public List<PostgresOpenLineageEventDigest.DatasetRow> getDatasets()

Return the datasets read and written.

Returns:

list

getAssertions

public List<PostgresOpenLineageEventDigest.AssertionRow> getAssertions()

Return the data quality assertions.

Returns:

list

getTests

public List<PostgresOpenLineageEventDigest.TestRow> getTests()

Return the tests.

Returns:

list