Package org.odpi.openmetadata.adapters.connectors.lineageinsight.openlineage

Class LovelaceOpenLineageRunProfilerService

java.lang.Object

org.odpi.openmetadata.frameworks.connectors.Connector

org.odpi.openmetadata.frameworks.connectors.ConnectorBase

org.odpi.openmetadata.frameworks.opengovernance.GovernanceActionServiceConnector

org.odpi.openmetadata.frameworks.opengovernance.GeneralGovernanceActionService

org.odpi.openmetadata.adapters.connectors.lineageinsight.openlineage.LovelaceOpenLineageAnalysisServiceBase

org.odpi.openmetadata.adapters.connectors.lineageinsight.openlineage.LovelaceOpenLineageRunProfilerService

All Implemented Interfaces:

AuditLoggingComponent, SecureConnectorExtension, VirtualConnectorExtension, GovernanceActionService

public class LovelaceOpenLineageRunProfilerService
extends LovelaceOpenLineageAnalysisServiceBase

LovelaceOpenLineageRunProfilerService analyses the series of runs of each job in an OpenLineage log store and records the run profile - how often the job runs, how regularly, how long it takes, how often it fails and how much data it handles - in the RunMetrics classification of the job's process. The OpenLineage cataloguer keeps the counts and latest values in RunMetrics as events arrive; this service adds the derived values that need the run series, in the classification's additional properties.

Nested Class Summary

Nested classes/interfaces inherited from class org.odpi.openmetadata.frameworks.connectors.ConnectorBase

ConnectorBase.ProtectedConnection

Field Summary

Fields inherited from class org.odpi.openmetadata.adapters.connectors.lineageinsight.openlineage.LovelaceOpenLineageAnalysisServiceBase

ANALYSIS_SERVICE_PROPERTY, ANALYSIS_TIME_PROPERTY, ANALYSIS_WINDOW_END_PROPERTY, ANALYSIS_WINDOW_START_PROPERTY, analysisTime, windowEnd, windowStart

Fields inherited from class org.odpi.openmetadata.frameworks.opengovernance.GeneralGovernanceActionService

governanceContext

Fields inherited from class org.odpi.openmetadata.frameworks.opengovernance.GovernanceActionServiceConnector

governanceServiceName, propertyHelper

Fields inherited from class org.odpi.openmetadata.frameworks.connectors.ConnectorBase

auditLog, connectionBean, connectorInstanceId, embeddedConnectors, messageFormatter, secretsStoreConnectorMap

Constructor Summary

Constructors

Constructor	Description
LovelaceOpenLineageRunProfilerService()	Default constructor

Method Summary

Modifier and Type	Method	Description
protected int	analyse(OpenLineageRunHistory history)	Profile the runs of each job.
protected String	getAnalysisDescription()	Describe what the service produces.

Methods inherited from class org.odpi.openmetadata.adapters.connectors.lineageinsight.openlineage.LovelaceOpenLineageAnalysisServiceBase

addAnalysisProperties, findDataAsset, findProcess, formatDate, formatDuration, getWindowDays, put, put, start

Methods inherited from class org.odpi.openmetadata.frameworks.opengovernance.GeneralGovernanceActionService

disconnect, getActionTarget, getAllActionTargets, getProperty, setGovernanceContext

Methods inherited from class org.odpi.openmetadata.frameworks.opengovernance.GovernanceActionServiceConnector

getArrayRequestParameter, getBooleanRequestParameter, getConnectorComponentDescription, getIntRequestParameter, getLongRequestParameter, getStringRequestParameter, handleUnexpectedException, setAuditLog, setGovernanceServiceName, validateContext

Methods inherited from class org.odpi.openmetadata.frameworks.connectors.ConnectorBase

combineConfigurationProperties, disconnectConnectors, equals, fromCamelToCanonicalCase, fromCanonicalToCamelCase, fromCanonicalToKebabCase, fromCanonicalToSnakeCase, fromKebabToCanonicalCase, fromSnakeToCanonicalCase, getArrayConfigurationProperty, getArrayConfigurationProperty, getArrayConfigurationProperty, getBooleanConfigurationProperty, getConnection, getConnectorInstanceId, getDateConfigurationProperty, getIntConfigurationProperty, getLongConfigurationProperty, getSecretsCollectionName, getSecretsLocation, getSecretsProvider, getStringConfigurationProperty, getStringConfigurationProperty, getSuppliedPlaceholderProperties, hashCode, initialize, initializeEmbeddedConnectors, initializeSecretsStoreConnector, isActive, logExceptionRecord, logExceptionRecord, logRecord, logRecord, throwMissingConfigurationProperty, throwMissingElement, throwMissingEndpointAddress, throwMissingResource, throwNoAsset, throwWrongTypeOfAsset, throwWrongTypeOfResource, throwWrongTypeOfRootSchema, toString

Methods inherited from class org.odpi.openmetadata.frameworks.connectors.Connector

clearStatisticProperty, clearStatisticTimestamp, getConnectorStatistics, getStatisticCounter, getStatisticProperty, getStatisticTimestamp, incrementStatisticCounter, initializeStatisticCounter, refreshStatistics, setStatisticProperty, setStatisticTimestamp

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Details

LovelaceOpenLineageRunProfilerService

public LovelaceOpenLineageRunProfilerService()

Default constructor

Method Details

getAnalysisDescription

protected String getAnalysisDescription()

Describe what the service produces.

Specified by:

getAnalysisDescription in class LovelaceOpenLineageAnalysisServiceBase

Returns:

description

analyse

protected int analyse(OpenLineageRunHistory history)
               throws InvalidParameterException,
PropertyServerException,
UserNotAuthorizedException

Profile the runs of each job.

Specified by:

analyse in class LovelaceOpenLineageAnalysisServiceBase

Parameters:

history - events in the analysis window

Returns:

number of processes updated

Throws:

InvalidParameterException - invalid parameter

PropertyServerException - repository problem

UserNotAuthorizedException - security problem