Class KafkaTopicIntegrationConnector
java.lang.Object
org.odpi.openmetadata.frameworks.connectors.Connector
org.odpi.openmetadata.frameworks.connectors.ConnectorBase
org.odpi.openmetadata.frameworks.integration.connectors.IntegrationConnectorBase
org.odpi.openmetadata.adapters.connectors.apachekafka.integration.KafkaTopicIntegrationConnector
- All Implemented Interfaces:
AuditLoggingComponent
,SecureConnectorExtension
,VirtualConnectorExtension
,CatalogTargetIntegrator
,IntegrationConnector
public class KafkaTopicIntegrationConnector
extends IntegrationConnectorBase
implements CatalogTargetIntegrator
KafkaTopicIntegrationConnector catalogues active topics in a kafka broker.
-
Nested Class Summary
Nested classes/interfaces inherited from class org.odpi.openmetadata.frameworks.connectors.ConnectorBase
ConnectorBase.ProtectedConnection
-
Field Summary
Fields inherited from class org.odpi.openmetadata.frameworks.integration.connectors.IntegrationConnectorBase
auditLog, catalogTargetsManager, connectorName, integrationContext
Fields inherited from class org.odpi.openmetadata.frameworks.connectors.ConnectorBase
connectionBean, connectorInstanceId, embeddedConnectors, messageFormatter, secretsStoreConnectorMap
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionvoid
Shutdown kafka monitoringvoid
integrateCatalogTarget
(RequestedCatalogTarget requestedCatalogTarget) Perform the required integration logic for the assigned catalog target.void
refresh()
Requests that the connector does a comparison of the metadata in the third party technology and open metadata repositories.void
refreshEndpointTarget
(ApacheKafkaAdminConnector apacheKafkaAdminConnector) Processes any event broker configured in this connector's connection.Methods inherited from class org.odpi.openmetadata.frameworks.integration.connectors.IntegrationConnectorBase
engage, getConnectorComponentDescription, getNetworkAddress, passEventToCatalogTargets, refreshCatalogTargets, registerCatalogTargetChangeListener, setAuditLog, setConnectorName, setContext, start
Methods inherited from class org.odpi.openmetadata.frameworks.connectors.ConnectorBase
combineConfigurationProperties, disconnectConnectors, equals, getArrayConfigurationProperty, getArrayConfigurationProperty, getArrayConfigurationProperty, getBooleanConfigurationProperty, getConnection, getConnectorInstanceId, getDateConfigurationProperty, getIntConfigurationProperty, getLongConfigurationProperty, getStringConfigurationProperty, getStringConfigurationProperty, getSuppliedPlaceholderProperties, hashCode, initialize, initializeEmbeddedConnectors, initializeSecretsStoreConnector, isActive, logExceptionRecord, logRecord, logRecord, throwMissingConfigurationProperty, throwMissingEndpointAddress, throwMissingResource, throwNoAsset, throwWrongTypeOfAsset, throwWrongTypeOfResource, throwWrongTypeOfRootSchema, toString
Methods inherited from class org.odpi.openmetadata.frameworks.connectors.Connector
clearStatisticProperty, clearStatisticTimestamp, getConnectorStatistics, getStatisticCounter, getStatisticProperty, getStatisticTimestamp, incrementStatisticCounter, initializeStatisticCounter, refreshStatistics, setStatisticProperty, setStatisticTimestamp
Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
Methods inherited from interface org.odpi.openmetadata.frameworks.integration.connectors.CatalogTargetIntegrator
getNewRequestedCatalogTargetSkeleton
Methods inherited from interface org.odpi.openmetadata.frameworks.connectors.VirtualConnectorExtension
initializeEmbeddedConnectors
-
Constructor Details
-
KafkaTopicIntegrationConnector
public KafkaTopicIntegrationConnector()
-
-
Method Details
-
refresh
Requests that the connector does a comparison of the metadata in the third party technology and open metadata repositories. Refresh is called when the integration connector first starts and then at intervals defined in the connector's configuration as well as any external REST API calls to explicitly refresh the connector. This method performs two sweeps. It first retrieves the topics from the event broker (Kafka) and validates that are in the catalog - adding or updating them if necessary. The second sweep is to ensure that all the topics catalogued actually exist in the event broker.- Specified by:
refresh
in interfaceIntegrationConnector
- Throws:
ConnectorCheckedException
- there is a problem with the connector. It is not able to refresh the metadata.
-
refreshEndpointTarget
public void refreshEndpointTarget(ApacheKafkaAdminConnector apacheKafkaAdminConnector) throws ConnectorCheckedException Processes any event broker configured in this connector's connection.- Throws:
ConnectorCheckedException
- there is a problem within the connector.
-
integrateCatalogTarget
public void integrateCatalogTarget(RequestedCatalogTarget requestedCatalogTarget) throws ConnectorCheckedException Perform the required integration logic for the assigned catalog target.- Specified by:
integrateCatalogTarget
in interfaceCatalogTargetIntegrator
- Parameters:
requestedCatalogTarget
- the catalog target- Throws:
ConnectorCheckedException
- there is an unrecoverable error and the connector should stop processing.
-
disconnect
Shutdown kafka monitoring- Specified by:
disconnect
in interfaceIntegrationConnector
- Overrides:
disconnect
in classIntegrationConnectorBase
- Throws:
ConnectorCheckedException
- something failed in the super class
-