DataStax Apache Pulsar™ Connector has a simple yet powerful syntax for mapping fields from a Pulsar record to columns in a supported database table. An instance of the DataStax Apache Pulsar™ Connector can capture multiple topics and supports mapping a single topic to one or more tables.
DataStax Apache Pulsar™ Connector supports topic-to-table mappings with supported databases:
-
cfgPulsarDisplayingTopic.adoc Display messages to determine the data structure of the topic messages.
-
cfgPulsarMapKeyPair.adoc Create a topic-table map for Pulsar messages that only contain a key and value in each record.
-
cfgPulsarMapJson.adoc For JSON fields, map individual fields in the structure to columns.
-
cfgPulsarMapAvroMessages.adoc Supports mapping individual fields from a Avro format field.
-
cfgPulsarRecordHeaderToTable.adoc Extract values from Pulsar record header and write to the database table.
-
cfgPulsarMapUdt.adoc Write complex types directly into User-defined Types (UDT).
-
cfgPulsarMapMultipleTables.adoc Ingest a single topic into multiple tables using a single connector instance.
-
cfgPulsarMultTopicToTables.adoc Ingest multiple topics and write to different tables using a single connector instance.
-
cfgPulsarSelectiveUpdateMapsAndUdts.adoc Selectively update maps and UDTs based on Pulsar fields.
-
cfgPulsarCqlQuery.adoc Provide CQL queries when new record arrives on the Pulsar topic.
-
cfgPulsarNowFunction.adoc You can use the now() function in mappings.