File to JSON Kafka - connect_cdc_sqdata - Latest

Connect CDC (SQData) Replicator Engine

Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect CDC (SQData)
Version
Latest
Language
English
Product name
Connect CDC (SQData)
Title
Connect CDC (SQData) Replicator Engine
Copyright
2024
First publish date
2000
ft:lastEdition
2024-08-01
ft:lastPublication
2024-08-01T16:58:30.842568

Simple JSON formatted Kafka where the * (asterisk) specifies that every source object name (i.e. table name) will become the Topic name.

Syntax
OPTIONS [AVRO COMPATIBLE NAMES]
,[CONFLUENT REPOSITORY <registry_url>]
,[MAX IN FLIGHT <number>]
,[ISO8601 PRECISION <number>]
,[METADATA (<metadata_name> [AS <metadata_alias> ] [,<metadata_name> [AS <metadata_alias> ]] [, ...])]
,[STRIP TRAILING SPACES]
,[ROTATE DELAY <duration>]
,[ROTATE SIZE <size> [K|M|G]]
,[NAMESPACE '<namespace>']
, [FORMAT TOMBSTONE]
Example

REPLICATE DB2 file:./data/G1A02_001.DAT
              TO JSON 'kafka:///*/key'
              WITH 1 WORKER
;
OPTIONS
LOGICAL DECIMAL TYPE,
STRIP TRAILING SPACES,
FORMAT TOMBSTONE,
IGNORE NOMAPPING,
MAX IN FLIGHT 100,
UOW CACHE MEMORY OF 512M
;
MAPPINGS
 SOURCE SQDATA.TBLT6
    TOPIC SQD_RPL_DEPT6_JSON_T
,SOURCE SQDATA.TBLT6
    TOPIC SQD_RPL_DEPT2_JSON_T
;