Kafka distributed streaming platform - connect_cdc_sqdata - Latest

Connect CDC (SQData) Apply engine
Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect CDC (SQData)
Version
Latest
ft:locale
en-US
Product name
Connect CDC (SQData)
ft:title
Connect CDC (SQData) Apply engine
Copyright
2026
First publish date
2000
ft:lastEdition
2026-08-24
ft:lastPublication
2026-08-24T13:31:43.482000
L1_Product_Gateway
Integrate
L2_Product_Segment
Data Integration
L3_Product_Brand
Precisely Connect
L4_Investment_Segment
Application Data Integration
L5_Product_Group
ADI - Connect
L6_Product_Name
Connect CDC
Table 1. Changes in this topic
Change type Description
Updated in version 5.0.6 Updated Schema Registry description to include Protobuf schema generation alongside AVRO.
Apache's Distributed Streaming Platform, Kafka, is a robust tool for building real-time streaming data pipelines on Open Systems platforms. Its functionality is similar to IBM's MQ and more robust than Java Messaging Service (JMS) however it is not natively supported on z/OS. Connect CDC SQData bridges the gap between z/OS and Kafka with its DB2 and IMS Change Data Capture on Z/OS, Replicator Engine running on Linux and Apply Engine Kafka Consumers running on Linux. This provides a hybrid solution that effectively supports three of Kafka's four core API's without modification of z/OS business applications in heterogeneous z/OS and Open Systems environments:
  • The Producer API which allows a business application to publish a stream of events to one or more Kafka topics.
  • The Connector API that can connect Kafka topics to existing source databases. For example, a connector to a relational database that captures every change to a table.
  • The Consumer API that can connect the Apply Engine to a partitioned stream of CDC Data to facilitate Parallel Apply processing to Relational databases and other Targets.

Connect CDC (SQData) high performance Change Data Capture can be used to detect business events that "Change Data" in real time and/or capture all changes that occur in a DB2 source database. The resulting CDC data is processed by the Replicator Engine running on Linux that formats and publishes Kafka Topics using the Producer API.

Connect CDC (SQData) also seamlessly supports Confluent's proprietary Schema Registry by automating the generation of AVRO and Protobuf schemas for new tables and updating those schemas when they change in the Relational source database.

Architecture diagram showing Db2 z/OS Change Data Capture connecting via TCP/IP to an Apply Engine on Linux writing to Kafka topics using Confluent Schema Registry.

When operating in Replicator / Distributor mode, streaming IMS CDC data can be partitioned for parallel Apply Engines facilitating higher performance Replication of non-relational data than otherwise possible.

Architecture diagram showing IMS CDC data from z/OS distributed by the IMS Replicator Distributor on Linux to Kafka partitioned topics, consumed by Apply Engine consumer groups writing to RDBMS and Kafka targets.