Create HDFS apply engine script - connect_cdc_sqdata - Latest

Connect CDC (SQData) HDFS Quickstart

Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect CDC (SQData)
Version
Latest
ft:locale
en-US
Product name
Connect CDC (SQData)
ft:title
Connect CDC (SQData) HDFS Quickstart
Copyright
2024
First publish date
2000
ft:lastEdition
2024-11-25
ft:lastPublication
2024-11-25T15:07:58.704000

HDFS files can contain virtually any type of data. In the case of HDFS files created by the SQData Apply Engine they generally represent either the complete before and after image of the source data from the SQData Capture Agent or only selected fields from the Captured data that might represent a particular business event. The default Payload Format for HDFS is JSON.

The HDFS Apply Engine script generated in this step is a no-map replication script where the source datastore and target topics contain the identical data.

If you have a use case that involves replication of non-identical source/target datastores/topics, you will need to create Hadoop target descriptions before creating the Apply Engine.