Create HDFS apply engine script - connect_cdc_sqdata - Latest

Connect CDC (SQData) HDFS Quickstart

Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect CDC (SQData)
Version
Latest
Language
English
Product name
Connect CDC (SQData)
Title
Connect CDC (SQData) HDFS Quickstart
Copyright
2024
First publish date
2000
Last edition
2024-07-30
Last publish date
2024-07-30T20:10:32.610182

HDFS files can contain virtually any type of data. In the case of HDFS files created by the SQData Apply Engine they generally represent either the complete before and after image of the source data from the SQData Capture Agent or only selected fields from the Captured data that might represent a particular business event. The default Payload Format for HDFS is JSON.

The HDFS Apply Engine script generated in this step is a no-map replication script where the source datastore and target topics contain the identical data.

If you have a use case that involves replication of non-identical source/target datastores/topics, you will need to create Hadoop target descriptions before creating the Apply Engine.