Add source data structures - connect_cdc_sqdata - Latest

Connect CDC (SQData) HDFS Quickstart

Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect CDC (SQData)
Version
Latest
Language
English
Product name
Connect CDC (SQData)
Title
Connect CDC (SQData) HDFS Quickstart
Copyright
2024
First publish date
2000
Last edition
2024-07-30
Last publish date
2024-07-30T20:10:32.610182

This section assumes that full before and after data is being placed in the Hadoop HDFS datastore. SQData simplifies creation of each record via a single "Replicate" Command. Replicate uses the source data structure "DESCRIPTION" for both source and target. The SQData Apply Engine will automatically handle both Code Page translation and Data Type transformation as well as provide for the handling of invalid source data when applicable.

Example

The source data structures, typically in the form of COBOL copybooks for IMS or VSAM source data or DDL for Relational source data are placed into the Data Type specific directories created previously.
BEGIN GROUP DB2_SOURCE;
DESCRIPTION DB2SQL ./DB2DDL/EMP.ddl AS EMP
 KEY IS EMP_NO;
DESCRIPTION DB2SQL ./DB2DDL/DEPT.ddl AS DEPT
 KEY IS DEPT_NO;
END GROUP;
The content of the DB2 source DDL for the EMPLOYEE table in the EMP.ddl file:
 CREATE TABLE EMPLOYEE
 ( EMP_NO                          CHAR(6) NOT NULL
   ,FIRSTNME                       VARCHAR(12) NOT NULL
   ,MIDINIT                        CHAR(1) NOT NULL
   ,LASTNAME                       VARCHAR(15) NOT NULL
   ,WORKDEPT CHAR(3)
   ,PHONENO CHAR(4)
   ,HIREDATE DATE
   ,JOB CHAR(8)
   ,EDLEVEL SMALLINT
   ,SEX CHAR(1)
   ,BIRTHDATE DATE
   ,SALARY DECIMAL(9, 2)
   ,BONUS DECIMAL(9, 2)
   ,COMM DECIMAL(9, 2)
 );