Datastore section - connect_cdc_sqdata - Latest

Connect CDC (SQData) Apply engine

Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect CDC (SQData)
Version
Latest
Language
English
Product name
Connect CDC (SQData)
Title
Connect CDC (SQData) Apply engine
Copyright
2024
First publish date
2000
ft:lastEdition
2024-07-30
ft:lastPublication
2024-07-30T20:19:56.898694
  • The DATASTORE command is used to specify the characteristics of source and target datastores. An Engine script may reference only one primarysource DATASTORE but may write or "apply" to multiple target datastores. There may also be secondary Prior to specifying the DATASTORE command in the script, one or more DESCRIPTION commands must be provided to describe the structure of each record in the datastore.
  • A CDC Datastore may contain all the changed data for multiple physical Tables or all the different type of segments in an IMS database. Depending on the nature of the Engine processing the CDC Datastore one or more physical target Datastores may be affected.
  • While a Relational Source datastore can contain only a single Table, an Engine can create multiple physical target datastores.
  • A hierarchical or flat file source datastore may contain many different segments or record layouts which could result in one or more physical target datastores.
  • <alias> is the name used to refer to the datastore in other sections of the apply engine script
  • One or more descriptions must be associated with the datastore
<datastore_type> Used for
AVRO Kafka
Binary Files, messaging systems
Delimited Files, messaging systems
IMSCDC IMS CDC publisher
IMSDB IMS database
JSON Files, messaging systems
ORACLECDC Oracle CDC publisher
Relational RDBMS
UTSCDC Db2 CDC publisher
VSAM VSAM dataset
VSAMCDC VSAM CDC publisher
Syntax
DATASTORE <file_name>
        | file://[<relative_path.> | <full_path.>] <file_name>
        | <DD:ddname>[* | (<member_name>)]
        | <table_name>
        | RDBMS
        | cdc://[<host_name_or_address>[:<port_number>]]/<agent_name>/<engine_name>
        | cdcs://[<host_name_or_address>[:<port_number>]]/<agent_name>/<engine_name>
        | tcp://<hostname>/<tcpip_port>
        | mqs://[<qmgr_name>]/<queue_name> [:<correl_id>]
        | kafka://[<hostname>[:<port_number>]] / [<kafka_topic_id>][/<partition> | key | root_key]
        | hdfs://<hostname>[:<port_number>]/<hdfs_file_name>
      OF <DATASTORE_TYPE> AVRO | BINARY | DB2LOAD | DELIMITED | HSSUNLOAD | IMSCDC | IMSDB | JSON | ORACLECDC | RELATIONAL | UTSCDC | VSAM | VSAMCDC | XMLCDC
        [CHRDEL(‘<delchr>’)]
        [COLDEL(‘<delchr>’)]
        [RECDEL(‘<delchr>’)]
        [CCSID <code> | ASCII | EBCDIC ]
        [STAGING SIZE <nG>]                   -- file size in Gigabytes
        [STAGING DELAY <mm>]                 -- rotate every mm minutes
      AS <datastore_alias>
      DESCRIBED BY <description_alias1> [,<description_alias2>,…, <description_aliasn>] |  DUMMY
      DESCRIBED BY GROUP <group_name>
      [ACCEPT ALL]
      [BYPASS CHGCHECK]
      [CHECK FULL BEFORE IMAGE]
      [COMPENSATE]
      [COMPENSATE WITH WARNING]
      [NO COMPENSATION]
      [EXCEPTION <exception_datastore>]
      [FOR CHANGE|INSERT]
      [FORCE QUALIFIER <high_level>
      [FORMAT [CONFLUENT | CONTAINER | PLAIN]
      [IMSPATHDATA]
      [KEEP NULL FIELDS]
      [KEY IS <key1> [,<key2>...,<keyn>]]
      [OPERATION IS <change_op_field>]
      [PROCESS COMMIT]
      [QUERY </+ <SQL Select and Where clause> +/>]
      [RECONNECT]
      [RRS]
      [SINGLE IMAGE]
      [STRIP TRAILING SPACES]
      [WTO ON COMPENSATION EVERY <n> MINUTES]
      [WTO ON EXCEPTION ONCE]