- The DATASTORE command is used to specify the characteristics of source and target datastores. An Engine script may reference only one primarysource DATASTORE but may write or "apply" to multiple target datastores. There may also be secondary Prior to specifying the DATASTORE command in the script, one or more DESCRIPTION commands must be provided to describe the structure of each record in the datastore.
- A CDC Datastore may contain all the changed data for multiple physical Tables or all the different type of segments in an IMS database. Depending on the nature of the Engine processing the CDC Datastore one or more physical target Datastores may be affected.
- While a Relational Source datastore can contain only a single Table, an Engine can create multiple physical target datastores.
- A hierarchical or flat file source datastore may contain many different segments or record layouts which could result in one or more physical target datastores.
- <alias> is the name used to refer to the datastore in other sections of the apply engine script
- One or more descriptions must be associated with the datastore
<datastore_type> | Used for |
---|---|
AVRO | Kafka |
Binary | Files, messaging systems |
Delimited | Files, messaging systems |
IMSCDC | IMS CDC publisher |
IMSDB | IMS database |
JSON | Files, messaging systems |
ORACLECDC | Oracle CDC publisher |
Relational | RDBMS |
UTSCDC | Db2 CDC publisher |
VSAM | VSAM dataset |
VSAMCDC | VSAM CDC publisher |
Syntax
DATASTORE <file_name>
| file://[<relative_path.> | <full_path.>] <file_name>
| <DD:ddname>[* | (<member_name>)]
| <table_name>
| RDBMS
| cdc://[<host_name_or_address>[:<port_number>]]/<agent_name>/<engine_name>
| cdcs://[<host_name_or_address>[:<port_number>]]/<agent_name>/<engine_name>
| tcp://<hostname>/<tcpip_port>
| mqs://[<qmgr_name>]/<queue_name> [:<correl_id>]
| kafka://[<hostname>[:<port_number>]] / [<kafka_topic_id>][/<partition> | key | root_key]
| hdfs://<hostname>[:<port_number>]/<hdfs_file_name>
OF <DATASTORE_TYPE> AVRO | BINARY | DB2LOAD | DELIMITED | HSSUNLOAD | IMSCDC | IMSDB | JSON | ORACLECDC | RELATIONAL | UTSCDC | VSAM | VSAMCDC | XMLCDC
[CHRDEL(‘<delchr>’)]
[COLDEL(‘<delchr>’)]
[RECDEL(‘<delchr>’)]
[CCSID <code> | ASCII | EBCDIC ]
[STAGING SIZE <nG>] -- file size in Gigabytes
[STAGING DELAY <mm>] -- rotate every mm minutes
AS <datastore_alias>
DESCRIBED BY <description_alias1> [,<description_alias2>,…, <description_aliasn>] | DUMMY
DESCRIBED BY GROUP <group_name>
[ACCEPT ALL]
[BYPASS CHGCHECK]
[CHECK FULL BEFORE IMAGE]
[COMPENSATE]
[COMPENSATE WITH WARNING]
[NO COMPENSATION]
[EXCEPTION <exception_datastore>]
[FOR CHANGE|INSERT]
[FORCE QUALIFIER <high_level>
[FORMAT [CONFLUENT | CONTAINER | PLAIN]
[IMSPATHDATA]
[KEEP NULL FIELDS]
[KEY IS <key1> [,<key2>...,<keyn>]]
[OPERATION IS <change_op_field>]
[PROCESS COMMIT]
[QUERY </+ <SQL Select and Where clause> +/>]
[RECONNECT]
[RRS]
[SINGLE IMAGE]
[STRIP TRAILING SPACES]
[WTO ON COMPENSATION EVERY <n> MINUTES]
[WTO ON EXCEPTION ONCE]