Create a new server for FileSystem - Connect_CDC - connect_cdc_mimix_share - Latest

Connect CDC Getting Started Guide

Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect CDC (MIMIX Share)
Version
Latest
Language
English
Product name
Connect CDC
Title
Connect CDC Getting Started Guide
Copyright
2024
First publish date
2003
Last updated
2024-09-11
Published on
2024-09-11T13:50:21.429182

This section describes how you create a new server for FileSystem.

  1. On the Servers Properties dialog select FileSystem from the dropdown list in the DBMS type section.

  2. Enter information for each field on the Server Properties dialog. Refer to Table 4 for field information.

Table 1. Server Properties dialog for FileSystem

Parameter

Description

Name

Use alphanumeric characters to specify a unique server name for use in the model.

Note: The slash (/), backslash (\), colon (:), left caret (<), right caret (>) and spaces cannot be used in a server name.

DBMS Type

Select FileSystem from the dropdown list.

GMT offset (minutes)

Displays the amount of time, in minutes, that local time differs from Greenwich Mean Time (GMT). For example, Boston is 300 minutes less than GMT. (Informational only)

Settings tab

Parameter

Description

Use default location

When checked, sets the default location in the kernel directory to <install_location>/targetfiles/<modelname>/<File Server label name>. If unchecked, you must add the path of the file location box. This can be specified as a full path or a relative path (added from the kernel directory).

Location

Displays the file location. This can be changed.

Rollover criteria

Models the target file to roll over to a new operating system file based on specified events. The default setting is when a request stops. The other options are:

  • Select a specific point in time, specified as hours:minutes:seconds, using a 24-hour clock (for example, 23:00 for 11:00 pm). You cannot specify a day, only the time during the day.

  • After a specific interval, expressed in HH:MM:SS, where HH is any positive integer, and MM and SS are minutes and seconds. The hours may be greater than 24.

  • After the file reaches a specific size in characters.

  • After a file contains some number of rows.

  • When the request stops, sends an alert notification is sent to the monitoring and control tools, such as Connect CDC MonCon, when the file rolls over, based on the set criteria.

When the file rolls over, the format is:

Target File name_YYYYMMDDHHmmSS_rev.csv

where YYYY stands for the year, MM for the month, DD for the day, HH for hours, mm for minutes, SS for seconds, rev for the revision number.

File format

Sets the format for messages passed to Kafka:

CSV (No Schema): Comma Separated Values

Json: encodes messages in json objects, rather than json frag­ments, readable by a json parser

Omit null columns

Discards data resulting in a null value from the message. Only available for targets set to use the Json message format.

Images for update

Sets how Connect CDC writes Before and After values for all columns to the file when it captures an update statement:

After image only: Default. Connect CDC only writes After values to the record.

Both in the same record: Connect CDC writes both Before and After values to the same record. Only available for targets set to use the Json message format.

Each in a separate record: Connect CDC writes both Before and After values to different records. Connect CDC sets the before value entry in the sv_manip_type column to B.

Character set

One of the following:

  • Default–This is the operating system character set.

  • UTF-8–Use this if the source table contains Unicode columns.

Null String

The default is “~”. Connect CDC differentiates between null and empty strings. Connect CDC identifies an empty string as no character.

Quote character

The default is a double quote ("). The quote character has the same requirements as the delimiter character.

Field

The default field delimiter character is the comma. For the allowable set of characters see Valid character set for field and record.

Record

The default record delimiter character is \n for Unix, >\r\n for Windows. For the allowable set of characters see Valid character set for field and record.

Include before values

When selected, Before and After values for all columns will be written to the File Server when an update statement is captured. The Before value entry in the  column will be B.

Valid Character Set for Field and Record

 

 

You can specify multiple printable characters as delimiters. The default size value of the record delimiter is 10 and 20 in the case where escaped characters are used. At least one printable character and 2 for escaped character should be entered as a delimiter.

Valid Values and Limitations

  • Maximum printable characters allowed:10

  • Minimum printable characters allowed:1

  • Any upper and lower case letters

  • Any numeric digits

  • Any special characters from the following set:

  `,~!@#$%^&*()-_++{}[]|;:”’<>./?
  • Escaped characters ( backslash character “\”), followed by the characters from the following subset:

t, n, \, 0, or r will be counted as 1 character. If you use a space you must enter \b. The binary zero is notallowed in the list of escaped characters.

Note: You can mix all of the above characters as delimiters.