Using the transformation builder in an external data store - Data360_DQ+ - Latest

Data360 DQ+ Help

Product type
Software
Portfolio
Verify
Product family
Data360
Product
Data360 DQ+
Version
Latest
Language
English
Product name
Data360 DQ+
Title
Data360 DQ+ Help
Copyright
2024
First publish date
2016
ft:lastEdition
2024-07-09
ft:lastPublication
2024-07-09T15:09:58.774265

You can access the schema and transformation builder from an external data store that has one of the following layout types.

  • Avro
  • JSON
  • ORC
  • Parquet
  • XML

Viewing and schema transformations

Note: These steps apply if the Store Repository Type is S3 or Default. For information about Kafka data stores, see Using the transformation builder in a Kafka data store.

Complete the following steps to view the current transformations.

  1. Navigate to the data store.
  2. Click EditEdit Stage.
  3. Select the Details tab.
  4. In the Layout panel, click Edit Transformations. The Edit Transformations dialog is displayed.

Editing schema transformations

With the Edit Transformations dialog open, you can add or edit existing schema elements. For more information, see Building schema manually.

Refreshing the schema

If the schema is not displayed, click Refresh Schema. The schema is generated from the sample input file, and displayed. For example, `age` BIGINT,`registered` BOOLEAN,`email` STRING.

If you have made changes to the generated schema, for example by changing the way an array in the input is handled, these changes will be preserved

 

Viewing SQL