Connect for Big Data Sort Accelerator Properties - Connect_ETL - 9.13

Connect ETL for Big Data Sort User Guide
Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect (ETL, Sort, AppMod, Big Data)
Version
9.13
Language
English
Product name
Connect ETL
Title
Connect ETL for Big Data Sort User Guide
Copyright
2023
First publish date
2003
Last updated
2023-09-11
Published on
2023-09-11T19:03:59.237517

The following properties must be set as indicated in order to invoke the Connect for Big Data sort accelerator for MapReduce jobs:

mapreduce.job.map.output.collector.class

Value com.syncsort.dmexpress.hadoop.DMXMapOutputCollector

Description Sets the map side sort to Connect for Big Data Sort.
mapreduce.job.reduce.shuffle.consumer.plugin.class

Value com.syncsort.dmexpress.hadoop.DMXShuffleConsumerPlugin

Description Sets the reduce side merge to Connect for Big Data Sort.

dmx.home.dir

Value Path to <connect_install>, typically /usr/PreciselyConnect/Connect

Description Specifies where Connect for Big Data is installed. The path must be the same across all nodes in the cluster.