Connect for Big Data requires the following:
- Connect for Big Data Edition
- A supported Hadoop MapReduce and/or Spark
distribution:
- MapReduce
- Cloudera CDH 5.x (5.2 and higher) – YARN (MRv2)
- Hortonworks Data Platform (HDP) 2.x (2.3 and higher) – YARN
- Apache Hadoop 2.x (2.2 and higher) – YARN
- MapR, Community Edition and Enterprise Edition only (previously termed M5 and M7, respectively), 6.x – YARN
- Pivotal HD 3.0 – YARN
Connect for Big Data is certified as ODPi (1.0 and higher) interoperable.
- Spark
- Spark on YARN on the following Hadoop
distributions:
- Cloudera CDH 5.x (5.5 and higher)
- Hortonworks Data Platform (HDP) 2.3.4, 2.x (2.4 and higher)
- MapR 5.x (5.1 and higher), Community Edition and Enterprise Edition only (previously named M5 and M7, respectively)
- Spark on Mesos 0.21.0
- Spark Standalone 1.5.2 and higher
- Spark on YARN on the following Hadoop
distributions:
- MapReduce