Integrating the Routing Jar with Hue - Spectrum_Routing_for_Big_Data - 5.1

Spectrum Routing Installation: Cloudera

Product type
Software
Portfolio
Locate
Product family
Spectrum
Product
Spatial Big Data > Routing for Big Data
Version
5.1
Language
English
Product name
Spectrum Routing for Big Data
Title
Spectrum Routing Installation: Cloudera
Copyright
2024
First publish date
2017
Last updated
2024-10-18
Published on
2024-10-18T09:54:26.541418

The Routing jar can be loaded and referenced in a Hue notebook as an external library.

Prerequisite: To use the Routing jar in an interactive manner, you will need to use the Scala or Java interpreter which requires Livy.

Proceed according to your platform:

  1. Cloudera - start here.
    1. In Cloudera Manager, navigate to Hue -> Configuration.
    2. Search for this property:
      Hue Service Advanced Configuration Snippet (Safety Valve) for hue_safety_valve.ini
    3. Use the following 3 lines to set the property's value:
      [desktop]
      app_blacklist=
      
      use_default_configuration=true
    4. Click Save. Continue to step 3.
  2. EMR - start here.
    1. On the Master Node, open the file /etc/hue/conf/hue.ini.
    2. Uncomment and change the following line from:
      ## use_default_configuration=false
      to
      use_default_configuration=true
    3. Save the file. Continue to step 3.
  3. Restart Hive.
  4. Open the Hue editor.
  5. Select one of the query editors (Scala or Java).
  6. Establish a session. This can be accomplished by running any operation in the editor, executing 1+1 will suffice.
  7. When the query completes, click the gears icon button (in some versions of Hue, this button becomes visible after you click the vertical ellipsis button).
  8. In the session dialog, use the Add Property drop-down menu and select Jars.
  9. In the text box, specify the location in HDFS where your Routing jar is located. For example:

    Scala 2.12:

    hdfs:///precisely/routing/software/spark2/sdk/lib/spectrum-bigdata-routing-sdk-spark2_2.12-sdk_version.jar

    Scala 2.11:

    hdfs:///precisely/routing/software/spark2/sdk/lib/spectrum-bigdata-routing-sdk-spark2_2.11-sdk_version.jar
  10. Click Recreate. This will recreate the session.
  11. To return to your notebook, click any of the arrow icons or the gears button again. This will close any open dialogs and add the Routing jar to the session that was just created.