The Routing jar can be loaded and referenced in a Hue notebook as an external library.
Prerequisite: To use the Routing jar in an interactive manner, you will need to use the Scala or Java interpreter which requires Livy.
Proceed according to your platform:
-
Cloudera - start here.
- In Cloudera Manager, navigate to Hue -> Configuration.
-
Search for this property:
Hue Service Advanced Configuration Snippet (Safety Valve) for hue_safety_valve.ini
-
Use the following 3 lines to set the property's value:
[desktop] app_blacklist= use_default_configuration=true
- Click Save. Continue to step 3.
-
EMR - start here.
-
On the Master Node, open the file
/etc/hue/conf/hue.ini
. -
Uncomment and change the following line from:
## use_default_configuration=false
touse_default_configuration=true
- Save the file. Continue to step 3.
-
On the Master Node, open the file
- Restart Hive.
- Open the Hue editor.
- Select one of the query editors (Scala or Java).
- Establish a session. This can be accomplished by running any operation in the editor, executing 1+1 will suffice.
- When the query completes, click the gears icon button (in some versions of Hue, this button becomes visible after you click the vertical ellipsis button).
- In the session dialog, use the Add Property drop-down menu and select Jars.
-
In the text box, specify the location in HDFS where your Routing jar is located. For
example:
Scala 2.12:
hdfs:///precisely/routing/software/spark2/sdk/lib/spectrum-bigdata-routing-sdk-spark2_2.12-sdk_version.jar
Scala 2.11:
hdfs:///precisely/routing/software/spark2/sdk/lib/spectrum-bigdata-routing-sdk-spark2_2.11-sdk_version.jar
- Click Recreate. This will recreate the session.
- To return to your notebook, click any of the arrow icons or the gears button again. This will close any open dialogs and add the Routing jar to the session that was just created.