The Sqoop Out node can be used to efficiently output data to an external, relational database. This feature utilizes Apache Sqoop.
To utilize the node, Arguments and values for those Arguments must be set in the node's property panel. Fields that define which fields should be output to within the external database must also be configured.
Creating arguments
To use the Sqoop Out node, you must define a set of Arguments and values for each Argument.
Arguments should be valid Apache Sqoop Arguments, preceded by a ‘--'.
For example, to connect to a database via a JDBC URL, you would create a ‘--connect' Argument. After creating the ‘--connect' Argument, you would then create a value for it, using the JDBC URL String. For example, ‘jdbc:mysql://172.17.30.206:3306/test'
Within the UI, this argument and value would be specified and listed as follows:
--connect
jdbc:mysql://172.17.30.216:3306/test
Encrypting arguments
Sqoop Out Arguments and their values may also be encrypted. This option should be used, for example, when creating the value for a --password argument.
Arguments used to connect to a database
While a full listing of all commands that can be used within Apache Sqoop is beyond the scope of this help, the following example can be used as a model for how to use this node to make a basic connection to an external, relational database.
--connect
jdbc:mysql://172.17.30.216:3306/test
--username
userRoot123
--password
mypassword
--input-null-string
""
--table
customers
In this example, the arguments --connect, --username, and --password and their respective values are common Apache Sqoop arguments. The arguments --input-null-string, and --table and their respective values are Apache Sqoop Export Control Arguments.
A full description of these, and other Apache Sqoop Arguments, can be found here.
Fields
In addition to creating Arguments, you must also create Fields in the Sqoop Out node, to define which fields within the specified external database and table should be output to. The definitions of the fields from your Analysis should match those to which you are outputting.
Decrypt Secure Values: Admins Only
If you are a system admin and you have secure, encrypted fields within an Analysis, you can opt to decrypt them in your Sqoop Out nodes by checking the Decrypt Secure Values check box.
Note that encrypted values will not be immediately decrypted in the Sqoop Out node's sheet.