Distributing using HDFS - Spectrum_Location_Intelligence_for_Big_Data - 5.2.1

Location Intelligence SDK for Big Data Guide

Product type
Software
Portfolio
Locate
Product family
Spectrum
Product
Spatial Big Data > Location Intelligence SDK for Big Data
Version
5.2.1
Language
English
Product name
Location Intelligence for Big Data
Title
Location Intelligence SDK for Big Data Guide
Copyright
2024
First publish date
2015
Last updated
2024-10-16
Published on
2024-10-16T13:55:01.634374

Now that the SDK is installed, the resources needed must be distributed around the cluster. The LI resources must be accessible from each master and data node at the file-system level.

For the purpose of this guide, we will:

  • continue using sdkuser
  • install the resources into hdfs:///precisely/li/resources
Then, perform the following steps:
  1. Create an install directory on hdfs and give ownership to sdkuser.
    sudo -u hdfs hadoop fs -mkdir hdfs:///precisely
    sudo -u hdfs hadoop fs -chown sdkuser:sdkuser hdfs:///precisely
  2. Upload the Resources directory into HDFS.
    hadoop fs -mkdir hdfs:///precisely/li/software
    hadoop fs -copyFromLocal /precisely/li/software/resources 
    hdfs:///precisely/li/software/resources