Spark Integration - Spectrum_Location_Intelligence_for_Big_Data - 5.2.1

Location Intelligence SDK for Big Data Guide

Product type
Software
Portfolio
Locate
Product family
Spectrum
Product
Spatial Big Data > Location Intelligence SDK for Big Data
Version
5.2.1
Language
English
Product name
Location Intelligence for Big Data
Title
Location Intelligence SDK for Big Data Guide
Copyright
2024
First publish date
2015
Last updated
2024-10-16
Published on
2024-10-16T13:55:01.634374

Location Intelligence SDK for Spark

You can use Spark APIs to augment any dataset as spark dataframes and then use Location Intelligence SDK for Big Data Spark APIs in process to perform spatial operations.

For more information, refer to distribution zip "/docs/README.md" for scaladocs path. We have scaladocs online on the Geo Spatial Big Data SDKs documentation landing page.

You can find the Spark library (jar files) in the distribution at: location-intelligence-bigdata-distribution-version/spark3/sdk/lib

Download Manager

The Location Intelligence SDK uses the Download Manager SDK, which provides the capability to manage downloading data programmatically. The data is typically kept in HDFS or on an S3-compatible file system, and will be downloaded automatically by the SDK when you call download() at runtime. In addition, you can use the Download Manager SDK to set permissions in the case where you have multiple users interacting with the data.

For more information, refer to distribution zip "/docs/README.md" for javadocs path. We have javadocs online on the Geo Spatial Big Data SDKs documentation landing page.