Azure Blob Storage is Microsoft’s object storage solution for the cloud. It is optimized for storing massive amounts of unstructured data, such as text or binary data. It supports scenarios like backup and restore, disaster recovery, big data analytics, and cloud-native applications.
The Azure Blob Storage Target Datastore is identified by a URL composed of account name, container name and blob path.
Azure Blob Storage supports file rotation, enabling analytics on static file sets while avoiding conflicts with files being updated. Rotation can be triggered based on time intervals or file size.
Environmental Requirements
To use Azure Storage as a target datastore, the SQData Apply Engine requires the Azure SDK for C++ for client libraries.
export LD_LIBRARY_PATH=/work/external/azure/azure-sdk-cpp-install/lib64:<SQDDATA_GIT>/external/cloudfs/Linux_x86_64/lib/release:$LD_LIBRARY_PATHAuthentication
Azure Blob Storage authentication for the SQData Apply Engine is handled via the Azure SDK for C++ mechanisms. Refer to the Azure Identity documentation. The simplest setup is through environment variables or Azure CLI login.