Azure Blob Storage - connect_cdc_sqdata - Latest

Connect CDC (SQData) Apply engine
Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect CDC (SQData)
Version
Latest
ft:locale
en-US
Product name
Connect CDC (SQData)
ft:title
Connect CDC (SQData) Apply engine
Copyright
2025
First publish date
2000
ft:lastEdition
2025-10-17
ft:lastPublication
2025-10-17T16:13:45.771000

Azure Blob Storage is Microsoft’s object storage solution for the cloud. It is optimized for storing massive amounts of unstructured data, such as text or binary data. It supports scenarios like backup and restore, disaster recovery, big data analytics, and cloud-native applications.

The Azure Blob Storage Target Datastore is identified by a URL composed of account name, container name and blob path.

Azure Blob Storage supports file rotation, enabling analytics on static file sets while avoiding conflicts with files being updated. Rotation can be triggered based on time intervals, file size, or record count.

Environmental Requirements

To use Azure Storage as a target datastore, the SQData Apply Engine requires the Azure SDK for C++ for client libraries.

If building the Azure SDK for C++ from source, follow the official Azure SDK for C++ .

Example build command: 
sudo apt-get update
sudo apt-get install -y build-essential cmake ninja-build pkg-config git curl zip unzip tar

BASE_DIR="/usr/local"

# Clean up any previous builds
rm -rf "$BASE_DIR/vcpkg" "$BASE_DIR/azure-sdk-for-cpp" "$BASE_DIR/azure-sdk-cpp-install"

# Clone and bootstrap vcpkg with metrics disabled
git clone -b 2025.06.13 https://github.com/microsoft/vcpkg.git "$BASE_DIR/vcpkg"
"$BASE_DIR/vcpkg/bootstrap-vcpkg.sh" -disableMetrics

# Clone latest GA version of Azure SDK for C++
git clone --depth 1 -b azure-identity_1.12.0 https://github.com/Azure/azure-sdk-for-cpp.git "$BASE_DIR/azure-sdk-for-cpp"
mkdir -p "$BASE_DIR/azure-sdk-for-cpp/build"
cd "$BASE_DIR/azure-sdk-for-cpp/build"

# Configure with CMake
cmake -G Ninja \
  -DCMAKE_BUILD_TYPE=Release \
  -DBUILD_SHARED_LIBS=ON \
  -DCMAKE_INSTALL_PREFIX="$BASE_DIR/azure-sdk-cpp-install" \
  -DCMAKE_TOOLCHAIN_FILE="$BASE_DIR/vcpkg/scripts/buildsystems/vcpkg.cmake" \
  -DDISABLE_RUST_IN_BUILD=ON \
  ..

# Build and install
cmake --build .
cmake --install .
cd "$BASE_DIR"
After building, make the libraries accessible to the SQData Apply Engine:
export LD_LIBRARY_PATH=$BASE_DIR/azure-sdk-cpp-install:<SQDATA_INSTALL_DIR>/lib:$LD_LIBRARY_PATH

Authentication

Azure Blob Storage authentication for the SQData Apply Engine is handled via the Azure SDK for C++ mechanisms. Refer to the Azure Identity documentation. The simplest setup is through environment variables or Azure CLI login.