AWS Glue contains a data catalog of metadata from various source systems. The AWS Glue Connector extracts metadata from AWS Glue and stores it as Data360 Govern technical assets. This Connector requires an S3 bucket to store metadata.
To use this Connector:
- The Connector must have access to AWS Glue and the S3 bucket.
- You must have one or more AWS accounts, and one or more AWS users. At a minimum, an account must own an S3 bucket, and a user access key must be made available for the harvester to get objects from the S3 folder.
- You need to configure and execute an AWS Lambda Python script. Within AWS, an account with a Glue data catalog can execute a program to generate files containing the data catalog metadata and write those files to S3. For this Connector, the program is a Python script running in AWS Lambda, and the files are in JSON format. If you have more than one AWS account, each account will need its own copy of the Lambda to execute, writing the metadata to the same shared S3 bucket.
Note: Work with your Precisely representative or raise a support ticket to setup the required AWS Glue access to the Lambda.