Overview

This release introduces a sophisticated SDK/Client designed to interact with AWS S3 to automatically detect and register data assets as well as check the data assets against contracts. The tool connects to S3, identifies data files and analyzes their schemas. In addition, this release includes general UX improvements to the Gable platform.

New Features

  • S3 Data Asset Registration: Automatically register data assets directly from AWS S3 files.
  • Multi-File Support: Supports a variety of S3 file formats including CSV, JSON and Parquet.
  • Schema Detection: Automatically detect and catalog the structure and schema of data assets using schema inference.
  • Automated Structure Detection: Gable’s new S3 client can detect S3 file structures automatically, significantly reducing manual setup requirements.
  • Client Configuration: Enhanced configuration options to manage connections to AWS S3, specify file types, and setup data retrieval parameters.