Databricks AWS Utils

Databricks AWS Utils is a library to abstract Databricks integration with AWS Services

Features

  • Convert Delta Table to be consumed by AWS Athena with Schema evolution
  • Run queries against AWS RDS using AWS Secrets Manager to retrive the connection properties and returns as Spark DataFrame

Install

pip install databricks-aws-utils

Contributing

Change Log