Skip to content

Latest commit

 

History

History
23 lines (12 loc) · 856 Bytes

README.md

File metadata and controls

23 lines (12 loc) · 856 Bytes

data-flows

Data flows orchestrated using Prefect Version 2.

This project is comprised of the the following subprojects:

  • .aws

    This contains the Terraform CDK code for the AWS resources needed for this project. It also contains a custom docker image for the Prefect v2 agent.

  • .circleci

    This contains CircleCI configuration for managing the CICD process for this project.

  • common-utils

    This contains common Python utilities to use for Prefect v2 flow development and deployment.

  • data-products

    This contains the Python code for Prefect v2 flows owned by the Data Products Team.

This is built as a monorepo, which means new subprojects for Python code can be added as needed including for teams that want to build their own flows on Prefect v2.