Skip to content

Latest commit

 

History

History
19 lines (12 loc) · 803 Bytes

README.md

File metadata and controls

19 lines (12 loc) · 803 Bytes
Raw

Anyway ETL

This project includes the following components:

  • anyway-etl: A Python library and CLI which handles ETL processing tasks
  • airflow: An airflow server which executes and manages the processing tasks

See the Anyway Docker docs for the easiest method to use and develop tasks.

For more advanced documentation see the docs directory.

Continuous Deployment

  • Every push to main branch causes deployment to the Kubernetes cluster's anyway-dev environment
    • Except for changes to the anyway dependency, which is picked up automatically by the Airflow server and don't require a deployment
  • Every release causes deployment to the Kubernetes cluster's anyway environment (the production environment)