This project deploys a Prefect Worker on Amazon ECS Fargate using Terraform to orchestrate data workflows via Prefect Cloud. The setup includes a VPC, ECS cluster, IAM roles, and networking components.
Terraform was chosen for its:
- Cross-cloud flexibility, enabling reuse for other cloud providers if needed.
- Declarative syntax (HCL) for clear resource definitions.
- Strong community support and module ecosystem.
- AWS account with permissions for VPC, ECS, IAM, and Secrets Manager.
- Terraform >= 1.2.0 installed.
- AWS CLI configured.
- Prefect Cloud account with API key, account ID, workspace ID, and ac 520E count URL.
- Clone the Repository:
git clone https://github.com/gopalepic/Prefect-Worker.git
video of the whole configuration and setup is provided