Hi ECS Meltano users, how are you generating new task-definitions for your orchestrator (prefect in my case) to run every time you added a new plugin?
a
aaronsteers
06/28/2021, 4:24 PM
Hi, @keat. I haven't heard much about prefect yet, but if you are interested in seeing an integration, we would welcome a feature request in our issue tracker. We've got a planned integration with Dagster, and we do already support Airflow.
aaronsteers
06/28/2021, 4:25 PM
For ECS more generally, most people put their secrets in AWS Parameter Store (SSM) and either populate them by mapping secrets/creds to env var values on the task, or else using a tool like chamber to hydrate the needed config and secrets after the container starts.