Hi Team I am exploring my options to install and d...
# infra-deployment
a
Hi Team I am exploring my options to install and deploy meltano taps/targets on AWS MWAA I found some old threads earlier (most of them are inaccessible now). In a nutshell, containers was the way using MWAA + ECS. Is there any way to setup meltano pipelines without using containers on MWAA? CC: @Edgar Ramírez (Arch.dev)
e
I'm unfortunately not familiar with MWAA but if there's a way to install additional dependencies (ideally to an isolated virtual env) then you could install meltano and run it with the
BashOperator
👀 1
a
We can install dependencies (not certainly to a virtual env). Libraries will be installed in the base python installation. Also, I do not find any way to create any venvs, so i believe each tap and target will have to share the same python libraries.
e
meltano install
would create those tap and target venvs for you
a
But there is no way to run/execute this command on MWAA. Okay there is a startup script.