Hello all,I'm planning to use meltano with airflow...
# troubleshooting
r
Hello all,I'm planning to use meltano with airflow in production for multiple clients i.e. approx. 20 client has it's own shopify, facebook etc.. accounts. So my question is what is best approach to handle multiple client? • In case how to handle remove,update delete client from meltano yaml file(Python for yaml manipulation)? • Should I use docker container approach i.e. each client have it's own meltano container?
Hey @edgar_ramirez_mondragon,Will you pls gives your feedback on this issue, when you get time?
e
Sure
• In case how to handle remove,update delete client from meltano yaml file(Python for yaml manipulation)?
that’s what plugin inheritance is for, so check it out
• Should I use docker container approach i.e. each client have it’s own meltano container?
If you’re going for isolation between different clients’ configuration and compute, then yeah. You can configure any plugin setting with environment variables and you could use a different env file for each file
docker run --env-file=client1.env
(https://docs.docker.com/engine/reference/commandline/run/#env)
r
Thanks @edgar_ramirez_mondragon