Hi, is it possible to run the two commands paralle...
# getting-started
n
Hi, is it possible to run the two commands parallelly below:
meltano run inherited-tap-example-1 inherited-target-example-1
meltano run inherited-tap-example-2 inherited-target-example-2
where I have tap-example and target-example defined before and I am basically inheriting the respective extractors and loaders which have different configs and db names
a
Their auto-generated state IDs will be keyed off the names, so these should be safe to run in parallel - assuming no name collisions when they're inserted to the target tables. Is that your question? Or do you mean also if Meltano will run them in parallel for you?
n
Yeah I wanted to know if meltano will run them in parallel. And if they do, how do I do that?
a
As of now, Meltano does not run them in parallel for you. If you use Airflow to orchestrate, the DAG process for jobs can support parallelism, but that is just one layer up from the Meltano call directly.
If you just want to do this locally in your terminal, there are some tricks like these ones that come from capabilities in the terminal itself.
n
Hey thats awesome! Thank you!