Is there a guide for scaling airflow horizontally with meltano?
a
aaronsteers
04/21/2021, 5:13 PM
Nothing I know of as of yet. In theory, standard Airflow scaling principles should apply. I also see many users applying kubernetes-type runners to run dockerized meltano cli commands, using the scheduler of their cloud platform.