Hello, I’m using Meltano orchestrated by Airflow’s...
# troubleshooting
s
Hello, I’m using Meltano orchestrated by Airflow’s BashOperator (because of current sqlalchemy version incompatibility between Airflow and Meltano). Is there any clean way to handle backfilling ? Airflow handles well the concepts of backfilling, by exposing a logical start and end date for DAG runs. But I don’t know how to send this to meltano
1
e
Meltano doesn't have the same concept of a backfill as Airflow since most extractors can't deal with end dates, but there's the
meltano run --full-refresh
flag for one-off backfilling. https://github.com/meltano/meltano/issues/7549
s
Thanks