Hi. Interested in how people here handle backfills...
# best-practices
m
Hi. Interested in how people here handle backfills using a specific date range? With my custom python scripts, I offload this to airflow by specifying a start and end date in the default args of the dag and then allowing airflows date template variable to feed into my functions. I understand with Meltano some taps can specify a start date but what about an end date? This is only a problem for some sources where the daily data volume is incredibly large and the data source sometimes make retrospective changes to only specific historical dates.