I really would like to see how you can backfill wi...
# office-hours
k
I really would like to see how you can backfill with airflow. tap google analytics has a start date and end date but you can only download one day at a time, otherwise you get sampled data.  does airflow automatically set the start and end date to be one day apart and do all the days?
t
We answered this in Demo Day 😄 I left a comment in https://gitlab.com/meltano/meltano/-/issues/2738#note_617746129 to link to the gitlab data team DAG for doing backfills
j
Wow @taylor, that’s a very elegant implementation
k
I ended up using an excel sheet to generate bunch of meltano elt commands with different start and end dates and unique job-ids which is the same idea as the python script