Hi community! I'm facing the same problem described in this post (https://meltano.slack.com/archives/CFG3C3C66/p1614621579049600) with Adswerve

target-bigquery

. Whenever the tap fails, an empty state is pushed, causing the next run to start from the start_date. This bug was reported (https://github.com/adswerve/target-bigquery/issues/9) on Github and marked as closed in June 2021, but I can't find a version of target-bigquery free of this undesirable behaviour. If someone could help me with this, I would really appreciate!

Hi @delson_barros. Does pipelinewise-target-bigquery have the same issue?

Hi @edgar_ramirez_mondragon! Thank you for your reply! I'm not sure, I haven't tested it yet (I'll try and test) I thought that this issue would be solved with Adswerve target-bigquery (following the thread on Github), so I'm not sure if someone else still faces the same problem or if I'm doing something wrong

@delson_barros Ok, so did you add the plugin with

meltano add loader target-bigquery

?

@edgar_ramirez_mondragon, Actually I used

meltano install loader target-bigquery

, changing the github url to @v0.11.2 or @v0.11.3, in the meltano.yml file. I opened the loader folders to check whether the code was really updated and the different versions were being installed correctly, but the problem with empty states still persisted. In order to test this, I made the following: I ran a meltano job completely, so a state file would be created; then I ran the same job again, disconnecting the Internet during the first seconds, so the tap would fail but target-bigquery don't. In this case, target-bigquery completed its processes, corrupting the state file at the end. No version I tested was able to deal correctly with this test case, keeping the previous and healthy state file.

Thank you @delson_barros, this might be a bug in Meltano then. Just to confirm: what version of Meltano are you running?

Thank you for your time @edgar_ramirez_mondragon! I'm running meltano 1.78.0

@delson_barros Ah, that's an old one 😅. Can you try in the most recent (1.88.0)? 😄