Hello there :slightly_smiling_face: Thanks a lot ...
# troubleshooting
b
Hello there šŸ™‚ Thanks a lot for the tools and the job! I tried to find out a solution, but I am a bit stuck šŸ‘¼ First of all, I run a
meltano run tap-spreadsheet-everywhere target-bigquery
The 1st task is running ok, detecting the files (csv) onto my GCS bucket, then filter with timestamp & pattern to be ready to sync these files. The 2nd task is running also ok, getting all the data, then push it into a BQ dataset. The problem is that at the end of the 2nd task, when the state is snapshot, I have to cases : • There is record from 1st task to process : everything is going well, state update with timestamp
Copy code
{
  "singer_state": {
    "XANDR_Hourly": {
      "modified_since": "2023-02-25T12:10:53.897000+00:00"
    }
  }
}
• There is NO record from 1st task to process : the state is reset to "empty"
Copy code
{
  "singer_state": {}
}
I found this PR onto
target-bigquery
project, but even with latest version it didn't work. So if you have any time, I need helps šŸš€ Have a good day!
Copy code
z3-target-bigquery @ git+<https://github.com/z3z1ma/target-bigquery.git@3952428bb043d1db80250e1f11cbcad9c8b18ecd>
Copy code
Target 'target-bigquery' completed reading 1 lines of input (0 records, (0 batch manifests, 0 state messages).
Maybe due to this : They reverted a PR on
target-bigquery
on a failed rebase IMHO. I pushed a new PR : https://github.com/z3z1ma/target-bigquery/pull/65