benjamin_longearet
07/21/2023, 12:26 PMmeltano run tap-spreadsheet-everywhere target-bigquery
The 1st task is running ok, detecting the files (csv) onto my GCS bucket, then filter with timestamp & pattern to be ready to sync these files.
The 2nd task is running also ok, getting all the data, then push it into a BQ dataset.
The problem is that at the end of the 2nd task, when the state is snapshot, I have to cases :
⢠There is record from 1st task to process : everything is going well, state update with timestamp
{
"singer_state": {
"XANDR_Hourly": {
"modified_since": "2023-02-25T12:10:53.897000+00:00"
}
}
}
⢠There is NO record from 1st task to process : the state is reset to "empty"
{
"singer_state": {}
}
I found this PR onto target-bigquery
project, but even with latest version it didn't work.
So if you have any time, I need helps š
Have a good day!
z3-target-bigquery @ git+<https://github.com/z3z1ma/target-bigquery.git@3952428bb043d1db80250e1f11cbcad9c8b18ecd>
benjamin_longearet
07/21/2023, 12:34 PMTarget 'target-bigquery' completed reading 1 lines of input (0 records, (0 batch manifests, 0 state messages).
benjamin_longearet
07/21/2023, 4:28 PMtarget-bigquery
on a failed rebase IMHO.
I pushed a new PR : https://github.com/z3z1ma/target-bigquery/pull/65