Hi meltano experts! Is there a possibility that `t...
# troubleshooting
a
Hi meltano experts! Is there a possibility that
tap-shopify
loading to
tap-bigquery
and scheduled to run twice per day is pulling full dataset every time? The discrepancy between numbers gives this idea as they have increased too much) If so, how can the config be updated? Thanks
e
Not an expert 😅, but are you passing
--job_id=...
to you elt command? If so, are you always passing the same value?
a
I guess it's just metadata that needs to be added)
v
If everything in the metadata is set to FULL-TABLE then you would expect that to happen as it'd be a full refresh. (I'm not an expert either 😄 )
I guess what I"m saying is it depends on the metadata as you referenced
a
I mean it's empty now