Has anyone run into an issue with a loader/target only loading 1 record even though the extractor/tap extracts many records? This is happening on only 1 table out of dozens from

tap-mysql

to

target-snowflake

for me. I’m completely baffled

I haven't had it happen but I also don't use

target-snowflake

I'd verify the records are in your output file. Something like

meltano invoke tap-mysql > out

cat out | meltano invoke target-snowflake

then then I"d manually prune down the output file (like a git bisect) until I find what's happening

this might be an issue with the “state” of the pipeline, usually this happens when you load data and then manually delete everything in the target… to fix this you can try to reset the state for that table

Thanks to both of you! I discovered that the issue was that the source table didn’t have any primary keys but I was artificially imposing a primary key on the target table (the db schema). So when Snowflake went to update the table it would only update the last record because according to the primary key it was the only row that needed updating.