Hi, i have a long running meltano pull, +hours at this point. it has a replication key and i can see that it's updating the key. i keep seeing this

Target sink for 'public-events' is full.

and this:

Number of results in first chunk: 1"

i'm concerned that this is ingesting 1 entry for like 1M possibly entries and is the source of the long pull? any ideas. thanks

What tap is this? It may one with a parent-child relationship in which each parent stream record has 1 or 0 child records. A schema message is emitted for each to the target flushes the records. If it's done too frequently it can be a bottleneck. Can you confirm? • https://github.com/meltano/sdk/issues/1061

postgres tap; snowflake target

Both MeltanoLabs?

yes

Ok I think

Number of results in first chunk: 1"

is probably not relevant, it's coming from

snowflake.connector.cursor

?

yes

Can you try increasing the batch size with the

batch_size_rows

setting?