Hello everyone, I'm relatively new to Meltano, and I'm encountering an issue in my environment. I'm utilizing Meltano to replicate data into a data warehouse, and this particular database requires the use of

FULL_TABLE

replication. Problem: I'm dealing with a table that has a size of 2.1 GB and contains over 11,000 rows, with two fields populated with extensive JSON data. Whenever Meltano processes this table, I encounter the following error message:

[error    ] Extraction failed              code=-9 message=            
ELT could not be completed: Extractor failed.

Curiously, it starts the loading of some records into my data warehouse but subsequently crashes with the above error. To provide context, this pipeline is orchestrated by Airflow and is built from an image featuring Meltano v:2.12.0. • Database: PostgresSQL • Target: Snowflake • Tap: tap-postgres-transferwise Has someone encountered something similar while loading large JSONs fields?

Would it be possible to try the Meltanolabs variant of the postgres tap, I recently switched to using it and haven't had many issues so far, but using a target to load into Clickhouse instead of Snowflake

Have you tried your command with

--log-level=debug

?

meltano --log-level=debug run tap-postgres target-snowflake

or similar?