Meltano

Hi, I'm just starting out with meltano and I would like to know if there is a way to limit the number of imported rows by the postgres tap for example.

Just curious what exactly are you trying to do, do you not want your entire table to be replicated in your target?

While I'm testing out my configuration I would like to avoid copying all the 60 milion rows of my table. This to speed up the development.

I configured a postgres tap with a big query loader and the pipeline fails with a unclear error message. I think that there are some column/values that big query does not like. As a first debug step I wanted to try importing a single row and see if the problem is there or not.

You can try <https://docs.meltano.com/reference/command-line-interface#test|test>ing your plugins, or maybe a dry run/catalog dump to see if the connections are working fine, Maybe another table replication first since I also can’t find how to replicate filtered data in tap-postgres.
Otherwise maybe share the logs here and someone might know what it means.

Does testing run unit test of the plugins? or do I need to define tests? (just tried and says 0 tests run)