I want to extract limited data(say first 1000 rows) from the database in the ELT. Is there a way to do it??

The tap would have to support that, I'm not sure how common or uncommon it is.

@proud-jackal-38797 are you trying to limit the amount for testing or for another purpose?

@salmon-salesclerk-77709 testing only!

Checkout https://gitlab.com/meltano/meltano/-/issues/2640 and some of the linked issues. We don’t have a `--test`flag in yet but it’s on our radar. To your 2nd point, we generally make the assumption that you want to get most all of the data in. You can set a backfill date on some taps but there’s currently no filter option like you’re asking for. We are thinking about some generic plugin that could be used in between the extract and load steps

Thank U @salmon-salesclerk-77709

@proud-jackal-38797 Hey I ran into this same issue, if your tap supports a --state, generate a state.json file and pass it thru. Then your tap will only pull from a sub set that you defined in the state.