Hello everyone 👋 happy tuesday! I was wondering if you could give me some guidance on testing taps. I would love to use the integrated

test

functions, but I'd like to understand a bit more how they work (source https://sdk.meltano.com/en/latest/testing.html#singer_sdk.testing.get_tap_test_class) What do the tests actually DO? My goal would be that it only tests that the tap CAN run, and not that it tries to run to completion. Most of my taps are full_table, so running their tests would take WAY too long. Thanks 😄

Hey Stephane 👋 The tests run the tap, extracting the records and testing them against certain assertions: required fields are present, data types conform to the schema, etc.

My goal would be that it only tests that the tap CAN run

The tests do validate that by proxy.

Most of my taps are full_table, so running their tests would take WAY too long.

You can pass, for example, the

suite_config=SuiteConfig(*max_records_limit=25*)

argument of

get_tap_test_class

to limit the volume of data extracted. https://sdk.meltano.com/en/latest/testing.html#singer_sdk.testing.SuiteConfig Do give https://github.com/meltano/sdk/issues/2688 a 👍 or let me know if there's something you'd like the docs to explain specifically.

As always, you're the best @Edgar Ramírez (Arch.dev)