Hello! I'm new to Meltano and I've created a custom extractor. I've included some logic in the

post_process

function that triggers a second API endpoint. This second call is what my schema is actually modeled after, but the call is conditional on the data returned from the first API call. Specifically: I'm extracting all lists from Affinity and evaluating their names. If a name fits a certain naming convention, I make the second API call, which then returns the data that my schema expects. The issue arises when a list name doesn't match the convention; no data gets returned and errors occur. Is there a way to allow the extractor to return nothing in these cases?

I think you want to return

None

from

post_process

to filter out the record, if the list name doesn't match the convention (see the

RESTStream

get_records

implementation here). Related SDK feature proposal you might be interested in: https://github.com/meltano/sdk/issues/93