Hi Everyone! I am currently trying to set up a demo DWH for my job. I am using still getting used to meltano so I am working with the HR demo project at the moment. I've almost figured it all out but one last thing i am still missing is how to correctly use the filter_table env variable. I am using trying to set a filter based on a variable and then run the import_hr command. filter_tables [env: TAP_ORACLE__HR_FILTER_TABLES] current value: 'HR-JOBS' The variable is set but when i run the job it always tells me that there are no selected streams. Command:

NO_COLOR=1 TAP_ORACLE__HR_FILTER_TABLES={table} meltano run import_hr

@sebastian_slanitsch have you been able to get it working in your meltano.yml config first before trying to pull it out into an env var? It looks like the variable should be

TAP_ORACLE_FILTER_TABLES

based on the hub docs too (unless youre inheriting the tap and renaming it). Maybe sharing your meltano.yml would be helpful for debugging, with any sensitive stuff removed

Have you run

meltano config tap-oracle--hr

to check the compiled config json that will be passed to the extractor?

Yes i have. It is correctly passed

Oh another thing you can try is deleting your

./meltano/run/tap-oracle--hr/

directory. I'm not exactly sure how this feature works but you might have a cache catalog file thats affecting it.

Or in the README I see reference to using meltano's select criteria https://github.com/s7clarke10/pipelinewise-tap-oracle/blob/3c27f0157d4da329f68574bb570d2cb235fa6878/README.md?plain=1#L141. You could try that also to get very similar behavior. I think the filter_tables config will just avoid a long discovery process where the tap is trying to get the schema for tons of tables

Thanks for the input. Deleting the directory doesn't help unfortunately. I'd really like to stay with the env variable, do you have any more ideas how i could figure it out?