I am trying to perform ELT with

meltano elt

command against Postgres Tap (MeltanoLabs) But I am getting error

psycopg2.errors.InsufficientPrivilege: permission denied for schema pdr_ops

Since the remote database is a third party Database, we do not have access to

pdr_ops

schema. Why is it trying to access

pdr_ops

schema. I only need to check against

pdr

schema How can I limit my operations to only one schema

pdr

and not face this permissions error ?

I think the tap wants to discover tables from every schema it can see. Other taps support a filter_schemas setting, so do log an issue if this is an approach that works for you.

Hi Edgar, What would the turn-around time be for such request ?

cc @visch

Yeah we should implement this, was going to do it for tap-mysql as well!

Thanks for the issue! We need to do it for mysql too so we'll just do both, probably close enough that we can get this added to the sdk as well

so we discovered this at production deployment, @visch do you have a vague ETA for this fix ? I am not sure about the LOE for it..

what's loe mean?

level of effort

acronyms are my arch enemy. Not huge just a timing thing, filter would need to get added here roughly https://github.com/meltano/sdk/blob/main/singer_sdk/connectors/sql.py#L371 with a config value. Feel free to do it yourself if you'd like! We'll get to it today/tomorrow

(Ah, it does make sense as an SDK feature!)

I am a bit Python handicapped so if its 2-3 days, I can try to push back our deployment