I'm trying to set up the Meltanolabs `tap-snowflak...
# singer-taps
m
I'm trying to set up the Meltanolabs
tap-snowflake
to read a single table but running into an issue where it keeps trying to look at other schemas in the database that it does not have permission to. This is how my config looks (with values changed):
Copy code
plugins:
  extractors:
  - name: tap-snowflake
    variant: meltanolabs
    config:
      account: ...
      role: ...
      user: ...
      warehouse: ...
      database: my_database
      schema: my_schema
      tables:
        - my_schema.my_table
    select:
      - my_schema-my_table.*
And this is the error I keep getting:
Copy code
sqlalchemy.exc.ProgrammingError: (snowflake.connector.errors.ProgrammingError) 002043 (02000): 01bfe764-3203-6517-0000-120d27b7901e: SQL compilation error:
Object does not exist, or operation cannot be performed.
[SQL: SHOW /* sqlalchemy:get_schema_tables_info */ TABLES IN SCHEMA some_other_schema]
The database user does not have permission to
some_other_schema
and will not get permission to that schema. I read that setting the tables config would limit discovery of the tap to only the listed objects, how do I get it to stop trying to inspect the other schemas in the database?
e
That seems like a bug. The
tables
setting is used, but it seems we query the database to get the available schema regardless, which we should but behind a conditional: https://github.com/MeltanoLabs/tap-snowflake/blob/863869f19f826b86432907ea50ace844dbe5b666/tap_snowflake/client.py#L223-L227 GitHub issues and PRs welcome!