Hi Everyone, I am using

tap-postgres

and

target-snowflake

to move data from postgres to Snowflake. In my

meltano.yaml

I am providing the target_snowflake_schema but after execution I could see the data are getting loaded in

public

schema and not the one I passed. Can anyone please help me if I am missing anything here

Hi @Dev Dasgupta. What does your

meltano.yml

look like?

meltano.yaml

version: 1
default_environment: dev
project_id: 8d46d142-ee51-42fd-90fd-0f1b3a8bba5d
environments:
- name: dev
- name: staging
- name: prod
plugins:
  - name: tap-postgres
    variant: meltanolabs
    pip_url: git+<https://github.com/MeltanoLabs/tap-postgres.git>
    config:
      database: meltano
      user: <uid>
      password: <pwd>
      host: localhost
    select:
    - public-tripdata.*
    metadata:
      public-tripdata:
        replication_method: LOG_BASED
        replication_key: _sdc_lsn

  loaders:
  - name: target-snowflake
    variant: meltanolabs
    pip_url: meltanolabs-target-snowflake

.env

ENV=dev
MELTANO_STATE_BACKEND_URI="s3://..."
AWS_ACCESS_KEY_ID=...
AWS_SECRET_ACCESS_KEY=...
TARGET_SNOWFLAKE_ACCOUNT=snowflake-account
TARGET_SNOWFLAKE_WAREHOUSE=snowflake-wh
TARGET_SNOWFLAKE_DATABASE=target-db
TARGET_SNOWFLAKE_USER=snowflake-user
TARGET_SNOWFLAKE_PASSWORD=snowflake-pwd
TARGET_SNOWFLAKE_ROLE=role
TARGET_SNOWFLAKE_SCHEMA=snowflake-schema

Can you try setting

TARGET_SNOWFLAKE_DEFAULT_TARGET_SCHEMA

? It's

The default target database schema name to use for all streams.

Sure let me try it out