Hello All, I am trying to create pipeline for target 

snowflake

  and was following the docs provided. While running the pipeline get the following error. These are the commands I ran and do see the file format created. Just checking if I am missing anything. If this was discussed earlier, link to the conversation would be helpful https://github.com/transferwise/pipelinewise-target-snowflake Commands ran in snowflake

-- {database}.{schema}.{file_format}
CREATE or replace FILE FORMAT DEV.dev_meltano.meltano TYPE = 'CSV' ESCAPE='\\' FIELD_OPTIONALLY_ENCLOSED_BY='"';

GRANT USAGE ON FILE FORMAT   DEV.dev_meltano.meltano TO ROLE SYSADMIN

What does you yaml config look like for the target?

These are my entries in the

meltano.yml

file

loaders:

- name: target-snowflake

variant: transferwise

pip_url: pipelinewise-target-snowflake

config:

account: {snow_flake_account}

add_metadata_columns: true

dbname: DEV

default_target_schema: DEV_JETHINABRAHAM

file_format: <http://DEV.dev|DEV.dev>_meltano.meltano (Tried <http://DEV.DEV|DEV.DEV>_JETHINABRAHAM.CSV also)

parallelism: -1

query_tag: meltano

role: LOADER

s3_bucket: dev-jethin

s3_endpoint_url: <s3://location>

s3_key_prefix: meltano

user: {username}

warehouse: {warehouse_name}

stage: <http://DEV.DEV|DEV.DEV>_JETHINABRAHAM.MELTANO_STAGE (configured in snowflake)

Two questions: 1) Is Meltano also running as the SYSADMIN role? 2) Were you using the SYSADMIN role when you created the file format?

Meltano is running in my local laptop which is a Mac..created a virtual env and pip installed meltano. I am trying to create a pipeline from AdWords to snowflake. In snowflake created a user and assigned sysadmin role to it. Configured AdWords using tap-adwords and snowflake using target -snowflake. These are the steps I followed. While going through the docs there were some pre requisites of file format and stage . Created those in snowflake and also s3 bucket and assigned the values as env variables and verified them showing up doing

meltano config target-anowflake list

Try

file_format: dev_meltano.meltano

(without the dbname prefix) and see if it helps. That’s how I have it in my config

Hey thanks for the update. Was able to figure out the issue. I had initially created the entries using the UI and then later used env variables. Even though I changed the variables and saw the changes while listing it, it was not reflecting during the etl run. Made changes to the role in the UI and it worked fine.