Hey all, I have just started using Meltano and this might be something basic I missed but I cannot figure out how to use

target-snowflake

for source

JSON

data. I have been trying to run meltano from

tap-shopify

to

target-snowflake

(pipelinewise variant) but since the target only accepts

CSV

or

Parquet

file format, it raises the

InvalidFileFormatException

when trying to load

JSON

data to Snowflake. I have tried setting

data_flattening_max_level

and even using

CSV

file format in Snowflake but none of them seem to work. Are there some steps that I am missing in this pipeline? Thanks!

Hey @sid! Can you share your meltano.yml config (excluding anything sensitive)?

Hey @pat_nadolny, thanks for the reply! Here’s the yml file, hopefully it has all the required information.

Thanks and when you ran it the

file_format: file-format-name

is set to the actual snowflake file format object name? What does the error message say? That might help debug

Got this error when I was trying to use JSON file format. Hope this helps!