Hi, I am new to Meltano. I was trying to start with a simple extractor to test things out. I am currently using csv extractor and trying to load my data into snowflake. I am following the below tutorial. https://meltano.com/tutorials/csv-with-postgres.html#initialize-your-project Below is my config file.

version: 1
send_anonymous_usage_stats: true
project_id: b355f1ea-8dd5-43e5-910e-11201178d8ae
plugins:
  extractors:
  - name: tap-google-analytics
    variant: meltano
    pip_url: git+<https://gitlab.com/meltano/tap-google-analytics.git>
    config:
      key_file_location: extract/tap-google-analytics@default/key_file_location/keys.json
      start_date: '2020-10-01'
      view_id: '161969997'
  - name: tap-gitlab
    variant: meltano
    pip_url: git+<https://gitlab.com/meltano/tap-gitlab.git>
  - name: tap-spreadsheets-anywhere
    pip_url: git+<https://github.com/ets/tap-spreadsheets-anywhere.git>
  - name: tap-csv
    variant: meltano
    pip_url: git+<https://gitlab.com/meltano/tap-csv.git>
    config:
      files:
        csv_files_definition: extract/files-def.json

The UI has shows more than one required inputs and I am not able to create a new pipeline. Can some please help me with this?

Hi @anas! This little bit is incorrect:

config:
      files:
        csv_files_definition: extract/files-def.json

You're currently setting the

files

setting (https://meltano.com/plugins/extractors/csv.html#files) to an object

{"csv_files_definition": "extract/files-def.json"}

. Instead, it looks like you want to set the

csv_files_definition

setting (https://meltano.com/plugins/extractors/csv.html#csv-files-definition) to

"extract/files-def.json"

:

config:
  csv_files_definition: extract/files-def.json

@anas What helped me the most was reading the documentation. Also, turning on debug will help you troubleshoot.

@timothy_suh it really helped turning the debug mode ON.. Thank you

@anas The UI is not currently capable of letting users direct edit array settings like

files

, but we can let the user upload a file for the

csv_files_definition

setting using an Upload button. The uploaded JSON file would then contain the

files

definition, as described in the docs. Would that work?