archie_sarre_wood
02/22/2023, 2:04 AMtarget-parquet
to work after loading my csv files and not sure why.
It's working fine with meltano run tap-spreadsheets-anywhere target-jsonl
but meltano run tap-spreadsheets-anywhere target-parquet
failsarchie_sarre_wood
02/22/2023, 2:05 AMversion: 1
default_environment: dev
project_id: 3fa34653-d5ae-4b33-8f72-7480e702a3be
environments:
- name: dev
- name: staging
- name: prod
hub_url: <https://deploy-preview-1158--meltano-hub.netlify.app>
plugins:
extractors:
- name: tap-spreadsheets-anywhere
variant: ets
pip_url: git+<https://github.com/ets/tap-spreadsheets-anywhere.git>
config:
tables:
- path: file://./data
name: orders
start_date: '2001-01-01T00:00:00Z'
key_properties: [id]
pattern: orders.csv
format: csv
- path: file://./data
name: reviews
start_date: '2001-01-01T00:00:00Z'
key_properties: [id]
pattern: reviews.csv
format: csv
loaders:
- name: target-parquet
variant: estrategiahq
pip_url: git+<https://github.com/estrategiahq/target-parquet.git>
config:
destination_path: ./data/parquet
compression_method: snappy
streams_in_separate_folder: true
add_record_metadata: true
- name: target-jsonl
variant: andyh1203
pip_url: target-jsonl
config:
destination_path: ./data/json
archie_sarre_wood
02/22/2023, 2:08 AMedgar_ramirez_mondragon
02/22/2023, 2:50 AMarchie_sarre_wood
02/22/2023, 4:05 AMarchie_sarre_wood
02/22/2023, 4:06 AMAndy Carter
02/27/2023, 1:43 PM