Does anyone have an example of how to configure ta...
# troubleshooting
n
Does anyone have an example of how to configure tap-spreadsheets-anywhere to pick up .gz files that contain csvs? The documentation mentions that is supports reading from this compression type, but I can't find example/figure out the right settings in my meltano.yml. Here is what I have. Its reading the bucket, but not identifying any files that match my search string:
Copy code
config:
      tables:
      - path: <s3://my-prd-bucket>
        name: inventory_reporting
        pattern: .*.csv.gz
        start_date: '2017-05-01T00:00:00Z'
        key_properties: [bucket, key]
        format: csv
        delimiter: ','
        quotechar: '"'
        universal_newlines: false
        sample_rate: 10
        max_sampling_read: 2000
        max_sampled_files: 3
e
Hi @nicholas_van_kuren! I was able to do it in a dev setup. Make sure that the pattern (which is a regular expression) actually matches files in your bucket root.
n
Perfect yes! Was able to get this working. Thanks again @edgar_ramirez_mondragon!