Hi All, Can we read XLSX files from tap-sftp ? Cou...
# troubleshooting
s
Hi All, Can we read XLSX files from tap-sftp ? Couldn't find it though
a
Hi, @sumit_singh. This might be a good option for you: https://hub.meltano.com/extractors/tap-spreadsheets-anywhere/
s
Thanks @aaronsteers, tried but getting below error. So When I log in to SFTP server, there is a folder names
uploads
and in uploads folder there are xlsx files, what would be wrong in below snap of meltano.yml ?
Copy code
INFO Using supplied catalog /home/ubuntu/meltano-projects/sftp_data/.meltano/run/tap-spreadsheets-anywhere/tap.properties.json.
INFO Processing 0 selected streams from Catalog
Copy code
- name: tap-spreadsheets-anywhere
    variant: ets
    pip_url: git+<https://github.com/ets/tap-spreadsheets-anywhere.git>
    config:
      tables:
      - path: "<sftp://user:password@host//uploads>"
        name: "transaction_reports"
        format: "excel"
        worksheet_name: "Sheet1"
        pattern: ".transaction.*"
        key_properties: []
        start_date: "2022-12-01T00:00:00Z"
p
@sumit_singh I havent personally used it for sftp excel files but I have for s3 csv/jsonl. Your config seems right though. Could it be your regex? I dont think you need the leading dot if the file paths are like
/uploads/transaction_reports.xlsx
s
@pat_nadolny Still getting the same output
@aaronsteers Can we use tap-sftp to extract XLSX files ?
p
@sumit_singh I think tap-spreadsheets-anywhere suppresses errors which is making it hard to understand whats failing - try running
meltano invoke tap-spreadsheets-anywhere --dev
aka "dev mode" which will raise your errors better. You might find out what your config issue is
a
Can we use tap-sftp to extract XLSX files ?
I don't have personal experience with this one so I'm not sure actually.
s
Still getting the same output after running
meltano invoke tap-spreadsheets-anywhere --dev