Hi everyone! I'm just getting started, so probably have a bunch of silly questions. I'm trying to do what seems the most basic test possible: using

tap-spreadsheets-anywhere

to read an excel file on my local filesystem and load it in postgres. I've been following the getting started page twice, once with

tap-csv

which worked fine, but now with the new tap, I'm not seeing anything being loaded. When I run

meltano --log-level=debug elt...

I see:

tap-spreadsheets-anywhere       | INFO Found 6 files.
tap-spreadsheets-anywhere       | INFO Wrote 0 records for stream "my_stream_name".

There are indeed 6 files in that folder, so that seems correct, but I'm seeing no errors or warnings, so I'm not sure where to look next. I went through the plugin docs, but nothing obvious there. I've tried all sorts of regex patterns including

".*"

which I'd assume would catch any file in there, but no luck. Any suggestions where to look?

@laurent Are you seeing any

Syncing file "<name>"

log messages originating from https://github.com/ets/tap-spreadsheets-anywhere/blob/208190734440b57b4445f94e5a0d43a43d20df99/tap_spreadsheets_anywhere/file_utils.py#L21?

No, can't see anything like

Syncing file...

in the logs

Hmm 😕 How about we jump on a quick Zoom call so I can help you debug this for a bit?

sure, yeah!

Thanks for the debugging session Douwe!

@laurent happy to take a look, so thanks for filing some issues. We do have a test in the project that demonstrates reading from a local xlsx file & that’s passing. So curious to hear more about what you’ve encountered there.

@eric_simmerman We were seeing https://github.com/ets/tap-spreadsheets-anywhere/blob/master/tap_spreadsheets_anywhere/excel_handler.py#L32 raise an "xlsx not supported" error. https://pypi.org/project/xlrd/ currently states:

This library will no longer read anything other than

.xls

files. For alternatives that read newer file formats, please see http://www.python-excel.org/.

That's for version 2.0.1. The description for 1.2.0 (https://pypi.org/project/xlrd/1.2.0/) stated:

Extract data from Excel spreadsheets (.xls and .xlsx, versions 2.0 onwards) on any platform.

This suggests that the tap should either pin version 1.2.0, or use another library for xlsx as suggested in http://www.python-excel.org/

Committed a quick fix just now to pin xlrd to 1.2.0

@eric_simmerman Great, thanks!

Great! thanks @eric_simmerman!

Through the power of opensource - I just merged a PR from https://github.com/JulesHuisman that moved us off xlrd and onto openpyxl

Wow: https://github.com/ets/tap-spreadsheets-anywhere/pull/9 Sounds like someone else hit the exact same issue just when you did @laurent!

awesome!