Running into some issues with `tap-sftp`, not sure...
# troubleshooting
s
Running into some issues with
tap-sftp
, not sure if this is a versioning issue or not. Was originally going to use
tap-spreadsheets-anywhere
as I am already using it for S3, but it did not appear to support key-based auth.
Copy code
Cannot start plugin tap-sftp--extended: Catalog discovery failed: command ['/project/.meltano/extractors/tap-sftp/venv/bin/tap-sftp', '--config', '/project/.meltano/run/tap-sftp--extended/tap.2ab56196-ac84-449c-b804-d85678312c0f.config.json', '--discover'] returned 1 with stderr:
 /project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/paramiko/pkey.py:59: CryptographyDeprecationWarning: TripleDES has been moved to cryptography.hazmat.decrepit.ciphers.algorithms.TripleDES and will be removed from cryptography.hazmat.primitives.ciphers.algorithms in 48.0.0.
  "cipher": algorithms.TripleDES,
/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/paramiko/transport.py:219: CryptographyDeprecationWarning: Blowfish has been moved to cryptography.hazmat.decrepit.ciphers.algorithms.Blowfish and will be removed from cryptography.hazmat.primitives.ciphers.algorithms in 45.0.0.
  "class": algorithms.Blowfish,
/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/paramiko/transport.py:243: CryptographyDeprecationWarning: TripleDES has been moved to cryptography.hazmat.decrepit.ciphers.algorithms.TripleDES and will be removed from cryptography.hazmat.primitives.ciphers.algorithms in 48.0.0.
  "class": algorithms.TripleDES,
Traceback (most recent call last):
  File "/project/.meltano/extractors/tap-sftp/venv/bin/tap-sftp", line 4, in <module>
    from tap_sftp.tap import main
  File "/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/tap_sftp/tap.py", line 9, in <module>
    from tap_sftp.discover import discover_streams
  File "/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/tap_sftp/discover.py", line 5, in <module>
    from tap_sftp.singer_encodings import json_schema
  File "/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/tap_sftp/singer_encodings/json_schema.py", line 2, in <module>
    from tap_sftp.aws_ssm import AWS_SSM
  File "/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/tap_sftp/aws_ssm.py", line 1, in <module>
    import boto3
  File "/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/boto3/__init__.py", line 16, in <module>
    from boto3.session import Session
  File "/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/boto3/session.py", line 17, in <module>
    import botocore.session
  File "/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/botocore/session.py", line 29, in <module>
    import botocore.configloader
  File "/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/botocore/configloader.py", line 19, in <module>
    from botocore.compat import six
  File "/project/.meltano/extractors/tap-sftp/venv/lib/python3.12/site-packages/botocore/compat.py", line 34, in <module>
    from botocore.vendored.six.moves import http_client
ModuleNotFoundError: No module named 'botocore.vendored.six.moves'
1
e
Ok, I can reproduce that with
Copy code
uvx -p 3.12 --from git+<https://github.com/MeltanoLabs/tap-sftp.git> tap-sftp --help
so definitely something broken with the tap's dependencies. I'll see if I can fix them.
Q: Are these CSVs you're trying to pull from the ftp server?
s
Thanks! They're JSON files.
e
Gotcha. Another thing: can you try setting
pip_url: tap-sftp==1.2.1
for that plugin? That'll use https://github.com/singer-io/tap-sftp, which is compatible AFAICT.
s
Yep, that actually resolved the issue!
Thanks again Edgar
e
Awesome!
s
@Edgar Ramírez (Arch.dev) I am actually confused at this point if
tap-sftp
works for JSON files, or CSV only, based on the delimeter being a required setting. 🤔
e
Ah, no I don't think it's intended to work for JSON files