https://linen.dev logo
Join Slack
Powered by
Installing forked versions of tap and target...rec...
# troubleshooting
s
Installing forked versions of tap and target...recently getting this in log while running 
meltano install --clean
, previously didn't get this error.
Copy code
2025-04-02T17:35:09.960498Z [info     ] Environment 'dev' is active
2025-04-02T17:35:10.699018Z [warning  ] Certificate did not match expected hostname: <http://sp.meltano.com|sp.meltano.com>. Certificate: {'subject': ((('commonName', '*.<http://ops.snowcatcloud.com|ops.snowcatcloud.com>'),),), 'issuer': ((('countryName', 'US'),), (('organizationName', 'Amazon'),), (('commonName', 'Amazon RSA 2048 M02'),)), 'version': 3, 'serialNumber': 'xxxxxxxxxxx', 'notBefore': 'Mar  7 00:00:00 2025 GMT', 'notAfter': 'Apr  5 23:59:59 2026 GMT', 'subjectAltName': (('DNS', '*.<http://ops.snowcatcloud.com|ops.snowcatcloud.com>'),), 'OCSP': ('<http://ocsp.r2m02.amazontrust.com>',), 'caIssuers': ('<http://crt.r2m02.amazontrust.com/r2m02.cer',>), 'crlDistributionPoints': ('<http://crl.r2m02.amazontrust.com/r2m02.crl',)>}
Installing 4 plugins...
2025-04-02T17:35:11.553489Z [warning  ] Certificate did not match expected hostname: <http://sp.meltano.com|sp.meltano.com>. Certificate: {'subject': ((('commonName', '*.<http://ops.snowcatcloud.com|ops.snowcatcloud.com>'),),), 'issuer': ((('countryName', 'US'),), (('organizationName', 'Amazon'),), (('commonName', 'Amazon RSA 2048 M02'),)), 'version': 3, 'serialNumber': 'xxxxxxxxxxxxxx', 'notBefore': 'Mar  7 00:00:00 2025 GMT', 'notAfter': 'Apr  5 23:59:59 2026 GMT', 'subjectAltName': (('DNS', '*.<http://ops.snowcatcloud.com|ops.snowcatcloud.com>'),), 'OCSP': ('<http://ocsp.r2m02.amazontrust.com>',), 'caIssuers': ('<http://crt.r2m02.amazontrust.com/r2m02.cer',>), 'crlDistributionPoints': ('<http://crl.r2m02.amazontrust.com/r2m02.crl',)>}
Installing extractor 'tap-mysql'...
Installing loader 'target-snowflake'...
Installing orchestrator 'airflow'...
Installing file bundle 'files-airflow'...
âś… 1
p
I believe this is the same issue I was facing earlier. It seems there's some cert issue with the usage tracking that meltano uses and it's causing issues (it brought down my whole airflow/meltano setup). I was able to fix it by disabling anonymous usage tracking. Here's a link to the setting you'd need to disable: https://docs.meltano.com/reference/settings/#send_anonymous_usage_stats
đź‘Ť 1
e
I'm looking into it. In the meantime, it's safe to just ignore those warnings.
s
getting these now:
Copy code
2025-04-03T10:26:43.558801Z [info     ] Environment 'dev' is active
2025-04-03T10:26:45.442422Z [error    ] The cached `discovery.yml` manifest could not be parsed.
2025-04-03T10:26:45.444067Z [warning  ] Falling back on the bundled `discovery.yml` manifest...
Installing 2 plugins...
Installing extractor 'tap-mysql'...
Installing loader 'target-snowflake'...
Installed extractor 'tap-mysql'
Loader 'target-snowflake' could not be installed: failed to install plugin 'target-snowflake'.
  Running command git clone --filter=blob:none --quiet <https://github.com/sumit-siingh/pipelinewise-target-snowflake.git> /tmp/pip-req-build-imbi5rcp
  error: subprocess-exited-with-error

  Ă— python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [6 lines of output]
      usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
         or: setup.py --help [cmd1 cmd2 ...]
         or: setup.py --help-commands
         or: setup.py cmd --help

      error: invalid command 'bdist_wheel'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for pipelinewise-target-snowflake
ERROR: Failed to build installable wheels for some pyproject.toml based projects (pipelinewise-target-snowflake)

Installed 1/2 plugins
Failed to install plugin(s)
e
what does your 
pip_url
look like?
s
Copy code
git+<https://github.com/sumit-siingh/pipelinewise-tap-mysql.git|https://github.com/sumit-siingh/pipelinewise-tap-mysql.git>
similar for target-snowflake as well
I tried installing it in a project on local MacOS it worked, but updated it in existing production project on EC2 it failed today... Ps: it has worked in the past
e
What version of Meltano is this? Might also be worth trying the uv venv backend.
s
I believe it version 2.4 something
venv backend might not be supported in v2.x
e
Yeah, it's not supported
Ok, and do you know the python version in the EC2 box?
s
3.9
e
ERROR: Failed to build installable wheels for some pyproject.toml based projects (pipelinewise-target-snowflake)
This message is confusing because your fork doesn't even have a 
pyproject.toml
, it uses 
setup.py
and setuptools 🤔
How are you running commands in the EC2 instance? Are you ssh-ing?
s
yes, ssh
Copy code
meltano --version
meltano, version 2.4.0
Copy code
python3 --version
Python 3.10.12
e
Ok, might be worth trying to install like this
Copy code
PIP_NO_CACHE_DIR=1 meltano --log-level debug install --clean
s
Right now, I ran 
meltano install --clean
and it worked now on same EC2, also the above command worked too
Copy code
plugins:
  extractors:
  - name: tap-mysql
    variant: transferwise
    pip_url: git+<https://github.com/sumit-siingh/pipelinewise-tap-mysql.git>
    config:
      host: local
      user: user
      database: db
    metadata:
      '*':
        replication-method: LOG_BASED
  loaders:
  - name: target-snowflake
    variant: transferwise
    pip_url: git+<https://github.com/sumit-siingh/pipelinewise-target-snowflake.git>
    config:
e
Maybe it was a transient error
đź‘Ť 1
s
Thanks for all the help @Edgar RamĂ­rez (Arch.dev)
e
np!
5 Views
Open in Slack
PreviousNext
Powered by