Hello, Running into some trouble with our meltano sync, from postgres to snowflake. Tried updating to the most recent version of meltano on Python 3.9. I began receiving the following error:

ValueError: numpy.dtype size changed, may indicate binary incompatibility. Expected 96 from C header, got 88 from PyObject

I understand that documentation has been posted here to specify a version but I am not sure what version to specify. This should be the tap we are using. https://github.com/transferwise/pipelinewise-target-snowflake I have tried multiple versions of meltano, even the one we were on before, and I am still getting the same error. A specific set of versions or potentially a new load tap would be appreciated.

did you run

meltano install --clean

after switching versions?

It's a docker container, FROM meltano/meltano:latest-python3.9

oh, if you're on docker and seeing that error after rebuilding then it's probably not what I suggested. What value is set in

meltano.yml

for the loader's

pip_url

?

@Edgar Ramírez (Arch.dev) apologies for the delay. Here is some of the yaml I am using:

plugins:
  loaders:
    - name: target-snowflake
      variant: transferwise
      pip_url: git+<https://github.com/transferwise/pipelinewise-target-snowflake.git>

I have experimented with a few different configurations

Can you try this?

pip_url: git+<https://github.com/transferwise/pipelinewise-target-snowflake.git> numpy<2

https://github.com/transferwise/pipelinewise-target-snowflake/issues/430

@Edgar Ramírez (Arch.dev) that seemed to fix this error but we got another error like the one below:

raise LibraryNotFoundError('Error detecting the version of libcrypto')

I looked this one up and found this. https://community.snowflake.com/s/article/Python-Connector-fails-to-connect-with-LibraryNotFoundError-Error-detecting-the-version-of-libcrypto I tried to change the pip url to

git+<https://github.com/transferwise/pipelinewise-target-snowflake.git> numpy<2 oscrypto>1.3.0

but got this error:

=> => #   Downloading numpy-1.26.4-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (62 kB)                                                        
 => => # ERROR: Ignored the following versions that require a different python version: 2.1.0 Requires-Python >=3.10; 2.1.0rc1 Requires-Python >=3.10; 2.1.1 Requires-P
 => => # ython >=3.10                                                                                                                                                  
 => => # ERROR: Could not find a version that satisfies the requirement oscrypto>1.3.0 (from versions: 0.11.1, 0.12.0, 0.13.0, 0.13.1, 0.14.0, 0.14.1, 0.14.2, 0.15.0, 
 => => # 0.16.0, 0.16.1, 0.16.2, 0.17.0, 0.17.1, 0.17.2, 0.17.3, 0.18.0, 0.19.0, 0.19.1, 1.0.0, 1.1.0, 1.1.1, 1.2.0, 1.2.1, 1.3.0)                                     
 => => # ERROR: No matching distribution found for oscrypto>1.3.0

Any other ideas? I appreciate your help