https://linen.dev logo
Join Slack
Powered by
Is there a variant of `target-redshift` that other...
# troubleshooting
n
Is there a variant of 
target-redshift
that others recommend with Python 3.10 (currently testing locally on Mac OS 13.2)? I’m getting 
ERROR: Failed building wheel for psycopg2-binary
when running 
meltano add loader target-redshift
(additional traceback in the thread) Seems like the transferwise variant of the loader is no longer maintained?
Copy code
meltano add loader target-redshift
Added loader 'target-redshift' to your Meltano project
Variant:        transferwise (default)
Repository:     <https://github.com/transferwise/pipelinewise-target-redshift>
Documentation:  <https://hub.meltano.com/loaders/target-redshift--transferwise>

Installing loader 'target-redshift'...
Loader 'target-redshift' could not be installed: failed to install plugin 'target-redshift'.
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [151 lines of output]
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build/lib.macosx-13.2-arm64-3.10
      creating build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/_json.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/extras.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/compat.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/errorcodes.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/tz.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/_range.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/_ipaddress.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/_lru_cache.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/__init__.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/extensions.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/errors.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/sql.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      copying lib/pool.py -> build/lib.macosx-13.2-arm64-3.10/psycopg2
      running build_ext
      building 'psycopg2._psycopg' extension
      creating build/temp.macosx-13.2-arm64-3.10
      creating build/temp.macosx-13.2-arm64-3.10/psycopg

        [...]

      ld: library not found for -lssl
      clang: error: linker command failed with exit code 1 (use -v to see invocation)
      error: command '/usr/bin/clang' failed with exit code 1
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for psycopg2-binary
ERROR: Could not build wheels for psycopg2-binary, which is required to install pyproject.toml-based projects
@Matt Menzenski - I came across your 
py-311
branch (https://github.com/menzenski/pipelinewise-target-redshift/tree/py-311). Has that been working for you?
m
yes, it’s been working well for us. Note that if you depend on the latest commit on that branch it’ll write 
object
type fields as 
SUPER
type in Redshift -you might want this or you might not. (If you don’t want it, depend on the prior commit hash instead).
We’ve been running that branch in production since the beginning of february without issue
n
Excellent! Thank you. I’ll give that version a spin. Appreciate the tip on potential mods to the object type fields.
t
Great to hear that there is a working version, although it would be great if we could have an official target again for Redshift!
Open in Slack
PreviousNext
Powered by