Hii everyone!! I want your help, its my first time...
# getting-started
j
Hii everyone!! I want your help, its my first time using Meltano. i want to run this example i found https://github.com/pnadolny13/meltano_example_implementations/tree/main/meltano_projects/dbt_orchestration but im getting an a error, i’m using python
3.8.13
Hoping you can guide me !
e
It looks like there are some empty `pip_url`s in your
meltano.yml
j
Oh Im using the same one from the repo
also i run this
meltano add loader target-postgres
but its the same error
p
Hey @jenn_leon - nice! I wrote this example but fair warning it uses some experimental features πŸ˜„, thanks for trying it out. With that said, you shouldnt be having issues installing. I'm pulling a fresh clone to see if I can replicate your issue
if you run
meltano --log-level=debug add loader target-postgres
you should get more detail around why its failing to install
theres some common issues that people run into for postgres related extractors/loaders https://hub.meltano.com/loaders/postgres#troubleshooting
j
Amazing Pat, im happy u can help me hehe, Yes i see that and try to apply the solutions from starkoverflow but also didnt work
p
hmm setting the LDFLAGS and CPPFLAGS didnt help? What error message are you getting?
j
This is the error (sorry for copying it here)
Copy code
ld: warning: directory not found for option '-L/usr/local/opt/openssl/lib'
      ld: library not found for -lssl
      clang: error: linker command failed with exit code 1 (use -v to see invocation)
      error: command 'clang' failed with exit status 1
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure

Γ— Encountered error while trying to install package.
╰─> psycopg2-binary

note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.

2022-04-26T14:49:03.761485Z [debug    ] Failed to install plugin(s)    
Traceback (most recent call last):
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/meltano/cli/__init__.py", line 50, in main
    cli(obj={"project": None})
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/meltano/cli/params.py", line 23, in decorate
    return func(*args, **kwargs)
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/meltano/cli/params.py", line 56, in decorate
    func(project, *args, **kwargs)
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/click/decorators.py", line 21, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/meltano/cli/add.py", line 129, in add
    raise CliError("Failed to install plugin(s)")
meltano.cli.utils.CliError: Failed to install plugin(s)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/jennleon/.pyenv/versions/3.8.13/envs/meltano_db_orch/lib/python3.8/site-packages/meltano/cli/__init__.py", line 58, in main
    raise CliError(str(err)) from err
meltano.cli.utils.CliError: Failed to install plugin(s)
Failed to install plugin(s)
(meltano_db_orch) jennleon@Jennifers-MacBook-Pro dbt_orchestration %
Also run
pip3 install psycopg2-binary
and
pip install psycopg2
without problems
p
@edgar_ramirez_mondragon any idea on what might be happening here?
@jenn_leon do you have openssl installed? It looks like its not able to find that directory you can try
brew info openssl
j
I found the problem for the
target-postres
, i was exporting the wrong path, founded here sorry for bothering! πŸ˜…
p
Nice! For the dbt error, what meltano version are you on? I dont get that one from a fresh clone. You can try deleting those extra spaces in https://github.com/pnadolny13/meltano_example_implementations/blob/c503bf3a8670110[…]3c2d59fd2d13dee8/meltano_projects/dbt_orchestration/meltano.yml but I'm also curious what that error is
j
im using meltano
1.101.0
. i remove the extra spaces and rerun
meltano install
and now its stuck installing the tap-csv πŸ˜…
p
haha ouch - everything gets installed into the
.meltano
directory so you can try deleting that whole directory and installing again in case anything got messed up as part of debugging the other issues
j
Okay remove directory, installed one by one, but still get stuck, there is a way to make a β€œdebug” install or see more logs?? cause its not clear whats going on 😭
p
can you share what commands youre running? You should be able to just run
meltano install
given that meltano.yml file in the repo or you can run
meltano install extractors
, you shouldnt have to run any
add
statements
j
Of course i run this
Copy code
761  meltano install --clean
  762  meltano install extractor tap-csv
  763  meltano install loader target-postgres
  764  meltano install orchestrators airflow
  765  meltano install
i dunno if i make something super wrong but yeah, also before the simple
meltano install
i delete the directory again
p
hmmm yeah that looks right to me πŸ˜”. And what is the current error you're getting?
j
There is no error per se, but the installation is frozen, i left it for a couple of minutes for but nothing its changing
It’s been more than 10 minutes and still stuck, maybee you have any suggestions?
p
@jenn_leon yeah it shouldnt take that long - its running a pip install behind the scenes so I wonder if thats getting stuck, I'd stop it and run with
meltano --log-level=debug install
or
..install x
so you get some logs related to whats hanging
e
the one stuck seems to be dbt. It might take a while if
dbt-snowflake
is compiling its dependencies
j
ohhh okay, i will let it be πŸ˜… Thank you for your help!!!
e
also, if you're not using snowflake, you can get rid of
dbt-snowflake
from the
pip_url
πŸ™‚