https://linen.dev logo
Join Slack
Powered by
Does meltano have a cache I am unaware of? After m...
# troubleshooting
a
Does meltano have a cache I am unaware of? After making an update to a target and attempting to install using the "git+ssh" method to install from the repo, I get this error when running 
meltano-install
Copy code
ERROR: Cannot install target-s3-jsonl and target-s3-jsonl==1.0.0 because these package versions have conflicting dependencies.
e
hi @adam_roderick! yeah, 
meltano install
tries to reuse the virtual environments and upgrade the plugin instead of recreating them every time it's called. To force re-creation, do 
meltano install --clean
a
@edgar_ramirez_mondragon thanks, I did not realize this was the behavior. However, I see the same error running 
meltano install --clean
. I deleted the 
.meltano
directory and tried again--same result.
I do not get this error when I manually create a venv and 
pip install
into that venv
Probably just my lack of understanding of either pip or meltano, but I'm not sure where to look to troubleshoot further
e
What does you 
pip_url
look like?
a
Copy code
- name: target-s3-jsonl
      namespace: target_s3_jsonl
      pip_url: <git+ssh://git@github.com/datateer/target-s3-jsonl.git@main>
      executable: target-s3-jsonl
e
I do see a dep conflict with normal pip installation:
Copy code
$ pip install git+<https://github.com/Datateer/target-s3-jsonl.git@main>
Collecting git+<https://github.com/Datateer/target-s3-jsonl.git@main>
  Cloning <https://github.com/Datateer/target-s3-jsonl.git> (to revision main) to /private/var/folders/8b/z9sdckf92_g3hgnh6nv0yhbh0000gn/T/pip-req-build-73w9a8jd
  Running command git clone -q <https://github.com/Datateer/target-s3-jsonl.git> /private/var/folders/8b/z9sdckf92_g3hgnh6nv0yhbh0000gn/T/pip-req-build-73w9a8jd
  Resolved <https://github.com/Datateer/target-s3-jsonl.git> to commit f9f9b9b51283c0fdf94c49860ade542498e2b3af
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Collecting jsonschema==3.2.0
  Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Collecting boto3==1.18.22
  Using cached boto3-1.18.22-py3-none-any.whl (131 kB)
Collecting backoff==1.11.1
  Using cached backoff-1.11.1-py2.py3-none-any.whl (13 kB)
Collecting adjust-precision-for-schema==0.3.3
  Using cached adjust_precision_for_schema-0.3.3-py3-none-any.whl (2.6 kB)
INFO: pip is looking at multiple versions of <Python from Requires-Python> to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of target-s3-jsonl to determine which version is compatible with other requirements. This could take a while.
ERROR: Cannot install target-s3-jsonl and target-s3-jsonl==1.0.0 because these package versions have conflicting dependencies.

The conflict is caused by:
    target-s3-jsonl 1.0.0 depends on jsonschema==3.2.0
    adjust-precision-for-schema 0.3.3 depends on jsonschema==2.6.0

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit <https://pip.pypa.io/en/latest/user_guide/#fixing-conflicting-dependencies>
WARNING: You are using pip version 21.2.4; however, version 22.0.3 is available.
You should consider upgrading via the '/Users/edgarramirez/Code/test-install/bin/python3.9 -m pip install --upgrade pip' command.
a
I upgraded pip and now see what you see. Thank you for looking at this @edgar_ramirez_mondragon
Just reporting back, that was the issue. I'm embarrassed I didn't see it, but upgrading pip made it clear. Thank you!
Open in Slack
PreviousNext
Powered by