https://linen.dev logo
Join Slack
Powered by
Hi! I’m trying to `meltano add utility superset` ...
# plugins-general
e
Hi! I’m trying to 
meltano add utility superset
but can’t get that to work… It fails like so:
Copy code
Added utility 'superset' to your Meltano project
Variant:        meltano (default)
Repository:     <https://github.com/apache/superset>
Documentation:  <https://hub.meltano.com/utilities/superset--meltano>

Installing utility 'superset'...
Utility 'superset' could not be installed: failed to install plugin 'superset'.

Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

Failed to install plugin(s)
Does anyone have hints or ideas? Thank you 🙂
r
Have you tried with 
--log-level debug
?
e
Getting 
Error: No such option: --log-level
r
meltano --log-level debug add utility superset
e
ty!
Do you want more of the stack trace?
r
Yeah probably -it's massive, I know! 😅
e
Let’s see how well this pastes to Slack 😅
Ah… Too much… 2 seconds
Failed to install plugin(s) ╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮ │ /Users/erik/anaconda3/envs/mds/lib/python3.8/site-packages/click/core.py:1078 in main │ │ │ │ 1075 │ │ try: │ │ 1076 │ │ │ try: │ │ 1077 │ │ │ │ with self.make_context(prog_name, args, **extra) as ctx: │ │ ❱ 1078 │ │ │ │ │ rv = self.invoke(ctx) │ │ 1079 │ │ │ │ │ if not standalone_mode: │ │ 1080 │ │ │ │ │ │ return rv │ │ 1081 │ │ │ │ │ # it’s not safe to 
ctx.exit(rv)
here! │ │ │ │ /Users/erik/anaconda3/envs/mds/lib/python3.8/site-packages/meltano/cli/utils.py:612 in invoke │ │ │ │ 609 │ │ enact_environment_behavior(self.environment_behavior, ctx) │ │ 610 │ │ if ctx.obj.get(“tracker”): │ │ 611 │ │ │ ctx.obj[“tracker”].add_contexts(CliContext.from_click_context(ctx)) │ │ ❱ 612 │ │ super().invoke(ctx) │ │ 613 │ │ 614 │ │ 615 class InstrumentedDefaultGroup(InstrumentedGroupMixin, DefaultGroup, DYMGroup): │ │ │ │ /Users/erik/anaconda3/envs/mds/lib/python3.8/site-packages/click/core.py:1688 in invoke │ │ │ │ 1685 │ │ │ │ super().invoke(ctx) │ │ 1686 │ │ │ │ sub_ctx = cmd.make_context(cmd_name, args, parent=ctx) │ │ 1687 │ │ │ │ with sub_ctx: │ │ ❱ 1688 │ │ │ │ │ return _process_result(sub_ctx.command.invoke(sub_ctx)) │ │ 1689 │ │ │ │ 1690 │ │ # In chain mode we create the contexts step by step, but after the │ │ 1691 │ │ # base command has been invoked. Because at that point we do not │ │ │ │ /Users/erik/anaconda3/envs/mds/lib/python3.8/site-packages/meltano/cli/utils.py:661 in invoke │ │ │ │ 658 │ │ if ctx.obj.get(“tracker”): │ │ 659 │ │ │ ctx.obj[“tracker”].add_contexts(CliContext.from_click_context(ctx)) │ │ 660 │…
(I cut out the top 3 from the trace as they were visible in the screenshot)
Could it be a python version problem? I’m currently on 3.8 in this environment (for no good reason, really)
r
Sounds like a 
pip install
problem, but the error output is not getting surfaced in Meltano - this looks relevant: https://github.com/meltano/meltano/issues/8131
Could it be a python version problem?
Could very well be. I would try running a manual 
pip install <plugin pip_url>
in a fresh virtual environment and see what happens. 🙂
e
I switched to python 3.9.18 in this environment and I’m re-running 
meltano --log-level debug add utility superset
- seems promising, doesn’t fail as fast at least 😄
r
Yeah, it's probably an issue with a Python version requirement of a dependency then maybe.
Worth noting that if you're using Meltano v3, you can provide a Python executable to the 
--python
option of 
meltano add
now: https://docs.meltano.com/reference/command-line-interface/#how-to-use
e
Hah, cool. Yea, I’m on 3.0.0
This seems kind of weird, though…
r
My understanding is you are configuring the Python executable Meltano uses to create the virtual environment for that plugin (
superset
in this case), not the underlying Python version Meltano itself was installed with.
e
Finally managed to run the command with python version 3.9, but still no luck... Same issue. Is it possible to run the whole thing in a debugger or something to see what's going on? Long time since I did any serious python work...
r
As in you are running something like 
meltano add --python python3.9 utility superset
and seeing the same 
Failed to install plugin(s)
error? No idea about running Meltano in a debugger - maybe @Will Da Silva (Arch) can speak to that.
e
No, I installed meltano in a clean venv. Also installed python 3.9.18 using pyenv. Ran meltano from the venv directory... Does this work for you btw, if you try to add this utility in an empty meltano project? If so, which python version are you using?
r
Python 3.7
Copy code
reuben@reuben-Inspiron-14-5425:/tmp/project$ meltano add utility superset
Added utility 'superset' to your Meltano project
Variant:	meltano (default)
Repository:	<https://github.com/apache/superset>
Documentation:	<https://hub.meltano.com/utilities/superset--meltano>

Installing utility 'superset'...
Utility 'superset' could not be installed: failed to install plugin 'superset'.
  Running command git clone --filter=blob:none --quiet <https://github.com/meltano/superset-ext.git> /tmp/pip-req-build-aggc8cn_
ERROR: Ignored the following versions that require a different python version: 2.0.0 Requires-Python ~=3.8; 2.0.1 Requires-Python ~=3.8; 2.1.0 Requires-Python ~=3.8; 2.1.1 Requires-Python ~=3.8; 2.1.1rc1 Requires-Python ~=3.8; 2.1.1rc2 Requires-Python ~=3.8; 2.1.1rc3 Requires-Python ~=3.8; 3.0.0rc01 Requires-Python ~=3.9; 3.0.0rc2 Requires-Python ~=3.9; 3.0.0rc3 Requires-Python ~=3.9; 3.0.0rc4 Requires-Python ~=3.9
ERROR: Could not find a version that satisfies the requirement apache-superset==2.0.0 (from versions: 0.34.0, 0.34.1, 0.35.1, 0.35.2, 0.36.0, 0.37.0, 0.37.1, 0.37.2, 0.38.0, 0.38.1, 1.0.0, 1.0.1, 1.1.0, 1.2.0, 1.3.0, 1.3.1, 1.3.2, 1.4.0, 1.4.1, 1.4.2, 1.5.0, 1.5.1, 1.5.2, 1.5.3)
ERROR: No matching distribution found for apache-superset==2.0.0

Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

Failed to install plugin(s)
Python 3.8
Copy code
reuben@reuben-Inspiron-14-5425:/tmp/project$ meltano#3.8 add utility superset
Added utility 'superset' to your Meltano project
Variant:	meltano (default)
Repository:	<https://github.com/apache/superset>
Documentation:	<https://hub.meltano.com/utilities/superset--meltano>

Installing utility 'superset'...
Utility 'superset' could not be installed: failed to install plugin 'superset'.
  Running command git clone --filter=blob:none --quiet <https://github.com/meltano/superset-ext.git> /tmp/pip-req-build-l71u6jyw
  Running command git clone --filter=blob:none --quiet <https://github.com/meltano/edk.git> /tmp/pip-install-yousj08a/meltano-edk_11b146b3fcbb4c2eb8c99b783be37ddf
  Running command git checkout -q b194cb5b96e99c872e936dd76c62a9f32f17a5e7
ERROR: Cannot install apache-superset==2.0.0 and superset-ext because these package versions have conflicting dependencies.
ERROR: ResolutionImpossible: for help visit <https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts>

Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

Failed to install plugin(s)
Python 3.9
Copy code
reuben@reuben-Inspiron-14-5425:/tmp/project$ meltano#3.9 add utility superset
Added utility 'superset' to your Meltano project
Variant:	meltano (default)
Repository:	<https://github.com/apache/superset>
Documentation:	<https://hub.meltano.com/utilities/superset--meltano>

Installing utility 'superset'...
Utility 'superset' could not be installed: failed to install plugin 'superset'.
  Running command git clone --filter=blob:none --quiet <https://github.com/meltano/superset-ext.git> /tmp/pip-req-build-zgcqdlz1
  Running command git clone --filter=blob:none --quiet <https://github.com/meltano/edk.git> /tmp/pip-install-byi3asve/meltano-edk_2c060f6efd684cf5897a3173e292046b
  Running command git checkout -q b194cb5b96e99c872e936dd76c62a9f32f17a5e7
ERROR: Cannot install apache-superset==2.0.0 and superset-ext because these package versions have conflicting dependencies.
ERROR: ResolutionImpossible: for help visit <https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts>

Need help fixing this problem? Visit <http://melta.no/> for troubleshooting steps, or to
join our friendly Slack community.

Failed to install plugin(s)
Python 3.10 ```reuben@reuben-Inspiron-14-5425:/tmp/project$ meltano#3.10 add utility superset Added utility 'superset' to your Meltano project Variant: meltano (default) Repo…
e
Yea, really seems like it. Sad. Thanks for looking into it 🙂
Managed to install superset "manually", and given the fact that this was by no means a smooth process, I would be very impressed if it would be possible to install it as a plugin 😅
e
@erik_kinding I'm experiencing the same problem(s). Would you mind sharing a quick recap of how you managed to get it working?
e
Weird as it may sound, I don't remember exactly what I did, but I believe I ended up running it on a local k8s cluster 🙈 See these instructions: https://superset.apache.org/docs/installation/running-on-kubernetes/
e
Thanks. We actually already have a Superset instance running in our cluster.
2 Views
Open in Slack
PreviousNext
Powered by