Extending existing pipeline, and suddenly tap-gith...
# troubleshootingj
jan_soubusta
02/21/2023, 2:03 PMExtending existing pipeline, and suddenly tap-github stopped work for me.
Config screenshot below.
I execute:
Copy code
meltano --environment cicd_dev run tap-github-repo target-snowflake Copy code
023-02-21T13:59:48.317777Z [error ] Cannot start plugin tap-github-repo: Executable 'tap-github' could not be found. Extractor 'tap-github-repo' may not have been installed yet using `meltano install extractor tap-github-repo`, or the executable name may be incorrect.venvmeltano.ymlw
willi_langlitz
02/21/2023, 4:38 PMYou can use:
Copy code
executable: tap-githubwilli_langlitz
02/21/2023, 4:40 PMAnd if it is still not workingtry to install the child extractor (don't know why we should do this though)
j
jan_soubusta
02/21/2023, 6:00 PMexecutable does not help
jan_soubusta
02/21/2023, 6:06 PMstrange, I downgraded meltano do 2.12, which works for me in Gitlab pipeline, and it does not help, it is still failing with the same error
jan_soubusta
02/21/2023, 6:06 PMAny advice how to debug this issue would be much appreciated
jan_soubusta
02/21/2023, 6:08 PMTrue is that the
tap-githubmeltano installjan_soubusta
02/21/2023, 6:13 PMI have solution!
rm -rf .meltanojan_soubusta
02/21/2023, 6:58 PMLooks like when you play with meltano in a venv, e.g. you bump the version, it can lead to these issues.
In the pipeline, a Gitlab worker starts from scratch from an image, so this issue can't happen there 😉
s
Sven Balnojan
02/28/2023, 1:37 PM@jan_soubusta My solution for any of these issues is to have all my projects (not just Meltano) super stateless. I start with a fresh dockerized dev setup multiple times a day. That kind of forces me to make sure I don't inject some dependencies somewhere I'm not aware of.
j
jan_soubusta
02/28/2023, 4:47 PMA good habit to work around the issue, but I still think it should not behave like this.
Personally, I have not faced such an issue with any other PyPI package - upgrade of version should not break it like this, IMO.
s
Sven Balnojan
03/01/2023, 9:32 AMHm @edgar_ramirez_mondragon are you able to see the problem here? I know it's solved, but I would like to know whether there is either a possible fix for this or a best practice that makes sense to put somewhere?
e
edgar_ramirez_mondragon
03/01/2023, 2:35 PMI think
meltano install --clean