Has anyone gotten `poetry` actions to work in a CI CD enviro Meltano #singer-tap-development

Has anyone gotten `poetry` actions to work in a CI...

stephen_bailey

08/09/2021, 10:57 AM

Has anyone gotten

poetry

actions to work in a CI/CD environment such as Github Actions? I was trying to setup some boilerplate actions that would run

poetry publish

and

poetry run pytest

for my tap, but there is apparently an issue with poetry deleting the

setuptools

module (https://github.com/python-poetry/poetry/issues/3139). Plenty of ways around it, but I was thinking -- if the SDK can help standardize the taps and testing, it would also be nice to have standard, poetry-based CI/CD. My question, I guess, is whether anyone has encountered this before and knows whether there's something I should change in my

pyproject.toml

file or

poetry.lock

stephen_bailey

08/09/2021, 11:01 AM

This is the repo I was fiddling with: https://github.com/immuta/tap-clockify/blob/master/.github/workflows/test_package.yml And this is where the errors occur. https://github.com/immuta/tap-clockify/runs/3279549058?check_suite_focus=true#step:5:115

edgar_ramirez_mondragon

08/09/2021, 3:45 PM

Hi @stephen_bailey! I have some GH actions working for tap-dbt using poetry. I have one workflow for testing the tap with

poetry run tap-dbt --test --config=ENV

and another for releasing to PyPI triggered by a GitHub release, which uses an action maintained by PyPA. You're right that the cookiecutters could include an optional set of github or gitlab CI/CD workflows.

stephen_bailey

08/09/2021, 3:48 PM

niiiice! i knew someone had done this already, and better 🙂 will give it a shot and share if i hit any roadbumps

stephen_bailey

08/14/2021, 10:48 AM

coming back to this. it looks like this is an issue that is being actively worked on, and it seems to be more common in docker deployments, where the how of how poetry is installed is.a little less controlled. https://github.com/python-poetry/poetry/issues/3139#issuecomment-820164065 the issue that is happening for me, is that i am unable to generate a

poetry.lock

file locally that can be reused successfully in the github actions container, even when using the same simple action script. If i remove the

poetry.lock

file, it all works well. it sounds like they are going to add something akin to

poetry install --no-remove

to handle this

stephen_bailey

08/16/2021, 8:05 PM

Update here on the

poetry

issue: they are releasing a fix in the next version of Poetry to prevent the "uninstallation" packages that were not managed by Poetry. My current fix for this in the action is to install the Preview version is:

Copy code

- name: Install Poetry
        run: |
          curl -sSL <https://raw.githubusercontent.com/python-poetry/poetry/master/install-poetry.py> | python -
          export PATH=$PATH:$HOME/.local/bin
          poetry self update --preview

Open in Slack

Previous Next