Is anyone running Meltano in a docker image in Git...
# troubleshootingm
Matt Menzenski
02/10/2023, 3:43 PMIs anyone running Meltano in a docker image in GitHub actions? We’re running meltano in GitHub actions today but not in the Docker image, as I haven’t been able to figure out how to invoke the meltano executable in the container in a GitHub actions step (as it seems in a GitHub actions step you can’t use the defined container entrypoint?)
v
visch
02/10/2023, 3:50 PMNot doing it with a container right now but I'll show what I have
e
edgar_ramirez_mondragon
02/10/2023, 3:51 PMv
visch
02/10/2023, 3:52 PMBetter than mine I"ll stay out of this 😄
m
Matt Menzenski
02/10/2023, 3:54 PMthank you @edgar_ramirez_mondragon! I feel like I tried running the whole job in a container but will take another look
j
jacob_matson
02/10/2023, 5:12 PMI'm not using an action but can run meltano inside docker with codespaces, using make. basically, build docker container and copy makefile into it, then invoke "make pipeline" which wraps all the meltano commands.
jacob_matson
02/10/2023, 5:13 PMit runs with these two commands in the makefile found here.
Copy code
docker-build:
docker build -t mdsbox . Copy code
docker-run-superset:
docker run \
--publish 8088:8088 \
--env MELTANO_CLI_LOG_LEVEL=WARNING \
--env MDS_SCENARIOS=10000 \
--env MDS_INCLUDE_ACTUALS=true \
--env MDS_LATEST_RATINGS=true \
--env MDS_ENABLE_EXPORT=true \
--env ENVIRONMENT=docker \
mdsbox make pipeline superset-visualsj
jan_soubusta
02/13/2023, 10:12 AMDon't wanna troll, but I recommend to use Gitlab. There, you can override the entry point easily:
https://gitlab.com/patrikbraborec/gooddata-data-pipeline/-/blob/main/.gitlab-ci.yml#L83
I could not use the official Meltano image, so I created a simple Dockefile meeting my needs:
https://gitlab.com/patrikbraborec/gooddata-data-pipeline/-/blob/main/Dockerfile_meltano