Question <@U06CE9BN604> <@U06CBKL5W7L> - I’m wanti...
# hub
t
Question @douwe_maan @aaronsteers - I’m wanting to update the container used for the hub so that it includes Python. Context is that there’s now a script that generates the discovery.yml, but to expose it on the hub via pages it needs to run in the
pages
job in CI - but the image for that job is the Ruby one. Is there a favored or recommended image that has both ruby and python, or, alternatively, should I just make an image in a separate project and pull from there (I did that on the data team but that’s a non-zero amount of time to setup).
a
I don’t know of any images that contain both, but for my part, if you could create the image in manually triggered build step rather than in a separate project, that would be my preference.
This way, we keep the image close to the repo it serves
t
yeah, that’s doable too I think. the only issue is tagging can be a little awkward using git tags, but it should be fine
d
@taylor Could the
pages
job use the build artifacts of a previous Python-based job?
t
ohhh I don’t know! That’s a good idea. I’ll see 🙂
It seems like the job can reference artifacts from previous pipelines, but it doesn’t seem like you can pass artifacts between jobs w/in a pipeline.
d
Also:
When a job uses
needs
, it no longer downloads all artifacts from previous stages by default
So maybe artifacts are carried over automatically anyway?
t
Yeah, I’m testing that but I haven’t been successful. I may be over thinking it by trying to
cp
things manually. I just pushed a simplification based on a forum post I found
d
This does feel like the cleanest approach and it should be possible, so I'd keep hacking away at this a little longer!
t
I will! Just doing some rubber ducking in a slack thread 🦆 😄
yup, looks like I was overthinking it. discovery.yml shows up in https://gitlab.com/meltano/hub/-/jobs/1353416382/artifacts/browse/test/ 🙌
d
Super cool!
a
👍