Hi! As a new Meltano user, I'm trying to setup Ap...
# getting-started
s
Hi! As a new Meltano user, I'm trying to setup Apache Airflow on Kubernetes, using the Airflow Helm Chart, which seems pretty nice. For this I created a fairly simple custom image, combining Meltano and Airflow (just added the utility airflow, nothing special) in a single container. Basically I'm just trying to alias
meltano invoke airflow
to
airflow
, so it can be used with the Airflow Helm Chart. I'm running in quite a few problems, which I did not expect. I can work around most of the issues by moving config from the helm chart to meltano.yml or changing the Dockerfile, but it's like I'm reinventing the wheel, and it's taking ages to fix every little thing. Which means I'm either doing something really smart, or something really stupid. Can you tell me whether I missed something somewhere?
e
Welcome @Sander van den Bos!
I can work around most of the issues by moving config from the helm chart to meltano.yml or changing the Dockerfile
What sort of config would you need to move around?
s
Thanks for getting back to me! Getting back on
Which means I'm either doing something really smart, or something really stupid.
, it was the latter. Once I found the difference between
add orchestrator airflow
and
add utility airflow
, everything went smooth. Sorry for taking your time!
e
Oh, no worries! I'm curious if you saw a reference to
add orchestrator airflow
somewhere in the docs or in another place?
s
I think I found them in another place when I started, some Medium.com articles if I recall correctly. Since I was new to Meltano, I never realized that there was a separate Airflow utility.
👍 1