Another thing I have noticed is for the airflow k8s worker, all logs are sent to stderr? They are info logs but are labeled as ERROR

Yeah, if you're running Meltano as a subprocess (the only recommended way until the Python API is stable 😅) then Airflow won't be aware of the log levels in the Meltano program.