Hey Meltano Team Is there a way to redirect ` meltano run` t Meltano #announcements

Hey Meltano Team, Is there a way to redirect `.me...

rahul_anand

07/23/2020, 7:08 PM

Hey Meltano Team, Is there a way to redirect

.meltano/run

to a mounted volume in the docker containerized Meltano Project? I am thinking it may be good to generate logs, execution details on a mounted volume to make these data accessible from outside docker container and prevent exceeding the docker disk size limit. Any recommendations?

douwe_maan

07/23/2020, 8:44 PM

@rahul_anand For sure! I just tried this and it works exactly as you'd expect:

Copy code

docker run -v some-local-dir:/project/.meltano/run elt ...

douwe_maan

07/23/2020, 8:44 PM

If you'd only like to exfiltrate ELT logs, mount at

/project/.meltano/run/elt

douwe_maan

07/23/2020, 8:54 PM

Right now the log directory cannot be changed from

.meltano/run/elt

, but there's an issue for that at https://gitlab.com/meltano/meltano/-/issues/2107. Let me know if the mount approach described above works or if has some downside in your scenario I'm not aware of!

rahul_anand

07/24/2020, 12:56 AM

Thanks @douwe_maan for checking the mount option. I wanted to check with your team to ensure that I am not planning something against the Meltano design. In my view mounting the

/project/.meltano/run/elt

should be sufficient for now. I will check and confirm.

douwe_maan

09/07/2020, 8:40 PM

@rahul_anand FYI: If you're still mounting

.meltano/*run*/elt

, the second paragraph here will be relevant once you upgrade: https://meltano.slack.com/archives/CP8K1MXAN/p1599510962005300

Open in Slack

Previous Next