Hey all. I’ve got a containerized project which I’m running via AWS Batch jobs. I’d also like to create some jobs where I compile the dbt project and transfer some of the artifacts (docs, etc) out of the container onto something like S3. I can obviously just write a script to do that and include it in the container, but just curious if there’s any nifty built-in functionality within Meltano I should/could make use of.

Meltano doesn’t have any functionality for that yet, no

More just curious if there was any natural place something like that might “fit”.

No, not really. Unless you’re planning to make a python package out of it, in which you could add it as a utility plugin and have Meltano handle the installation and

meltano invoke

I think there may actually be some value in going to the trouble to include a script like that as a plugin executed via

meltano invoke

. I’m currently trying to run some extra stuff after my

meltano elt

command in the same container runtime, so I tried putting everything in a shell script, but I think that is disrupting the environment (variables) that my meltano command is relying on.