Is there any concept of ‘hooks’ in Meltano?

Hi @mammoth-napkin-71897! In what context do you mean? Meltano does use its own form of hooks internally, for example to create temp config and catalog files for Singer, and for cleaning those up.

I suppose mostly in terms of attaching supporting processes to CLI operations…

@mammoth-napkin-71897 you’ll probably be interested in https://gitlab.com/meltano/meltano/-/issues/2813 and some of the related issues

I also wonder if meltano run does what you want here? This works or will work at some point

meltano run prehook tap-name target-name posthook

although I'm kinda abusing things a bit here this is one of the ideas of meltano run!

@flat-bear-81546 - Yeah, I think that’s basically what I was referring to w/

meltano run

in conjunction with creating some Utility plugins to expose cli’s that

meltano run

can use.

Right now just

#/bin/bash
./prehook.sh
meltano elt tap-name target-name
./posthook.sh

Or use airflow or whatever 🙂

By the way, just to throw an idea out there (and I’m happy to write this up as a ticket if it seems interesting enough): I know that Kedro uses pytests’s https://pluggy.readthedocs.io/en/latest/ as a basis for its own hook system… Assuming I understand correctly how pluggy works, I think one could imagine a Hook plugin type in Meltano where the plugin author would have say a dozen entrypoints to override.