haleemur_ali
10/03/2024, 4:21 AMrun
, el
and elt
. It seems el & elt allow --select
and --exclude
to be specified where run
does not. I saw that elt
was being deprecated in favour of el
and the cli docs for el mention the following:
The command meltano run is the recommended way to run cross-plugin workflows in a composable manner.
Are we moving towards having just 1 command, or does it make sense to keep both run
& el
. I'd love to understand when to prefer run
over el
& vice versa.Jens Christian Hillerup
10/03/2024, 8:22 AMel
is happening as part of the run
. meltano run
creates a run with an ID and some status about how it went etc. in Meltano's own database. I don't think el
does that..Edgar Ramírez (Arch.dev)
10/03/2024, 2:29 PMrun
& el
. The latter like you mentioned supports --select
and --exclude
and we don't have plans for adding them to run
.haleemur_ali
10/03/2024, 6:06 PMel
Jens Christian Hillerup
10/03/2024, 7:08 PMel
command at a certain interval, then using the run
API that becomes a "thing" with metadata like "when did the run start/end", "were there any problems" etc.Jens Christian Hillerup
10/03/2024, 7:09 PMrun
is for "production" so to speak. el
is for trying stuff out, doing one-offs, etc.. Stuff that you do by hand, essentiallyEdgar Ramírez (Arch.dev)
10/03/2024, 7:11 PMrun
has a different implementation and works on Windows, if that's important to you
2. run
can run mappers, e.g. meltano run extractor mapping loader
3. run
can also run more complex commands: https://docs.meltano.com/reference/command-line-interface/#run