Hello! I am just getting started with meltano. I was wondering for different transformation operations if there was an option to use something other than dbt (such as a free-form python script) etc.

Hey @pranavsingh, I’d imagine you could use Meltano to Extract the data into your target’s “raw” area / schema, then run your Python scripts to transform the data (of course you could schedule this with something like Airflow as well). The Meltano folks know best though, so feel free to correct me if I’m wrong 😄

@pranavsingh Andy is right: if you want to do this today, you'll want to run

meltano elt

followed by your own script, which means you can't make use of Meltano's built-in scheduling functionality, but you do unlock the full power of Airflow DAGs. Meltano's architecture is very modular though, and it wouldn't be difficult to implement support for simple Python script

transform

plugins in addition to the current ones that effectively require

dbt

as a runner. I'd suggest creating an issue with this idea so we can get the conversation going around what this could look like in a practical sense!