Hi guys. What is the best way to use dynamic variables within targets and taps? For example, passing a output_path that depends on the entity (in this case, table name) and could vary depending on the table name. Would using python + airflow to fetch this data and pass it as a parameter into the meltano cli run a good practice, or there are better ways to do it? Thanks! (first time using meltano)

Could you layout your full use case here a bit, what's the tap and the target? What's your end goal. I have some guesses here but it's hard to say what the "standard" is without knowing the problem a bit better

I need to load data from a postgres database into a file system as parquet. for each table in my database schema I need to create a separate folder in my host, and within those folder save parquet files for each daily extraction. for example, if we create a new table in postgres, I want to automatically create a directory with the name of it is this possible?

target-parquet or something like that sounds like what you want. https://hub.meltano.com/loaders/target-parquet/ The target should be able to do that all based on stream names automatically for you

Oh, so stream names is the name of the feature I might be looking for? thank you, I'll take a look into the parquet loader

Yeah I think you should start with just running a basic target-jsonl with your tap you're after to get a feel for singer

Thanks Derek, that really clarified the whole thing