Is there a way to combine a full refresh with 'stateful' update runs during the day? What I would like to achieve using tasks is: • midnight - truncate tables and

meltano run tap target --full-refresh

• every other hour -

meltano run tap target

Is there some dbt magic that can do the truncation bit? I can't use

activate version

for various reasons, structure of my data on the tap side etc. ALso I don't believe tasks support flags like

--full-refresh

right?

yeah something like midnight

meltano run dbt:drop_tables tap-name target-name

every other hour

meltano run tap-name target-name

should just do the trick for you, simple enough without complicating things

I'd need a

--full-refresh

at midnight run right? I've been using tasks up until now but looks like I need to specify some run commands instead