Shubham Kawade
06/11/2024, 5:13 AMselected
and If I want to load the data for just 3 of these streams, I find myself commenting the others in meltano.yml
file and then running the meltano run
command.
Is there a better way to do this?
something like meltano run tap-some_name target_somename stream_name
?Denis I.
06/11/2024, 8:33 AMmerge-state
and select
flagsShubham Kawade
06/11/2024, 9:05 AMDenis I.
06/11/2024, 11:00 AMrun
would be as following:
TAP_SOMENAME__SELECT_FILTER=stream_name meltano run tap-somename target-somename --merge-state
The select_filter is defined through env vars since run
doesn’t support it directly. The merge-state
is required to merge the partial state with previous run.