Shubham Kawade
06/11/2024, 5:13 AMselected and If I want to load the data for just 3 of these streams, I find myself commenting the others in meltano.yml file and then running the meltano run command.
Is there a better way to do this?
something like meltano run tap-some_name target_somename stream_name ?Denis I.
06/11/2024, 8:33 AMmerge-state and select flagsShubham Kawade
06/11/2024, 9:05 AMDenis I.
06/11/2024, 11:00 AMrun would be as following:
TAP_SOMENAME__SELECT_FILTER=stream_name meltano run tap-somename target-somename --merge-state
The select_filter is defined through env vars since run doesn’t support it directly. The merge-state is required to merge the partial state with previous run.