hello people, I'm just getting started with Melta...
# getting-started
s
hello people, I'm just getting started with Meltano, and I have a tap which has multiple streams available. Let's say if I have 10 streams
selected
and If I want to load the data for just 3 of these streams, I find myself commenting the others in
meltano.yml
file and then running the
meltano run
command. Is there a better way to do this? something like
meltano run tap-some_name target_somename stream_name
?
d
It could be done with a combination of
merge-state
and
select
flags
s
could you please share the command? It's a little bit confusing
d
Sure, the example for
run
would be as following:
TAP_SOMENAME__SELECT_FILTER=stream_name meltano run tap-somename target-somename --merge-state
The select_filter is defined through env vars since
run
doesn’t support it directly. The
merge-state
is required to merge the partial state with previous run.
🔥 2