Meltano

Hi. I have a few tables that need to be re-ingested. I’m using incremental ingestion with pipelinewise tap-postgres. How do I trigger a re-ingestion of these tables?

Looks like `meltano state merge` is what I need

Maybe. Be aware that you'll need to manually remove the data from the destination too.

FWIW I'm not sure the `merge` command can be used to remove state for a table... only change it. So if you can change the state to "the beginning" then merge might work for this but I've always done a `get`, removed the state for the table in question, and done a `set` to put it back.

`--full-refresh` will ignore state and do what you want!

<@U069EPD13KN> is there a way to do that for a single stream (or a small subset of streams)? i.e. if a pipeline normally replicates a thousand tables is there a way to re-initialize just one using the `--full-refresh` switch?

&gt; Maybe. Be aware that you’ll need to manually remove the data from the destination too.
Yep. I’ve found that, too.

&gt; So if you can change the state to “the beginning” then merge might work for this
This seems to work for me.

As for `--full-refresh`, yeah, I’ve got some colossal tables in there. A `--refresh-only stream1,stream2` would be fantastic.

<@U06D11WBKK2> there isn’t a way to do it from the command line. Editing the state and deleting the timestamps for those streams would probably be the easiest.