Does anyone know how to force a resync when using ...
# plugins-general
d
Does anyone know how to force a resync when using logical replication w/ pipelinewise’s tap-postgres?
I think the proper way is to force a new state name?
t
It depends on what you mean by "re-sync". You can use the
--full-refresh
option to tell the tap to ignore the state data and retrieve all data in the source, but that won't clear the existing data from the destination. Depending on the type of target you're using and how it works that may or may not be a problem.
d
I think the main thing I am trying to do is correct a drift i caused between the state file and the database. Over the weekend we had an outage and had to subsequently pause meltano from syncing but i also had to drop the replication slot to prevent it from growing above our desired threshold.
because the rep slot was dropped and the syncing paused, there are some db changes that are now not in our target
t
I don't think I know enough about PG replication to be super helpful here. 😞 At a very high level it sounds to me like you're going to need to either restart everything as if it were brand new or do a bunch of manual data movement/tweaking of the state data in the meltano DB though... and I would not recommend the latter unless your data is so large that re-starting is impractical.
d
yeah i think i need to essentially do a full refresh and build from there
ty!