Hi all! I am not able to get state to work with t...
# troubleshooting
s
Hi all! I am not able to get state to work with tap-redshift(signal-ai variant) and target-postgres(default). I am facing 2 issues: 1. The emitted log output is always None, even when sync has completed successfully. This is the output of my
meltano invoke tap-redshift
Copy code
{"type": "STATE", "value": {"currently_syncing": "zr.cc.config", "bookmarks": {"zr.cc.config": {"version": null}}}}
{"type": "STATE", "value": {"currently_syncing": null, "bookmarks": {"zr.cc.config": {"version": null}}}}
I am expecting it to store the TS and replication key somewhere in the above info. 2. My state is not being persisted for some reason. I tried using both local file system and s3 state backend, but I don’t see the state file or folder getting created.
u
@silverbullet1 it doesnt look like we list the signal ai variant on the hub anymore https://hub.meltano.com/extractors/tap-redshift/. The Monad variant is probably a more active fork. I dont think this is your issue because you'd be seeing state records populated when you invoke but there was a similar thread a while back about the signal ai variant not having the state capability https://meltano.slack.com/archives/C01TCRBBJD7/p1655194042845799
s
Ohh bummer. I did try the Monad variant but was facing some issues(related to psycopg2 issues as discussed in other threads). I think there is no way around but to implement the SDK based connector. Let me try that..but I do have some custom requirements like specifying custom primary keys, schema evolution, etc. Will have to spend some time on this.