I opened an issue for this, but what is the recomm...
# singer-tap-developments
stephen_bailey
11/02/2021, 1:06 PMI opened an issue for this, but what is the recommended way to handle a timestamp replication key that is
epochdateutil.parserdatetime.fromtimestamp Copy code
>>> from datetime import datetime
>>> ts = 1634606164.000200
>>> datetime.fromtimestamp(ts)
datetime.datetime(2021, 10, 18, 21, 16, 4, 200)v
visch
11/02/2021, 1:09 PMI don't know, but if you want an example of what I did for this scenario check out
https://github.com/AutoIDM/tap-clickup/blob/main/tap_clickup/streams.py#L190
I went the other way and left everything as epoch
s
stephen_bailey
11/02/2021, 4:09 PMgotcha, that makes sense 👍
stephen_bailey
11/03/2021, 1:06 PMThis is what I ended up doing as well. Just have to convert the start date to time stamp and then treat the replication value as a number. One question - does it always take the “max” value for the new state?
v
visch
11/03/2021, 1:08 PMSDK did release a fix that I believe does that but I'd test it. https://github.com/AutoIDM/tap-clickup/blob/main/tap_clickup/streams.py#L181 was written before the fix and handles it as well