Hello everyone I am trying to run tap-amazon-sp (...
# troubleshooting
c
Hello everyone I am trying to run tap-amazon-sp (hotgluexyz variant). It has already been correctly configured, as you have helped me 🙌 However, as I try to run it I get a
KeyError: 'LastUpdateDate'
on
singer_sdk/helpers/_state.py", line 219, in increment_state
🤔 Has anybody ever run into this error before? (be it with this or another tap) A bigger part of the stack trace is in the screenshot below, or fully in the attached log file.
e
That seems to indicate that the declared replication key is not actually present in at least one of the records. But looking at https://developer-docs.amazon.com/sp-api/docs/orders-api-v0-reference#orderlist seems to indicate that it should be present 🤔
🤔 1
c
I think I was able to solve this issue now! Your point did help, @Edgar Ramírez (Arch.dev), thanks. What I did was select the other entities under
order
(not only their
AmazonOrderId
) in such a way that this replication key is kept. Now I am facing a QuotaExceeded issue, but trying to check whether the tap has some kind of flexible-retry workaround 🤔
e
It's great that you got it working! FWIW the tap is using a fairly old version of our
singer-sdk
library (0.4.4 vs current 0.38.0) and a few of these problems have been addressed upstream in the meantime: 1. Replication keys are automatically selected: https://github.com/meltano/sdk/commit/eec6e6abd951ea43d7a5ca1e61237dcd8e29ebc2 2. Backoff helpers have been improved It might be worth forking the repo and making updates there. I don't know if hotglue (the maintainers) are interested, but submitting MRs for those changes would also be nice. I would do so myself but I don't have credentials to test the tap.