HI, I want to use the inbuild Singer backoff handl...
# singer-tap-developmentn
Nir Diwakar (Nir)
04/08/2024, 1:12 PMHI, I want to use the inbuild Singer backoff handler but I want to handle the exceptions myself after the maximum retries have completed. How do I handle this exception? What function should I override?
singer_sdk.exceptions.RetriableAPIError: 429 Client Error
Nir Diwakar (Nir)
04/08/2024, 1:17 PMI need to handle the case when maximum retries have been completed.
Nir Diwakar (Nir)
04/08/2024, 2:13 PMI tried this, but it doesn't work:
def giveup_handler(self):
logging.error("We retried too many times :(")
@backoff.on_exception(backoff.expo, RetriableAPIError, on_giveup=giveup_handler)
e
Edgar Ramírez (Arch.dev)
04/08/2024, 3:32 PMHey @Nir Diwakar (Nir). Have you checked https://sdk.meltano.com/en/v0.36.1/classes/singer_sdk.RESTStream.html#singer_sdk.RESTStream.backoff_handler?
n
Nir Diwakar (Nir)
04/08/2024, 5:32 PMYes, I did. I followed the documentation but the event handler doesn't seem to work
Nir Diwakar (Nir)
04/08/2024, 5:33 PMNeither can I find a code example in any of the meltano connectors. Can you please help me with a sample implementation?
In backoff_handler(details)
what variables can I access in details?
4 Views