Hey everyone! I currently have a loop returns tap ...
# troubleshootingt
timothy_ng
12/06/2022, 6:27 PMHey everyone! I currently have a loop returns tap in a github action workflow, but it seems to fail only once a day with every other run throughout the day being successful.
Is there a reason why one run may be failing but others aren't? Seems like it's always
Copy code
[error ] Extraction failed code=1 message=requests.exceptions.HTTPError: 504 Server Error:v
visch
12/06/2022, 6:35 PM500's are common, make sure your tap retries on them with a good backoff!
j
jacob_matson
12/06/2022, 6:50 PMagree with Derek, also...in my exp there is some extreme lumpiness in two areas that may be impacting you - 1, load on github actions at PST midnight, 2, load on whatever your source is at midnight local time.
my guess is you are hitting one or both of those.
jacob_matson
12/06/2022, 6:51 PMmy experience with POS systems like shopify is that that there are "close of business" batch processes running on a daily basis that either cause extreme slowness OR a 504 like you are seeing
v
visch
12/06/2022, 6:52 PMright, and I"d lump all those into the "tap needs to handle it" bucket as there's so many reasons 500's can happen sometimes the server just looks at your request and decides it doesn't like it
visch
12/06/2022, 6:53 PMthe sdk is pretty good at making sure the general cases just aren't an issue!
t
timothy_ng
12/06/2022, 7:48 PMThanks everyone! I have the workflow run every 4 hours, where it only fails once a day (usually in the mornings) so I had a feeling it might just be server load issues. Thanks for confirming my suspicions!