Skip to content
This repository has been archived by the owner on Dec 16, 2022. It is now read-only.

experimental: add backoff #2968

Merged
merged 4 commits into from
Jun 18, 2019
Merged

experimental: add backoff #2968

merged 4 commits into from
Jun 18, 2019

Conversation

joelgrus
Copy link
Contributor

@joelgrus joelgrus commented Jun 18, 2019

Our tests have been consistently failing all day because of intermittent failed requests.get and requests.head calls to S3. It seems like these failures are rooted in AWS denying the requests (on account of volume / frequency?), so this PR implements retries with backoffs for all of our requests calls

Copy link
Contributor

@brendan-ai2 brendan-ai2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@joelgrus
Copy link
Contributor Author

success!

@joelgrus joelgrus merged commit a655ad5 into allenai:master Jun 18, 2019
@brendan-ai2
Copy link
Contributor

Sweet!

reiyw pushed a commit to reiyw/allennlp that referenced this pull request Nov 12, 2019
* add backoff

* use for etag

* use backoff everywhere

* pylint
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants