Skip to content

Commit

Permalink
Fix retry logic in GeminiAPI by adjusting attempt count and initializ…
Browse files Browse the repository at this point in the history
…ing content variable
  • Loading branch information
pufanyi committed Jan 7, 2025
1 parent 02c03bd commit 761696f
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion lmms_eval/models/gemini_api.py
Original file line number Diff line number Diff line change
Expand Up @@ -149,6 +149,8 @@ def get_uuid(task, split, doc_id):

message = [contexts] + visuals

content = ""

for attempt in range(5):
try:
content = self.model.generate_content(
Expand All @@ -172,7 +174,7 @@ def get_uuid(task, split, doc_id):
break
except Exception:
pass
if attempt < 5 - 1: # If we have retries left, sleep and then continue to next attempt
if attempt < 4 - 1: # If we have retries left, sleep and then continue to next attempt
time.sleep(NUM_SECONDS_TO_SLEEP)
else: # If this was the last attempt, log and return empty
eval_logger.error(f"All 5 attempts failed. Last error message: {str(e)}")
Expand Down

0 comments on commit 761696f

Please sign in to comment.