Running HLE LLM-as-judge evaluation...
Judging question with gpt-5.4 repeat 1...
Judging question with claude-opus-4-6 repeat 1...
Judging question with gemini-3.5-flash repeat 1...
Attempt 1/20 failed: Invalid \escape: line 1 column 165 (char 164)
Retrying in 2s...
Attempt 2/20 failed: Invalid \escape: line 1 column 165 (char 164)
Retrying in 4s...
Succeeded on attempt 3
Judging question with gpt-5.4 repeat 2...
Judging question with claude-opus-4-6 repeat 2...
Judging question with gemini-3.5-flash repeat 2...
Judging question with gpt-5.4 repeat 3...
Judging question with claude-opus-4-6 repeat 3...
Judging question with gemini-3.5-flash repeat 3...
Reward: 1.000000
Evaluation complete.
