Running HLE LLM-as-judge evaluation...
Judging question with gpt-5.4 repeat 1...
Judging question with claude-opus-4-6 repeat 1...
Judging question with gemini-3.5-flash repeat 1...
Attempt 1/20 failed: Invalid \escape: line 1 column 323 (char 322)
Retrying in 2s...
Succeeded on attempt 2
Judging question with gpt-5.4 repeat 2...
Judging question with claude-opus-4-6 repeat 2...
Judging question with gemini-3.5-flash repeat 2...
Attempt 1/20 failed: Invalid \escape: line 1 column 248 (char 247)
Retrying in 2s...
Succeeded on attempt 2
Judging question with gpt-5.4 repeat 3...
Judging question with claude-opus-4-6 repeat 3...
Judging question with gemini-3.5-flash repeat 3...
Reward: 0.222222
Evaluation complete.
