2024-12-26
My latest piece for @TIME contextualises o3's benchmark results with a look at the new wave of evals shaping the field, including @EpochAIResearch's FrontierMath, @METR_Evals's RE-Bench, and @scale_AI / @ai_risks's Humanity's Last Exam:
Time
A look at the more challenging AI evaluations emerging in response to the rapid progress of models, including FrontierMath, Humanity's Last Exam, and RE-Bench
more interesting than it sounds! LinkedIn: Ross Dawson : The frontier of “evals”. Evaluations comparing AI ahd human capabilities are evolving rapidly as AI rapidly leaves existin...
Merry Christmas everyone here is 2500 words on AI evals — more interesting than it sounds!
Time
A look at the more challenging AI evaluations emerging in response to the rapid progress of models, including FrontierMath, Humanity's Last Exam, and RE-Bench
more interesting than it sounds! LinkedIn: Ross Dawson : The frontier of “evals”. Evaluations comparing AI ahd human capabilities are evolving rapidly as AI rapidly leaves existin...
2024-12-25
My latest piece for @TIME contextualises o3's benchmark results with a look at the new wave of evals shaping the field, including @EpochAIResearch's FrontierMath, @METR_Evals's RE-Bench, and @scale_AI / @ai_risks's Humanity's Last Exam:
Time
A look at the more challenging AI evaluations emerging in response to the rapid progress of models, including FrontierMath, Humanity's Last Exam, and RE-Bench
Despite their expertise, AI developers don't always know what their most advanced systems are capable of—at least, not at first. X: @tharin_p and @tharin_p X: @tharin_p : My latest...
Merry Christmas everyone here is 2500 words on AI evals — more interesting than it sounds!
Time
A look at the more challenging AI evaluations emerging in response to the rapid progress of models, including FrontierMath, Humanity's Last Exam, and RE-Bench
Despite their expertise, AI developers don't always know what their most advanced systems are capable of—at least, not at first. X: @tharin_p and @tharin_p X: @tharin_p : My latest...