The UK government's new AI safety body releases Inspect, an evaluation tool for AI model capabilities, including models' core knowledge and ability to reason
The U.K. Safety Institute, the U.K.'s recently established AI safety body, has released a toolset designed to “strengthen AI safety” …
@soundboy This is very cool, thanks for sharing openly! Wonder if there's a way to integrate with https://huggingface.co/models to evaluate the million models there or to create a public leaderboard with results of the evals (ex: https://huggingface.co/...) cc @IreneSolaiman @cle…
The @GOVUK's AI Safety Institute just released a GitHub repo, inspect_ai, to engineer and evaluate LLMs. It's on the account belonging to the UK Department of Business, Energy & Industrial Strategy. Docs: https://ukgovernmentbeis.github.io/ ... GitHub: https://github.com/... [ima…
Very heartening to see a head of state say this on AI. From UK PM @RishiSunak today “That's why we don't support calls for a blanket ban or pause in AI. It's why we are not legislating. It's also why we are pro-open source. Open source drives innovation. It creates...