We're hiring an application security engineer at @METR_Evals!
Looking for someone to help secure our SOTA open source evals platform and our tooling for researchers.
SWE + security background is what we're looking for.
economist.com/science-and-te…
> The published reports do not describe evidence of the AI attempting to retrieve weights from the secure server on which they were stored, although the AI agents were successful in compromising the server on which they were evaluated.
> As long as AI
@METR_Evals and @EpochAIResearch ran complex agentic SWE evaluations spanning many days and gigabytes of compressed transcripts. This challenged us to significantly optimize many aspects of our eval platform data format, transcript ingestion, web viewer, and database.
What are the largest software engineering tasks AI can perform?
To answer this, we built MirrorCode, our long-horizon SWE benchmark that lets AI code autonomously for days at a time.
The best models complete some tasks we estimate would take human engineers several weeks.
00:00
✕
Wait! Don't Go Yet 🚀
Get our FREE eBook "10 Programming Tips That Changed Everything" when you subscribe!
