The benchmark confronts agents with design tasks and evaluates them on existing experimental measurements. He also studies the effect of specialized tools.
DRYLAB-Bench seeks to distinguish the possession of biological knowledge from the ability of an agent to mobilize it in a design task. Its protocol uses 30 scenarios from biosafety frameworks and evaluates proposals on 187,695 experimental measures already available.
The evaluation of fifteen models underlines that access to biological tools can increase the risks measured. The use of these existing data avoids carrying out new dangerous experiments for each proposal. These results are used to evaluate protections; they do not demonstrate, on their own, an ability to cause real biological damage.
Preprint filed on arXiv on October 9, 2026; results are those reported by the authors and remain to be independently confirmed.
Read the full article on the original source
Go to the source →