How to Write Your First AI Eval - SallyAnn DeLucia, Arize AI
Workshop pratique : passer des « vibe checks » à de vraies évaluations, des critères pass/fail à la construction d'un juge LLM à partir des traces d'un agent.
AM-IA brings together news, research papers and applications relating to artificial intelligence published around the world into a single feed — and makes them available in your European language at the click of a button.
Scroll to browse · Click to filter
Workshop pratique : passer des « vibe checks » à de vraies évaluations, des critères pass/fail à la construction d'un juge LLM à partir des traces d'un agent.
The New York startup, led by FirstMark with CVS Health Ventures, wants to make the personalized support of elderly patients affordable. It also publishes BabaBench, a benchmark of agents on long-term health approaches.
The DSA, the AI Act or the Online Safety Act regulate digital damage on platforms, but not autonomous cyber weapons launched by states against civilian infrastructure. A study proposes a framework for filling this gap.
Researchers describe a training content production chain where agents write, humans validate, and public engagement rewrites the generation rules.
Electricity, water, emissions and electronic waste: researchers extend the notions of green AI and red AI to the entire IA-data-telecom pile and classify remedies into four levels.
142 questions from australian repositories (reimbursement, triage, vaccination): most errors come from a poorly-memorized rule, not badly applied, and some models are wrong with almost every other tip.
Of the 39,800 seconds of actual driving with 13 models from three manufacturers, the track maintenance aid indicator shows only 47% of times when the perception of markings is degraded.
A simulation of a constellation of about one million computing satellites shows that it would contaminate on average 20% of LSST poses over a year, and would multiply by more than ten the brightness of the sky at dusk.
Relaunched discreetly by Amazon, the Bee has only one button, no screen or speaker: it listens continuously, summarizes exchanges and offers actions. Mr. G. Siegler finds him bluffing and disturbing.
The moderators of the open source subreddit now refuse any project that uses, is produced by or targets AI. The new rules have led to a sling and the creation of a competing forum.
Comment Bridgewater a dû revoir la recherche de son analyste IA pour respecter les droits d'accès de 100 millions de documents, avec l'aide de turbopuffer.
Pre-entry models cite AI in 27% of their study, career or product recommendations; their versions published after instruction do so in 59% of cases.
Updated on October 24, the list lists the abandonments of 2026: Sora, Atlas, Relay, Huxe, Yupp, Notion Mail, the bankruptcy of Character.AI, and recalls that about 42% of IA projects are abandoned.
Seized by the Lula campaign, Brazil's highest electoral court imposes on Meta identical criteria for both candidates, under penalty of 500,000 reais of fine per day.
An index learned by total graph variation, combined with the humidity of Indochina soils, predicts summer rains in the Yangtse basin better than the El Niño indicators.
A new measure, the response coverage gap, shows that six LLMs leave behind entire profiles of true respondents, to the point of doing less than a random response draw.
In simulation on a unit G1, the policies learned under terrestrial gravity still stand on the Moon, while those trained for the Moon collapse on Earth.
A new open index covers 146 countries and 18,796 tasks: the share of delegable jobs rises from 22.5 per cent in poor countries to 48.7 per cent in rich countries.
Tested on more than 5,000 simulated chat tours in India, South Africa and Kenya, three health chatbots on WhatsApp yield when the user relativizes an emergency.
Rather than just detecting automated scams by IA, TokenTrap occupies them with unnecessary and costly calculations, without ever delivering them IDs or payment.