OpenConjecture: Out of 200 random guesses, GPT models offer a 60% solution, but not always the one expected
Rather than judging AI on its most publicized breakthroughs, researchers tested it on a random sample of recent conjectures. Trivial counter-examples and unoriginal evidence are alongside real novelties.