The Resilience of Failure and the Pursuit of Mathematical Truth in Arithmetic Statistics

Mathematics is often perceived by the public as a rigid, crystalline landscape of absolute certainty, where proofs are either entirely correct or fundamentally flawed. However, beneath the surface of theorems and equations lies a discipline defined by human intuition, tentative leaps of faith, and the recurring necessity of correcting one’s own intellectual course. This tension between the pursuit of absolute truth and the fallibility of the researcher is nowhere more apparent than in the field of arithmetic statistics—the study of patterns within complex arithmetic objects such as number fields, class groups, and elliptic curves.
The field is anchored by a series of high-level conjectures that serve as both map and compass for researchers. Among the most significant are the Cohen-Lenstra conjectures, formulated in the 1980s by Henri Cohen and Hendrik Lenstra during the nascent stages of computational number theory. These conjectures provide a framework for understanding how certain arithmetic objects behave statistically, suggesting that the structures we observe in numbers—such as their factorization patterns—are not chaotic, but follow predictable, underlying regularities.
The Odyssey of Jordan Ellenberg
For Jordan Ellenberg, a mathematician and professor at the University of Wisconsin-Madison, these conjectures have served as a career-long focal point. A scholar renowned for his ability to translate abstract mathematical concepts for a broader audience—most notably through his 2014 bestseller, How Not to be Wrong: The Power of Mathematical Thinking—Ellenberg has found that the reality of the research process is rarely as linear as his book title might suggest.
In 2001, Ellenberg began what would become a yearslong intellectual odyssey to test the validity of the Cohen-Lenstra predictions. At the time, the mathematical community largely accepted the conjectures based on the absence of counter-evidence, but there was little rigorous, formal proof to support them. "We were like, there’s no evidence these conjectures are true," Ellenberg recalled. "People conjecture them because we can’t think of any reason to think otherwise, but there’s no real evidence that they’re true."
Ellenberg’s initial mission was to disprove them. He spent significant time scouring the landscape of arithmetic objects for an exception to the rules proposed by Cohen and Lenstra. Yet, the search for a counter-example proved elusive. After years of exhaustive analysis, the absence of a "smoking gun" forced a humbling pivot: Ellenberg transitioned from skeptic to advocate, dedicating his efforts to proving the conjectures rather than dismantling them.
A Chronology of Discovery and Setback
The trajectory of this research is a study in the incremental nature of modern mathematics. In 2009, Ellenberg, working alongside collaborators Akshay Venkatesh and Craig Westerland, published a celebrated paper that demonstrated a weaker form of the Cohen-Lenstra conjectures. By applying insights from geometric topology, the team showed that certain geometric spaces stabilize in predictable ways as they expand.
This breakthrough was a significant milestone, providing the first major evidence that the statistical regularities predicted in the 1980s were grounded in deeper structural truths. Encouraged by this success, the team pushed further. In 2012, they released a follow-up paper attempting to identify the specific value to which those spaces converged.
The mathematical community initially greeted the 2012 findings with enthusiasm. However, in 2013, a colleague pointed out a critical oversight in the paper’s argument—a technical flaw that compromised the validity of the final conclusion. For a researcher, such a moment is often the low point of a career. Rather than attempting to mask the error or engage in drawn-out debates, Ellenberg and his co-authors conducted a thorough review and, upon realizing the problem was insurmountable, formally retracted the paper.
In a move that garnered respect within the mathematical community, Ellenberg documented the error in a blog post. He used the incident to advocate for a more transparent culture in academia, arguing that the public disclosure of mistakes is a necessary component of the scientific process.

The Mathematics of Human Error
The retraction of a paper is rarely a permanent stain in the long-term arc of a career, but it serves as a powerful case study in the philosophy of the profession. Ellenberg characterizes the experience as an essential, if uncomfortable, lesson. "I don’t mind being identified as a guy who made a mistake," he said. "I think it’s important that people have models for what to do in this situation, because we’re human beings carrying out a human endeavor; there are going to be mistakes."
The inherent difficulty of the work is underscored by the complexity of the problems. In arithmetic statistics, a proof often requires dozens of independent logical steps to align perfectly. If a single step fails, the entire structure can collapse. This requires, according to Ellenberg, a paradoxical combination of traits: the "wild belief" that one’s intuition is correct, and the "incorrigible humility" to discard that same belief the moment it is proven wrong.
Broadening the Horizon: The Next Generation
While the 2012 paper was retracted, the underlying research was not wasted. Much of the methodology developed by Ellenberg and his team remains foundational to the ongoing study of arithmetic statistics. Furthermore, the vacuum left by the retraction has been filled by a new generation of mathematicians, including Harvard’s William Caspar Graustein Professor of Mathematics, Melanie Wood, and researcher Aaron Landesman.
Landesman, a 2016 alumnus who has long followed Ellenberg’s work, has made significant strides in proving specific cases of the Cohen-Lenstra predictions over function fields. In collaboration with researcher Ishan Levy, Landesman has expanded the scope of the inquiry, making progress on other major conjectures such as the Poonen-Rains and Malle’s conjectures.
"What’s important is to be aware of the past work and make sure you understand the error, because you don’t want to do the same thing," Landesman noted. His work, and that of his peers, demonstrates that mathematical progress is a relay race, where the failures of one generation provide the guardrails for the next.
Implications and Future Directions
The implications of proving the Cohen-Lenstra conjectures are vast. If fully realized, these proofs would provide a unified statistical theory for number fields, potentially unlocking deeper secrets regarding the distribution of primes and the behavior of elliptic curves—topics that sit at the heart of modern cryptography and pure mathematics.
However, the path to a full proof remains steep. As Landesman observed, "There’s still a long way to go to actually prove the full Cohen-Lenstra conjecture, but we’re getting closer."
Ellenberg, now looking toward his next intellectual project, is currently preparing a new book, fittingly titled Don’t be Too Sure. It is a title that encapsulates his career: a warning against the dangers of overconfidence and a testament to the idea that in mathematics, as in life, the most valuable insights often come from the ability to navigate through the uncertainty of one’s own failures.
For the mathematical community, the story of the Cohen-Lenstra conjectures serves as a reminder that the pursuit of truth is a collective, human effort. It is an endeavor that requires, as Ellenberg describes it, a form of "faith" that the truth is waiting to be found—even when the map to get there is riddled with dead ends and necessary detours. Whether through the rigor of a formal proof or the courage to admit an error, the discipline continues to inch closer to a complete understanding of the numerical structures that govern our world.







