The Music of the Primes: Why an unsolved problem in mathematics matters

Before anyone could find out how they were doing it, the twins were separated at the age of thirty-seven by their doctors, who believed that their private numerological language had been hindering their development. Had they listened to the arcane conversations that can be heard in the common rooms of university maths departments, these doctors would probably have recommended closing them down too.

It’s likely that the twins were using a trick based on what’s called Fermat’s Little Theorem to test whether a number is prime. The test is similar to the way in which autistic-savants can quickly identify that April 13, 1922, for instance, was a Thursday – a feat the twins performed regularly on TV chat shows. Both tricks depend on doing something called clock or modular arithmetic. Even if they lacked a magic formula for the primes, their skill was still extraordinary. Before they were separated they had reached twenty-digit numbers, well beyond the upper limit of Sacks’s prime number tables.

Like Sagan’s heroine listening to the cosmic prime number beat and Sacks eavesdropping on the prime number twins, mathematicians for centuries had been straining to hear some order in this noise. Like Western ears listening to the music of the East, nothing seemed to make sense. Then, in the middle of the nineteenth century, came a major breakthrough. Bernhard Riemann began to look at the problem in a completely new way. From his new perspective, he began to understand something of the pattern responsible for the chaos of the primes. Underlying the outward noise of the primes was a subtle and unexpected harmony. Despite this great step forward, this new music kept many of its secrets out of earshot. Riemann, the Wagner of the mathematical world, was undaunted. He made a bold prediction about the mysterious music that he had discovered. This prediction is what has become known as the Riemann Hypothesis. Whoever proves that Riemann’s intuition about the nature of this music was right will have explained why the primes give such a convincing impression of randomness.

Riemann’s insight followed his discovery of a mathematical looking-glass through which he could gaze at the primes. Alice’s world was turned upside down when she stepped through her looking-glass. In contrast, in the strange mathematical world beyond Riemann’s glass, the chaos of the primes seemed to be transformed into an ordered pattern as strong as any mathematician could hope for. He conjectured that this order would be maintained however far one stared into the never-ending world beyond the glass. His prediction of an inner harmony on the far side of the mirror would explain why outwardly the primes look so chaotic. The metamorphosis provided by Riemann’s mirror, where chaos turns to order, is one which most mathematicians find almost miraculous. The challenge that Riemann left the mathematical world was to prove that the order he thought he could discern was really there.

Bombieri’s email of April 7, 1997, promised the beginning of a new era. Riemann’s vision had not been a mirage. The Mathematical Aristocrat had offered mathematicians the tantalising possibility of an explanation for the apparent chaos in the primes. Mathematicians were keen to loot the many other treasures they knew should be unearthed by the solution to this great problem.

A solution of the Riemann Hypothesis will have huge implications for many other mathematical problems. Prime numbers are so fundamental to the working mathematician that any breakthrough in understanding their nature will have a massive impact. The Riemann Hypothesis seems unavoidable as a problem. As mathematicians navigate their way across the mathematical terrain, it is as though all paths will necessarily lead at some point to the same awesome vista of the Riemann Hypothesis.

Many people have compared the Riemann Hypothesis to climbing Mount Everest. The longer it remains unclimbed, the more we want to conquer it. And the mathematician who finally scales Mount Riemann will certainly be remembered longer than Edmund Hillary. The conquest of Everest is marvelled at not because the top is a particularly exciting place to be, but because of the challenge it poses. In this respect the Riemann Hypothesis differs significantly from the ascent of the world’s tallest peak. Riemann’s peak is a place we all want to sit upon because we already know the vistas that will open up to us should we make it to the top. The person who proves the Riemann Hypothesis will have made it possible to fill in the missing gaps in thousands of theorems that rely on it being true. Many mathematicians have simply had to assume the truth of the Hypothesis in reaching their own goals.

The dependence of so many results on Riemann’s challenge is why mathematicians refer to it as a hypothesis rather than a conjecture. The word ‘hypothesis’ has the much stronger connotation of a necessary assumption that a mathematician makes in order to build a theory. ‘Conjecture’, in contrast, represents simply a prediction of how mathematicians believe their world behaves. Many have had to accept their inability to solve Riemann’s riddle and have simply adopted his prediction as a working hypothesis. If someone can turn the hypothesis into a theorem, all those unproven results would be validated.

By appealing to the Riemann Hypothesis, mathematicians are staking their reputations on the hope that one day someone will prove that Riemann’s intuition was correct. Some go further than just adopting it as a working hypothesis. Bombieri regards it as an article of faith that the primes behave as Riemann’s Hypothesis predicts. It has become virtually a cornerstone in the pursuit of mathematical truth. If, however, the Riemann Hypothesis turns out to be false, it will completely destroy the faith we have in our intuition to sniff out the way things work. So convinced have we become that Riemann was right that the alternative will require a radical revision of our view of the mathematical world. In particular, all the results that we believe exist beyond Riemann’s peak would disappear in a puff of smoke.

Most significantly, a proof of the Riemann Hypothesis would mean that mathematicians could use a very fast procedure guaranteed to locate a prime number with, say, a hundred digits or any other number of digits you care to choose. You might legitimately ask, ‘So what?’ Unless you are a mathematician such a result looks unlikely to have a major impact on your life.

Finding hundred-digit primes sounds as pointless as counting angels on a pinhead. Although most people recognise that mathematics underlies the construction of an aeroplane or the development of electronics technology, few would expect the esoteric world of prime numbers to have much impact on their lives. Indeed, even in the 1940s G.H. Hardy was of the same mind: ‘both Gauss and lesser mathematicians may be justified in rejoicing that here is one science [number theory] at any rate whose very remoteness from ordinary human activities should keep it gentle and clean’.

But a more recent turn of events has seen prime numbers take centre stage in the rough and dirty world of commerce. No longer are prime numbers confined to the mathematical citadel. In the 1970s, three scientists, Ron Rivest, Adi Shamir and Leonard Adleman, turned the pursuit of prime numbers from a casual game played in the ivory towers of academia into a serious business application. By exploiting a discovery made by Pierre de Fermat in the seventeenth century, these three found a way to use the primes to protect our credit card numbers as they travel through the electronic shopping malls of the global marketplace. When the idea was first proposed in the 1970s, no one had any idea how big e-business would turn out to be. But today, without the power of prime numbers there is no way this business could exist. Every time you place an order on a website, your computer is using the security provided by the existence of prime numbers with a hundred digits. The system is called RSA after its three inventors. So far, over a million primes have already been put to use to protect the world of electronic commerce.

Every business trading on the Internet therefore depends on prime numbers with a hundred digits to keep their business transactions secure. The expanding role of the Internet will ultimately lead to each of us being uniquely identified by our very own prime numbers. Suddenly there is a commercial interest in knowing how a proof of the Riemann Hypothesis might help in understanding how primes are distributed throughout the universe of numbers.

The extraordinary thing is that although the construction of this code depends on discoveries about primes made by Fermat over three hundred years ago, to break this code depends on a problem that we still can’t answer. The security of RSA depends on our inability to answer basic questions about prime numbers. Mathematicians know enough about the primes to build these Internet codes, but not enough to break them. We can understand one half of the equation but not the other. The more we demystify the primes, however, the less secure these Internet codes are becoming. These numbers are the keys to the locks that protect the world’s electronic secrets. This is why companies such as AT&T and Hewlett-Packard are ploughing money into endeavours to understand the subtleties of prime numbers and the Riemann Hypothesis. The insights gained could help to break these prime number codes, and all companies with an Internet presence want to be the first to know when their codes become insecure. And this is the reason why number theory and business have become such strange bedfellows. Business and security agencies are keeping a watchful eye on the blackboards of the pure mathematicians.

So it wasn’t only the mathematicians who were getting excited about Bombieri’s announcement. Was this solution of the Riemann Hypothesis going to cause a meltdown of e-business? Agents from the NSA, the US National Security Agency, were dispatched to Princeton to find out. But as mathematicians and security agents made their way to New Jersey, a number of people began to smell something fishy in Bombieri’s email. Fundamental particles have been given some crazy names – gluons, cascade hyperons, charmed mesons, quarks, the last of these courtesy of James Joyce’s Finnegans Wake. But ‘morons’? Surely not! Bombieri has an unrivalled reputation for appreciating the ins and outs of the Riemann Hypothesis, but those who know him personally are also aware of his wicked sense of humour.

Fermat’s Last Theorem had fallen foul of an April Fool prank that emerged just after a gap had appeared in the first proof that Andrew Wiles had proposed in Cambridge. With Bombieri’s email, the mathematical community had been duped again. Eager to relive the buzz of seeing Fermat proved, they had grabbed the bait that Bombieri had thrown at them. And the delights of forwarding email meant that the first of April had disappeared from the original source as it rapidly disseminated. This, combined with the fact that the email was read in countries with no concept of April Fool’s Day, made the prank far more successful than Bombieri could have imagined. He finally had to own up that his email was a joke. As the twenty-first century approached, we were still completely in the dark as to the nature of the most fundamental numbers in mathematics. It was the primes that had the last laugh.

Why had mathematicians been so gullible that they believed Bombieri? It’s not as though they give up their trophies lightly. The stringent tests that mathematicians require to be passed before a result can be declared proven far exceed those deemed sufficient in other subjects. As Wiles realised when a gap appeared in his first proof of Fermat’s Last Theorem, completing 99 per cent of the jigsaw is not enough: it would be the person who put in the last piece who would be remembered. And the last piece can often remain hidden for years.

The search for the secret source that fed the primes had been going on for over two millennia. The yearning for this elixir had made mathematicians all too susceptible to Bombieri’s ruse. For years, many had simply been too frightened to go anywhere near this notoriously difficult problem. But it was striking how, as the century drew to a close, more and more mathematicians were prepared to talk about attacking it. The proof of Fermat’s Last Theorem only helped to fuel the expectation that great problems could be solved.

Mathematicians had enjoyed the attention that Wiles’s solution to Fermat had brought them as mathematicians. This feeling undoubtedly contributed to the desire to believe Bombieri. Suddenly, Andrew Wiles was being asked to model chinos for Gap. It felt good. It felt almost sexy to be a mathematician. Mathematicians spend so much time in a world that fills them with excitement and pleasure. Yet it is a pleasure they rarely have the opportunity to share with the rest of the world. Here was a chance to flaunt a trophy, to show off the treasures that their long, lonely journeys had uncovered.

A proof of the Riemann Hypothesis would have been a fitting mathematical climax to the twentieth century. The century had opened with Hilbert’s direct challenge to the world’s mathematicians to crack this enigma. Of the twenty-three problems on Hilbert’s list, the Riemann Hypothesis was the only problem to make it into the new century unvanquished.

On May 24, 2000, to mark the 100th anniversary of Hilbert’s challenge, mathematicians and the press gathered in the Collège de France in Paris to hear the announcement of a fresh set of seven problems to challenge the mathematical community for the new millennium. They were proposed by a small group of the world’s finest mathematicians, including Andrew Wiles and Alain Connes. The seven problems were new except for one that had appeared on Hilbert’s list: the Riemann Hypothesis. In obeisance to the capitalist ideals that shaped the twentieth century, these challenges come with some extra spice. The Riemann Hypothesis and the other six problems now have a price tag of one million dollars apiece. Incentive indeed for Bombieri’s fictional young physicist – if glory weren’t enough.

The idea for the Millennium Problems was the brainchild of Landon T. Clay, a Boston businessman who made his money in trading mutual funds on a buoyant stock market. Despite dropping out of mathematics at Harvard he has a passion for the subject, a passion he wants to share. He realises that money is not the motivating force for mathematicians: ‘It’s the desire for truth and the response to the beauty and power and elegance of mathematics that drive mathematicians.’ But Clay is not naive, and as a businessman he knows how a million dollars might inspire another Andrew Wiles to join the chase for the solutions of these great unsolved problems. Indeed, the Clay Mathematics Institute’s website, where the Millennium Problems were posted, was so overwhelmed by hits the day after the announcement that it collapsed under the strain.

The seven Millennium Problems are different in spirit to the twenty-three problems chosen a century before. Hilbert had set a new agenda for mathematicians in the twentieth century. Many of his problems were original and encouraged a significant shift in attitudes towards the subject. Rather than focusing on the particular, like Fermat’s Last Theorem, Hilbert’s twenty-three problems inspired the community to think more conceptually. Instead of picking over individual rocks in the mathematical landscape, Hilbert offered mathematicians the chance of a balloon flight high above their subject to encourage them to understand the overarching lay of the land. This new approach owes a lot to Riemann, who fifty years before had begun this revolutionary shift from mathematics as a subject of formulas and equations to one of ideas and abstract theory.

The choice of the seven problems for the new millennium was more conservative. They are the Turners in the mathematical gallery of problems, whereas Hilbert’s questions were a more modernist, avant-garde collection. The conservatism of the new problems was partly because their solutions were expected to be sufficiently clear cut for their solvers to be awarded the million-dollar prize. The Millennium Problems are questions that mathematicians have known about for some decades, and in the case of the Riemann Hypothesis, over a century. They are a classic selection.

Clay’s seven million dollars is not the first time that money has been offered for solutions to mathematical problems. In 1997 Wiles picked up 75,000 Deutschmarks for his proof of Fermat’s Last Theorem, thanks to a prize offered in 1908 by Paul Wolfskehl. The story of the Wolfskehl Prize is what had brought Fermat to Wiles’s attention at the impressionable age of ten. Clay believes that if he can do the same for the Riemann Hypothesis, it will be a million dollars well spent. More recently, two publishing houses, Faber & Faber in the UK and Bloomsbury in the USA, offered a million dollars for a proof of Goldbach’s Conjecture as a publicity stunt to launch their publication of Apostolos Doxiadis’s novel Uncle Petros and Goldbach’s Conjecture. To earn the money you had to explain why every even number can be written as the sum of two prime numbers. However, the publishers didn’t give you much time to crack it. The solution had to be submitted before midnight on March 15, 2002, and was bizarrely open only to US and UK residents.

Clay believes that mathematicians receive little reward or recognition for their labours. For example, there is no Nobel Prize for Mathematics that they can aspire to. Instead, the award of a Fields Medal is considered the ultimate prize in the mathematical world. In contrast to Nobel prizes, which tend to be awarded to scientists at the end of their careers for achievements long past, Fields Medals are restricted to mathematicians below the age of forty. This is not because of the generally held belief that mathematicians burn out at an early age. John Fields, who conceived of the idea and provided funds for the prize, wanted its award to spur on the most promising mathematicians to even greater achievements. The medals are awarded every four years on the occasion of the International Congress of Mathematicians. The first ones were awarded in Oslo in 1936.

The age limit is strictly adhered to. Despite Andrew Wiles’s extraordinary achievement in proving Fermat’s Last Theorem, the Fields Medal committee weren’t able to award him a medal at the Congress in Berlin in 1998, the first opportunity after the final proof was accepted, for he was born in 1953. They did have a special medal struck to honour Wiles’s achievement. But it still does not compare to being a member of the illustrious club of Fields Medal winners. The recipients include many of the key players in our drama: Enrico Bombieri, Alain Connes, Atle Selberg, Paul Cohen, Alexandre Grothendieck, Alan Baker, Pierre Deligne. Those names account for nearly a fifth of the medals ever awarded.

But it is not for the money that mathematicians aspire to these medals. In contrast to the big bucks behind the Nobel prizes, the purse that accompanies a Fields Medal contains a modest 15,000 Canadian dollars. So Clay’s millions will help compete with the monetary kudos of the Nobel prizes. In contrast to Fields Medals and the Faber—Bloomsbury Goldbach prize, the money is there regardless of age or nationality, and with no time limits for a solution, except for the ticking clock of inflation.

However, the greatest incentive for the mathematician chasing one of the Millennium problems is not the monetary reward but the intoxicating prospect of the immortality that mathematics can bestow. Solving one of Clay’s problems may earn you a million dollars, but that is nothing compared with carving your name on civilisation’s intellectual map. The Riemann Hypothesis, Fermat’s Last Theorem, Goldbach’s Conjecture, Hilbert space, the Ramanujan tau function, Euclid’s algorithm, the Hardy—Littlewood Circle Method, Fourier series, Gödel numbering, a Siegel zero, the Selberg trace formula, the sieve of Eratosthenes, Mersenne primes, the Euler product, Gaussian integers – these discoveries have all immortalised the mathematicians who have been responsible for unearthing these treasures in our exploration of the primes. Those names will live on long after we have forgotten the likes of Aeschylus, Goethe and Shakespeare. As G.H. Hardy explained, ‘languages die and mathematical ideas do not. “Immortality” may be a silly word, but probably a mathematician has the best chance of whatever it may mean.’

Those mathematicians who have laboured long and hard on this epic journey to understand the primes are more than just names set in mathematical stone. The twists and turns that the story of the primes has taken are the products of real lives, of a dramatis personae rich and varied. Historical figures from the French revolution and friends of Napoleon give way to modern-day magicians and Internet entrepreneurs. The stories of a clerk from India, a French spy spared execution and a Jewish Hungarian fleeing the persecution of Nazi Germany are bound together by an obsession with the primes. All these characters bring a unique perspective in their attempt to add their name to the mathematical roll call. The primes have united mathematicians across many national boundaries: China, France, Greece, America, Norway, Australia, Russia, India and Germany are just a few of the countries from which have come prominent members of the nomadic tribe of mathematicians. Every four years they converge to tell the stories of their travels at an International Congress.

It is not only the desire to leave a footprint in the past which motivates the mathematician. Just as Hilbert dared to look forward into the unknown, a proof of the Riemann Hypothesis would be the start of a new journey. When Wiles addressed the press conference at the announcement of the Clay prizes he was keen to stress that the problems are not the final destination:

There is a whole new world of mathematics out there, waiting to be discovered. Imagine if you will, the Europeans in 1600. They know that across the Atlantic there is a New World. How would they have assigned prizes to aid in the discovery and development of the United States? Not a prize for inventing the airplane, not a prize for inventing the computer, not a prize for founding Chicago, not a prize for machines that would harvest areas of wheat. These things have become a part of America, but such things could not have been imagined in 1600. No, they would have given a prize for solving such problems as the problem of longitude.

The Riemann Hypothesis is the longitude of mathematics. A solution to the Riemann Hypothesis offers the prospect of charting the misty waters of the vast ocean of numbers. It represents just a beginning in our understanding of Nature’s numbers. If we can only find the secret of how to navigate the primes, who knows what else lies out there, waiting for us to discover?

CHAPTER TWO

The Atoms of Arithmetic

When things get too complicated, it sometimes makes sense to stop and wonder: Have I asked the right question? Enrico Bombieri, ‘Prime Territory’ in The Sciences

Two centuries before Bombieri’s April Fool had teased the mathematical world, equally exciting news was being trumpeted from Palermo by another Italian, Giuseppe Piazzi. From his observatory Piazzi had detected a new planet that orbited the Sun somewhere between the orbits of Mars and Jupiter. Christened Ceres, it was much smaller than the seven major planets then known, but its discovery on January 1, 1801, was regarded by everyone as a great omen for the future of science in the new century.

Excitement turned to despair a few weeks later as the small planet disappeared from view as its orbit took it around the other side of the Sun, where its feeble light was drowned out by the Sun’s glare. It was now lost to the night sky, hidden once again amongst the plethora of stars in the firmament. Nineteenth-century astronomers lacked the mathematical tools for calculating its complete path from the short trajectory they had been able to track during the first few weeks of the new century. It seemed that they had lost the planet and had no way of predicting where it would next appear.