The Hot Hand

COPYRIGHT

HarperCollinsPublishers

1 London Bridge Street

London SE1 9GF

www.harpercollins.co.uk

First published in the US by Custom House, an imprint of HarperCollinsPublishers 2020

This UK edition published by HarperCollinsPublishers 2020

FIRST EDITION

© Ben Cohen 2020

Cover layout design © HarperCollinsPublishers 2020

Cover photograph © Shutterstock.com

A catalogue record of this book is available from the British Library

Ben Cohen asserts the moral right to be identified as the author of this work

All rights reserved under International and Pan-American Copyright Conventions. By payment of the required fees, you have been granted the nonexclusive, non-transferable right to access and read the text of this e-book on screen. No part of this text may be reproduced, transmitted, downloaded, decompiled, reverse engineered, or stored in or introduced into any information storage retrieval system, in any form or by any means, whether electronic or mechanical, now known or hereinafter invented, without the express written permission of HarperCollins e-books.

Find out about HarperCollins and the environment at www.harpercollins.co.uk/green

Source ISBN: 9780008285296

Ebook Edition © March 2020 ISBN: 9780008285319

Version 2020-01-29

NOTE TO READERS

This ebook contains the following accessibility features which, if supported by your device, can be accessed via your ereader/accessibility settings:

 Change of font size and line height

 Change of background and font colours

 Change of font

 Change justification

 Text to speech

Page numbers taken from the following print edition: ISBN 9780008285296

CONTENTS

Cover

Title Page

Copyright

Note to Readers

Dedication

Introduction

One ON FIRE

“Boomshakalaka.”

Two THE LAW OF THE HOT HAND

“Unhappy fortune!”

Three SHUFFLE

“It’s just random.”

Four BET THE FARM

“Principles over patterns.”

Five WHEEL OF FORTUNE

“It’s my life.”

Six THE FOG

“Be true to the data.”

Seven THE VAN GOGH IN THE ATTIC

“Aha, aha, aha!”

Epilogue

An Author’s Note on Sources

Endnotes

Bibliography

Acknowledgments

List of Searchable Terms

About the Publisher

DEDICATION

For my parents, and for Stephanie

INTRODUCTION

1.

One of the most enchanting moments of my life happened in a meaningless basketball game that nobody else would have any reason to remember. On that day I felt something magical that I have never forgotten. But it would take many years to figure out why. It was all because of a phenomenon that I did not understand, could not have explained, and was not supposed to be real. This book is the story of that seductive idea.

I went to a small high school that barely had enough kids for a varsity basketball team, let alone a junior varsity team. I was on the junior varsity. I started that game on the bench because I started every game on the bench. On this drab winter afternoon, our team walked into a cramped gym, and I went through my normal pregame routine of missing a whole lot more shots than I made. But exactly what happened next I can’t really tell you. The sad truth is that I recall almost none of the other material details about this game. The final score, for example. I have no clue. I couldn’t tell you which team won, either. The only certainty in my mind is that I must have removed my warm-ups at some point and walked onto the court, because what I’m about to describe couldn’t have happened otherwise. It hadn’t happened to me before, and it hasn’t happened to me since, which is why I still think about it all these years later.

I had the hot hand.

This odd series of events started when I checked into the game after halftime and managed to swish my first shot of the third quarter. I felt good. I swished my next shot. I felt better. I felt like I wanted to shoot again. It was at that point that I swished another shot, and it began to dawn on me that I was going to make any shot I dared to take.

As it turned out, contrary to every piece of prior evidence from my pathetic basketball career, the other team was coming to the same bizarre conclusion, and I found myself double-teamed when I touched the ball. I had tricked the other players into believing that I had talent. It was around this time when all the hours I had spent watching basketball on television came in useful. I thought about what someone who was actually good at shooting might do. The next time the ball was in my hands, I pretended I was one of those people. I faked a shot with a surprising amount of confidence for someone who never had a reason to attempt this move before. And it worked! The two defenders flew past me in what seemed like slow motion. Those poor suckers left me enough time to sip espresso before I sent the ball arcing toward the basket and swished one last shot. The whole thing was nothing short of astonishing. In one quarter of one game, I scored more points than I had in my entire life.

I quit playing basketball not long after that game. It was mostly because I was awful. But it was at least partly because I knew that I had already peaked. I would never again experience the rush of having the hot hand.

To have the hot hand is to achieve some elevated state of ability in which you feel briefly superhuman. There is no more pleasurable sensation for humans. Even if you’re unfamiliar with basketball, you’re probably familiar with this ethereal feeling. The hot hand exists in nearly every industry and touches nearly every person on earth.

What does it mean to have the hot hand in basketball? It’s when you’ve made a few shots in a row, the hoop looks as big as a helipad, and you believe you’re more likely to sink your next shot because you’ve made those previous shots. It’s those glorious moments when you can’t miss that stick with you. But there doesn’t have to be a singular definition of the hot hand. You can simply tell when players are hot when you see them ablaze.

I know what that feels like. As much as I watched basketball, I usually found playing basketball to be as enjoyable as driving on the New Jersey Turnpike. But on that night, when I had the hot hand, I was ecstatic. There was no part of me that entertained the silly notion of passing the ball to a teammate. The buzzkill known as “regression to the mean” failed to cross my mind. I was going to shoot almost as soon as I touched the ball, and there was nothing that anybody could have done to stop me. I was hot. For this sublime period of time, I felt like I was defying probability. It would have been totally irrational if not for the fact that everyone on the court believed it was rational. They had seen it before. I had seen it, too. It just had never happened to me.

My brush with the hot hand lingered with me long after my basketball career was over. I was still thinking about it when I began doing what so many people do when they can no longer play sports: write about sports. I’m the NBA reporter for the Wall Street Journal, and I have written hundreds of stories about basketball, taking advantage of my press credential to gain access to the inner sanctums of the league’s thirty teams. It’s now my job to watch others catch the hot hand. But one day, while minding my own business and looking for story ideas by reading the latest academic research, I bumped into a ghost from my past. It turned out there were hundreds of scholarly papers about this notion of the hot hand.

I couldn’t stop reading these studies. I read them more carefully than I read the lease to my apartment. I found them to be so fascinating because the hot hand was a scientific topic that I didn’t have to read a textbook to comprehend. Or at least that’s what I thought. I read one paper, then another, and then one more. I was on a hot streak of reading studies about hot streaks. I kept reading and reading until I had plowed through decades of work by economists, psychologists, and statisticians, and there was nothing left for me to read.

Only when I was done reading did I realize why so many people had written so many papers about the hot hand: because there was no such thing as the hot hand.

2.

Pine City, Minnesota, is an obscure speck on the map smack in the middle between Minneapolis and Duluth. I drove to this rural town on a wintry afternoon not too long ago to figure out how the small high school there had become the nation’s unlikeliest laboratory of sports innovation. I went to watch the Pine City Dragons hack basketball.

The coach of the Pine City High School basketball team was a history, government, politics, geography, and economics teacher with big eyes and a thick, dark beard named Kyle Allen. When he came to Pine City, the school was known for excellence in the arts, insomuch as it was known for anything at all. Most of his players also played musical instruments. Many of his players were in the choir that sang the national anthem before games. One of his players quit to perform in the winter musical. That player happened to be the team’s star player. So there was almost nothing outwardly impressive about the Pine City Dragons.

But they won. They won a lot. They won a lot more than they had any right to win.

It was the way they won, though, that had me curious. I flew to Minnesota, drove to Pine City, and walked back into high school, where I found Allen’s players in a classroom inhaling the nutritional benefits of cheese curds and cookies. The same kids busy eating junk food would soon transform into a mighty basketball machine.

The first thing that Kyle Allen did when he moved to Pine City for his first coaching job was blow his entire budget. He was one of thousands of coaches who splurged on technology that created the sort of useful statistics that were previously available only to NBA teams. Pine City’s players soon had access to personalized metrics, customized video clips, and more numbers than they saw in their math classes. That profusion of data was the guiding force behind Allen’s coaching philosophy. He’d come to Pine City at a peculiar time in the history of sports. The seminal Michael Lewis book Moneyball was published when he was still in high school, which put him squarely in the age demographic that straddled a generational divide that was about to roil sports. At issue were the origins of athletic dominance. Kyle Allen understood why he should ground his decisions in data before the data that was relevant to him existed. But once reality caught up, he pounced. He wanted more data. He wanted bigger data. He wanted better data.

For his entire life until that point, basketball teams had known precious little about themselves. And not just small high schools in Minnesota. Even teams at the highest levels of the sport were flying blind. There were primitive statistics—basic metrics like points per game—that could give you a sense of value. But there was nothing much deeper than dividing the number of points by the number of games.

That was about to change. Allen spent just about every penny that Pine City’s basketball team had as part of his mission to find some value in the numbers. He wanted his team to play smart, and it was quickly becoming clear across basketball that playing smart meant differentiating between the good shots with more value and the bad shots with less value. That simple insight was a breakthrough decades in the making. The good shots were layups and three-pointers. The bad shots were everything in between. The Pine City Dragons became the team that almost never took bad shots.

Their entire strategy was based on maximizing their number of good shots. A typical game for Kyle Allen’s merry band of basketball rebels was one in which they took about eighty-five good shots and a few bad shots. In a perfect game, they would take only those shots, and they were closer to perfect than every team in basketball. The bad shots accounted for less than 5 percent of their attempts—lower than any NBA team, any college team, and any known high school team. “In all honesty,” Allen said, “that’s even higher than we want it to be.”

He became a glutton for data after getting his first taste of it. Soon he began the process of quantifying his basketball team. Before long the Pine City Dragons were number one, two, and three in the state record books in one statistical category: most three-pointers in a season. They recorded their stats on iPads, in traditional scorebooks, and on whiteboards in a locker room that carried the unfortunate aroma of teenage boys. They counted the collective number of hours they spent in the gym that summer. They even hired managers to track how much they talked to one another in practice. “Basically,” Allen said, as if there were anything basic about it, “everything needs to come down to a number for us.”

There was something familiar about the scene inside the Pine City gym on a weeknight that made me unexpectedly nostalgic. I had been in gyms like this one before. I had played in gyms like this one before. It was in a gym like this one where I had the hot hand. I should have been able to relate to Kyle Allen’s players.

But to watch the Pine City Dragons was to see the future of basketball. They were reinventing the sport into something unrecognizable right in front of me. It felt like being told the sky was green and the grass was blue. I couldn’t relate to these kids because I had never thought about which shots had the most value. The only thing I valued was getting home for dinner without embarrassing myself. And it wasn’t only because I was a terrible basketball player that I wasn’t thinking about this stuff. It was because nobody was. And now everybody was.

The kids in Pine City were simply accumulating ideas that had smitten other high school, college, and NBA teams and taking them to a surreal extreme. This counterintuitive strategy to shoot when they were right next to the basket or very far away from the basket but never in between was drilled into their heads until it became intuition. The players no longer needed to be told by their coach to shoot only the good shots. All they had to do was look down at their court. The paint area and land beyond the three-point line were the color of hardwood. The area in between—the section of the court that might as well have been swimming with piranhas—was emerald green. The dreaded part of the floor actually looked different in Pine City. It was yet another reminder of how they wanted to play.

“That’s how you should play!” one NBA coach said when I told him about this eccentric team I was slightly obsessed with. “Are they better than what they would be?”

They were. The Pine City Dragons had become one of the most fearsome basketball teams in the state of Minnesota. They were harnessing new data, new technology, and new and exciting ways of thinking to reach striking new conclusions about ideas that had long ago been agreed upon. It had been only a decade since I’d mostly humiliated myself in a gym like this one. But in one generation, the game had changed. Everything I thought to be true was very clearly not.

3.

I believed it was serendipity that I had stumbled across the hot hand in my favorite sport. It wasn’t. The history of the hot hand has always been rooted in basketball. And so basketball is in this book because it has to be. There is no intellectually honest way to write about the hot hand without writing about basketball. The very smart people who have studied the hot hand for a very long time understood that basketball happens to be a wonderful excuse to explore the rest of the world.

But the stories that have always resonated with me are the ones that are not quite about sports, and there are genius scholars and Nobel Prize winners who have devoted their attention to the hot hand in basketball because they weren’t just studying basketball. When you start looking for the hot hand, in fact, it becomes hard not to see it everywhere.

That’s why I had to make sure I hadn’t lost my mind when I read the first scholarly paper about the hot hand that was published in 1985. What made it such a classic work of psychology was its startling conclusion that the hot hand did not exist. This seemed too crazy to be true. As I would soon discover, I was not alone in my shock. The paper was a widely discussed sensation in part because nobody believed it.

We’d all seen the hot hand. We’d all felt the hot hand. The hot hand was burned into our memories. And the appeal of this enticing paper was that it challenged something we all thought to be true. It was a study with a digestible takeaway that forced us to reckon with an eternal question of the human condition: How much should we believe what we see and feel?

The world’s brightest academics have been searching for hard evidence of the hot hand ever since. By obsessively looking for proof of something they couldn’t find, these people inadvertently turned the hot hand into the Bigfoot of basketball. But those decades of crumpled papers, broken pencils, and deleted spreadsheets only strengthened the case of the original paper. It became clear over time that it was foolish to believe in the hot hand.

Or was it?

That is the mystery at the heart of this book.

We were just beginning to listen to our scientific luminaries and accept that our collective belief in the hot hand may be wrong. And then something incredible happened. It turned out we might have been right to believe in the hot hand after all.

By now you’re probably wondering: Is the hot hand real? Yes. But also no. It’s complicated. (You might have guessed as much, considering you’re about to read an entire book about it.) There are certain situations in which you can take advantage of the hot hand, and there are other scenarios in which allowing the hot hand to guide your behavior can be disastrous. It can be just as costly to indulge the hot hand as it is to ignore the hot hand.

But we’ll get there. The story you’re about to read is this quest for the hot hand from beginning to end. This is not a book about basketball, but you will have a front-row seat to the most important game of NBA superstar Stephen Curry’s career. It’s not a book about finance, but you will hear the secrets of a billionaire investor who made his fortune betting against streaks. It’s not a book about art or war, but you will meet those who uncovered a long-lost Van Gogh painting and pursued a missing hero of the Holocaust. It’s not a book about music, but you will hear from a fabulous composer forgotten by history. It’s not a book about literature or medicine, but you will read more than you might have wanted to read about Shakespeare and the plague. It’s not a book about technology, but you might think twice before listening to your next Spotify playlist. It’s not a book about travel, but you will take a trip to the jungles of the Amazon and to my favorite sugar beet farm on the border of North Dakota and Minnesota.

It’s not a book about any of those things. It’s a book about all of those things. This is a book about the awesome power of the hot hand. And it begins with man and fire.

One

ON FIRE

“Boomshakalaka.”

1.

Mark Turmell was a remarkably odd teenager who became an enormously successful adult for two reasons. The first was that he recognized from a young age what he wanted to do for the rest of his life and never strayed from his ambition. The second explanation for his phenomenal success was that he was a pyromaniac.

When he was a kid in the 1970s, he strolled around his Bay City, Michigan, neighborhood lighting matches along the gutters, walking away, and turning around for a peek, which provided him with the little thrills required to survive childhood. In that fleeting moment when he looked behind him, the unpredictability was so overwhelming that it felt to him like anything was possible. Sometimes there was nothing. Sometimes there was smoldering. And sometimes there was a raging fire. Mark Turmell loved when there was fire.

Turmell managed to keep himself occupied between his infernos by fiddling with computers. He had a friend whose father was a professor at the local community college, and every so often he let the boys play with the computer terminal in his office. Turmell quickly became obsessed with computers. To be more specific, he became obsessed with the video games on computers. He loved them more than he loved fire. Turmell began to sense that he was meant to make video games. He was so confident about his future line of work that he once told his algebra teacher that he didn’t need to study for her class because he wouldn’t need algebra when he was designing video games. The most amazing part of his pathetic excuse for not doing his homework was that he was actually right.

He was soon going to high school in the morning, taking computer science classes at that local community college in the afternoon, and staying on campus in the computer lab all night. “The only problem with having someone like Mark,” one of his professors said, “is that they never want to go home.” He was so maniacal about his craft by the time he was fifteen years old that he’d stopped playing his favorite sport, basketball, even though he had the advantage of being one of the taller kids in town, because any time on the basketball court was time that could’ve been spent playing with computers.

When he decided to buy his own computer, he pooled the money that he’d saved mowing lawns to purchase a brand-new Apple II. Turmell’s investment paid off almost immediately. All it took for him to spin a profit was some borderline criminal behavior. Turmell used his Apple II to hack into the community college’s network and poke around the sensitive information that schools pay large sums of money to keep private. Once he confessed to his intrusion, the college hired Turmell. It became his job to make sure no one else did what he’d already done. As word of his skills got around town, business got even better for Mark Turmell. Bay City’s engineers were so desperate for the expertise of a computer geek that at one point they put software for the local sewage system in the hands of this teenager who didn’t have a driver’s license yet.

While he was quickly becoming the richest kid in the neighborhood, Turmell wasn’t satisfied with his oversight of critical infrastructure. He dreamed of doing bigger things than cleaning the poop of Bay City. He still wanted to make video games, and now there was nothing stopping him. He’d bought the right computer, subscribed to the right magazines, and taught himself the right programming languages. The raw, teenage energy raging in his body kept Turmell awake late at night in his childhood bedroom tinkering on his Apple II. “I kept plugging away waiting for some roadblock that I couldn’t surpass,” he says. “The roadblock never came.”