David Epstein: Creative breakthroughs need limits | Full Interview

General Magic: Vision and Innovation

• General Magic was a company founded in the late 1980s by a trio of former Apple employees, including Marc Porat, who was a visionary and had the job of looking at the future of technology inside Apple, and two designers of the original Mac 10s.
• The company made several innovations, including an early form of USB, precursors to emojis, virtual keyboards, and a virtual meeting space where devices could communicate to carry out tasks and do commerce, which they called "the cloud" in 1990 1m14s.
• General Magic formed a massive 17-company partnership that covered much of the communications world, and their meetings had to start with an antitrust lawyer listing all the topics that they were not allowed to discuss 2m6s.
• Marc Porat's goal was to create a heaven for engineers where they were free to play and create with the only limits being their imagination, but this lack of limits led to the company missing deadlines and adding too many features to their products 2m42s.

General Magic's Product and Challenges

• The company's first product, the Sony Magic Link, was a commercial failure, selling only about 3,000 units in six months, due to its poor battery life, choppy user experience, and numerous features that made it difficult to use 4m10s.
• An example of the company's lack of boundaries is the story of engineer Steve Pearlman, who was tasked with creating a calendar function, but ended up expanding it to start from the beginning of the universe, resulting in a huge waste of time and resources 5m30s.
• The company's failure was due to its inability to keep a boundary on its projects, and the lack of constraints led to a lack of focus and a failure to deliver a successful product 6m40s.

Pixar's Approach to Creativity and Constraints

• General Magic was a company that struggled with creativity due to a lack of constraints, making it difficult for employees to determine what to focus on, as they had the freedom to work on anything they could conceive 10s.
• In contrast, Pixar, under the leadership of Ed Catmull, who had a vision to create the world's first fully computer-animated feature film, implemented strict constraints to channel creative ideas into achievable goals, resulting in the release of Toy Story 20 years after Catmull started grad school 1m14s.
• Ed Catmull believed that ideas are abundant in organizations, but it's the process of containing and channeling them that is rare, and to achieve this, Pixar implemented rules such as the three pitches rule, where directors had to bring three different story ideas to avoid getting anchored on a single idea 2m6s.
• Pixar also kept teams small for as long as possible, allowing directors and small teams to spend years in story development, refining the core of a story, and using techniques such as dailies and brain trust meetings to get feedback and outside advice 3m30s.

Constraints and Creative Output

• One of the problems Pixar faced was the "beautifully shaded penny problem," where directors and animators would get obsessed with perfecting minor details, and to solve this, they used a visual constraint system with popsicle sticks and velcro to represent the amount of work that could be done in a week 5m40s.
• The use of constraints at Pixar allowed the company to create a process for containing and channeling creative ideas, which was in stark contrast to General Magic's lack of direction and focus, where the main problem was not defining a problem they were solving, and their customer was unclear 7m10s.
• The absence of defined problems and constraints can lead to a lack of direction and uncontrolled growth, as seen in the example of General Magic, where every new idea was implemented without limits, resulting in a loss of focus on the core product and its target audience 10s.

The Psychology of Constraints and Creativity

• Humans have a hardwired cognitive bias known as subtractive neglect bias, which causes them to overlook subtractive solutions, even when they are the most effective, as demonstrated in a study where adults were tasked with balancing a masonry brick on a Lego structure without crushing a Stormtrooper action figure, and most participants added multiple blocks instead of removing one that was upsetting the balance 42s.
• The subtraction audit is a process of proactively identifying things that can be taken away, such as unnecessary meetings, processes, or obligations, and stopping one of them to reduce friction and increase productivity, which can be applied to both teams and individuals 2m6s.
• Individuals can benefit from the subtraction audit by simplifying their to-do lists, focusing on one main task per day, and eliminating non-essential activities, as exemplified by the author's personal experience of reducing their to-do list and increasing productivity by setting a single daily goal 4m30s.
• The concept of constraints is also related to the planning fallacy, where people underestimate the time required to complete tasks, leading to overambitious to-do lists and increased stress, which can be mitigated by setting realistic goals and prioritizing tasks 6m15s.
• Research in psychology has shown that people can become more creative when given fewer choices, highlighting the importance of constraints in driving innovation and productivity, and the author's interest in constraints was sparked by their own need to improve their project management skills and execute ideas more effectively 8m40s.
• Inventors who are given a limited set of pieces, such as 20 out of 100, tend to create more creative solutions than those who have access to all the pieces, and people can also name more white foods in 20 seconds than white things in general, which illustrates how constraints can foster creativity 10s.

Constraints in Art and Literature

• The brain is wired to avoid thinking whenever possible, as it is metabolically costly, and when given full freedom, people tend to follow the path of least resistance, reaching for familiar solutions, making it essentially impossible to be creative without constraints 42s.
• Theodore Geisel, also known as Dr. Seuss, was given a vocabulary list of 200 words for children and asked to write a book using only those words, which led to the creation of his famous book "The Cat in the Hat", and he also wrote "Green Eggs and Ham" using only 50 words, demonstrating how limited vocabulary forced him to experiment with rhythm and meter 2m6s.
• Virginia Woolf applied what is called prelude constraints to her writing, where she outlined traditional narrative structures and then deliberately avoided using them, resulting in her breakthrough novel "Jacob's Room" and the development of her unique stream of consciousness style 2m6s.
• Haruki Murakami, a Japanese novelist, started writing in his late 20s and, dissatisfied with his generic style, decided to write in English, a language he barely knew, and then translate it back into Japanese, which led to the creation of his distinctive simple and rhythmic style 2m6s.
• Applying constraints, even arbitrary ones, can instantly increase creativity, as seen in the examples of Dr. Seuss, Virginia Woolf, and Haruki Murakami, who all achieved breakthroughs by forcing themselves to work within specific limitations 2m6s.

Freedom and the Dangers of Anomie

• The concept of having no constraints, only limited by one's imagination, is not how creative breakthroughs are achieved, as seen in the example of Pixar, which builds on creative ideas by layering constraints to make them manageable 10s.
• The idea of having too much freedom is a relatively recent concern, emerging during the industrial revolution, and has been written about by thinkers such as Kierkegaard, who discussed the "dizziness of freedom," and Eric Fromm, who wrote about the "urge to escape from freedom" 42s.
• The sociologist Emil Durkheim conducted an analysis of suicide in the late 19th century and found that it is a sociological phenomenon, with rates increasing during times of economic collapse and boom, as well as during periods of social upheaval that remove normal rules and reciprocal obligations between people and community 2m6s.
• Durkheim's concept of "anomie," or rulelessness, suggests that the removal of social structures and rules can lead to increased anxiety, desperation, and suicide, highlighting the potential collateral damage of the drive for ever-increasing freedom 2m6s.
• The social psychologist Jonathan Haidt has written about the importance of social integration and the negative effects of excessive freedom and choice, which can lead to anxiety and depression, as seen in the high rates of these conditions in the richest and most free parts of the world 2m6s.
• Haidt's work, as well as that of political scientist Robert Putnam, suggests that having social control of time, reciprocal obligations to others, and being grounded by obligations to other people is crucial for well-being, with Putnam's research showing that joining a single club can cut one's chance of dying in the next year in half 2m6s.
• The dissolution of dense networks of reciprocal obligation, as discussed in Robert Putnam's book Bowling Alone, has had tremendous effects on health, well-being, and longevity, and this issue has become more pronounced as people have become more virtual and engaged in online micro dramas with a lack of social norms and obligations 10s.

The Role of Social Integration and Structure

• The Soviet Union's experiment with changing work weeks to keep factories operating all the time, which resulted in people having different work weeks and rarely having the same days off, was a social disaster and had to be undone, highlighting the importance of collective regulation of time 2m6s.
• In contrast, Sweden's forced regulation of time, where a large portion of the country is forced to take time off, has been shown to have a positive impact on mental health, with the dispensing of anti-depressants plummeting during these periods, even among retired people, demonstrating the importance of collective use and enforcement of time 2m6s.
• Despite the common desire for more choice and freedom over one's own time, research has shown that people actually want to give up some of their autonomy to sync with other people, preferably at a large scale, in order to thrive as a hyper-social species 2m6s.

Maximizing vs. Satisficing

• The attempt to optimize and make the best decisions, also known as maximizing behavior, has been increasing, but this can actually lead to misery and is an illusion, as it is impossible to evaluate all options and make the best decision, and instead, people should focus on satisficing, or picking a good enough solution 2m6s.
• Herbert Simon, a thinker who had a significant influence on the book, developed the concept of satisficing, which involves picking something that is good enough, rather than trying to consider all options and pick the optimal one, and his work has shown that this approach is more effective and realistic, given the limitations of the human brain 2m6s.
• Simon's concept of satisficing is in contrast to maximizing, and he argued that people should set criteria for what is a good enough solution, rather than trying to find the best one, and this approach can help people prioritize and make decisions more effectively, by acknowledging and accepting their own mortality and limitations 2m6s.
• Classical economic theory suggests that people evaluate all options and make the optimal choice, but in reality, this is not possible, and striving for it can lead to less happiness and satisfaction with decisions, so it is recommended to proactively satisfice by setting criteria for what is good enough and going with that 10s.
• Having simple decision rules and setting criteria for good enough solutions can lead to a happier and more satisfied life, as seen in the example of Herbert Simon, who had a trophy case with the highest awards in economics, psychology, and computer science, despite having simple decision rules and a limited wardrobe 42s.

The Theory of Constraints in Business and Life

• Eli Goldratt, an Israeli physicist, developed the theory of constraints, which states that a single bottleneck or the slowest step in a system limits the overall output of the system, and he demonstrated this by improving production at a chicken coop building business by identifying and addressing the bottleneck 2m6s.
• Goldratt's theory of constraints can be applied to various situations, such as a hiking trip with a boy scout troop, where the slowest hiker, Herby, limited the group's overall pace, and redistributing the weight of the backpacks to help Herby allowed the group to move faster overall 4m10s.
• The idea of identifying and addressing bottlenecks can be applied to personal and professional life, as seen in the example of Alex Rogo, a fictional plant manager who saves his plant and his marriage by applying the theory of constraints, and this concept has been widely adopted, including by Jeff Bezos, who made his executives read Goldratt's book, "The Goal" 6m0s.
• The theory of constraints, which emphasizes the importance of focus, was popularized by a 1,200-page handbook written by Goldratt, who condensed the theory into one word: focus, as it shows where to apply effort to improve the overall system 10s.
• A case study on a company that manufactured custom gear boxes for industry illustrates the theory of constraints, where the bottleneck was found to be in the design office, and implementing a "stop starting and start finishing" rule significantly improved production, reducing the total time from 1 year to 2 months 2m6s.
• Modern work can be insidious in adding tasks and obligations, making attention and focus the bottleneck, and regularly conducting "subtraction audits" to remove unnecessary tasks and tools can help improve productivity 4m30s.
• The theory of constraints can be applied to individuals, as seen in the example of Sheila Taormina, a swimmer who used the theory to identify her bottleneck as strength and power, and by focusing on that area, she was able to improve her performance and eventually compete in the Olympics 8m10s.
• The concept of subtraction audits involves regularly reviewing tasks and tools to identify those that have outlived their usefulness and removing them to reduce friction and improve focus, which is essential because people are not naturally inclined to solve problems by subtracting things 6m40s.
• Applying the theory of constraints requires proactively identifying the bottleneck and applying effort there, rather than simply adding more tasks or resources, and this approach can be incredibly impactful in improving performance and achieving goals 10m0s.

Focus and Productivity in the Digital Age

• A female athlete, who is half a foot shorter than her relay teammates, achieves significant success in swimming, including making the Olympic team, becoming a gold medalist, and competing in three different sports in four summer Olympics, after learning about the theory of constraints in a management class 10s.
• Herbert Simon's statement that in an information-rich environment, there is a poverty of attention, is relevant in today's context, where people switch screens approximately every 45 seconds, leading to increased stress levels and decreased productivity 2m6s.
• Research by Gloria Mark shows that frequent screen switching and multitasking can be detrimental to focus and productivity, as the brain drops one set of rules and activates another, leaving a residue that makes it harder to focus on a particular task 2m6s.
• To improve focus and productivity, recommendations include batching tasks, such as checking email at specific times, rather than constantly throughout the day, and avoiding starting the day by checking the inbox to minimize the ziggarnic effect 4m42s.
• Taking breaks before attention is depleted, and being mindful of self-interruption, which is the tendency to become accustomed to a certain level of distraction, are also important strategies for maintaining focus and productivity 6m12s.
• The ziggarnic effect, a psychological phenomenon where unfinished tasks leave an imprint on the brain, can be mitigated by completing important tasks before checking email or engaging in other activities that may distract from the main goals 5m30s.
• Dr. Mark's research also found that people check email on average 77 distinct times per day, highlighting the need to batch tasks and minimize multitasking to achieve better focus and productivity 4m42s.
• When individuals are accustomed to a certain rhythm of distractions, such as notifications from their phone or messages, they become prone to self-interrupting with intrusive thoughts at the same rate, even when they attempt to focus, and this can be mitigated by structuring focus and altering the cadence of interruptions 10s.
• Studies have shown that having a phone visible, even if it's off, can decrease performance on cognitive tasks, and this effect is more significant for people who are more phone-dependent, highlighting the importance of removing distractions when focusing 2m6s.
• To improve focus, it's recommended to put distractions out of the room, alter the cadence of interruptions to train the ability to focus for at least half an hour, and use cognitive outsourcing by writing down intrusive thoughts in a notebook to clear the mind 2m6s.

Structure and Ritual in Creative Work

• Modern work can become amorphous, especially when working from home, and it's essential to set up structures around work, including seasons and cycles of hard work and rest, to maintain productivity and mental well-being 4m30s.
• Discipline and ritual can provide the structure that allows people to do their best creative work, as noted by music producer Rick Rubin, and this is exemplified by writer Isabel Allende, who thrives on a rigid ritual and structure, starting every book on January 8th and following a strict daily routine 6m20s.
• Isabel Allende's ritual includes starting her workday by lighting a candle, working in an austere room, and closing the door, and she has maintained this structure even through personal tragedies, demonstrating the importance of routine and discipline in creative work 8m40s.

The Myth of the Lone Genius

• The creation of something new often appears to be a story of boundless creativity, but it is actually a story of boundaries that channel focus, give life seasonality and ritual, and empower creativity rather than stifling it 10s.
• As an independent writer, having total freedom and autonomy did not lead to thriving, but instead, putting constraints in place made it possible to thrive, and this was achieved by prioritizing ruthlessly, focusing on a smaller number of things, and having a structured workday and seasonality in projects 2m6s.
• The idea of the lone genius is a myth, and most history books or books about innovation tend to identify individual innovations with individual creators or inventors, but the real story is one of multiple discovery, where multiple people arrive at the same breakthrough at the same time, even when working independently 42s.
• The concept of multiple discovery was popularized by Robert Merton, the founder of the sociology of science, who found that most world-changing breakthroughs, such as the light bulb, the telephone, the microphone, the camera, the jet engine, and the transistor, were arrived at by multiple people at almost the same time 2m6s.
• The history of innovation shows that the narrative of the lone genius has been overvalued and overprioritized, and instead, there are boundaries that are being set up and channeling people toward a breakthrough, with many individuals converging on a solution 2m6s.
• To achieve a better balance and thrive, it is necessary to have grounding in the community, prioritize ruthlessly, and focus on a smaller number of things, as well as having a structured workday, seasonality in projects, and embodied experiences with others, such as joining a nonprofit board or attending community classes 2m6s.

The Role of Context in Scientific Discovery

• The context that pushes individuals towards a certain problem is more important than any individual mind, and this can be seen in the story of Dmitri Mendeleev, a Siberian chemist who is famous for creating the periodic table, but the story of how he created it is often misrepresented 10s.
• Mendeleev had a publishing contract for a two-volume introduction to chemistry textbook and was trying to find a way to fit all 63 known elements into the second volume in a way that made sense to his customers, which led him to experiment with describing families of elements together and ultimately discover the periodic pattern 2m6s.
• Mendeleev was not the only one to discover the periodic pattern, as there were five other scientists who also created periodic tables in the same time period, and this was likely due to the standardization of chemistry notation and measurement that occurred at a chemistry conference in Carl's Rua in 1860, where Stanislau Kanitsaro introduced a standardized way of measuring the weight of elements 4m38s.
• The standardization of chemistry notation and measurement allowed scientists to communicate their work across space and compare their findings, which often precedes breakthroughs in innovation, and this can be seen in the history of innovation, where setting standards has often led to major discoveries 6m15s.

The Importance of Problem Framing in Innovation

• The story of Einstein coming up with special relativity is also often misrepresented, and the famous thought experiment where he rides a beam of light was not told by Einstein until decades after it supposedly happened, highlighting the importance of understanding the true context and circumstances of scientific discoveries 8m30s.
• Einstein's creative breakthrough was influenced by a well-defined problem known as the magnet and wire problem, which involved moving a magnet and a wire past one another to induce an electrical current, and he realized that the laws of physics didn't have to be different depending on which one was moving, leading to a change in the conception of time and space 10s.
• The history of innovation often shows that someone defining a problem well draws a bounding box for people's creative thinking, and this was the case with Einstein, who was able to think about a specific problem that other scientists had framed and put into the open for solution 10s.
• Charles Darwin's breakthrough was not solely the result of his freedom to think and create while away on the Beagle, but rather his ability to synthesize existing work and combine it in new ways, as he was enmeshed in the thinking of his day and was responding to questions that his peers were laying out in a well-defined way 2m6s.
• Darwin corresponded with breeders and gardeners, learning about spontaneous traits that are passed down from one animal to another, which were called "sports" by breeders, and he used this knowledge to synthesize existing ideas into a coherent whole 2m6s.
• Alfred Russell Wallace came up with similar ideas to Darwin at the same time, and both men had read the same essay by Thomas Malthus, which argued that humanity would always reach a crisis point due to population growth outpacing food supply, and this essay framed a problem that made both Wallace and Darwin think about how species in nature respond to limited resources 2m6s.
• Malthus is considered a problem setter, someone who defines a problem well, and his work had a significant impact on subsequent breakthroughs, such as those made by Darwin and Wallace, by channeling their past work into a specific problem 10s.
• Problem setters often do not receive much fame or attention, but they play a crucial role in creative breakthroughs by defining problems that others can then work to solve, as seen in the example of David Hilbert, who made a list of important mathematical problems at the turn of the 20th century 1m30s.
• Hilbert's list of problems, which he defined clearly and distributed to his colleagues, set an agenda for mathematics in the 20th century and led to the solution of many of those problems, demonstrating the significant influence of problem setters 2m6s.
• The concept of problem setters is also illustrated by scientific papers that are wrong but seminal, as they often define a problem in a way that attracts other minds and leads to breakthroughs, such as Nobel-level discoveries 3m40s.

Problem Setting and Its Influence on Innovation

• Problem defining is a skill that is open to many people and is incredibly important, as it can empower others to work productively on a problem, and can be as simple as conducting research and characterizing a problem 4m50s.
• An example of effective problem defining is the work of engineer J. Shri Seth, who used a process called "mosaic building" to identify common problems among her colleagues and define them in a way that brought people together to work on a solution 6m10s.
• Research has been conducted on the concept of specific curiosity, which involves taking on a specific question and exploring it in depth, and this can prompt creative engines in others by defining and refining a particular curiosity, even to the point of writing it out and pitching it to someone 10s.
• Tony Fadell, the lead designer of the iPod and co-founder of Nest, emphasizes the importance of constraints and has used exercises such as making his team work inside a literal box to define the problem they are trying to solve and identify the key features that convey this problem to the customer 1m14s.
• Fadell's approach includes having entrepreneurs write a press release for their product before starting work on it, as a way to force them to define the problem they are trying to solve, and this is seen as a valuable exercise in problem definition 2m6s.
• Problem setting or problem definition is considered an undervalued skill, and it is essential to understand the problem that customers need solved, rather than just providing them with a product or service, as illustrated by the saying that people want a quarter-inch hole in the wall, not a quarter-inch drill 2m42s.
• The example of Jeff Hawkins, who created the app Graffiti for the General Magic operating system and later developed the Palm Pilot, demonstrates the importance of identifying a clear customer problem and creating a coherent device that solves it, which can lead to significant success 3m30s.
• Demis Hassabis, founder of Google DeepMind and Nobel Prize winner, emphasizes the importance of defining a good problem and making boundaries around it, as this skill is becoming increasingly important in the age of AI, and it involves channeling thinking and narrowing down the definition of the problem 5m10s.

The Evolutionary Nature of Innovation

• The history of innovation, as described by science historian James Burke, shows that well-defined problems can lead to a relay race of invention, resulting in significant breakthroughs and changes in the world, and Burke's own work, such as his TV show Connections, illustrates this concept 6m20s.
• The process of innovation can be illustrated by drawing a line from one narrow problem to another, such as the development from medieval castle battlements to film projectors, which involved solving successive problems like eliminating visual blind spots and increasing the range of cannons, ultimately leading to advancements in technology 10s.
• Thomas Kuhn, a philosopher of science, wrote a famous book called "The Structure of Scientific Revolutions" that introduced the concept of paradigm shifts, where a creator would come up with something so different from what came before that it would essentially leave people on either side of the break speaking different languages 1m30s.
• However, Kuhn later took a different approach in a book that was published posthumously, which presents an evolutionary theory of scientific development, emphasizing the idea that discovery is an evolutionary process involving the successive solution of narrow problems one after another 2m45s.
• This nuanced view of innovation suggests that breakthroughs are not the result of single lone geniuses, but rather the result of solving one tightly defined problem after another, and it is this approach that has driven the march of innovation throughout history 3m10s.
• The key to innovation is to define problems in the most succinct way possible and to focus on solving one narrow problem at a time, rather than trying to make giant leaps or waiting for a paradigm shift to occur 4m20s.