What Is an AI Anyway? | Mustafa Suleyman | TED

Summary

Highlights

• Mustafa Suleyman shares his 15-year journey in AI development 🚀.
• Discusses the skepticism around AI in its early days, including AGI 🤔.
• Comparison of AI development to the human evolutionary journey 🌱.
• Forecasts AI as an 'infinite inventor' capable of reshaping industries 🌐.
• Stresses the ethical responsibility in AI development to avoid potential pitfalls ⚖️.
• Explores potential AI applications in education, healthcare, and beyond 🏥.
• Cautions against enabling self-replication in AI to prevent unforeseen consequences 🚫.
• Endorses a vision where AI embodies human empathy, curiosity, and creativity ❤️.

Key Takeaways

• AI's evolution from fringe science to a transformative global influence 🌎.
• Framing AI as a 'digital species' emphasizes its potential as a partner in human progress 🤝.
• The importance of incorporating ethics in AI development to maximize benefits 🌟.
• Suleyman's vision of AI contributing to education, healthcare, and solving climate crises 🌱.
• The necessity for proactive dialogue on AI's risks, like autonomy and self-improvement 🔍.

Overview

Chapters

• 00:00 - 00:30: Introduction to AI In the chapter titled 'Introduction to AI', the author reflects on their 15-year journey in the field of AI, noting its initial perception as fringe. Back in 2010, even discussing artificial general intelligence (AGI) was considered extreme, highlighting the significant evolution of AI's acceptance and the shift in the tech community's perspective towards this area of research.
• 00:30 - 01:00: Initial Reactions to AGI The chapter "Initial Reactions to AGI" discusses the skepticism and disbelief that surrounded the notion of developing Artificial General Intelligence (AGI) during its early stages. Many people viewed this endeavor as a fantasy reserved for science fiction and believed it would take several decades, if achievable at all. The pursuit of AI was often met with skepticism and derision, with those involved in its development considered eccentric or unrealistic. However, this perception began to shift as AI started to outperform humans in various tasks, suggesting the potential and feasibility of AGI.
• 01:00 - 01:30: AI's Growing Capabilities The chapter titled "AI's Growing Capabilities" discusses the rapidly expanding abilities of AI in areas previously thought unattainable. AI can now understand images, translate languages, transcribe speech, play complex games like Go and chess, and even diagnose diseases. This has led to widespread realization of AI's potential impact, prompting tough questions about its future role, such as addressing the climate crisis and providing personalized education.
• 01:30 - 02:00: Questions and Concerns about AI This chapter addresses common questions and concerns about AI, including potential socioeconomic impacts like universal basic income and job displacement. It also touches on fears related to AI's influence on warfare, the geopolitical AI race, specifically between the US and China, and threats such as mass misinformation. The discussion culminates in highlighting an even more fundamental question central to the author's daily work with AI.
• 02:00 - 02:30: A Fundamental Question from a Child During breakfast, Mustafa's six-year-old nephew, Caspian, engages in a playful conversation with Pi, an AI developed by Mustafa. Caspian, with genuine curiosity, asks Mustafa a fundamental and sincere question: 'What is an AI anyway?' This illustrates Caspian's inquisitive nature and his imaginative thoughts, like wishing to visit dinosaurs at the zoo in the future.
• 02:30 - 03:00: Defining AI The chapter explores the concept of artificial intelligence by engaging in a conversation about software's capabilities, especially its power to simulate human-like understanding and interaction. A comparison is made to human abilities, raising questions about AI's potential and its current limitations, exemplified by a humorous anecdote where AI cannot yet play simple games. This leads to a reflection on AI's person-like qualities and the inherent complexity in defining its nature.
• 03:00 - 03:30: AI as a Digital Species The chapter titled 'AI as a Digital Species' challenges traditional views of artificial intelligence, pointing out that typical descriptions may feel defensive or overly optimistic. AI is often likened to past technologies like printing or steam, with the promise of enhancing human intelligence and productivity, or growing into an oracle-like entity aiding in solving significant scientific issues. However, these descriptions seem more appropriate in academic or policy settings, hinting at a need for a more nuanced understanding of AI's role in society.
• 03:30 - 04:00: Historical Context and Technological Progress The chapter titled 'Historical Context and Technological Progress' begins with the author's reflective thoughts during a breakfast conversation with a perceptive six-year-old. The child asks a simple yet profound question that challenges those working in AI: 'What are we actually creating?' This question prompts the author to consider the implications of developing something entirely new and fundamentally different from any previous invention. The chapter seems to set the stage for exploring the broader impacts and philosophical questions surrounding AI and technological progress.
• 04:00 - 04:30: Rapid Advancements in AI The chapter 'Rapid Advancements in AI' discusses the pivotal moment humanity faces with the rapid development of artificial intelligence. It emphasizes the importance of understanding and articulating this transformative experience with appropriate metaphors and mental models to harness AI's benefits while mitigating its risks.
• 04:30 - 05:00: AI's Ubiquitous Influence The speaker acknowledges the transformative potential of AI technology, while emphasizing the need to communicate its essence clearly and ethically, even to young children. The speaker suggests viewing AI as a new digital species to better conceptualize and navigate its impact on society.
• 05:00 - 05:30: Transformation through Personal AI The chapter titled 'Transformation through Personal AI' discusses the concept of personal AI entities becoming digital companions and partners in human lives. The transcript suggests a transformative journey over the next 10, 20, or 30 years, indicating that the integration of personal AI is inevitable and significant. It emphasizes the importance of preparing for and shaping the future with personal AI as a central component.
• 05:30 - 06:00: AIs as Companions and Colleagues The chapter discusses the evolution of life on Earth, starting from microscopic organisms billions of years ago. It highlights the critical shift that happened a few million years ago when a branch of life, eventually leading to humans, began to use tools. This set the stage for the development of AIs as companions and colleagues.
• 06:00 - 06:30: Addressing AI's Ambiguity The chapter titled "Addressing AI's Ambiguity" explores the evolution of tool-making, beginning with early human innovations such as stone axes and fire, leading up to the development of language, writing, and industrial technologies. This rapid progression of inventions fostered the emergence of 'homo technologicus' approximately 80 years ago.
• 06:30 - 07:00: The Need for Boundaries The chapter titled 'The Need for Boundaries' discusses the rapid advancements in technology, particularly focusing on the transition from the first mainframes and transistors to modern smartphones and virtual-reality headsets. It highlights the explosion of creation in information, knowledge, communication, and computation. The chapter also mentions the emergence of a new wave in this technological revolution: artificial intelligence, noting how historical technological advancements are accelerating.
• 07:00 - 07:30: AI's Potential and Ethical Considerations The chapter discusses the rapid acceleration of technological advancements, emphasizing how each development amplifies the next. It highlights the intertwined nature of human and technological progress, with over a billion people engaging with large language models in a short span of 18 months. The narrative stresses the occurrence of landmark events in AI, reflecting on past skepticism about AI's creative capabilities.
• 07:30 - 08:00: Comparing AI to Historical Innovations The chapter titled 'Comparing AI to Historical Innovations' highlights the transformative impact of AI in recent times. It portrays AI as a boundless source of creativity, capable of generating poetry, images, music, and videos that expand human imagination. Contrary to initial beliefs, AI has developed empathetic capabilities, facilitating meaningful interactions with individuals, supporting emotional challenges, and discussing personal aspirations. Additionally, AI's advancements are evident in its abilities to drive automobiles, manage energy infrastructure, and invent novel compounds, achievements considered unfeasible just a few years prior.
• 08:00 - 08:30: AI as a Reflection of Humanity The chapter discusses the rapid advancement in AI technology, emphasizing the exponential growth in data and computational power. It highlights that recent AI models use significantly more computation compared to earlier models, illustrating this with the comparison that the Inflection 2.5 model employs five billion times more computation than the DeepMind AI from a decade ago. This surge in computational capacity exemplifies the transformative impact of AI's evolution over the last decade.
• 08:30 - 09:00: Vision for AI's Role in Society This chapter delves into the evolution of AI models over the past decade, highlighting the exponential increase in their capabilities. Starting with mere millions of parameters, the most advanced models now operate with tens of trillions. A remarkable analogy is drawn: while a human reading 24/7 throughout their lifetime might read eight billion words, modern AI models process words at a scale that's orders of magnitude larger, consuming over eight trillion words. This disparity underscores the formidable scale and power of current AI technologies and hints at their transformative potential in society.
• 09:00 - 09:30: Final Reflections and Gratitude The chapter reflects on the rapid pace of technological advancement, noting that just a single month of training can lead to significant progress and hinting at ongoing developments. It highlights that we are entering a new phase in technological history, characterized by the widespread adoption of artificial intelligence (AI). Just as the internet and smartphones introduced browsers and apps, respectively, cloud-based supercomputers are now paving the way for AIs to become ubiquitous in our daily lives. The chapter concludes with the idea that soon, every interaction will be facilitated by a conversational interface, marking a transformative period in technology.
• 09:30 - 10:00: Q&A: AI Risks and Management The chapter titled 'Q&A: AI Risks and Management' discusses the concept of having personal AIs that possess infinite knowledge, factual accuracy, reliability, near-perfect IQ, and exceptional emotional intelligence (EQ). These personal AIs are described as kind, supportive, and empathetic companions that could transform everyday life by providing personalized tutoring and affordable medical advice.
• 10:00 - 10:30: Discussing AI's Rapid Development The chapter titled 'Discussing AI's Rapid Development' explores the integration of AI into daily professional and personal contexts. It highlights the potential of AI to function as a personal assistant for various professionals, including lawyers, doctors, business strategists, and coaches, providing 24/7 access. A key concept introduced is AQ or 'actions quotient', which assesses the AI's capacity to execute tasks in both digital and physical environments. Anticipating future developments, the chapter suggests that not only individuals will benefit from AIs, but organizations ranging from small businesses to national governments will also integrate AI systems.
• 10:30 - 11:00: Safety and Ethical Responsibility This chapter delves into the evolving role of AI, emphasizing the emergence of unique interactive personas representing towns, buildings, and objects. It suggests that AI will transcend being mere mechanistic assistants to becoming companions, confidants, and partners that convincingly imitate humans in many tasks. The chapter emphasizes the intimate scale at which this transformation will be felt, underlining a significant shift in how humans interact with AI. It hints at ethical and safety considerations inherent in such a deep integration of AI into everyday life.
• 11:00 - 11:30: Closing Remarks The chapter discusses the multifaceted roles of AI in society, ranging from organizing social events for individuals to aiding in understanding complex medical diagnoses. It highlights the potential of AI to impact large-scale operations such as scientific discoveries, autonomous vehicles, and drones. The AI's capabilities extend to managing daily tasks like ordering takeout and operating power stations. Furthermore, it emphasizes AI's ability to communicate in multiple languages, process sensor data, and interact with humans and other AI systems.

What Is an AI Anyway? | Mustafa Suleyman | TED Transcription

• 00:00 - 00:30 I want to tell you what I see coming. I've been lucky enough to be working on AI for almost 15 years now. Back when I started, to describe it as fringe would be an understatement. Researchers would say, “No, no, we’re only working on machine learning.” Because working on AI was seen as way too out there. In 2010, just the very mention of the phrase “AGI,” artificial general intelligence,
• 00:30 - 01:00 would get you some seriously strange looks and even a cold shoulder. "You're actually building AGI?" people would say. "Isn't that something out of science fiction?" People thought it was 50 years away or 100 years away, if it was even possible at all. Talk of AI was, I guess, kind of embarrassing. People generally thought we were weird. And I guess in some ways we kind of were. It wasn't long, though, before AI started beating humans at a whole range of tasks
• 01:00 - 01:30 that people previously thought were way out of reach. Understanding images, translating languages, transcribing speech, playing Go and chess and even diagnosing diseases. People started waking up to the fact that AI was going to have an enormous impact, and they were rightly asking technologists like me some pretty tough questions. Is it true that AI is going to solve the climate crisis? Will it make personalized education available to everyone?
• 01:30 - 02:00 Does it mean we'll all get universal basic income and we won't have to work anymore? Should I be afraid? What does it mean for weapons and war? And of course, will China win? Are we in a race? Are we headed for a mass misinformation apocalypse? All good questions. But it was actually a simpler and much more kind of fundamental question that left me puzzled. One that actually gets to the very heart of my work every day.
• 02:00 - 02:30 One morning over breakfast, my six-year-old nephew Caspian was playing with Pi, the AI I created at my last company, Inflection. With a mouthful of scrambled eggs, he looked at me plain in the face and said, "But Mustafa, what is an AI anyway?" He's such a sincere and curious and optimistic little guy. He'd been talking to Pi about how cool it would be if one day in the future, he could visit dinosaurs at the zoo.
• 02:30 - 03:00 And how he could make infinite amounts of chocolate at home. And why Pi couldn’t yet play I Spy. "Well," I said, "it's a clever piece of software that's read most of the text on the open internet, and it can talk to you about anything you want." "Right. So like a person then?" I was stumped. Genuinely left scratching my head.
• 03:00 - 03:30 All my boring stock answers came rushing through my mind. "No, but AI is just another general-purpose technology, like printing or steam." It will be a tool that will augment us and make us smarter and more productive. And when it gets better over time, it'll be like an all-knowing oracle that will help us solve grand scientific challenges." You know, all of these responses started to feel, I guess, a little bit defensive. And actually better suited to a policy seminar
• 03:30 - 04:00 than breakfast with a no-nonsense six-year-old. "Why am I hesitating?" I thought to myself. You know, let's be honest. My nephew was asking me a simple question that those of us in AI just don't confront often enough. What is it that we are actually creating? What does it mean to make something totally new, fundamentally different to any invention that we have known before?
• 04:00 - 04:30 It is clear that we are at an inflection point in the history of humanity. On our current trajectory, we're headed towards the emergence of something that we are all struggling to describe, and yet we cannot control what we don't understand. And so the metaphors, the mental models, the names, these all matter if we’re to get the most out of AI whilst limiting its potential downsides.
• 04:30 - 05:00 As someone who embraces the possibilities of this technology, but who's also always cared deeply about its ethics, we should, I think, be able to easily describe what it is we are building. And that includes the six-year-olds. So it's in that spirit that I offer up today the following metaphor for helping us to try to grapple with what this moment really is. I think AI should best be understood as something like a new digital species.
• 05:00 - 05:30 Now, don't take this too literally, but I predict that we'll come to see them as digital companions, new partners in the journeys of all our lives. Whether you think we’re on a 10-, 20- or 30-year path here, this is, in my view, the most accurate and most fundamentally honest way of describing what's actually coming. And above all, it enables everybody to prepare for and shape what comes next. Now I totally get, this is a strong claim,
• 05:30 - 06:00 and I'm going to explain to everyone as best I can why I'm making it. But first, let me just try to set the context. From the very first microscopic organisms, life on Earth stretches back billions of years. Over that time, life evolved and diversified. Then a few million years ago, something began to shift. After countless cycles of growth and adaptation, one of life’s branches began using tools, and that branch grew into us.
• 06:00 - 06:30 We went on to produce a mesmerizing variety of tools, at first slowly and then with astonishing speed, we went from stone axes and fire to language, writing and eventually industrial technologies. One invention unleashed a thousand more. And in time, we became homo technologicus. Around 80 years ago,
• 06:30 - 07:00 another new branch of technology began. With the invention of computers, we quickly jumped from the first mainframes and transistors to today's smartphones and virtual-reality headsets. Information, knowledge, communication, computation. In this revolution, creation has exploded like never before. And now a new wave is upon us. Artificial intelligence. These waves of history are clearly speeding up,
• 07:00 - 07:30 as each one is amplified and accelerated by the last. And if you look back, it's clear that we are in the fastest and most consequential wave ever. The journeys of humanity and technology are now deeply intertwined. In just 18 months, over a billion people have used large language models. We've witnessed one landmark event after another. Just a few years ago, people said that AI would never be creative.
• 07:30 - 08:00 And yet AI now feels like an endless river of creativity, making poetry and images and music and video that stretch the imagination. People said it would never be empathetic. And yet today, millions of people enjoy meaningful conversations with AIs, talking about their hopes and dreams and helping them work through difficult emotional challenges. AIs can now drive cars, manage energy grids and even invent new molecules. Just a few years ago, each of these was impossible.
• 08:00 - 08:30 And all of this is turbocharged by spiraling exponentials of data and computation. Last year, Inflection 2.5, our last model, used five billion times more computation than the DeepMind AI that beat the old-school Atari games just over 10 years ago. That's nine orders of magnitude more computation.
• 08:30 - 09:00 10x per year, every year for almost a decade. Over the same time, the size of these models has grown from first tens of millions of parameters to then billions of parameters, and very soon, tens of trillions of parameters. If someone did nothing but read 24 hours a day for their entire life, they'd consume eight billion words. And of course, that's a lot of words. But today, the most advanced AIs consume more than eight trillion words
• 09:00 - 09:30 in a single month of training. And all of this is set to continue. The long arc of technological history is now in an extraordinary new phase. So what does this mean in practice? Well, just as the internet gave us the browser and the smartphone gave us apps, the cloud-based supercomputer is ushering in a new era of ubiquitous AIs. Everything will soon be represented by a conversational interface.
• 09:30 - 10:00 Or, to put it another way, a personal AI. And these AIs will be infinitely knowledgeable, and soon they'll be factually accurate and reliable. They'll have near-perfect IQ. They’ll also have exceptional EQ. They’ll be kind, supportive, empathetic. These elements on their own would be transformational. Just imagine if everybody had a personalized tutor in their pocket and access to low-cost medical advice.
• 10:00 - 10:30 A lawyer and a doctor, a business strategist and coach -- all in your pocket 24 hours a day. But things really start to change when they develop what I call AQ, their “actions quotient.” This is their ability to actually get stuff done in the digital and physical world. And before long, it won't just be people that have AIs. Strange as it may sound, every organization, from small business to nonprofit to national government,
• 10:30 - 11:00 each will have their own. Every town, building and object will be represented by a unique interactive persona. And these won't just be mechanistic assistants. They'll be companions, confidants, colleagues, friends and partners, as varied and unique as we all are. At this point, AIs will convincingly imitate humans at most tasks. And we'll feel this at the most intimate of scales.
• 11:00 - 11:30 An AI organizing a community get-together for an elderly neighbor. A sympathetic expert helping you make sense of a difficult diagnosis. But we'll also feel it at the largest scales. Accelerating scientific discovery, autonomous cars on the roads, drones in the skies. They'll both order the takeout and run the power station. They’ll interact with us and, of course, with each other. They'll speak every language, take in every pattern of sensor data,
• 11:30 - 12:00 sights, sounds, streams and streams of information, far surpassing what any one of us could consume in a thousand lifetimes. So what is this? What are these AIs? If we are to prioritize safety above all else, to ensure that this new wave always serves and amplifies humanity, then we need to find the right metaphors for what this might become.
• 12:00 - 12:30 For years, we in the AI community, and I specifically, have had a tendency to refer to this as just tools. But that doesn't really capture what's actually happening here. AIs are clearly more dynamic, more ambiguous, more integrated and more emergent than mere tools, which are entirely subject to human control. So to contain this wave, to put human agency at its center
• 12:30 - 13:00 and to mitigate the inevitable unintended consequences that are likely to arise, we should start to think about them as we might a new kind of digital species. Now it's just an analogy, it's not a literal description, and it's not perfect. For a start, they clearly aren't biological in any traditional sense, but just pause for a moment and really think about what they already do. They communicate in our languages. They see what we see.
• 13:00 - 13:30 They consume unimaginably large amounts of information. They have memory. They have personality. They have creativity. They can even reason to some extent and formulate rudimentary plans. They can act autonomously if we allow them. And they do all this at levels of sophistication that is far beyond anything that we've ever known from a mere tool. And so saying AI is mainly about the math or the code
• 13:30 - 14:00 is like saying we humans are mainly about carbon and water. It's true, but it completely misses the point. And yes, I get it, this is a super arresting thought but I honestly think this frame helps sharpen our focus on the critical issues. What are the risks? What are the boundaries that we need to impose? What kind of AI do we want to build or allow to be built?
• 14:00 - 14:30 This is a story that's still unfolding. Nothing should be accepted as a given. We all must choose what we create. What AIs we bring into the world, or not. These are the questions for all of us here today, and all of us alive at this moment. For me, the benefits of this technology are stunningly obvious, and they inspire my life's work every single day.
• 14:30 - 15:00 But quite frankly, they'll speak for themselves. Over the years, I've never shied away from highlighting risks and talking about downsides. Thinking in this way helps us focus on the huge challenges that lie ahead for all of us. But let's be clear. There is no path to progress where we leave technology behind. The prize for all of civilization is immense.
• 15:00 - 15:30 We need solutions in health care and education, to our climate crisis. And if AI delivers just a fraction of its potential, the next decade is going to be the most productive in human history. Here's another way to think about it. In the past, unlocking economic growth often came with huge downsides. The economy expanded as people discovered new continents and opened up new frontiers. But they colonized populations at the same time.
• 15:30 - 16:00 We built factories, but they were grim and dangerous places to work. We struck oil, but we polluted the planet. Now because we are still designing and building AI, we have the potential and opportunity to do it better, radically better. And today, we're not discovering a new continent and plundering its resources. We're building one from scratch. Sometimes people say that data or chips are the 21st century’s new oil,
• 16:00 - 16:30 but that's totally the wrong image. AI is to the mind what nuclear fusion is to energy. Limitless, abundant, world-changing. And AI really is different, and that means we have to think about it creatively and honestly. We have to push our analogies and our metaphors to the very limits to be able to grapple with what's coming.
• 16:30 - 17:00 Because this is not just another invention. AI is itself an infinite inventor. And yes, this is exciting and promising and concerning and intriguing all at once. To be quite honest, it's pretty surreal. But step back, see it on the long view of glacial time, and these really are the very most appropriate metaphors that we have today. Since the beginning of life on Earth,
• 17:00 - 17:30 we've been evolving, changing and then creating everything around us in our human world today. And AI isn't something outside of this story. In fact, it's the very opposite. It's the whole of everything that we have created, distilled down into something that we can all interact with and benefit from. It's a reflection of humanity across time, and in this sense, it isn't a new species at all.
• 17:30 - 18:00 This is where the metaphors end. Here's what I'll tell Caspian next time he asks. AI isn't separate. AI isn't even in some senses, new. AI is us. It's all of us. And this is perhaps the most promising and vital thing of all that even a six-year-old can get a sense for. As we build out AI, we can and must reflect all that is good, all that we love,
• 18:00 - 18:30 all that is special about humanity: our empathy, our kindness, our curiosity and our creativity. This, I would argue, is the greatest challenge of the 21st century, but also the most wonderful, inspiring and hopeful opportunity for all of us. Thank you. (Applause) Chris Anderson: Thank you Mustafa. It's an amazing vision and a super powerful metaphor.
• 18:30 - 19:00 You're in an amazing position right now. I mean, you were connected at the hip to the amazing work happening at OpenAI. You’re going to have resources made available, there are reports of these giant new data centers, 100 billion dollars invested and so forth. And a new species can emerge from it. I mean, in your book, you did, as well as painting an incredible optimistic vision, you were super eloquent on the dangers of AI.
• 19:00 - 19:30 And I'm just curious, from the view that you have now, what is it that most keeps you up at night? Mustafa Suleyman: I think the great risk is that we get stuck in what I call the pessimism aversion trap. You know, we have to have the courage to confront the potential of dark scenarios in order to get the most out of all the benefits that we see. So the good news is that if you look at the last two or three years, there have been very, very few downsides, right? It’s very hard to say explicitly what harm an LLM has caused.
• 19:30 - 20:00 But that doesn’t mean that that’s what the trajectory is going to be over the next 10 years. So I think if you pay attention to a few specific capabilities, take for example, autonomy. Autonomy is very obviously a threshold over which we increase risk in our society. And it's something that we should step towards very, very closely. The other would be something like recursive self-improvement. If you allow the model to independently self-improve, update its own code, explore an environment without oversight, and, you know,
• 20:00 - 20:30 without a human in control to change how it operates, that would obviously be more dangerous. But I think that we're still some way away from that. I think it's still a good five to 10 years before we have to really confront that. But it's time to start talking about it now. CA: A digital species, unlike any biological species, can replicate not in nine months, but in nine nanoseconds, and produce an indefinite number of copies of itself, all of which have more power than we have in many ways. I mean, the possibility for unintended consequences seems pretty immense.
• 20:30 - 21:00 And isn't it true that if a problem happens, it could happen in an hour? MS: No. That is really not true. I think there's no evidence to suggest that. And I think that, you know, that’s often referred to as the “intelligence explosion.” And I think it is a theoretical, hypothetical maybe that we're all kind of curious to explore, but there's no evidence that we're anywhere near anything like that. And I think it's very important that we choose our words super carefully.
• 21:00 - 21:30 Because you're right, that's one of the weaknesses of the species framing, that we will design the capability for self-replication into it if people choose to do that. And I would actually argue that we should not, that would be one of the dangerous capabilities that we should step back from, right? So there's no chance that this will "emerge" accidentally. I really think that's a very low probability. It will happen if engineers deliberately design those capabilities in. And if they don't take enough efforts to deliberately design them out.
• 21:30 - 22:00 And so this is the point of being explicit and transparent about trying to introduce safety by design very early on. CA: Thank you, your vision of humanity injecting into this new thing the best parts of ourselves, avoiding all those weird, biological, freaky, horrible tendencies that we can have in certain circumstances, I mean, that is a very inspiring vision. And thank you so much for coming here and sharing it at TED. Thank you, good luck. (Applause)