Sam Altman: OpenAI, GPT-5, Sora, Board Saga, Elon Musk, Ilya, Power & AGI

Lex Fridman Podcastwith Sam Altman· · Episode aired March 18, 2024· 13 min read
Listen to this summary

High-Level Overview

In his second appearance on the Lex Fridman Podcast, OpenAI CEO Sam Altman opens up about the November 2023 board crisis in which he was fired and then reinstated, calling it the most painful professional experience of his life. From there the conversation ranges widely: his relationship with Ilya Sutskever, Elon Musk's lawsuit against OpenAI, what Sora reveals about AI world models, why he thinks GPT-4 "kind of sucks" relative to what is coming, iterative deployment and the mysterious Q*, compute as the currency of the future, nuclear energy, competition and safety, search and ads, model bias, programming's future, robots, AGI timelines and power, and even why he tweets without capital letters.

The tone is candid, measured and at times vulnerable, with Altman frequently hedging, declining to share secrets and admitting uncertainty, while Fridman mixes probing questions with humor about secret nuclear facilities and the shift key. The conversation flows from personal reflection on the board drama, to technical and product questions about OpenAI's models, to big-picture questions about governance, AGI, simulation and hope for humanity.

Table of contents

The Discussion Explores:

  • The OpenAI board saga: what happened, how it felt, what changed in governance and what Altman learned about trust
  • Ilya Sutskever, Mira Murati and the people who held OpenAI together
  • Elon Musk's lawsuit, what open means in OpenAI, and open versus closed models
  • Sora and whether AI models build a real understanding of the world, plus copyright and creators
  • GPT-4's strengths and weaknesses, memory, reasoning, Q*, iterative deployment and GPT-5
  • Compute as the world's most precious commodity, nuclear fission and fusion, and theatrical AI risks
  • Competition, search, ads, model bias and safety as a whole-company effort
  • AGI definitions and timelines, why no one person should control it, simulation, aliens and hope

Deep Dive into Main Ideas

The Board Saga: Pain, Love and Lessons

Altman describes the weekend that began on Friday, November 17: "That was definitely the most painful professional experience of my life." It was chaotic and shameful, yet he felt enormous love, with his phone flooded by supportive messages that felt like reading his own eulogy. After an initial period of confusion and rage on Friday, he quickly accepted the outcome and got excited about starting a focused AGI research effort. On Saturday two board members asked about his return; he initially did not want to but agreed because he loved the company, and then spent a confusing weekend being told a deal was almost done. The low point was Sunday night, when the board appointed a new interim CEO. He went four and a half days barely sleeping or eating, and afterward spent about a month to 45 days in a fugue state while still having to run OpenAI. He says "the dominant emotion of the weekend was love" and that he eventually chose not to feel like a victim forever because this is the most important work he will ever touch.

On governance, he says the board members were well-meaning people who made suboptimal decisions under pressure. The flaw was structural: a nonprofit board answers to no one but itself, while Altman wants OpenAI's board to answer to the world as much as possible. The old board had shrunk from nine to six members and could not agree on additions, and lacked experienced board members. New members Bret Taylor and Larry Summers (the latter suggested by the old board) were chosen on the battlefield, and going forward the board will be hired in slates to combine nonprofit, company, legal, governance and technical expertise. For board members he cares about track record, the y-intercept, more than trajectory. He is glad the crisis happened early, as a preview of the pressure to come, but admits it has changed his default trust in people. His old philosophy was "you get a little bit screwed in exchange for getting to live with your guard down," and he now plans more for bad scenarios, though he does not fear becoming cynical.

Ilya, Mira and the Team

Altman praises Mira Murati for her handling of the crisis but says what he truly values in leaders is how they act "on a boring Tuesday at 946 in the morning" in ordinary meetings and decisions. Asked about Ilya Sutskever, he jokes that Ilya is not being held in a secret nuclear facility, says he loves and respects him, and hopes they work together for the rest of their careers, though Ilya's plans are for Ilya to discuss. To the meme asking what Ilya saw: "Ilya did not see AGI." Instead, Altman describes Ilya as someone who takes AGI safety and its impact on society extremely seriously and thinks on ten-year horizons, as well as a surprisingly silly person when playing with a puppy. He gives himself a very good grade for the team he has assembled.

Elon Musk, the Lawsuit and What Open Means

Altman says OpenAI started as a research lab with no idea it would build products or need huge amounts of capital, so its structure was patched repeatedly into something eyebrow-raising, through what he considers reasonable decisions at each step. According to Altman, Musk thought OpenAI would fail, wanted total control, and at times wanted it to become a for-profit he controlled or merge with Tesla; when OpenAI declined, he left. Altman does not know Musk's real motivations but calls the lawsuit "unbecoming of a builder" from someone he respects as one of the great builders of our time, and says he once remarked that he missed the old Elon and was flooded with agreement. He hopes for an amicable relationship in the future and notes that Grok only open-sourced after critics called it hypocritical.

On the name, he says he would pick a different one with hindsight, but the kind of open he cares about is putting powerful tools in people's hands for free, with no ads on the free version. On open source, he wants nuance over religious battle lines: some models, especially smaller ones people can run locally, should be open and others closed. He would heavily discourage any startup from starting as a nonprofit and adding a for-profit arm later, and does not think OpenAI sets a precedent.

Sora, World Models and Creators

Altman believes AI models understand more about the world than most people give them credit for, even though obvious failures make it easy to call it all fake. Early Sora videos impressed him by handling occlusion, keeping an object consistent after someone walks in front of it, though he would not claim it has a great underlying 3D model. The approach of training on visual patches seems to go surprisingly far, while weaknesses like cats sprouting extra limbs will improve with scale and may also reflect something fundamentally different from human learning. OpenAI uses lots of human data but not internet-scale human labeling. Before release, Sora needs to become efficient enough to scale, and concerns like deepfakes and misinformation must be handled.

On copyright, he reframes the question as whether people who create valuable data deserve compensation, and says yes, suggesting artists should be able to opt out of style imitation or share economically when their style is used. He compares the moment to photography, which worried artists and then became a new art form, and argues the better question than how many jobs AI will replace is what percentage of tasks, on five-second to five-day horizons, AI can do, letting people work at higher levels of abstraction. He expects most YouTube videos to use AI tools while still being directed by people, and Fridman adds that humans mostly care about other humans.

Get new Lex Fridman Podcast summaries by email

The GIST of every new Lex Fridman Podcast summary in your inbox, daily or weekly. Free, and you can unsubscribe any time.

GPT-4, Memory and Slower Thinking

Asked what impresses him most about GPT-4, Altman says: "I think it kind of sucks." Relative to where we need to go, GPT-3 now looks unimaginably horrible, and he expects the gap between GPT-5 and GPT-4 to match the gap between GPT-4 and GPT-3. His job is to live a few years in the future. He sees glimmers of something amazing in using it as a brainstorming partner and, occasionally, in longer multi-step tasks. He credits ChatGPT's success as much to post-training such as RLHF and to product work as to the base model; it was the moment much of the world went from not believing to believing. Most people do not use the full 128K context yet, but he imagines future context windows that effectively hold your whole life, and he wants memory that integrates lessons, including from November, under easy user control and transparency. He notes younger users treat ChatGPT as the default start of any knowledge task, and says hallucination will improve but not be solved this year.

On reasoning, he agrees AI should be able to spend more compute on harder problems, like proving Fermat's Last Theorem, than on easy ones, and expects a new paradigm for slower thinking. On Q*, he says only that OpenAI is not ready to talk about it and that better reasoning is an important direction it has not yet cracked. He explains iterative deployment, releasing GPT-1 through 4 publicly because "AI and surprise don't go together" and society needs time to adapt, and admits that if people still perceive leaps, OpenAI may need to release even more iteratively. He does not know when GPT-5 will come or what it will be called, but promises an amazing model this year, attributing progress to a line he paraphrases from Ilya about multiplying 200 medium-sized things together into one giant thing. What excites him most about the next model is that it gets better across the board, and Fridman describes the feeling of a model that grasps the question behind a badly worded prompt.

Compute, Energy and Theatrical Risk

Altman denies tweeting about raising $7 trillion but affirms the underlying belief: "compute is going to be the currency of the future," perhaps the most precious commodity in the world. Unlike smartphone chips, where demand is capped by how many phones people need, intelligence behaves more like energy: at a low price the world will use enormous amounts, such as an AI reading his email all day, and at a high price it might be reserved for curing cancer. Energy is the hardest part, followed by data centers, supply chains and chip fabrication. His answer to energy is nuclear, both fusion, where he thinks Helion is doing the best work, and new fission reactors, and he calls the industry's halt a shame.

That leads to a concern about AI: some things will go theatrically wrong, and he admits the chance he eventually gets shot is not zero. Just as air pollution has killed far more people than nuclear reactors while people fear reactors more, dramatic risks that would make a good movie climax dominate attention over slow-burning ones. He also expects AI to get caught up in left-versus-right politics, as anything of consequence does.

Competition, Search, Ads and Bias

Competition brings better, faster and cheaper products, but the risk is an arms race. Altman lays out a quadrant of short or long timelines to AGI and slow or fast takeoff, saying "short timelines slow takeoff is the safest quadrant" and that he wants to ensure a slow takeoff. Fridman wishes Musk and OpenAI collaborated more on safety. On search, Altman finds building a better Google boring; Google's ten blue links and ads are one way to find information, and the more exciting goal is helping people find, act on and synthesize information, with integrating chat and search being a problem no one has cracked. On ads, he says "I kind of hate ads just as like an aesthetic choice," likes that paying users know answers are not influenced by advertisers, and believes OpenAI can pay for its compute without ads, though he does not fully rule them out.

On Google Gemini's controversial images, he says these problems are hard and OpenAI has made its own mistakes. His proposed fix is to publish the desired behavior of a model with concrete examples, such as how it should answer who is better between Trump and Biden, so a failure is clearly either a bug to fix or a policy to debate. He says OpenAI is less caught up in culture wars than other San Francisco companies because its shared ideology is a belief in AGI. Safety, he predicts, will eventually be what most of the company thinks about, spanning technical alignment, state actors trying to steal models (who are already trying), and societal and economic impacts.

Programming, Robots and What AGI Means

Humans will still do a lot of programming in five to ten years, but in a different shape, with some programming entirely in natural language and the best practitioners mixing tools. OpenAI will return to robotics at some point, since it would be depressing to have AGI yet need humans to do everything physical. Altman now considers the question of when AGI arrives poorly formed, because definitions vary so much: "AGI is also not an ending," but more of a mile marker. Still, he expects quite capable, remarkable systems by the end of the decade and possibly sooner. He notes GPT-3.5 changed expectations but not the world itself; the global economy does not feel different since GPT-4. For him, a key sign would be a system that significantly increases the rate of scientific discovery, since he believes most real economic growth comes from scientific and technological progress. If handed the first AGI, he would ask whether a theory of everything exists and whether alien civilizations are out there, though he suspects it might first ask for new machines and measurements.

Power, Governance and Trust

Asked whether he trusts himself with the power of building AGI, Altman says no one person, including himself, should have total control over OpenAI or AGI, and that robust governance is essential. He acknowledges that although the board legally could fire him, in practice it did not quite work, which is its own governance failure, even if he believes he can defend the specifics. He has never had or wanted super-voting control and still does not. He wants governments to set rules of the road, and knows critics will call that regulatory capture: "I'm just willing to be misunderstood there."

Existential risk from the AI itself is not currently his top worry, though OpenAI has people working hard on it and he could be surprised. He argues that fixation on the AI escaping the box, a theatrical risk, pushed other significant risks out of the discourse.

Lowercase Tweets, Simulation, Aliens and Hope

In a lighter moment, Altman explains that he grew up as a very online kid who never capitalized in chats, that capitalization conventions have been declining for centuries, and that he still capitalizes strategy memos and formal messages. On simulation, Sora's ability to generate worlds nudges his probability up only somewhat. He compares insights like the square root of negative one, a simple operator that opens a whole new realm of reality, to how AI may serve as a gateway to new ways of seeing. He deeply wants to believe there are many intelligent alien civilizations and finds the Fermi paradox scary, suggesting space travel may simply be very hard.

His hope rests on humanity's trajectory and on the collective scaffolding of civilization: we are not genetically different from our ancestors, but we can do dramatically more because of what everyone built together, and no one person builds the iPhone or discovers all of science. He wonders whether AI will be more like a single brain or part of that shared scaffolding. Asked about death, he says he would mostly feel grateful for his life, though curious to see what happens next. Fridman closes with Arthur C. Clarke: "maybe that our role on this planet is not to worship God but to create him."


Conclusion

This conversation shows Sam Altman at a reflective moment, shaken by a crisis that nearly destroyed OpenAI and trying to translate it into better governance, while insisting that no single person, himself included, should control AGI. His technical and strategic views are consistent: today's models, GPT-4 included, will soon look primitive; progress should be released iteratively so society can adapt; compute and energy are the bottlenecks of the coming era; and the real measure of AGI is whether it accelerates scientific discovery. He is guarded on secrets like Q* and GPT-5, open about his disappointment with Elon Musk, and pragmatic about ads, bias, open source and safety. For listeners wanting to understand how the head of the leading AI lab thinks about power, risk and the road ahead, it is an essential and surprisingly personal listen.


This is a summary of "Sam Altman: OpenAI, GPT-5, Sora, Board Saga, Elon Musk, Ilya, Power & AGI" from Lex Fridman Podcast, giving you the GIST so you can decide if you want the REST. Listen to the full episode.

Get new Lex Fridman Podcast summaries by email

The GIST of every new Lex Fridman Podcast summary in your inbox, daily or weekly. Free, and you can unsubscribe any time.

Want the REST?

This is an independent summary. Listen to the full conversation from Lex Fridman Podcast.

Full episode

More from Lex Fridman Podcast