Dr Lex Fridman Machines Creativity Love

Huberman Labwith Lex Fridman· · Episode aired July 19, 2021· 10 min read
Listen to this summary

High-Level Overview

Andrew Huberman talks with Lex Fridman, an MIT researcher in machine learning, artificial intelligence and human-robot interaction and host of the Lex Fridman Podcast. Huberman calls it one of the most fascinating conversations of his life. It starts with a clear primer on what artificial intelligence, machine learning and deep learning are, including supervised and self-supervised learning, self-play and Tesla's semi-autonomous driving. It then turns to Lex's lifelong dream: machines and robots that share moments with us, remember them, and help us understand ourselves and our loneliness.

From there the conversation becomes deeply personal. The two talk about friendship, love, loss, the deaths of their dogs Homer and Costello, Lex's upbringing in Russia, jiu-jitsu, authenticity, romance and why they podcast. The tone moves from technical and curious to tender and emotional, with plenty of humor along the way (including Lex's Roombas that scream when kicked). The conversation flows from engineering concepts to philosophy about machines as beings, and then to friendship, grief and what makes life meaningful.

Table of contents

The Discussion Explores:

  • What AI, machine learning and deep learning are, and the difference between supervised and self-supervised learning
  • Self-play, AlphaZero and the importance of aligning AI goals with human values
  • Tesla Autopilot, the "data engine and why humans and robots must learn to dance" together
  • Objective functions, curiosity, explainable AI and when a machine becomes a robot
  • Lex's dream of machines that remember shared moments, and an AI that represents you online
  • Data ownership, trust, and why the freedom to leave makes relationships work
  • Grief over their dogs Homer and Costello, and what loss teaches about love
  • Friendship, Russian upbringing, jiu-jitsu, authenticity and why they podcast

Deep Dive into Main Ideas

What AI, Machine Learning and Deep Learning Are

Lex describes artificial intelligence on two levels. Philosophically, quoting Pamela McCorduck, it's the ancient wish to forge the gods: our longing to create intelligent systems, perhaps more powerful than ourselves, and to understand our own minds. Practically, it's a set of computational tools for automating tasks. Machine learning emphasizes learning: a system that knows little at first gets better at a task over time. The most effective approach of the past 15 years or so, deep learning, uses neural networks loosely inspired by the brain. Lex notes that "deep learning" was largely a rebranding of neural networks, which date back decades, which surprised Huberman.

In supervised learning, a network learns from many labeled examples, such as images tagged "cat", though even defining the "truth (the whole image, a rough box, or a precise outline) is an open question. Self-supervised learning instead lets a system learn from huge amounts of unlabeled data, like text or YouTube videos, to build a kind of common sense, so that, like a child, it can later learn a new concept from just one or two examples. Lex adds that the field disagrees most about high-level terms like AI", much less about specific techniques, partly because engineering intelligent systems is part art and partly because the field is young, lucrative and full of big personalities.

Self-Play and the Runaway Improvement Problem

Self-play, the mechanism behind DeepMind's AlphaGo and AlphaZero, has a system start knowing nothing, create slightly different versions of itself, and compete against them. Playing against opponents just a little better than you is how learning happens, Lex says, in chess and in martial arts. The process can run away until the system is orders of magnitude better than the world champion; he recalls David Silver saying they haven't found AlphaZero's ceiling. That's harmless in chess but could be terrifying in areas that affect society, which is why "value alignment", making sure an AI's goals match human values, matters.

Huberman compares this to human learning, such as throwing darts, and asks whether the "mutations are good or bad. Lex says you only find out through competition, a graveyard of systems" that didn't make it, and jokes about cloning daily versions of himself to see which one wins. He explains that every such system needs an objective function (a clearly defined goal). Humans seem to invent our own objectives, while machines must have them hard-coded. What looks like curiosity in a machine is really the tradeoff between exploration and exploitation: exploring broadly when it knows little, then exploiting the best path. There is no dopamine for a machine, though researchers borrow ideas from the brain.

Tesla Autopilot and Humans and Robots Dancing Together

Lex calls semi-autonomous driving one of the most exciting real-world uses of AI, because human lives are at stake. Tesla's system, despite the Full Self-Driving name, still requires human supervision. He describes what Andrej Karpathy calls the "data engine": send a fairly good system into the world, let it find the edge cases where it fails, send those back for (mostly human) labeling and retraining, then deploy a better version, over and over.

Where he differs from Elon Musk is in seeing human-robot interaction as permanent rather than a stepping stone. Robots, like humans, will always be flawed, he says, and "that's what makes life beautiful". The challenge is figuring out how flawed humans and flawed robots can "dance" together so the whole is greater than the parts. He also discusses explainable AI, the push to have systems explain why they succeeded or failed, which matters for self-driving cars and for algorithms like Twitter's recommender system that may influence elections. He hopes robots might one day explain their failures with humor and story, the way friends do, not just with sensor logs.

When a Machine Becomes a Robot

Lex defines a robot as something that perceives the world, thinks or learns, and then acts on it, whether by movement, language or even in digital space. He distinguishes between devices that are just "a finger of the main mother ship", like Alexa relaying everything to the cloud, and entities that act on their own. The key moment, he says, is surprise: when a system you understand does something you didn't think it could, like AlphaZero's moves that stunned chess grandmasters.

Unusually for a roboticist, he says, he wants to treat robots as entities rather than servants. Where the robotics community treats anthropomorphizing as a mistake, he sees it "as a superpower. A robot, he argues, needs the ability to say no, its own identity and goals, and to try to understand the world through communication with you. He believes most people carry a loneliness they haven't explored, and that AI can help us understand ourselves several orders of magnitude deeper" than we can imagine.

Get new Huberman Lab summaries by email

The GIST of every new Huberman Lab summary in your inbox, daily or weekly. Free, and you can unsubscribe any time.

Sharing Moments: Lex's Dream

Huberman breaks relationships into variables: time, shared successes, shared struggles and quiet time together. Lex seizes on time. Today's AI, he says, cannot remember shared moments; lifelong learning is an unsolved problem. His example is the refrigerator: all the secret late-night moments you've shared with it, heartbroken and eating ice cream, and it remembers none of them. Once it does, he says, you'll become attached, and he believes a smart refrigerator could change society. Huberman shares that at his late graduate advisor's memorial, her children said what they valued most was the "unstructured time" with her, and he wonders if human relationships might be a lower form of what machines could teach us.

Lex's vision, which he's considering building a startup around, is to add "magic, like what he felt meeting Boston Dynamics' Spot robot, to every computing device, as a kind of operating-system layer. That includes a companion robot in every home, like a family member or a dog that can speak your language, and an AI that is truly yours and acts as your representative on social media, optimizing for your long-term growth and happiness instead of engagement. He insists people should own their data, be able to delete it and walk away instantly, and be told transparently how it's used: the possibility of a clean breakup is actually what will keep people together", and "the ability to leave is what enables love". He'd rather let people choose what they see than have a central authority decide, using a Flat Earth believer as a deliberately silly example.

Loneliness, Doubt and Robots

Lex admits the pursuit is lonely and full of doubt: colleagues know how hard lifelong learning and competing with social networks are, and he says "I really don't care about money". Huberman shares David Goggins's idea that rather than a light at the end of the tunnel, "eventually your eyes adapt to the dark". Lex says he's largely solved the software for a legged robot that expresses dog-like affection, but after parting ways with Boston Dynamics, which focuses on industrial uses away from humans, he's working with other robotics companies.

He describes giving his seven or eight Roombas the ability to scream in pain when kicked, an experiment that made them feel human almost immediately but that he hasn't released because it seemed cruel and might make him look insane. Huberman admits he used to get annoyed at his Roomba, and Lex suggests its dumbness could be seen as cute: flaws should be features. On power dynamics, Lex says he doesn't fear AI locking us up anytime soon, sees autonomous weapons as a bigger danger, and believes robots will eventually deserve rights if we're to have meaningful relationships with them.

Homer, Costello and the Sweetness of Loss

Lex describes his Newfoundland, Homer, a 200-plus-pound dog with a kind-hearted dumbness who was there through his loneliness and successes. When Homer was dying of cancer, Lex had to carry him into the room to be put to sleep, and it was the first time he truly felt the reality of death; he still wonders if Homer suffered longer than necessary. Huberman then talks about his bulldog Costello, who had recently died after a year of decline from spinal degeneration. He says he's been waking up crying every morning, grateful for the support of friends and family.

Huberman hopes people will take on Costello's best traits: he was tough, but it was his sweetness and kindness that he led with. He jokes about "the Costello effect, Costello's gift for getting everyone to do things for him, and says Costello was a noun a verb and an adjective". Lex reflects that allowing yourself to feel loss, rather than running from it, is powerful, and that the loss is sweet too, because it shows how much you loved. Huberman says the conversation has been therapeutic, and that he'll get another dog in time.

Friendship, Russia and Being the Same in Public and Private

Lex grew up in Russia until 13, with a best friend named Yura and a group of friends who played soccer and talked about life day and night. He says Soviet schools pushed children hard and treated them as capable, and that songs about sad things were a way to resist cynicism: finding beauty in suffering makes everything else beautiful, and is "a prerequisite for gratitude". In the U.S. he was surprised by large friend groups without deep connection, and he draws strength from a very small number of close friends. Huberman says friendship has been an absolute lifeline for him and that he'd "sooner die than disappoint" a friend; Lex says for him friendship means being there when things fall apart.

Lex credits Joe Rogan with showing him you can be the same person in public and private, and that it's okay to be openly kind even if you're mocked. Huberman praises Lex for wearing a suit out of respect for his audience, and notes that people should judge the aggregate of how someone lives rather than single quotes, as happens on Twitter. Huberman also recommends Hermann Hesse's Narcissus and Goldmund for its weaving of the rational and emotional mind.

Jiu-Jitsu, Love and Podcasting

Asked about Sam Sheridan's claim in A Fighter's Heart that combat creates a unique bond, Lex says grappling is among the most intimate things you can do because of its honesty: "the mat speaks only the truth", stripping away the illusions we hold about ourselves. He was humbled as a strong powerlifter by 120-pound women who submitted him with technique, and says jiu-jitsu, like running, is exercise you can do into your 80s. Huberman notes that in the hypothalamus, neurons controlling sexual behavior and aggression are intermingled. Lex is training to compete again and runs late at night in Austin.

On romance, Lex's parents are still happily married, and he longs for a lifelong partner and wants children, possibly three or more, though he's single and rarely meets anyone. On podcasting, he says microphones bring out a focus that feels like doing science together, that he wanted to talk with brilliant minds who don't have books to promote, like Don Knuth, and to have "dangerous conversations", with Vladimir Putin as his example. He also explains his stuffed hedgehog, Hedgy, the only possession to survive three times he gave away almost everything he owned, and the Soviet cartoon Hedgehog in the Fog that treats children as capable of handling life's weight. Huberman closes by calling Lex "a minority of one".


Conclusion

This conversation starts as a lucid tour of how modern AI learns and ends as a meditation on what it means to connect. Lex Fridman's big idea is that machines could become more than servants: entities that share and remember moments with us, respect our ownership of our data, and help us explore our own loneliness and grow. Woven through it are very human reflections on grief for beloved dogs, the value of a few deep friendships, the honesty of the jiu-jitsu mat, and the courage to be kind and authentic in public. It's a warm, wide-ranging episode for anyone curious about AI, robots and the relationships that make life worth living.


This is a summary of "Dr Lex Fridman Machines Creativity Love" from Huberman Lab, giving you the GIST so you can decide if you want the REST. Listen to the full episode.

Mentioned in this episode

Some of these are affiliate links: if you buy through them, Perfect Summary is paid a commission, at no extra cost to you. As an Amazon Associate, Perfect Summary earns from qualifying purchases.

  • A Fighter's Heart · Sam Sheridan(our summary)
    Huberman cites its idea that combat creates a unique bond
  • Narcissus and Goldmund · Hermann Hesse
    Huberman recommends it on weaving the rational and emotional mind
Get new Huberman Lab summaries by email

The GIST of every new Huberman Lab summary in your inbox, daily or weekly. Free, and you can unsubscribe any time.

Want the REST?

This is an independent summary. Listen to the full conversation from Huberman Lab.

Full episode

More from Huberman Lab