Downloaded from YTS.MX
[RUMINATIVE MUSIC PLAYING]
Official YIFY movies site: YTS.MX
[DEVICE CHIMES]
JULIETTE LOVE: Hi, Alpha.
ALPHA: Hello.
LOVE: Can you help me write code?
ALPHA: I was trained to answer questions,
but I'm able to learn.
LOVE: That's very open-minded of you.
ALPHA: Thank you. I'm glad you're happy with me.
What's this guy doing?
ALPHA: That's a developer.
What do you think he's working on?
ALPHA: That's a tough question.
He might be working on a new feature,
a bug fix or something else.
It's quite possible.
ALPHA: Yes.
LOVE: Do you see my backpack?
ALPHA: That's a badminton racket.
It's a squash racket, but that's pretty close.
ALPHA: That's a badminton racket.
No, but you're not the first person
to make that mistake.
[UPBEAT MUSIC PLAYING]
NEWSREADER 1: AI, the technology
that has been advancing at breakneck speed.
NEWSREADER 2: Artificial intelligence is all the rage.
NEWSREADER 3: Some are now raising alarm about...
NEWSREADER 4: It is definitely concerning.
NEWSREADER 5: This is an AI arms race.
NEWSREADER 6: We don't know
how this is all going to shake out,
but it's clear something is happening.
DEMIS HASSABIS: I'm kind of restless.
Trying to build AGI is the most exciting journey,
in my opinion, that humans have ever embarked on.
If you're really going to take that seriously,
there isn't a lot of time.
Life's very short.
My whole life goal is to solve
artificial general intelligence.
And on the way, use AI as the ultimate tool
to solve all the world's
most complex scientific problems.
I think that's bigger than the Internet.
I think that's bigger than mobile.
I think it's more like
the advent of electricity or fire.
ANNOUNCER: World leaders
and artificial intelligence experts
are gathering for the first ever
global AI safety summit,
set to look at the risks
of the fast growing technology and also...
HASSABIS: I think this is a hugely
critical moment for all humanity.
It feels like we're on the cusp
of some incredible things happening.
NEWSREADER: Let me take you through
some of the reactions in today's papers.
HASSABIS: AGI is pretty close, I think.
There's clearly huge interest in what it is capable of,
where it's taking us.
HASSABIS: This is the moment
I've been living my whole life for.
[MID-TEMPO ELECTRONIC MUSIC PLAYS]
I've always been fascinated by the mind.
So I set my heart on studying neuroscience
because I wanted to get inspiration
from the brain for AI.
ELEANOR MAGUIRE: I remember asking Demis,
"What's the end game?"
You know? So you're going to come here
and you're going to study neuroscience
and you're going to maybe get a Ph.D. if you work hard.
And he said,
"You know, I want to be able to solve AI.
"I want to be able to solve intelligence."
HASSABIS: The human brain is the only existent proof
we have, perhaps in the entire universe,
that general intelligence is possible at all.
And I thought someone in this building
should be interested
in general intelligence like I am.
And then Shane's name popped up.
HOST: Our next speaker today is Shane Legg.
He's from New Zealand,
where he trained in math and classical ballet.
Are machines actually becoming more intelligent?
Some people say yes, some people say no.
It's not really clear.
We know they're getting a lot faster
at doing computations.
But are we actually going forwards
in terms of general intelligence?
HASSABIS: We were both obsessed with AGI,
artificial general intelligence.
So today I'm going to be talking about
different approaches to building AGI.
With my colleague Demis Hassabis,
we're looking at ways to bring in ideas
from theoretical neuroscience.
I felt like we were the keepers of a secret
that no one else knew.
Shane and I knew no one in academia
would be supportive of what we were doing.
AI was almost an embarrassing word
to use in academic circles, right?
If you said you were working on AI,
then you clearly weren't a serious scientist.
So I convinced Shane the right way to do it
would be to start a company.
SHANE LEGG: Okay, we're going to try to do
artificial general intelligence.
It may not even be possible.
We're not quite sure how we're going to do it,
but we have some ideas or, kind of, approaches.
Huge amounts of money, huge amounts of risk,
lots and lots of compute.
And if we pull this off,
it'll be the biggest thing ever, right?
That is a very hard thing for a typical investor
to put their money on.
It's almost like buying a lottery ticket.
I'm going to be speaking about the system of neuroscience
and how it might be used to help us build AGI.
HASSABIS: Finding initial funding
for this was very hard.
We're going to solve all of intelligence.
You can imagine some of the looks I got
when we were pitching that around.
So I'm a V.C. and I look at about
700 to 1,000 projects a year.
And I fund literally 1% of those.
About eight projects a year.
So that means 99% of the time, you're in "No" mode.
"Wait a minute. I'm telling you,
"this is the most important thing of all time.
"I'm giving you all this build-up
"about how... explain
"how it connects with the brain,
"why the time's right now, and then you're asking me,
"'But what's your, how are you going to make money?
"'What's your product?'"
It's like, so prosaic a question.
You know?
"Have you not been listening to what I've been saying?"
LEGG: We needed investors
who aren't necessarily going to invest
because they think it's the best
investment decision.
They're probably going to invest
because they just think it's really cool.
NEWSREADER: He's the Silicon Valley
version of the man behind the curtain
inThe Wizard of Oz.
He had a lot to do with giving you
PayPal, Facebook, YouTube and Yelp.
LEGG: If everyone says "X,"
Peter Thiel suspects that the opposite of X
is quite possibly true.
HASSABIS: So Peter Thiel was our first big investor.
But he insisted that we come to Silicon Valley
because that was the only place we could...
There would be the talent,
and we could build that kind of company.
But I was pretty adamant we should be in London
because I think London's an amazing city.
Plus, I knew there were really amazing people
trained at Cambridge and Oxford and UCL.
In Silicon Valley,
everybody's founding a company every year,
and then if it doesn't work,
you chuck it and you start something new.
That is not conducive
to a long-term research challenge.
So we were totally an outlier for him.
Hi, everyone. Welcome to DeepMind.
So, what is our mission?
We summarize it as...
DeepMind's mission is to build the world's first
general learning machine.
So we always stress the word "general" and "learning" here
are the key things.
LEGG: Our mission was to build an AGI,
an artificial general intelligence.
And so that means that we need a system which is general.
It doesn't learn to do one specific thing.
That's a really key part of human intelligence.
We can learn to do many, many things.
It's going to, of course, be a lot of hard work.
But one of the things that keeps me up at night
is to not waste this opportunity to, you know,
to really make a difference here,
and have a big impact on the world.
LEGG: The first people that came
and joined DeepMind really believed in the dream.
But this was, I think, one of the first times
they found a place full of other dreamers.
You know, we collected this Manhattan Project,
if you like, together to solve AI.
HELEN KING: In the first two years,
we were in total stealth mode.
And so we couldn't say to anyone
what were we doing or where we worked.
It was all quite vague.
BEN COPPIN: It had no public presence at all.
You couldn't look at a website.
The office was at a secret location.
When we would interview people in those early days,
they would show up very nervously.
[LAUGHS]
I had at least one candidate who said,
"I just messaged my wife to tell her exactly
"where I'm going just in case
"this turns out to be some kind of horrible scam
"and I'm going to get kidnapped."
Well, my favorite new person who's an investor,
who I've been working for a year, is Elon Musk.
So for those of you who don't know,
this is what he looks like.
And he hadn't really thought much about AI
until we chatted.
His mission is to die on Mars or something.
- But not on impact. - [LAUGHTER]
So...
We made some big decisions
about how we were going to approach building AI.
This is a reinforcement learning setup.
This is the kind of setup that we think about
when we say we're building, you know, an AI agent.
It's basically the agent, which is the AI,
and then there's the environment
that it's interacting with.
We decided that games,
as long as you're very disciplined
about how you use them,
are the perfect training ground
for AI development.
LEGG: We wanted to try to create one algorithm
that could to be trained up to play
several dozen different Atari games.
So just like a human,
you have to use the same brain to play all the games.
DAVID SILVER: You can think of it
that you provide the agent with the cartridge.
And you say,
"Okay, imagine you're born into that world
"with that cartridge, and you just get to interact
"with the pixels and see the score.
"What can you do?"
So what you're going to do is take your Q function. Q-K...
HASSABIS: Q-learning is one of the oldest methods
for reinforcement learning.
And what we did was combine reinforcement learning
with deep learning in one system.
No one had ever combined those two things together
at scale to do anything impressive,
and we needed to prove out this thesis.
LEGG: We tried doingPong as the first game.
It seemed like the simplest.
It hasn't been told
anything about what it's controlling
or what it's supposed to do.
All it knows is that score is good
and it has to learn what its controls do,
and build everything... first principles.
[GAME BEEPING]
It wasn't really working.
HASSABIS: I was just saying to Shane,
"Maybe we're just wrong, and we can't even doPong."
LEGG: It was a bit nerve-racking,
thinking how far we had to go
if we were going to really build
a generally intelligent system.
HASSABIS: And it felt like it was time
to give up and move on.
And then suddenly...
[STIRRING MUSIC PLAYS]
We got our first point.
And then it was like, "Is this random?"
"No, no, it's really getting a point now."
It was really exciting that this thing
that previously couldn't even figure out
how to move a paddle
had suddenly been able to totally get it right.
HASSABIS: Then it was getting a few points.
And then it won its first game.
And then three months later, no human could beat it.
You hadn't told it the rules, how to get the score, nothing.
And you just tell it to maximize the score,
and it goes away and does it.
This is the first time
anyone had done this end-to-end learning.
"Okay, so we have this working in quite a general way.
"Now let's try another game."
HASSABIS: So then we triedBreakout.
At the beginning, after 100 games,
the agent is not very good.
It's missing the ball most of the time,
but it's starting to get the hang of the idea
that the bat should go towards the ball.
Now, after 300 games,
it's about as good as any human can play this.
We thought, "Well, that's pretty cool,"
but we left the system playing for another 200 games,
and it did this amazing thing.
It found the optimal strategy
was to dig a tunnel around the side
and put the ball around the back of the wall.
KORAY KAVUKCUOGLU: Finally, the agent
is actually achieving
what you thought it would achieve.
That is a great feeling. Right?
Like, I mean, when we do research,
that is the best we can hope for.
We started generalizing to 50 games,
and we basically created a recipe.
We could just take a game
that we have never seen before.
We would run the algorithm on that,
and DQN could train itself from scratch,
achieving human level
or sometimes better than human level.
LEGG: We didn't build it to play any of them.
We could just give it a bunch of games
and would figure it out for itself.
And there was something quite magical in that.
MURRAY SHANAHAN: Suddenly you had something
that would respond and learn
whatever situation it was parachuted into.
And that was like a huge, huge breakthrough.
It was in many respects
the first example
of any kind of thing you could call
a general intelligence.
HASSABIS: Although we were a well-funded startup,
holding us back was not enough compute power.
I realized that this would accelerate
our time scale to AGI massively.
I used to see Demis quite frequently.
We'd have lunch, and he did...
say to me that he had two companies
that were involved in buying DeepMind.
And he didn't know which one to go with.
The issue was, would any commercial company
appreciate the real importance of the research?
And give the research time to come to fruition
and not be breathing down their necks,
saying, "We want some kind of commercial benefit from this."
[MACHINERY HUMMING]
Google has bought DeepMind for a reported £400,000,000,
making the artificial intelligence firm
its largest European acquisition so far.
The company was founded
by 37-year-old entrepreneur Demis Hassabis.
After the acquisition, I started mentoring
and spending time with Demis,
and just listening to him.
And this is a person who fundamentally
is a scientist and a natural scientist.
He wants science to solve every problem in the world,
and he believes it can do so.
That's not a normal person you find in a tech company.
HASSABIS: We were able to not only join Google
but run independently in London,
build our culture,
which was optimized for breakthroughs
and not deal with products,
do pure research.
Our investors didn't want to sell,
but we decided
that this was the best thing for the mission.
In many senses, we were underselling
in terms of value before it more matured,
and you could have sold it for a lot more money.
And the reason is because there's no time to waste.
There's so many things that got to be cracked
while the brain is still in gear.
You know, I'm still alive.
There's all these things that gotta be done.
So you haven't got-- I mean, how many...
How many billions would you trade for
another five years of life, you know,
to do what you set out to do?
Okay, all of a sudden,
we've got this massive scale compute available to us.
What can we do with that?
HASSABIS: Go is the pinnacle of board games.
It is the most complex game ever devised by man.
There are more possible board configurations
in the game of Go than there are atoms in the universe.
SILVER: Go is the holy grail of artificial intelligence.
For many years,
people have looked at this game
and they've thought, "Wow, this is just too hard."
Everything we've ever tried in AI,
it just falls over when you try the game of Go.
And so that's why it feels like
a real litmus test of progress.
We had just bought DeepMind.
They were working on reinforcement learning
and they were the world's experts in games.
And so when they introduced the idea
that they could beat the top level Go players
in a game that was thought to be incomputable,
I thought, "Well, that's pretty interesting."
Our ultimate next step is to play the legendary
Lee Sedol in just over two weeks.
NEWSREADER 1: A match like no other
is about to get underway in South Korea.
NEWSREADER 2: Lee Sedol is getting ready to rumble.
HASSABIS: Lee Sedol is probably
one of the greatest players of the last decade.
I describe him as the Roger Federer of Go.
ERIC SCHMIDT: He showed up,
and all of a sudden we have a thousand Koreans
who represent all of Korean society,
the top Go players.
And then we have Demis.
And the great engineering team.
He's very famous
for very creative fighting play.
So this could be difficult for us.
SCHMIDT: I figured Lee Sedol is going to beat these guys,
but they'll make a good showing.
Good for a startup.
I went over to the technical group
and they said,
"Let me show you how our algorithm works."
RESEARCHER: If you step through the actual game,
we can see, kind of, how AlphaGo thinks.
HASSABIS: The way we start off on training AlphaGo
is by showing it 100,000 games
that strong amateurs have played.
And we first initially
get AlphaGo to mimic the human player,
and then through reinforcement learning,
it plays against different versions of itself
many millions of times and learns from its errors.
Hmm, this is interesting.
ANNOUNCER 1: All right, folks,
you're going to see history made.
[ANNOUNCER 2 SPEAKING KOREAN]
SCHMIDT: So the game starts.
ANNOUNCER 1: He's really concentrating.
ANNOUNCER 3: If you really look at the...
[ANNOUNCERS EXCLAIM]
That's a very surprising move.
ANNOUNCER 3: I think we're seeing an original move here.
Yeah, that's an exciting move.
I like...
SILVER: Professional commentators
almost unanimously said
that not a single human player would have chosen move 37.
So I actually had a poke around in AlphaGo
to see what AlphaGo thought.
And AlphaGo actually agreed with that assessment.
AlphaGo said there was a one in 10,000 probability
that move 37 would have been played by a human player.
[SEDOL SPEAKING IN KOREAN]
SILVER: The game of Go has been studied
for thousands of years.
And AlphaGo discovered something completely new.
ANNOUNCER: He resigned. Lee Sedol has just resigned.
He's beaten.
[ELECTRONIC MUSIC PLAYING]
NEWSREADER 1: The battle between man versus machine,
a computer just came out the victor.
NEWSREADER 2: Google put its DeepMind team
to the test against
one of the brightest minds in the world and won.
SCHMIDT: That's when we realized
the DeepMind people knew what they were doing
and to pay attention to reinforcement learning
as they have invented it.
Based on that experience,
AlphaGo got better and better and better.
And they had a little chart
of how much better they were getting.
And I said, "When does this stop?"
And Demis said,
"When we beat the Chinese guy,
"the top-rated player in the world."
ANNOUNCER 1: Ke Jie versus AlphaGo.
ANNOUNCER 2: And I think we will see
AlphaGo pushing through there.
ANNOUNCER 1: AlphaGo is ahead quite a bit.
SCHMIDT: About halfway through the first game,
the best player in the world was not doing so well.
ANNOUNCER 1: What can black do here?
ANNOUNCER 2: Looks difficult.
SCHMIDT: And at a critical moment...
the Chinese government ordered the feed cut off.
It was at that moment we were telling the world
that something new had arrived on earth.
In the 1950s
when Russia'sSputnik satellite was launched,
it changed the course of history.
TV HOST: It is a challenge that America must meet
to survive in the Space Age.
SCHMIDT: This has been called theSputnik moment.
The Sputnikmoment created a massive reaction in the US
in terms of funding for science and engineering,
and particularly of space technology.
For China, AlphaGo was the wakeup call,
the Sputnikmoment.
It launched an AI space race.
HASSABIS: We had this huge idea that worked,
and now the whole world knows.
It's always easier to land on the moon
if someone's already landed there.
It is going to matter who builds AI,
and how it gets built.
I always feel that pressure.
SILVER: There's been a big chain of events
that followed on from all of the excitement of AlphaGo.
When we played against Lee Sedol,
we actually had a system
that had been trained on human data,
on all of the millions of games
that have been played by human experts.
We eventually found a new algorithm,
a much more elegant approach to the whole system,
which actually stripped out all of the human knowledge
and just started completely from scratch.
And that became a project which we called AlphaZero.
Zero, meaning having zero human knowledge in the loop.
Instead of learning from human data,
it learned from its own games.
So it actually became its own teacher.
HASSABIS: AlphaZero is an experiment
in how little knowledge can we put into these systems
and how quickly and how efficiently
can they learn?
But the other thing is AlphaZero doesn't have any rules.
It learns through experience.
The next stage was to make it more general,
so that it could play any two-player game.
Things like chess,
and in fact, any kind of two-player
perfect information game.
It's going really well.
It's going really, really well.
- Oh, wow. - It's going down, like fast.
HASSABIS: AlphaGo used to take a few months to train,
but AlphaZero could start in the morning
playing completely randomly
and then by tea be at superhuman level.
And by dinner it will be the strongest chess entity
there's ever been.
- Amazing, it's amazing. - Yeah.
It's discovered its own attacking style, you know,
to take on the current level of defense.
I mean, I never in my wildest dreams...
I agree. Actually, I was not expecting that either.
And it's fun for me.
I mean, it's inspired me to get back into chess again,
because it's cool to see
that there's even more depth than we thought in chess.
[HORN BLOWS]
HASSABIS: I actually got into AI through games.
Initially, it was board games.
I was thinking, "How is my brain doing this?"
Like, what is it doing?
I was very aware of that from a very young age.
So I've always been thinking about thinking.
NEWSREADER: The British and American chess champions
meet to begin a series of matches.
Playing alongside them are the cream
of Britain and America's youngest players.
NEWSREADER 2: Demis Hassabis is representing Britain.
COSTAS HASSABIS: When Demis was four,
he first showed an aptitude for chess.
By the time he was six,
he became London under-eight champion.
HASSABIS: My parents were very interesting
and unusual, actually.
I'd probably describe them as quite bohemian.
My father was a singer-songwriter
when he was younger,
and Bob Dylan was his hero.
[HORN HONKS]
[ANGELA HASSABIS SPEAKING]
Yeah, yeah.
HOST: What is it that you like about this game?
It's just a good thinking game.
HASSABIS: At the time, I was the second-highest rated
chess player in the world for my age.
But although I was on track
to be a professional chess player,
I thought that was what I was going to do.
No matter how much I loved the game,
it was incredibly stressful.
Definitely was not fun and games for me.
My parents used to, you know,
get very upset when I lost the game
and angry if I forgot something.
And because it was quite high stakes for them, you know,
it cost a lot of money to go to these tournaments.
And my parents didn't have much money.
My parents thought, you know,
"If you interested in being a chess professional,
"this is really important. It's like your exams."
I remember I was about 12-years-old
and I was at this international chess tournament
in Liechtenstein up in the mountains.
[BELL TOLLING]
And we were in this huge church hall
with, you know,
hundreds of international chess players.
And I was playing the ex-Danish champion.
He must have been in his 30s, probably.
In those days, there was a long time limit.
The games could literally last all day.
[YAWNS]
- [TIMER TICKING] - We were into our tenth hour.
[TIMER TICKS FRANTICALLY]
[MOUSE GASPS]
And we were in this incredibly unusual ending.
I think it should be a draw.
But he kept on trying to win for hours.
[HORSE NEIGHS]
Finally, he tried one last cheap trick.
All I had to do was give away my queen.
Then it would be stalemate.
But I was so tired,
I thought it was inevitable I was going to be checkmated.
And so I resigned.
He jumped up. Just started laughing.
[LAUGHING]
And he went,
"Why have you resigned? It's a draw."
And he immediately, with a flourish,
sort of showed me the drawing move.
I felt so sick to my stomach.
It made me think of the rest of that tournament.
Like, are we wasting our minds?
Is this the best use of all this brain power?
Everybody's, collectively, in that building?
If you could somehow plug in
those 300 brains into a system,
you might be able to solve cancer
with that level of brain power.
This intuitive feeling came over me
that although I love chess,
this is not the right thing to spend my whole life on.
LEGG: Demis and myself,
our plan was always to fill DeepMind
with some of the most
brilliant scientists in the world.
So we had the human brains
necessary to create an AGI system.
By definition, the "G" in AGI is about generality.
What I imagine is being able to talk to an agent,
the agent can talk back,
and the agent is able to solve novel problems
that it hasn't seen before.
That's a really key part of human intelligence,
and it's that cognitive breadth
and flexibility that's incredible.
The only natural general intelligence
we know of as humans,
we obviously learn a lot from our environment.
So we think that simulated environments
are one of the ways to create an AGI.
SIMON CARTER: The very early humans
were having to solve logic problems.
They were having to solve navigation, memory,
and we evolved in that environment.
If we can create a virtual recreation
of that kind of environment,
that's the perfect testing ground
and training ground
for everything we do at DeepMind.
GUY SIMMONS: What they were doing here
was creating environments for childlike beings,
the agents to exist within and play.
That just sounded like
the most interesting thing in all the world.
SHANAHAN: A child learns by tearing things up
and then throwing food around
and getting a response from mommy or daddy.
This seems like an important idea to incorporate
in the way you train an agent.
RESEARCHER 1: The humanoid is supposed to stand up.
As his center of gravity rises,
it gets more points.
You have a reward
and the agent learns from the reward,
like, you do something well, you get a positive reward.
You do something bad, you get a negative reward.
RESEARCHER 2: [EXCLAIMS] It looks like it's standing.
It's still a bit drunk.
RESEARCHER 1: It likes to walk backwards.
RESEARCHER 2: [CHUCKLES] Yeah.
The whole algorithm is trying to optimize
for receiving as much rewards as possible,
and it's found that walking backwards,
it's good enough to get very good scores.
RAIA HADSELL: When we learn to navigate,
when we learn to get around in our world,
we don't start with maps.
We just start with our own exploration,
adventuring off across the park,
without our parents by our side,
or finding our way home from school when we're young.
[FAST ELECTRONIC MUSIC PLAYING]
HADSELL: A few of us came up with this idea
that if we had an environment where a simulated robot
just had to run forward,
we could put all sorts of obstacles in its way
and see if it could manage to navigate
different types of terrain.
The idea would be like a parkour challenge.
It's not graceful,
but was never trained to hold a glass whilst it was running
and not spill water.
You set this objective that says,
"Just move forward, forward velocity,
"and you'll get a reward for that."
And the learning algorithm figures out
how to move this complex set of joints.
That's the power of
reward-based reinforcement learning.
SILVER: Our goal is to try and build agents
which, we drop them in, they know nothing,
they get to play around in whatever problem you give them
and eventually figure out how to solve it for themselves.
Now we want something which can do that
in as many different types of problems as possible.
A human needs diverse skills to interact with the world.
How to deal with complex images,
how to manipulate thousands of things at once,
how to deal with missing information.
We think all of these things together
are represented by this game calledStarCraft.
All it's being trained to do is,
given this situation, this screen,
what would a human do?
We took inspiration from large language models
where you simply train a model
to predict the next word,
which is exactly the same as
predict the next StarCraft move.
SILVER: Unlike chess or Go,
where players take turns to make moves,
inStarCraft there's a continuous flow of decisions.
On top of that,
you can't even see what the opponent is doing.
There is no longer a clear definition
of what it means to play the best way.
It depends on what your opponent does.
HADSELL: This is the way that we'll get to
a much more fluid,
more natural, faster, more reactive agent.
ORIOL VINYALS: This is a huge challenge
and let's see how far we can push.
TIM LILLICRAP: Oh!
Holy monkey!
I'm a pretty low-level amateur.
I'm okay, but I'm a pretty low-level amateur.
These agents have a long ways to go.
HASSABIS: We couldn't beat someone of Tim's level.
You know, that was a little bit alarming.
LILLICRAP: At that point, it felt like
it was going to be, like, a really big long challenge,
maybe a couple of years.
VINYALS: Dani is the best DeepMind StarCraft 2 player.
I've been playing the agent every day for a few weeks now.
I could feel that the agent
was getting better really fast.
[CHEERING, LAUGHTER]
Wow, we beat Danny. That, for me,
was already like a huge achievement.
HASSABIS: The next step is
we're going to book in a pro to play.
[KEYBOARD TAPPING]
[GROANS]
[CHEERING, WHOOPING]
- [LAUGHS] - [PEOPLE CLAPPING]
It feels a bit unfair. All you guys against me.
[ALL LAUGH]
HASSABIS: We're way ahead of what I thought
we would do, given where we were two months ago.
Just trying to digest it all, actually.
But it's very, very cool.
SILVER: Now we're in a position where
we can finally share the work that we've done
with the public.
This is a big step.
We are really putting ourselves on the line here.
- Take it away. Cheers. - Thank you.
We're going to be live from London.
It's happening.
ANNOUNCER 1: Welcome to London.
We are going to have a live exhibition match,
MaNa against AlphaStar.
[CHEERING, APPLAUSE]
At this point now,
AlphaStar, 10 and 0 against professional gamers.
Any thoughts before we get into this game?
VINYALS: I just want to see a good game, yeah.
I want to see a good game.
SILVER: Absolutely, good game. We're all excited.
ANNOUNCER: All right. Let's see what MaNa can pull off.
ANNOUNCER 2: AlphaStar is definitely
dominating the pace of this game.
[SPORADIC CHEERING]
ANNOUNCER 1: Wow. AlphaStar is playing so smartly.
[LAUGHTER]
This really looks like I'm watching
a professional human gamer
from the AlphaStar point of view.
[KEYBOARD TAPPING]
HASSABIS: I hadn't really seen a pro playStarCraft up close,
and the 800 clicks per minute.
I don't understand how anyone can even click 800 times,
let alone doing 800 useful clicks.
ANNOUNCER 1: Oh, another good hit.
- [ALL GROAN] - AlphaStar is just
completely relentless.
SILVER: We need to be careful
because many of us grew up as gamers and are gamers.
And so to us, it's very natural
to view games as what they are,
which is pure vehicles for fun,
and not to see that more militaristic side
that the public might see if they looked at this.
You can't look at gunpowder and only make a firecracker.
All technologies inherently point into certain directions.
MARGARET LEVI: I'm very worried about
the certain ways in which AI
will be used for military purposes.
And that makes it even clearer how important it is
for our societies to be in control
of these new technologies.
The potential for abuse from AI will be significant.
Wars that occur faster than humans can comprehend
and more powerful surveillance.
How do you keep power forever
over something that's much more powerful than you?
[STEPHEN HAWKING SPEAKING]
Technologies can be used to do terrible things.
And technology can be used to do wonderful things
and solve all kinds of problems.
When DeepMind was acquired by Google...
- Yeah. - ...you got Google to promise
that technology you developed won't be used by the military
- for surveillance. - Right.
- Yes. - Tell us about that.
I think technology is neutral in itself,
um, but how, you know, we as a society
or humans and companies and other things,
other entities and governments decide to use it
is what determines whether things become good or bad.
You know, I personally think having autonomous weaponry
is just a very bad idea.
ANNOUNCER 1: AlphaStar is playing
an extremely intelligent game right now.
CUKIER: There is an element to what's being created
at DeepMind in London
that does seem like the Manhattan Project.
There's a relationship between Robert Oppenheimer
and Demis Hassabis
in which they're unleashing a new force upon humanity.
ANNOUNCER 1: MaNa is fighting back, though.
Oh, man!
HASSABIS: I think that Oppenheimer
and some of the other leaders of that project got caught up
in the excitement of building the technology
and seeing if it was possible.
ANNOUNCER 1: Where is AlphaStar?
I don't see AlphaStar's units anywhere.
HASSABIS: They did not think carefully enough
about the morals of what they were doing early enough.
What we should do as scientists
with powerful new technologies
is try and understand it in controlled conditions first.
ANNOUNCER 1: And that is that.
MaNa has defeated AlphaStar.
I mean, my honest feeling is that I think it is
a fair representation of where we are.
And I think that part feels... feels okay.
- I'm very happy for you. - I'm happy.
So well... well done.
My view is that the approach to building technology
which is embodied by move fast and break things,
is exactly what we should not be doing,
because you can't afford to break things
and then fix them afterwards.
- Cheers. - Thank you so much.
Yeah, get... get some rest. You did really well.
- Cheers, yeah? - Thank you for having us.
[ELECTRONIC MUSIC PLAYING]
HASSABIS: When I was eight,
I bought my first computer
with the winnings from a chess tournament.
I sort of had this intuition
that computers are this magical device
that can extend the power of the mind.
I had a couple of school friends,
and we used to have a hacking club,
writing code, making games.
And then over the summer holidays,
I'd spend the whole day
flicking through games magazines.
And one day I noticed there was a competition
to write an original version of Space Invaders.
And the winner won a job at Bullfrog.
Bullfrog at the time was the best game development house
in all of Europe.
You know, I really wanted to work at this place
and see how they build games.
NEWSCASTER: Bullfrog, based here in Guildford,
began with a big idea.
That idea turned into the game Populous,
which became a global bestseller.
In the '90s, there was no recruitment agencies.
You couldn't go out and say, you know,
"Come and work in the games industry."
It was still not even considered an industry.
So we came up with the idea to have a competition
and we got a lot of applicants.
And one of those was Demis's.
I can still remember clearly
the day that Demis came in.
He walked in the door, he looked about 12.
I thought, "Oh, my God,
"what the hell are we going to do with this guy?"
I applied to Cambridge.
I got in but they said I was way too young.
So... So I needed to take a year off
so I'd be at least 17 before I got there.
And that's when I decided to spend that entire gap year
working at Bullfrog.
They couldn't even legally employ me,
so I ended up being paid in brown paper envelopes.
[CHUCKLES]
I got a feeling of being really at the cutting edge
and how much fun that was to invent things every day.
And then you know, a few months later,
maybe everyone... a million people will be playing it.
MOLYNEUX: In those days computer games had to evolve.
There had to be new genres
which were more than just shooting things.
Wouldn't it be amazing to have a game
where you design and build your own theme park?
[GAME CHARACTERS SCREAMING]
Demis and I started to talk aboutTheme Park.
It allows the player to build a world
and see the consequences of your choices
that you've made in that world.
HASSABIS: A human player set out the layout
of the theme park and designed the roller coaster
and set the prices in the chip shop.
What I was working on was the behaviors of the people.
They were autonomous
and that was the AI in this case.
So what I was trying to do was mimic
interesting human behavior
so that the simulation would be
more interesting to interact with.
MOLYNEUX: Demis worked on ridiculous things,
like you could place down these shops
and if you put a shop too near a very dangerous ride,
then people on the ride would throw up
because they'd just eaten.
And then that would make other people throw up
when they saw the throwing-up on the floor,
so you then had to have lots of sweepers
to quickly sweep it up before the people saw it.
That's the cool thing about it.
You as the player tinker with it and then it reacts to you.
MOLYNEUX: All those nuanced simulation things he did
and that was an invention
which never really existed before.
It was unbelievably successful.
DAVID GARDNER: Theme Park actually turned out
to be a top ten title
and that was the first time we were starting to see
how AI could make a difference.
[BRASS BAND PLAYING]
CARTER: We were doing some Christmas shopping
and were waiting for the taxi to take us home.
I have this very clear memory of Demis talking about AI
in a very different way,
in a way that we didn't commonly talk about.
This idea of AI being useful for other things
other than entertainment.
So being useful for, um, helping the world
and the potential of AI to change the world.
I just said to Demis, "What is it you want to do?"
And he said to me,
"I want to be the person that solves AI."
HASSABIS: Peter offered me £1 million
to not go to university.
But I had a plan from the beginning.
And my plan was always to go to Cambridge.
I think a lot of my schoolfriends
thought I was mad.
Why would you not...
I mean, £1 million, that's a lot of money.
In the '90s, that is a lot of money, right?
For a... For a poor 17-year-old kid.
He's like this little seed that's going to burst through,
and he's not going to be able to do that at Bullfrog.
I had to drop him off at the train station
and I can still see that picture
of this little elven character disappear down that tunnel.
That was an incredibly sad moment.
HASSABIS: I had this romantic ideal
of what Cambridge would be like,
1,000 years of history,
walking the same streets that Turing,
Newton and Crick had walked.
I wanted to explore the edge of the universe.
[CHURCH BELLS TOLLING]
When I got to Cambridge,
I'd basically been working my whole life.
Every single summer,
I was either playing chess professionally,
or I was working, doing an internship.
So I was, like, "Right, I am gonna have fun now
"and explore what it means to be a normal teenager."
[PEOPLE CHEERING, LAUGHING]
Come on! Go, boy, go!
TIM STEVENS: It was work hard and play hard.
[ALL SINGING]
I first met Demis
because we both attended Queens' College.
Our group of friends,
we'd often drink beer in the bar,
play table football.
HASSABIS: In the bar, I used to play speed chess,
pieces flying off the board,
you know, the whole game in one minute.
Demis sat down opposite me.
And I looked at him and I thought,
"I remember you from when we were kids."
HASSABIS: I had actually been in the same chess tournament
as Dave in Ipswich,
where I used to go and try and raid his local chess club
to win a bit of prize money.
COPPIN: We were studying computer science.
Some people, who at the age of 17
would have come in and made sure to tell everybody
everything about themselves.
"Hey, I worked at Bullfrog
"and built the world's most successful video game."
But he wasn't like that at all.
SILVER: At Cambridge, Demis and myself
both had an interest in computational neuroscience
and trying to understand how computers and brains
intertwined and linked together.
JOHN DAUGMAN: Both David and Demis
came to me for supervisions.
It happens just by coincidence that the year 1997,
their third and final year at Cambridge,
was also the year when the first chess grandmaster
was beaten by a computer program.
[CAMERA SHUTTERS CLICKING]
NEWSCASTER: Round one today of a chess match
between the ranking world champion Garry Kasparov
and an opponent named Deep Blue
to test to see if the human brain can outwit a machine.
HASSABIS: I remember the drama
of Kasparov losing the last match.
NEWSCASTER 2: Whoa!
Kasparov has resigned!
When Deep Blue beat Garry Kasparov,
that was a real watershed event.
HASSABIS: My main memory of it was
I wasn't that impressed with Deep Blue.
I was more impressed with Kasparov's mind.
That he could play chess to this level,
where he could compete on an equal footing
with the brute of a machine,
but of course, Kasparov can do
everything else humans can do, too.
It was a huge achievement.
But the truth of the matter was,
Deep Blue could only play chess.
What we would regard as intelligence
was missing from that system.
This idea of generality and also learning.
Cambridge was amazing, because of course, you know,
you're mixing with people
who are studying many different subjects.
SILVER: There were scientists, philosophers, artists...
STEVENS: ...geologists, biologists, ecologists.
You know, everybody is talking about everything all the time.
I was obsessed with the protein folding problem.
HASSABIS: Tim Stevens used to talk obsessively,
almost like religiously about this problem,
protein folding problem.
STEVENS: Proteins are, you know,
one of the most beautiful and elegant things about biology.
They are the machines of life.
They build everything, they control everything,
they're why biology works.
Proteins are made from strings of amino acids
that fold up to create a protein structure.
If we can predict the structure of proteins
from just their amino acid sequences,
then a new protein to cure cancer
or break down plastic to help the environment
is definitely something
that you could begin to think about.
I kind of thought,
"Well, is a human being clever enough
"to actually fold a protein?"
We can't work it out.
JOHN MOULT: Since the 1960s,
we thought that in principle,
if I know what the amino acid sequence of a protein is,
I should be able to compute what the structure's like.
So, if you could just press a button,
and they'd all come popping out, that would be...
that would have some impact.
HASSABIS: It stuck in my mind.
"Oh, this is a very interesting problem."
And it felt to me like it would be solvable.
But I thought it would need AI to do it.
If we could just solve protein folding,
it could change the world.
HASSABIS: Ever since I was a student at Cambridge,
I've never stopped thinking about
the protein folding problem.
If you were to solve protein folding,
then the potential to help solve problems like
Alzheimer's, dementia and drug discovery is huge.
Solving disease is probably
the most major impact we could have.
[CLICKS MOUSE]
Thousands of very smart people
have tried to solve protein folding.
I just think now is the right time
for AI to crack it.
[THRILLING MUSIC PLAYING]
[INDISTINCT CONVERSATION]
RICHARD EVANS: We needed a reasonable way
to apply machine learning
to the protein folding problem.
[CLICKING MOUSE]
We came across this Foldit game.
The goal is to move around this 3D model of a protein
and you get a score every time you move it.
The more accurate you make these structures,
the more useful they will be to biologists.
I spent a few days
just kind of seeing how well we could do.
[GAME DINGING]
We did reasonably well.
But even if you were
the world's best Foldit player,
you wouldn't solve protein folding.
That's why we had to move beyond the game.
HASSABIS: Games are always just
the proving ground for our algorithms.
The ultimate goal was not just to crack Go and StarCraft.
It was to crack real-world challenges.
[THRILLING MUSIC CONTINUES]
JOHN JUMPER: I remember hearing this rumor
that Demis was getting into proteins.
I talked to some people at DeepMind and I would ask,
"So are you doing protein folding?"
And they would artfully change the subject.
And when that happened twice, I pretty much figured it out.
So I thought I should submit a resume.
HASSABIS: All right, everyone, welcome to DeepMind.
I know some of you, this may be your first week,
but I hope you all set...
JUMPER: The really appealing part for me about the job
was this, like, sense of connection
to the larger purpose.
HASSABIS: If we can crack
some fundamental problems in science,
many other people
and other companies and labs and so on
could build on top of our work.
This is your chance now
to add your chapter to this story.
JUMPER: When I arrived,
I was definitely[CHUCKLES] quite a bit nervous.
I'm still trying to keep...
I haven't taken any biology courses.
We haven't spent years of our lives
looking at these structures and understanding them.
We are just going off the data
and our machine learning models.
JUMPER: In machine learning,
you train a network like flashcards.
Here's the question. Here's the answer.
But in protein folding,
we're not doing the kind of standard task at DeepMind
where you have unlimited data.
Your job is to get better at chess or Go
and you can play as many games of chess or Go
as your computers will allow.
With proteins,
we're sitting on a very thick size of data
that's been determined by a half century
of time-consuming experimental methods in laboratories.
These painstaking methods can take months or years
to determine a single protein structure,
and sometimes, a structure can never be determined.
[TYPING]
That's why we're working with such small datasets
to train our algorithms.
EWAN BIRNEY: When DeepMind started to explore
the folding problem,
they were talking to us about which datasets they were using
and what would be the possibilities
if they did solve this problem.
Many people have tried,
and yet no one on the planet has solved protein folding.
[CHUCKLES] I did think to myself,
"Well, you know, good luck."
JUMPER: If we can solve the protein folding problem,
it would have an incredible kind of medical relevance.
HASSABIS: This is the cycle of science.
You do a huge amount of exploration,
and then you go into exploitation mode,
and you focus and you see
how good are those ideas, really?
And there's nothing better
than external competition for that.
So we decided to enter CASP competition.
CASP, we started to try and speed up
the solution to the protein folding problem.
CASP is when we say,
"Look, DeepMind is doing protein folding,
"this is how good we are,
"and maybe it's better than everybody else.
"Maybe it isn't."
CASP is a bit like
the Olympic Games of protein folding.
CASP is a community-wide assessment
that's held every two years.
Teams are given
the amino acid sequences of about 100 proteins,
and then they try to solve this folding problem
using computational methods.
These proteins have already been determined
by experiments in a laboratory,
but have not yet been revealed publicly.
And these known structures
represent the gold standard against which
all the computational predictions will be compared.
MOULT: We've got a score
that measures the accuracy of the predictions.
And you would expect a score of over 90
to be a solution to the protein folding problem.
[INDISTINCT CHATTER]
MAN: Welcome, everyone,
to our first, uh, semifinals in the winners' bracket.
Nick and John versus Demis and Frank.
Please join us, come around. This will be an intense match.
STEVENS: When I learned that Demis was
going to tackle the protein folding issue,
um, I wasn't at all surprised.
It's very typical of Demis.
You know, he loves competition.
And that's the end
- of the first game, 10-7. - [ALL CHEERING]
HASSABIS: The aim for CASP would be
to not just win the competition,
but sort of, um, retire the need for it.
So, 20 targets total have been released by CASP.
JUMPER: We were thinking maybe
throw in the standard kind of machine learning
and see how far that could take us.
Instead of having a couple of days on an experiment,
we can turn around five experiments a day.
Great. Well done, everyone.
[TYPING]
Can you show me the real one instead of ours?
MAN 1: The true answer is
supposed to look something like that.
MAN 2: It's a lot more cylindrical than I thought.
JUMPER: The results were not very good.
Okay.
JUMPER: We throw all the obvious ideas to it
and the problem laughs at you.
This makes no sense.
EVANS: We thought we could just throw
some of our best algorithms at the problem.
We were slightly naive.
JUMPER: We should be learning this,
you know, in the blink of an eye.
The thing I'm worried about is,
we take the field from
really bad answers to moderately bad answers.
I feel like we need some sort of new technology
for moving around these things.
[THRILLING MUSIC CONTINUES]
HASSABIS: With only a week left of CASP,
it's now a sprint to get it deployed.
[MUSIC FADES]
You've done your best.
Then there's nothing more you can do
but wait for CASP to deliver the results.
[HOPEFUL MUSIC PLAYING]
This famous thing of Einstein,
the last couple of years of his life,
when he was here, he overlapped with Kurt Godel
and he said one of the reasons he still comes in to work
is so that he gets to walk home
and discuss things with Godel.
It's a pretty big compliment for Kurt Godel,
shows you how amazing he was.
MAN: The Institute for Advanced Study
was formed in 1933.
In the early years,
the intense scientific atmosphere attracted
some of the most brilliant mathematicians and physicists
ever concentrated in a single place and time.
HASSABIS: The founding principle of this place,
it's the idea of unfettered intellectual pursuits,
even if you don't know what you're exploring.
Will result in some cool things,
and sometimes that then ends up being useful,
which, of course,
is partially what I've been trying to do at DeepMind.
How many big breakthroughs do you think are required
to get all the way to AGI?
And, you know, I estimate maybe
there's about a dozen of those.
You know, I hope it's within my lifetime.
- Yes, okay. - HASSABIS: But then,
all scientists hope that, right?
EMCEE: Demis has many accolades.
He was elected Fellow to the Royal Society last year.
He is also a Fellow of Royal Society of Arts.
A big hand for Demis Hassabis.
[MUSIC FADES]
HASSABIS: My dream has always been to try
and make AI-assisted science possible.
And what I think is
our most exciting project, last year,
which is our work in protein folding.
Uh, and we call this system AlphaFold.
We entered it into CASP and our system, uh,
was the most accurate, uh, predicting structures
for 25 out of the 43 proteins in the hardest category.
So we're state of the art,
but we still... I have to make... Be clear,
we're still a long way from
solving the protein folding problem.
We're working hard on this, though,
and we're exploring many other techniques.
[SOMBER MUSIC PLAYING]
Let's get started.
JUMPER: So kind of a rapid debrief,
these are our final rankings for CASP.
HASSABIS: We beat the second team
in this competition by nearly 50%,
but we've still got a long way to go
before we've solved the protein folding problem
in a sense that a biologist could use it.
JUMPER: It is area of concern.
JANET THORNTON: The quality of predictions varied
and they were no more useful than the previous methods.
PAUL NURSE: AlphaFold didn't produce good enough data
for it to be useful in a practical way
to, say, somebody like me
investigating my own biological problems.
JUMPER: That was kind of a humbling moment
'cause we thought we'd worked very hard and succeeded.
And what we'd found is we were the best in the world
at a problem the world's not good at.
We knew we sucked.
[INDISTINCT CHATTER]
JUMPER: It doesn't help if you have the tallest ladder
when you're going to the moon.
HASSABIS: The opinion of quite a few people on the team,
that this is sort of a fool's errand in some ways.
And I might have been wrong with protein folding.
Maybe it's too hard still
for where we're at generally with AI.
If you want to do biological research,
you have to be prepared to fail
because biology is very complicated.
I've run a laboratory for nearly 50 years,
and half my time,
I'm just an amateur psychiatrist
to keep, um, my colleagues cheerful when nothing works.
And quite a lot of the time and I mean, 80, 90%,
it does not work.
If you are at the forefront of science,
I can tell you, you will fail a great deal.
[CLICKS MOUSE]
HASSABIS: I just felt disappointed.
Lesson I learned is that ambition is a good thing,
but you need to get the timing right.
There's no point being 50 years ahead of your time.
You will never survive
fifty years of that kind of endeavor
before it yields something.
You'll literally die trying.
[TENSE MUSIC PLAYING]
CUKIER: When we talk about AGI,
the holy grail of artificial intelligence,
it becomes really difficult
to know what we're even talking about.
HASSABIS: Which bits are we gonna see today?
MAN: We're going to start in the garden.
[MACHINE BEEPS]
This is the garden looking from the observation area.
Research scientists and engineers
can analyze and collaborate and evaluate
what's going on in real time.
CUKIER: So in the 1800s,
we'd think of things like television and the submarine
or a rocket ship to the moon
and say these things are impossible.
Yet Jules Verne wrote about them and,
a century and a half later, they happened.
HASSABIS: We'll be experimenting
on civilizations really,
civilizations of AI agents.
Once the experiments start going,
it's going to be the most exciting thing ever.
- So how will we get sleep? - [MAN LAUGHS]
I won't be able to sleep.
LEGG: Full AGI will be able to do
any cognitive task a person can do.
It will be at a scale, potentially, far beyond that.
STUART RUSSELL: It's really impossible for us
to imagine the outputs of a superintelligent entity.
It's like asking a gorilla to imagine, you know,
what Einstein does
when he produces the theory of relativity.
LEGG: People often ask me these questions like,
"What happens if you're wrong, and AGI is quite far away?"
And I'm like, I never worry about that.
I actually worry about the reverse.
I actually worry that it's coming faster
than we can really prepare for.
[ROBOTIC ARM WHIRRING]
HADSELL: It really feels like we're in a race to AGI.
The prototypes and the models that we are developing now
are actually transforming
the space of what we know about intelligence.
[WHIRRING]
LEGG: Recently, we've had agents
that are powerful enough
to actually start playing games in teams,
then competing against other teams.
We're seeing co-operative social dynamics
coming out of agents
where we haven't pre-programmed in
any of these sorts of dynamics.
It's completely learned from their own experiences.
When we started, we thought we were
out to build an intelligence system
and convince the world that we'd done it.
We're now starting to wonder whether
we're gonna build systems
that we're not convinced are fully intelligent,
and we're trying to convince the world that they're not.
[CHUCKLES]
[CELL PHONE DINGS]
Hi, Alpha.
ALPHA: Hello there.
LOVE: Where are we today?
You're at the Museum of Modern Art in New York City.
Kind of. Um, what painting is this?
This isThe Creation of Adam by Michelangelo.
I don't think that painting is in New York City.
You are right. It's in the Vatican City.
LOVE: Do you think that's where we are?
ALPHA: No.
LOVE: Then how am I looking at this?
ALPHA: You're looking at
a digital copy of the painting.
Yes.
MAN 1: Who lives in this house?
[EXCITING MUSIC PLAYING]
ALPHA: An astronaut.
What's this astronaut's name?
ALPHA: His name is Mark.
This is a famous equation by Albert Einstein.
It shows that energy and mass are equivalent.
How would you explain it to a five year old?
ALPHA: Well, imagine you have a big rock,
and you want to know how much it weighs.
MAN 2: Is Mark in danger?
ALPHA: No. Mark is not in danger.
Why is that?
ALPHA: Because the dinosaur is not real.
[MEN CHUCKLING]
LOVE: All right.
Why could you not answer my question?
ALPHA: I think I couldn't answer your question
because I don't know enough about the subject.
Okay.
How could you learn more about the subject?
ALPHA: I can learn more about the subject
by reading books, articles, and websites.
You can teach me.
HASSABIS: My conclusion is,
if you now think about what we're doing,
is learning from all humans,
all their knowledge at once put on the Internet,
you would actually know a lot about the world.
Like a significant portion of everything humans can do.
And now, I think it's more like,
"Well, it might just work."
This is a big moment.
Who is this?
ALPHA: This is God reaching out to Adam.
RUSSELL: The advent of AGI
will divide human history into two parts.
The part up to that point and the part after that point.
LOVE: Why is he reaching out to touch Adam?
ALPHA: God is reaching out to touch Adam
to give him life.
RUSSELL: It will give us a tool
that can completely reinvent our entire civilization.
LOVE: What does this painting mean to you?
ALPHA: The painting means a lot to me.
Okay. Like what?
[MUSIC FADES]
ALPHA: I think the painting is a reminder
that we are all connected to each other
and that we are all part of something
bigger than ourselves.
That's pretty nice.
LEGG: When you cross that barrier of
"AGI might happen one day in the future"
to "No, actually, this could really happen in a time frame
"that is sort of, like, on my watch, you know,"
something changes in your thinking.
MAN: ...learned to orient itself by looking...
HASSABIS: We have to be careful with how we use it
and thoughtful about how we deploy it.
[GRIPPING MUSIC BUILDING]
HASSABIS: You'd have to consider
what's its top level goal.
If it's to keep humans happy,
which set of humans? What does happiness mean?
A lot of our collective goals are very tricky,
even for humans to figure out.
CUKIER: Technology always embeds our values.
It's not just technical, it's ethical as well.
So we've got to be really cautious
about what we're building into it.
MAN: We're trying to find a single algorithm which...
SILVER: The reality is that this is an algorithm
that has been created by people, by us.
You know, what does it mean to endow our agents
with the same kind of values that we hold dear?
What is the purpose of making these AI systems
appear so humanlike
so that they do capture hearts and minds
because they're kind of
exploiting a human vulnerability also?
The heart and mind of these systems
are very much human-generated data...
WOMAN: Mmm-hmm.
...for all the good and the bad.
LEVI: There is a parallel
between the Industrial Revolution,
which was an incredible moment of displacement
and the current technological change created by AI.
[CHANTING] Pause AI!
LEVI: We have to think about who's displaced
and how we're going to support them.
This technology is coming a lot sooner,
uh, than really the world knows or kind of
even we 18, 24 months ago thought.
So there's a tremendous opportunity,
tremendous excitement,
but also tremendous responsibility.
It's happening so fast.
How will we govern it?
How will we decide
what is okay and what is not okay?
AI-generated images are getting more sophisticated.
RUSSELL: The use of AI for generating disinformation
and manipulating human psychology
is only going to get much, much worse.
LEGG: AGI is coming,
whether we do it here at DeepMind or not.
CUKIER: It's gonna happen,
so we better create institutions to protect us.
It's gonna require global coordination.
And I worry that humanity is
increasingly getting worse at that rather than better.
LEGG: We need a lot more people
really taking this seriously and thinking about this.
It's, yeah, it's serious. It worries me.
It worries me. Yeah.
RUSSELL: If you received an email saying
this superior alien civilization
is going to arrive on Earth,
there would be emergency meetings
of all the governments.
We would go into overdrive
trying to figure out how to prepare.
- [MUSIC FADES] - [BELL TOLLING FAINTLY]
The arrival of AGI will be
the most important moment that we have ever faced.
[BELL CONTINUES TOLLING FAINTLY]
HASSABIS: My dream was that on the way to AGI,
we would create revolutionary technologies
that would be of use to humanity.
That's what I wanted with AlphaFold.
I think it's more important than ever
that we should solve the protein folding problem.
This is gonna be really hard,
but I won't give up until it's done.
You know, we need to double down
and go as fast as possible from here.
I think we've got no time to lose.
So we are going to make a protein folding strike team.
Team lead for the strike team will be John.
Yeah, we've seen Alpha...
You know, we're gonna try everything,
kitchen sink, the whole lot.
CASP14 is about
proving we can solve the whole problem.
And I felt that to do that,
we would need to incorporate some domain knowledge.
[EXCITING MUSIC PLAYING]
We had some fantastic engineers on it,
but they were not trained in biology.
KATHRYN TUNYASUVUNAKOOL: As a computational biologist,
when I initially joined the AlphaFold team,
I didn't immediately feel confident about anything.
[CHUCKLES] You know,
whether we were gonna be successful.
Biology is so ridiculously complicated.
It just felt like this very far-off mountain to climb.
MAN: I'm starting to play with the underlying temperatures
to see if we can get...
As one of the few people on the team
who's done work in biology before,
you feel this huge sense of responsibility.
"We're expecting you to do
"great things on this strike team."
That's terrifying.
But one of the reasons why I wanted to come here
was to do something that matters.
This is the number of missing things.
What about making use
of whatever understanding you have of physics?
Using that as a source of data?
But if it's systematic...
Then, that can't be right, though.
If it's systematically wrong in some weird way,
you might be learning that systematically wrong physics.
The team is already
trying to think of multiple ways that...
TUNYASUVUNAKOOL: Biological relevance
is what we're going for.
So we rewrote the whole data pipeline
that AlphaFold uses to learn.
HASSABIS: You can't force the creative phase.
You have to give it space for those flowers to bloom.
We won CASP.
Then it was back to the drawing board
and like, what are our new ideas?
Um, and then it's taken a little while, I would say,
for them to get back to where they were,
but with the new ideas.
And then now I think
we're seeing the benefits of the new ideas.
They can go further, right?
So, um, that's a really important moment.
I've seen that moment so many times now,
but I know what that means now.
And I know this is the time now to press.
[EXCITING MUSIC CONTINUES]
JUMPER: Adding side-chains improves direct folding.
That drove a lot of the progress.
- We'll talk about that. - Great.
The last four months, we've made enormous gains.
EVANS: During CASP13,
it would take us a day or two to fold one of the proteins,
and now we're folding, like,
hundreds of thousands a second.
Yeah, it's just insane. [CHUCKLES]
KAVUKCUOGLU: Now, this is a model
that is orders of magnitude faster,
while at the same time being better.
We're getting a lot of structures
into the high-accuracy regime.
We're rapidly improving to a system
that is starting to really
get at the core and heart of the problem.
HASSABIS: It's great work.
It looks like we're in good shape.
So we got, what, six, five weeks left? Six weeks?
So what's, uh... Is it... You got enough compute power?
MAN: I... We could use more.
[ALL LAUGHING]
TUNYASUVUNAKOOL: I was nervous about CASP
but as the system is starting to come together,
I don't feel as nervous.
I feel like things have, sort of,
come into perspective recently,
and, you know, it's gonna be fine.
NEWSCASTER: The Prime Minister has announced
the most drastic limits to our lives
the U.K. has ever seen in living memory.
BORIS JOHNSON: I must give the British people
a very simple instruction.
You must stay at home.
HASSABIS: It feels like we're in a science fiction novel.
You know, I'm delivering food to my parents,
making sure they stay isolated and safe.
I think it just highlights the incredible need
for AI-assisted science.
TUNYASUVUNAKOOL: You always know that
something like this is a possibility.
But nobody ever really believes it's gonna happen
in their lifetime, though.
[COMPUTER BEEPS]
- JUMPER: Are you recording yet? - RESEARCHER: Yes.
- Okay, morning, all. - Hey.
Good. CASP has started.
It's nice I get to sit around in my pajama bottoms all day.
TUNYASUVUNAKOOL: I never thought I'd live in a house
where so much was going on.
I would be trying to solve protein folding in one room,
and my husband would be trying
to make robots walk in the other.
[EXHALES]
One of the hardest proteins we've gotten in CASP thus far
is the SARS-CoV-2 protein
called ORF8.
ORF8 is a coronavirus protein.
It's one of the main proteins, um,
that dampens the immune system.
TUNYASUVUNAKOOL: We tried really hard
to improve our prediction.
Like, really, really hard.
Probably the most time that we have ever spent
on a single target.
To the point where my husband is, like,
"It's midnight. You need to go to bed."
So I think we're at Day 102 since lockdown.
My daughter is keeping a journal.
Now you can go out as much as you want.
JUMPER: We have received the last target.
They've said they will be sending out no more targets
in our category of CASP.
So we're just making sure
we get the best possible answer.
MOULT: As soon as we started to get the results,
I'd sit down and start looking at how close did anybody come
to getting the protein structures correct.
[ROBOT SQUEAKING]
[INCOMING CALL BEEPING]
- Oh, hi there. - MAN: Hello.
[ALL CHUCKLING]
It is an unbelievable thing, CASP has finally ended.
I think it's at least time to raise a glass.
Um, I don't know if everyone has a glass
of something that they can raise.
If not, raise, I don't know, your laptops.
- Um... - [LAUGHTER]
I'll probably make a speech in a minute.
I feel like I should but I just have no idea what to say.
So... let's see.
I feel like a reading of email...
is the right thing to do.
[ALL CHUCKLING]
TUNYASUVUNAKOOL: When John said,
"I'm gonna read an email," at a team social,
I thought, "Wow, John, you know how to have fun."
We're gonna read an email now. [LAUGHS]
Uh, I got this about four o'clock today.
Um, it is from John Moult.
And I'll just read it.
It says, "As I expect you know,
"your group has performed amazingly well in CASP 14,
"both relative to other groups
"and in absolute model accuracy."
[PEOPLE CLAPPING]
"Congratulations on this work.
"It is really outstanding."
The structures were so good,
it was... it was just amazing.
[TRIUMPHANT INSTRUMENTAL MUSIC PLAYING]
After half a century,
we finally have a solution
to the protein folding problem.
When I saw this email, I read it,
I go, "Oh, shit!"
And my wife goes, "Is everything okay?"
I call my parents, and just, like, "Hey, Mum.
"Um, got something to tell you.
"We've done this thing
"and it might be kind of a big deal." [LAUGHS]
When I learned of the CASP 14 results,
I was gobsmacked.
I was just excited.
This is a problem that I was beginning to think
would not get solved in my lifetime.
NURSE: Now we have a tool that can be used
practically by scientists.
SENIOR: These people are asking us, you know,
"I've got this protein involved in malaria,"
or, you know, some infectious disease.
"We don't know the structure.
"Can we use AlphaFold to solve it?"
JUMPER: We can easily predict all known sequences
in a month.
All known sequences in a month?
- Yeah, easily. - Mmm-hmm?
JUMPER: A billion, two billion.
Um, and they're...
So why don't we just do that? Yeah.
- We should just do that a lot. - Well, I mean...
That's way better. Why don't we just do that?
SENIOR: So that's one of the options.
- HASSABIS: Right. - There's this...
We should just... Right, that's a great idea.
We should just run every protein in existence.
And then release that.
Why didn't someone suggest this before?
Of course that's what we should do.
Why are we thinking about making a service
and then people submit their protein?
We just fold everything.
And then give it to everyone in the world.
Who knows how many discoveries will be made from that?
BIRNEY: Demis called us up and said,
"We want to make this open.
"Not just make sure the code is open,
"but we're gonna make it really easy
"for everybody to get access to the predictions."
THORNTON: That is fantastic.
It's like drawing back the curtain
and seeing the whole world of protein structures.
[ETHEREAL MUSIC PLAYING]
SCHMIDT: They released the structures
of 200 million proteins.
These are gifts to humanity.
JUMPER: The moment AlphaFold is live to the world,
we will no longer be the most important people
in AlphaFold's story.
HASSABIS: Can't quite believe it's all out.
PEOPLE: Aw!
WOMAN: A hundred and sixty-four users.
HASSABIS: Loads of activity in Japan.
RESEARCHER 1: We have 655 users currently.
RESEARCHER 2: We currently have 100,000 concurrent users.
Wow!
Today is just crazy.
HASSABIS: What an absolutely unbelievable effort
from everyone.
We're gonna all remember these moments
for the rest of our lives.
I'm excited about AlphaFold.
For my research, it's already propelling lots of progress.
And this is just the beginning.
SCHMIDT: My guess is,
every single biological and chemistry achievement
will be related to AlphaFold in some way.
[TRIUMPHANT INSTRUMENTAL MUSIC PLAYING]
AlphaFold is an index moment.
It's a moment that people will not forget
because the world changed.
HASSABIS: Everybody's realized now
what Shane and I have known for more than 20 years,
that AI is going to be the most important thing
humanity's ever gonna invent.
TRAIN ANNOUNCER: We will shortly be arriving
at our final destination.
[ELECTRONIC MUSIC PLAYING]
HASSABIS: The pace of innovation and capabilities
is accelerating,
like a boulder rolling down a hill that we've kicked off
and now it's continuing to gather speed.
NEWSCASTER: We are at a crossroads in human history.
AI has the potential
to transform our lives in every aspect.
It's no less important than the discovery of electricity.
HASSABIS: We should be looking at the scientific method
and trying to understand each step of the way
in a rigorous way.
This is a moment of profound opportunity.
SUNAK: Harnessing this technology
could eclipse anything we have ever known.
[ELECTRONIC DEVICE BEEPS]
HASSABIS: Hi, Alpha.
ALPHA: Hi.
What is this?
ALPHA: This is a chessboard.
If I was to play white, what move would you recommend?
ALPHA: I would recommend
that you move your pawn from E2 to E4.
And now if you were black, what would you play now?
ALPHA: I would play the Sicilian Defense.
That's a good choice.
- ALPHA: Thanks. - [CHUCKLES]
So what do you see? What is this object?
ALPHA: This is a pencil sculpture.
What happens if I move one of the pencils?
ALPHA: If you move one of the pencils,
the sculpture will fall apart.
I'd better leave it alone, then.
ALPHA: That's probably a good idea.
[HASSABIS CHUCKLES]
HASSABIS: AGI is on the horizon now.
Very clearly the next generation
is going to live in a future world
where things will be radically different because of AI.
And if you want to steward that responsibly,
every moment is vital.
This is the moment I've been living my whole life for.
It's just a good thinking game.
[UPLIFTING INSTRUMENTAL MUSIC PLAYING]