WEBVTT
1
00:00:02.415 --> 00:00:05.915
(bright musical flourish)
2
00:00:09.505 --> 00:00:13.160
(audience applauds)
3
00:00:13.160 --> 00:00:15.860 line:15%
Today's computers are so amazing
4
00:00:16.870 --> 00:00:20.950
that we fail to notice how terrible they really are.
5
00:00:22.230 --> 00:00:24.620
I'd like to talk to you today about this problem
6
00:00:24.620 --> 00:00:28.100
and how we can fix it with neuroscience.
7
00:00:28.100 --> 00:00:30.300 line:15%
First, I'd like to take you back to a frosty night
8
00:00:30.300 --> 00:00:34.520 line:15%
in Harlem in 2011 that had a profound impact on me.
9
00:00:34.520 --> 00:00:37.690
I was sitting in a dive bar outside of Columbia University
10
00:00:37.690 --> 00:00:40.470
where I had studied computer science and neuroscience,
11
00:00:40.470 --> 00:00:42.410 line:15%
and I was having this great conversation
12
00:00:42.410 --> 00:00:44.300 line:15%
with a fellow student about the power
13
00:00:44.300 --> 00:00:47.440 line:15%
of holograms to one day replace computers.
14
00:00:47.440 --> 00:00:49.160
And just as we were getting to the best part
15
00:00:49.160 --> 00:00:52.690
of the conversation, of course, his phone lights up.
16
00:00:52.690 --> 00:00:55.670
And he pulls it towards himself, and he looks down,
17
00:00:55.670 --> 00:00:58.740
and he starts typing, and then he forces his eyeballs
18
00:00:58.740 --> 00:01:02.450
back up to mine, and he goes, keep going, I'm with you.
19
00:01:02.450 --> 00:01:04.830
But of course his eyes were glazed over,
20
00:01:04.830 --> 00:01:07.030
and the moment was dead.
21
00:01:07.030 --> 00:01:09.580
Meanwhile, across the bar, I noticed another student
22
00:01:09.580 --> 00:01:12.000
holding his phone, this time towards a group,
23
00:01:12.000 --> 00:01:14.800
and he was swiping through pictures on Instagram.
24
00:01:14.800 --> 00:01:17.190
And these kids were laughing hysterically.
25
00:01:17.190 --> 00:01:20.950
And that dichotomy between how crappy I was feeling
26
00:01:20.950 --> 00:01:23.680
and how happy they were feeling about the same technology
27
00:01:23.680 --> 00:01:25.140
really got me thinking.
28
00:01:25.140 --> 00:01:26.120
And the more I thought of it,
29
00:01:26.120 --> 00:01:28.010
the more I realized, it was clearly
30
00:01:28.010 --> 00:01:31.290
not the digital information that was the bad guy here.
31
00:01:31.290 --> 00:01:32.900
It was simply the display position
32
00:01:32.900 --> 00:01:34.870
that were separating me from my friend
33
00:01:34.870 --> 00:01:37.680
and that was binding those kids together.
34
00:01:37.680 --> 00:01:39.880
See, they were connected around something,
35
00:01:39.880 --> 00:01:43.330
just like our ancestors who evolved their social cognitions
36
00:01:43.330 --> 00:01:45.830
telling stories around the campfire.
37
00:01:45.830 --> 00:01:47.540
And that's exactly what tools should do.
38
00:01:47.540 --> 00:01:49.740
I think they should extend our bodies,
39
00:01:49.740 --> 00:01:52.960
and I think computers today are doing quite the opposite.
40
00:01:52.960 --> 00:01:55.230
Whether you're sending an email to your wife
41
00:01:55.230 --> 00:01:58.910
or you're composing a symphony or just consoling a friend,
42
00:01:58.910 --> 00:02:01.270
you're doing it in pretty much the same way.
43
00:02:01.270 --> 00:02:03.490
You're hunched over these rectangles,
44
00:02:03.490 --> 00:02:06.463
fumbling with buttons and menus and more rectangles.
45
00:02:06.463 --> 00:02:08.880
And I think this is the wrong way.
46
00:02:08.880 --> 00:02:12.290
I think we can start using a much more natural machine.
47
00:02:12.290 --> 00:02:13.670
We should use machines that bring
48
00:02:13.670 --> 00:02:15.420
our work back into the world.
49
00:02:15.420 --> 00:02:18.240
We should use machines that use the principles
50
00:02:18.240 --> 00:02:20.850
of neuroscience to extend our senses
51
00:02:20.850 --> 00:02:23.370
versus going against them.
52
00:02:23.370 --> 00:02:26.120
Now, it just so happens that I have such a machine here.
53
00:02:26.120 --> 00:02:27.160
It's called the Meta 2.
54
00:02:27.160 --> 00:02:28.010
Let's try it out.
55
00:02:37.690 --> 00:02:40.550
Now, in front of me right now, I can see the audience,
56
00:02:40.550 --> 00:02:43.150
and I can see my very hands,
57
00:02:43.150 --> 00:02:45.390
and in three, two, one,
58
00:02:45.390 --> 00:02:47.940
we're gonna see an immersive hologram appear,
59
00:02:47.940 --> 00:02:50.050
a very realistic hologram appear in front of me
60
00:02:50.050 --> 00:02:52.820
of our very glasses that I'm wearing on my head right now.
61
00:02:52.820 --> 00:02:55.120
And of course, this could be anything that we're shopping
62
00:02:55.120 --> 00:02:58.300
for or learning from, and I can use my hands
63
00:02:58.300 --> 00:03:02.500
to very nicely kind of move it around with fine control,
64
00:03:02.500 --> 00:03:06.690
and I think Iron Man would be proud.
65
00:03:06.690 --> 00:03:09.736
We're gonna come back to this in just a bit.
66
00:03:09.736 --> 00:03:12.100
(audience applauds)
67
00:03:12.100 --> 00:03:13.410
Now, if you're anything like me,
68
00:03:13.410 --> 00:03:15.860
your mind is already reeling with the possibilities,
69
00:03:15.860 --> 00:03:17.780
what we can do with this kind of technology,
70
00:03:17.780 --> 00:03:19.110
so let's look at a few.
71
00:03:19.110 --> 00:03:21.640
My mom is an architect, so naturally, the first thing
72
00:03:21.640 --> 00:03:24.860
I imagined was laying out a building in 3D space.
73
00:03:24.860 --> 00:03:27.510
Instead of having to use these 2D floor plans,
74
00:03:27.510 --> 00:03:29.780
she's actually touching graphics right now
75
00:03:29.780 --> 00:03:31.780
and selecting an interior decor.
76
00:03:31.780 --> 00:03:35.160
This was all shot through a GoPro through our very glasses,
77
00:03:35.160 --> 00:03:37.800
and this next use case is very personal to me.
78
00:03:37.800 --> 00:03:41.320
It's Professor Adam Gazzaley's Glass Brain Project,
79
00:03:41.320 --> 00:03:44.870
courtesy of UCSF, and as a neuroscience student,
80
00:03:44.870 --> 00:03:47.480
I would always fantasize about the ability
81
00:03:47.480 --> 00:03:51.760
to learn and memorize these complex brain structures
82
00:03:51.760 --> 00:03:53.700
with an actual machine where I could touch
83
00:03:53.700 --> 00:03:56.580
and play with the various brain structures.
84
00:03:56.580 --> 00:04:00.150
Now, what you're seeing is called augmented reality.
85
00:04:00.150 --> 00:04:03.590
But to me, it's part of a much more important story,
86
00:04:03.590 --> 00:04:07.570
a story of how we can begin to extend our bodies
87
00:04:07.570 --> 00:04:12.570
with digital devices instead of the other way around.
88
00:04:13.810 --> 00:04:16.290
Now, in the next few years,
89
00:04:16.290 --> 00:04:18.660
humanity's gonna go through a shift, I think.
90
00:04:18.660 --> 00:04:20.710
We're gonna start putting an entire layer
91
00:04:20.710 --> 00:04:24.110
of digital information on the real world.
92
00:04:24.110 --> 00:04:26.300
Just imagine for a moment what this could mean
93
00:04:26.300 --> 00:04:28.710
for storytellers, for painters,
94
00:04:28.710 --> 00:04:33.050
for brain surgeons, for interior decorators,
95
00:04:33.050 --> 00:04:35.600
and maybe for all of us here today.
96
00:04:35.600 --> 00:04:37.730
And what I think we need to do as a community
97
00:04:37.730 --> 00:04:40.490
is really try and make an effort to imagine
98
00:04:40.490 --> 00:04:43.120
how we can create this new reality in a way
99
00:04:43.120 --> 00:04:46.670
that extends the human experience instead of gamifying
100
00:04:46.670 --> 00:04:49.380
our reality or cluttering it with digital information.
101
00:04:49.380 --> 00:04:51.480
And that's what I'm very passionate about.
102
00:04:52.390 --> 00:04:54.540
Now, I wanna tell you a little secret.
103
00:04:54.540 --> 00:04:57.320
In about five years, this is not the smallest device.
104
00:04:57.320 --> 00:04:59.410
In about five years, these are all gonna look
105
00:04:59.410 --> 00:05:03.490
like strips of glass on our eyes that project holograms.
106
00:05:03.490 --> 00:05:06.640
And just like we don't care so much about which phone we buy
107
00:05:06.640 --> 00:05:09.560
in terms of the hardware, we buy it for the operating
108
00:05:09.560 --> 00:05:12.380
system, as a neuroscientist, I always dreamt
109
00:05:12.380 --> 00:05:15.450
of building the iOS of the mind, if you will.
110
00:05:16.670 --> 00:05:19.540
And it's very, very important that we get this right,
111
00:05:19.540 --> 00:05:21.840
because we might be living instead of these things
112
00:05:21.840 --> 00:05:23.480
for at least as long as we've lived
113
00:05:23.480 --> 00:05:26.170
with the Windows graphical user interface.
114
00:05:26.170 --> 00:05:27.370
And I don't know about you,
115
00:05:27.370 --> 00:05:30.214
but living instead of Windows scares me.
116
00:05:30.214 --> 00:05:31.430
(audience laughs)
117
00:05:31.430 --> 00:05:34.330
To isolate the single most intuitive interface
118
00:05:34.330 --> 00:05:37.120
out of infinity, we use neuroscience to drive
119
00:05:37.120 --> 00:05:39.220
our design guidelines instead of letting a bunch
120
00:05:39.220 --> 00:05:41.610
of designers fight it out in the boardroom.
121
00:05:41.610 --> 00:05:44.960
And the principal we all revolve around is what's called
122
00:05:44.960 --> 00:05:47.390
the neural path of least resistance.
123
00:05:47.390 --> 00:05:50.100
At every turn, we're connecting the iOS of the brain
124
00:05:50.100 --> 00:05:53.970
with our brain on, for the first time, our brain's terms.
125
00:05:53.970 --> 00:05:56.310
In other words, we're creating, we're trying to create
126
00:05:56.310 --> 00:05:58.780
a zero learning curve computer.
127
00:05:58.780 --> 00:06:02.140
We're building a system that you've always known how to use.
128
00:06:02.140 --> 00:06:04.350
And here are the first three design guidelines
129
00:06:04.350 --> 00:06:07.370
that we employ in this brand-new form of user experience.
130
00:06:07.370 --> 00:06:10.454
First and foremost, you are the operating system.
131
00:06:10.454 --> 00:06:13.580
Traditional file systems are complex and abstract,
132
00:06:13.580 --> 00:06:16.210
and they take your brain extra steps to decode them.
133
00:06:16.210 --> 00:06:19.040
We're going against the neural path of least resistance.
134
00:06:19.040 --> 00:06:22.060
Meanwhile, in augmented reality, you can of course
135
00:06:22.060 --> 00:06:26.240
place your holographic TED panel over here,
136
00:06:26.240 --> 00:06:29.810
and your holographic email on the other side of the desk,
137
00:06:29.810 --> 00:06:33.430
and your spatial memory evolved just fine
138
00:06:33.430 --> 00:06:35.630
to go ahead and retrieve them.
139
00:06:35.630 --> 00:06:37.610
You could put your holographic Tesla that you're
140
00:06:37.610 --> 00:06:40.470
shopping for or whatever model my legal team told me
141
00:06:40.470 --> 00:06:42.180
to put in right before the show.
142
00:06:43.260 --> 00:06:44.093
Perfect.
143
00:06:44.093 --> 00:06:46.060
And your brain knows exactly how to get it back.
144
00:06:46.060 --> 00:06:50.070
The second interface guideline we call touch to see.
145
00:06:50.070 --> 00:06:53.090
What do babies do when they see something
146
00:06:53.090 --> 00:06:54.770
that grabs their interest?
147
00:06:54.770 --> 00:06:56.220
They try and reach out and touch it.
148
00:06:56.220 --> 00:06:57.320
And that's exactly how
149
00:06:57.320 --> 00:07:00.480
the natural machine should work as well.
150
00:07:00.480 --> 00:07:03.110
Turns out the visual system gets a fundamental boost
151
00:07:03.110 --> 00:07:05.430
from a sense we call proprioception.
152
00:07:05.430 --> 00:07:07.690
That's the sense of our body parts in space.
153
00:07:07.690 --> 00:07:09.520
So, by touching our work directly,
154
00:07:09.520 --> 00:07:11.280
we're not only gonna control it better;
155
00:07:11.280 --> 00:07:14.680
we're also going to understand it much more deeply,
156
00:07:14.680 --> 00:07:16.370
hence touch to see.
157
00:07:16.370 --> 00:07:18.510
But it's not enough to experience things ourselves.
158
00:07:18.510 --> 00:07:21.030
We're inherently these social primates,
159
00:07:21.030 --> 00:07:23.150
and this leads me to our third guideline,
160
00:07:23.150 --> 00:07:26.630
the holographic campfire from our first story.
161
00:07:26.630 --> 00:07:29.270
Our mirror neurons subsystems suggest that we can
162
00:07:29.270 --> 00:07:32.040
connect with each other and with our work much better
163
00:07:32.040 --> 00:07:35.090
if we can see each other faces and hands in 3D.
164
00:07:35.090 --> 00:07:36.950
So if you look at the video behind me,
165
00:07:36.950 --> 00:07:40.250
you can see two Meta users playing around
166
00:07:40.250 --> 00:07:42.410
with the same hologram, making eye contact,
167
00:07:42.410 --> 00:07:45.300
connected around this thing instead of being distracted
168
00:07:45.300 --> 00:07:46.810
by external devices.
169
00:07:48.780 --> 00:07:51.090
Let's go ahead and try this again
170
00:07:51.090 --> 00:07:52.610
with neuroscience in mind.
171
00:07:56.140 --> 00:07:59.300
So, again, our favorite interface, the iOS of the mind.
172
00:08:00.380 --> 00:08:03.400
I'm going to now take a step further and go ahead and grab
173
00:08:03.400 --> 00:08:06.820
this pair of glasses and leave it right here by the desk.
174
00:08:06.820 --> 00:08:07.653
I'm now with you.
175
00:08:07.653 --> 00:08:08.486
I'm in the moment.
176
00:08:08.486 --> 00:08:09.670
We're connecting.
177
00:08:09.670 --> 00:08:12.670
My spatial memory kicks in, and I can go ahead and grab it
178
00:08:12.670 --> 00:08:14.520
and bring it right back here, reminding me
179
00:08:14.520 --> 00:08:16.780
that I am the operating system.
180
00:08:16.780 --> 00:08:19.130
And now my proprioception is working,
181
00:08:19.130 --> 00:08:21.460
and I can go ahead and explode these glasses
182
00:08:21.460 --> 00:08:24.640
into a thousand parts and touch the very sensor
183
00:08:24.640 --> 00:08:27.370
that is currently scanning my hand.
184
00:08:27.370 --> 00:08:29.120
But it's not enough to see things alone.
185
00:08:29.120 --> 00:08:32.080
So in a second, my co-founder Ray is gonna make a 3D call.
186
00:08:32.080 --> 00:08:33.296
Ray?
187
00:08:33.296 --> 00:08:35.490
(telephone rings)
188
00:08:35.490 --> 00:08:36.990
Hey, Ray, how's it going, guys?
189
00:08:36.990 --> 00:08:40.410
I can see this guy in front of me in full 3D,
190
00:08:40.410 --> 00:08:42.851
and he's photorealistic.
191
00:08:42.851 --> 00:08:44.100
(audience applauds)
192
00:08:44.100 --> 00:08:45.200
Thank you.
193
00:08:45.200 --> 00:08:47.520
My mirror neuron subsystem suggests
194
00:08:47.520 --> 00:08:50.690
that this is gonna replace phones in not too long.
195
00:08:50.690 --> 00:08:52.530
Ray, how's it going?
196
00:08:52.530 --> 00:08:53.363
Great.
197
00:08:53.363 --> 00:08:54.590
We're live today.
198
00:08:54.590 --> 00:08:56.510
(audience applauds)
199
00:08:56.510 --> 00:08:59.810
Ray, give the crowd a gift of the holographic brain
200
00:08:59.810 --> 00:09:01.270
we saw from the video earlier.
201
00:09:01.270 --> 00:09:03.270
Guys, this is not only gonna change phones.
202
00:09:03.270 --> 00:09:06.710
It's also gonna change the way we collaborate.
203
00:09:06.710 --> 00:09:08.100
Thank you so much.
204
00:09:08.100 --> 00:09:09.020
Thanks, Ray.
205
00:09:09.020 --> 00:09:09.953
You're welcome.
206
00:09:09.953 --> 00:09:11.330
(audience applauds)
207
00:09:11.330 --> 00:09:14.000
So, folks, this is the message that I discovered
208
00:09:14.000 --> 00:09:16.370
in that bar in 2011.
209
00:09:16.370 --> 00:09:19.030
The future of computers is not locked inside
210
00:09:19.030 --> 00:09:21.000
one of these screens.
211
00:09:21.000 --> 00:09:23.890
It's right here, inside of us.
212
00:09:25.814 --> 00:09:28.814
(audience applauds)
213
00:09:30.000 --> 00:09:32.180
So if there's one idea that I could leave you
214
00:09:32.180 --> 00:09:34.010
with here today, it's that the natural machine
215
00:09:34.010 --> 00:09:35.790
is not some figment of the future.
216
00:09:35.790 --> 00:09:38.530
It's right here in 2016,
217
00:09:38.530 --> 00:09:41.250
which is why all hundred of us at Meta
218
00:09:41.250 --> 00:09:44.158
including the administrative staff, the executives,
219
00:09:44.158 --> 00:09:48.110
the designers, the engineers, before TED 2017,
220
00:09:48.110 --> 00:09:51.790
we're all gonna be throwing away our external monitors
221
00:09:51.790 --> 00:09:54.820
and replacing them with a truly and profoundly
222
00:09:54.820 --> 00:09:56.930
more natural machine.
223
00:09:56.930 --> 00:09:58.047
Thank you very much.
224
00:09:58.047 --> 00:10:01.047
(audience applauds)
225
00:10:02.023 --> 00:10:03.034
Thank you.
226
00:10:03.034 --> 00:10:03.867
Appreciate it.
227
00:10:03.867 --> 00:10:05.395
Thanks.
228
00:10:05.395 --> 00:10:07.225
Thanks, guys.
229
00:10:07.225 --> 00:10:09.636
Wow, thank you.
230
00:10:09.636 --> 00:10:11.700
So help me out on one thing,
231
00:10:11.700 --> 00:10:15.010
'cause there've been a few augmented reality
232
00:10:15.010 --> 00:10:18.210
demos shown over the last year or so out there.
233
00:10:18.210 --> 00:10:20.700
And there's sometimes a debate among technologists
234
00:10:20.700 --> 00:10:24.470
about, are we really seeing the real thing on screen?
235
00:10:24.470 --> 00:10:27.740
There's this issue of field of view that somehow,
236
00:10:27.740 --> 00:10:29.750
the technology is showing a broader view
237
00:10:29.750 --> 00:10:32.760
than you would actually see wearing the glasses.
238
00:10:32.760 --> 00:10:34.570
Were we seeing the real deal there?
239
00:10:34.570 --> 00:10:35.640
Absolutely the real deal.
240
00:10:35.640 --> 00:10:37.950
Not only that, we took extra measures
241
00:10:37.950 --> 00:10:40.400
to shoot it with a GoPro through the actual lens
242
00:10:40.400 --> 00:10:42.430
in the various videos that you've seen here.
243
00:10:42.430 --> 00:10:44.810
We wanna try and simulate the experience for the world
244
00:10:44.810 --> 00:10:46.850
that we're actually seeing through the glasses,
245
00:10:46.850 --> 00:10:48.870
not making any, cutting any corners.
246
00:10:48.870 --> 00:10:49.703
Thank you so much for sharing.
247
00:10:49.703 --> 00:10:50.915
Thanks so much, man.
248
00:10:50.915 --> 00:10:51.748
I appreciate that.
249
00:10:51.748 --> 00:10:52.892
(audience applauds)
250
00:10:52.892 --> 00:10:56.392 line:15%
(bright musical flourish)