What we're learning from online education - Daphne Koller
[Music]
[Music]
[Music]
[Music]
[Applause]
like<00:00:16.880> many<00:00:17.119> of<00:00:17.320> you<00:00:17.760> I'm<00:00:17.920> one<00:00:18.080> of<00:00:18.199> the<00:00:18.320> lucky
like many of you I'm one of the lucky
like many of you I'm one of the lucky
people<00:00:19.400> I<00:00:19.520> was<00:00:19.680> born<00:00:20.000> to<00:00:20.199> a<00:00:20.400> family<00:00:20.920> where
people I was born to a family where
people I was born to a family where
education<00:00:21.680> was<00:00:22.119> pervasive<00:00:23.119> I'm<00:00:23.240> a<00:00:23.359> third
education was pervasive I'm a third
education was pervasive I'm a third
generation<00:00:24.240> PhD<00:00:25.119> a<00:00:25.279> daughter<00:00:25.519> of<00:00:25.640> two
generation PhD a daughter of two
generation PhD a daughter of two
academics<00:00:27.160> in<00:00:27.320> my<00:00:27.519> childhood<00:00:28.039> I<00:00:28.160> played
academics in my childhood I played
academics in my childhood I played
around<00:00:28.679> in<00:00:28.840> my<00:00:29.000> father's<00:00:29.359> University<00:00:30.039> lab<00:00:31.039> so
around in my father's University lab so
around in my father's University lab so
it<00:00:31.320> was<00:00:31.519> taken<00:00:31.800> for<00:00:32.040> granted<00:00:32.559> that<00:00:32.680> I<00:00:32.840> attend
it was taken for granted that I attend
it was taken for granted that I attend
some<00:00:33.239> of<00:00:33.399> the<00:00:33.520> best<00:00:33.960> universities<00:00:34.960> which<00:00:35.120> in
some of the best universities which in
some of the best universities which in
turn<00:00:35.800> open<00:00:36.079> the<00:00:36.200> door<00:00:36.399> to<00:00:36.520> a<00:00:36.640> world<00:00:36.879> of
turn open the door to a world of
turn open the door to a world of
opportunity<00:00:39.079> unfortunately<00:00:40.079> most<00:00:40.280> of<00:00:40.440> the
opportunity unfortunately most of the
opportunity unfortunately most of the
people<00:00:40.760> in<00:00:40.840> the<00:00:40.960> world<00:00:41.160> are<00:00:41.320> not<00:00:41.480> so<00:00:41.680> lucky<00:00:42.680> in
people in the world are not so lucky in
people in the world are not so lucky in
some<00:00:43.079> parts<00:00:43.320> of<00:00:43.440> the<00:00:43.559> world<00:00:44.120> for<00:00:44.320> example
some parts of the world for example
some parts of the world for example
South<00:00:45.079> Africa<00:00:46.039> education<00:00:46.480> is<00:00:46.680> just<00:00:46.840> not
South Africa education is just not
South Africa education is just not
readily<00:00:47.480> accessible<00:00:48.440> in<00:00:48.640> South<00:00:48.920> Africa<00:00:49.480> the
readily accessible in South Africa the
readily accessible in South Africa the
educational<00:00:50.239> system<00:00:50.600> was<00:00:50.800> constructed<00:00:51.360> in
educational system was constructed in
educational system was constructed in
the<00:00:51.600> days<00:00:51.760> of<00:00:51.920> apartheid<00:00:52.680> for<00:00:52.879> the<00:00:53.039> white
the days of apartheid for the white
the days of apartheid for the white
minority<00:00:54.320> and<00:00:54.440> as<00:00:54.559> a<00:00:54.719> consequence<00:00:55.280> today
minority and as a consequence today
minority and as a consequence today
there's<00:00:55.800> just<00:00:55.960> not<00:00:56.199> enough<00:00:56.480> spots<00:00:56.840> for<00:00:57.039> the
there's just not enough spots for the
there's just not enough spots for the
many<00:00:57.359> more<00:00:57.640> people<00:00:58.160> who<00:00:58.320> want<00:00:58.519> and<00:00:58.680> deserve<00:00:59.000> a
many more people who want and deserve a
many more people who want and deserve a
high<00:00:59.320> quality<00:00:59.600> education
high quality education
high quality education
that<00:01:01.519> scarcity<00:01:02.280> led<00:01:02.480> to<00:01:02.640> a<00:01:02.800> crisis<00:01:03.199> in<00:01:03.399> January
that scarcity led to a crisis in January
that scarcity led to a crisis in January
of<00:01:03.960> this<00:01:04.159> year<00:01:04.519> at<00:01:04.640> the<00:01:04.760> University<00:01:05.199> of
of this year at the University of
of this year at the University of
Johannesburg<00:01:06.600> there<00:01:06.680> were<00:01:06.880> a<00:01:07.040> handful<00:01:07.400> of
Johannesburg there were a handful of
Johannesburg there were a handful of
positions<00:01:08.119> left<00:01:08.360> open<00:01:08.840> from<00:01:09.000> the<00:01:09.119> standard
positions left open from the standard
positions left open from the standard
admissions<00:01:10.080> process<00:01:10.840> and<00:01:10.960> the<00:01:11.080> night<00:01:11.400> before
admissions process and the night before
admissions process and the night before
they<00:01:11.880> were<00:01:12.119> supposed<00:01:12.439> to<00:01:12.600> open<00:01:12.840> that<00:01:13.000> for
they were supposed to open that for
they were supposed to open that for
registration<00:01:14.439> thousands<00:01:14.880> of<00:01:15.080> people<00:01:15.360> lined
registration thousands of people lined
registration thousands of people lined
up<00:01:15.799> outside<00:01:16.240> the<00:01:16.400> gate<00:01:17.040> in<00:01:17.159> a<00:01:17.320> line<00:01:17.560> a<00:01:17.720> mile
up outside the gate in a line a mile
up outside the gate in a line a mile
long<00:01:18.640> hoping<00:01:18.960> to<00:01:19.080> be<00:01:19.240> first<00:01:19.520> in<00:01:19.720> line<00:01:20.119> to<00:01:20.280> get
long hoping to be first in line to get
long hoping to be first in line to get
one<00:01:20.560> of<00:01:20.720> those<00:01:21.240> positions<00:01:22.240> when<00:01:22.400> the<00:01:22.560> gates
one of those positions when the gates
one of those positions when the gates
opened<00:01:23.400> there<00:01:23.520> was<00:01:23.640> a<00:01:23.920> stampede<00:01:24.920> and<00:01:25.079> 20
opened there was a stampede and 20
opened there was a stampede and 20
people<00:01:25.680> were<00:01:25.920> injured<00:01:26.560> and<00:01:26.759> one<00:01:26.960> woman<00:01:27.320> died
people were injured and one woman died
people were injured and one woman died
she<00:01:28.320> was<00:01:28.439> a<00:01:28.600> mother<00:01:29.159> who<00:01:29.360> gave<00:01:29.560> her<00:01:29.680> life<00:01:30.000> life
she was a mother who gave her life life
she was a mother who gave her life life
trying<00:01:30.640> to<00:01:30.840> get<00:01:31.119> her<00:01:31.280> son<00:01:31.720> a<00:01:31.840> chance<00:01:32.079> at<00:01:32.200> a
trying to get her son a chance at a
trying to get her son a chance at a
better
better
better
life<00:01:34.560> but<00:01:34.759> even<00:01:34.960> in<00:01:35.159> parts<00:01:35.399> of<00:01:35.520> the<00:01:35.680> world<00:01:36.200> like
life but even in parts of the world like
life but even in parts of the world like
the<00:01:36.520> United<00:01:36.960> States<00:01:37.680> where<00:01:38.159> education<00:01:38.720> is
the United States where education is
the United States where education is
available<00:01:39.640> it<00:01:39.799> might<00:01:40.040> not<00:01:40.200> be<00:01:40.399> within<00:01:40.720> reach
available it might not be within reach
available it might not be within reach
there's<00:01:41.960> been<00:01:42.200> much<00:01:42.479> discussed<00:01:43.240> in<00:01:43.360> the<00:01:43.560> last
there's been much discussed in the last
there's been much discussed in the last
few<00:01:44.000> years<00:01:44.280> about<00:01:44.479> the<00:01:44.600> rising<00:01:44.960> cost<00:01:45.200> of
few years about the rising cost of
few years about the rising cost of
healthcare<00:01:46.560> what<00:01:46.719> might<00:01:46.960> not<00:01:47.159> be<00:01:47.360> quite<00:01:47.600> as
healthcare what might not be quite as
healthcare what might not be quite as
obvious<00:01:48.399> to<00:01:48.640> people<00:01:49.280> is<00:01:49.439> that<00:01:49.600> during<00:01:49.920> that
obvious to people is that during that
obvious to people is that during that
same<00:01:50.439> period<00:01:51.119> the<00:01:51.280> costs<00:01:51.520> of<00:01:51.680> higher
same period the costs of higher
same period the costs of higher
education<00:01:52.479> tuition<00:01:53.240> have<00:01:53.399> been<00:01:53.560> increasing
education tuition have been increasing
education tuition have been increasing
at<00:01:54.200> almost<00:01:54.520> twice<00:01:54.840> the<00:01:55.000> rate<00:01:55.520> for<00:01:55.680> a<00:01:55.759> total<00:01:56.000> of
at almost twice the rate for a total of
at almost twice the rate for a total of
559<00:01:57.960> since
559 since
559 since
1985<00:01:59.960> this<00:02:00.079> makes<00:02:00.600> education<00:02:01.600> unaffordable
1985 this makes education unaffordable
1985 this makes education unaffordable
for<00:02:02.719> many
for many
for many
people<00:02:04.759> finally<00:02:05.280> even<00:02:05.479> for<00:02:05.759> those<00:02:06.039> who<00:02:06.159> do
people finally even for those who do
people finally even for those who do
manage<00:02:06.680> to<00:02:06.840> get<00:02:06.960> a<00:02:07.119> higher<00:02:07.360> education<00:02:08.080> the
manage to get a higher education the
manage to get a higher education the
doors<00:02:08.479> of<00:02:08.800> opportunity<00:02:09.360> might<00:02:09.560> not<00:02:09.800> open<00:02:10.720> only
doors of opportunity might not open only
doors of opportunity might not open only
a<00:02:11.120> little<00:02:11.400> over<00:02:11.840> half<00:02:12.440> of<00:02:12.640> recent<00:02:13.080> college
a little over half of recent college
a little over half of recent college
graduates<00:02:13.840> in<00:02:13.959> the<00:02:14.080> United<00:02:14.440> States<00:02:14.959> who<00:02:15.080> get<00:02:15.239> a
graduates in the United States who get a
graduates in the United States who get a
higher<00:02:15.640> education<00:02:16.519> actually<00:02:16.760> are<00:02:16.959> working<00:02:17.239> in
higher education actually are working in
higher education actually are working in
jobs<00:02:17.760> that<00:02:17.920> require<00:02:18.360> that<00:02:18.800> education<00:02:19.800> this<00:02:19.959> of
jobs that require that education this of
jobs that require that education this of
course<00:02:20.280> is<00:02:20.440> not<00:02:20.640> true<00:02:20.879> for<00:02:21.040> the<00:02:21.200> students<00:02:21.560> who
course is not true for the students who
course is not true for the students who
graduate<00:02:22.160> from<00:02:22.280> the<00:02:22.400> top<00:02:22.720> institutions<00:02:23.720> but
graduate from the top institutions but
graduate from the top institutions but
for<00:02:24.120> many<00:02:24.360> others<00:02:25.040> they<00:02:25.160> do<00:02:25.319> not<00:02:25.519> get<00:02:25.640> the
for many others they do not get the
for many others they do not get the
value<00:02:26.080> for<00:02:26.280> their<00:02:26.480> time<00:02:26.959> and<00:02:27.120> their
value for their time and their
value for their time and their
effort<00:02:29.920> Tom<00:02:30.120> fredman<00:02:30.760> in<00:02:30.879> his<00:02:31.080> recent<00:02:31.360> New
effort Tom fredman in his recent New
effort Tom fredman in his recent New
York<00:02:31.760> Times<00:02:32.040> article<00:02:32.840> captured<00:02:33.760> in<00:02:33.879> a<00:02:34.040> way
York Times article captured in a way
York Times article captured in a way
that<00:02:34.360> no<00:02:34.440> one<00:02:34.640> else<00:02:34.920> could<00:02:35.440> the<00:02:35.640> spirit<00:02:36.000> behind
that no one else could the spirit behind
that no one else could the spirit behind
our<00:02:36.519> effort<00:02:37.440> he<00:02:37.560> said<00:02:38.040> the<00:02:38.280> big<00:02:38.480> breakthroughs
our effort he said the big breakthroughs
our effort he said the big breakthroughs
are<00:02:39.400> what<00:02:39.599> happens<00:02:40.200> when<00:02:40.360> what<00:02:40.519> is<00:02:40.640> suddenly
are what happens when what is suddenly
are what happens when what is suddenly
possible<00:02:41.720> meets<00:02:42.080> what<00:02:42.200> is<00:02:42.360> desperately
possible meets what is desperately
possible meets what is desperately
necessary<00:02:44.200> I've<00:02:44.400> talked<00:02:44.720> about<00:02:44.959> what's
necessary I've talked about what's
necessary I've talked about what's
desperately<00:02:45.720> necessary<00:02:46.720> let's<00:02:47.000> talk<00:02:47.200> about
desperately necessary let's talk about
desperately necessary let's talk about
what's<00:02:47.640> suddenly<00:02:48.319> possible<00:02:49.319> what's<00:02:49.519> suddenly
what's suddenly possible what's suddenly
what's suddenly possible what's suddenly
possible<00:02:50.920> was<00:02:51.159> demonstrated<00:02:51.959> by<00:02:52.239> three<00:02:52.480> big
possible was demonstrated by three big
possible was demonstrated by three big
Stanford<00:02:53.159> classes<00:02:54.120> Each<00:02:54.280> of<00:02:54.480> which<00:02:54.680> had<00:02:54.800> an
Stanford classes Each of which had an
Stanford classes Each of which had an
enrollment<00:02:55.440> of<00:02:55.720> 100,000<00:02:56.440> people<00:02:56.680> or<00:02:57.000> more<00:02:58.000> so
enrollment of 100,000 people or more so
enrollment of 100,000 people or more so
to<00:02:59.080> understand<00:02:59.319> this<00:02:59.480> let's<00:02:59.680> look<00:02:59.840> look<00:02:59.959> at
to understand this let's look look at
to understand this let's look look at
one<00:03:00.159> of<00:03:00.319> those<00:03:00.519> classes<00:03:00.959> the<00:03:01.080> machine
one of those classes the machine
one of those classes the machine
learning<00:03:01.720> class<00:03:02.040> offered<00:03:02.360> by<00:03:02.480> my<00:03:02.680> colleague
learning class offered by my colleague
learning class offered by my colleague
and<00:03:03.159> co-founder<00:03:03.680> Andrew<00:03:04.040> in<00:03:04.920> Andrew<00:03:05.280> teaches
and co-founder Andrew in Andrew teaches
and co-founder Andrew in Andrew teaches
one<00:03:05.720> of<00:03:05.799> the<00:03:05.879> bigger<00:03:06.159> Stanford<00:03:06.680> classes<00:03:07.000> it's
one of the bigger Stanford classes it's
one of the bigger Stanford classes it's
a<00:03:07.239> machine<00:03:07.519> learning<00:03:07.920> class<00:03:08.159> and<00:03:08.280> it<00:03:08.599> has<00:03:08.799> 400
a machine learning class and it has 400
a machine learning class and it has 400
people<00:03:09.560> enrolled<00:03:10.280> every<00:03:10.519> time<00:03:10.720> it's<00:03:10.920> offered
people enrolled every time it's offered
people enrolled every time it's offered
when<00:03:12.040> Andrew<00:03:12.440> taught<00:03:12.720> the<00:03:12.799> machine<00:03:13.120> learning
when Andrew taught the machine learning
when Andrew taught the machine learning
class<00:03:14.040> to<00:03:14.200> the<00:03:14.319> general<00:03:14.720> public<00:03:15.239> it<00:03:15.360> had
class to the general public it had
class to the general public it had
100,000<00:03:16.400> people<00:03:16.840> registered<00:03:17.840> so<00:03:18.000> to<00:03:18.159> put<00:03:18.360> that
100,000 people registered so to put that
100,000 people registered so to put that
number<00:03:18.760> in<00:03:18.959> perspective<00:03:19.760> for<00:03:20.000> Andrew<00:03:20.360> to
number in perspective for Andrew to
number in perspective for Andrew to
reach<00:03:20.799> that<00:03:21.000> same<00:03:21.319> siiz<00:03:21.640> Audience<00:03:22.360> by
reach that same siiz Audience by
reach that same siiz Audience by
teaching<00:03:22.799> a<00:03:22.959> Stanford<00:03:23.480> class<00:03:23.959> he<00:03:24.080> would<00:03:24.280> have
teaching a Stanford class he would have
teaching a Stanford class he would have
to<00:03:24.519> do<00:03:24.760> that<00:03:25.040> for<00:03:25.280> 250
to do that for 250
to do that for 250
years<00:03:27.799> of<00:03:27.920> course<00:03:28.080> he'<00:03:28.280> get<00:03:28.439> really<00:03:28.760> bored
years of course he' get really bored
years of course he' get really bored
so<00:03:32.319> having<00:03:32.560> seen<00:03:32.840> the<00:03:33.040> impact<00:03:33.400> of<00:03:33.599> this<00:03:33.840> Andrew
so having seen the impact of this Andrew
so having seen the impact of this Andrew
and<00:03:34.319> I<00:03:34.519> decided<00:03:34.959> that<00:03:35.080> we<00:03:35.200> needed<00:03:35.439> to<00:03:35.640> really
and I decided that we needed to really
and I decided that we needed to really
try<00:03:36.080> and<00:03:36.239> scale<00:03:36.640> this<00:03:36.799> up<00:03:37.000> to<00:03:37.159> bring<00:03:37.920> the<00:03:38.080> best
try and scale this up to bring the best
try and scale this up to bring the best
quality<00:03:38.760> education<00:03:39.439> to<00:03:39.640> as<00:03:39.760> many<00:03:40.000> people<00:03:40.280> as
quality education to as many people as
quality education to as many people as
we<00:03:40.599> could<00:03:41.360> so<00:03:41.519> we<00:03:41.680> formed<00:03:42.000> corsera<00:03:42.920> whose<00:03:43.239> goal
we could so we formed corsera whose goal
we could so we formed corsera whose goal
is<00:03:43.959> to<00:03:44.159> take<00:03:44.400> the<00:03:44.640> best<00:03:45.280> courses<00:03:46.040> from<00:03:46.239> the
is to take the best courses from the
is to take the best courses from the
best<00:03:46.799> instructors<00:03:47.799> at<00:03:47.959> the<00:03:48.080> best
best instructors at the best
best instructors at the best
universities<00:03:49.439> and<00:03:49.599> provide<00:03:49.920> it<00:03:50.040> to<00:03:50.200> everyone
universities and provide it to everyone
universities and provide it to everyone
around<00:03:50.840> the<00:03:50.959> world<00:03:51.599> for<00:03:52.159> free<00:03:53.159> we<00:03:53.319> currently
around the world for free we currently
around the world for free we currently
have<00:03:53.959> 43<00:03:54.519> courses<00:03:55.000> on<00:03:55.120> the<00:03:55.319> platform<00:03:56.120> from
have 43 courses on the platform from
have 43 courses on the platform from
four<00:03:56.599> universities<00:03:57.560> across<00:03:57.879> a<00:03:58.040> range<00:03:58.239> of
four universities across a range of
four universities across a range of
disciplines<00:03:59.040> and<00:03:59.159> let<00:03:59.280> me<00:03:59.360> show<00:03:59.519> you<00:03:59.840> a<00:03:59.959> little
disciplines and let me show you a little
disciplines and let me show you a little
bit<00:04:00.200> of<00:04:00.280> an<00:04:00.400> overview<00:04:00.760> of<00:04:00.879> what<00:04:01.000> that<00:04:01.159> looks
bit of an overview of what that looks
bit of an overview of what that looks
like<00:04:04.120> welcome<00:04:04.400> to<00:04:04.560> calculus<00:04:05.400> 50<00:04:05.680> million
like welcome to calculus 50 million
like welcome to calculus 50 million
people<00:04:06.319> are<00:04:06.519> uninsured<00:04:07.120> models<00:04:07.400> help<00:04:07.560> us
people are uninsured models help us
people are uninsured models help us
design<00:04:08.200> more<00:04:08.400> effective<00:04:08.720> institutions<00:04:09.200> and
design more effective institutions and
design more effective institutions and
policies<00:04:10.920> we<00:04:11.079> get<00:04:11.319> unbelievable<00:04:12.200> segregation
policies we get unbelievable segregation
policies we get unbelievable segregation
so<00:04:12.959> Bush<00:04:13.280> imagined<00:04:13.720> that<00:04:13.840> in<00:04:13.959> the<00:04:14.120> future
so Bush imagined that in the future
so Bush imagined that in the future
you'd<00:04:14.920> wear<00:04:15.120> a<00:04:15.319> camera<00:04:16.079> right<00:04:16.199> in<00:04:16.320> the<00:04:16.440> center
you'd wear a camera right in the center
you'd wear a camera right in the center
of<00:04:16.759> your<00:04:16.919> head<00:04:17.239> Mills<00:04:17.680> wants<00:04:18.079> the<00:04:18.280> student<00:04:18.639> of
of your head Mills wants the student of
of your head Mills wants the student of
Sociology<00:04:19.440> to<00:04:19.639> develop<00:04:20.280> the<00:04:20.479> quality<00:04:20.799> of<00:04:21.000> mind
Sociology to develop the quality of mind
Sociology to develop the quality of mind
hanging<00:04:21.720> cable<00:04:22.440> takes<00:04:22.680> on<00:04:22.880> the<00:04:23.000> form<00:04:23.600> of<00:04:23.759> a
hanging cable takes on the form of a
hanging cable takes on the form of a
hyperbolic<00:04:24.479> cosine<00:04:24.960> for<00:04:25.280> each<00:04:25.560> pixel<00:04:25.880> in<00:04:26.000> the
hyperbolic cosine for each pixel in the
hyperbolic cosine for each pixel in the
image<00:04:26.960> set<00:04:27.240> the<00:04:27.360> red<00:04:27.520> to<00:04:27.680> zero<00:04:28.360> vaccine
image set the red to zero vaccine
image set the red to zero vaccine
allowed<00:04:29.360> us<00:04:29.479> to<00:04:29.680> to<00:04:29.840> eliminate<00:04:30.280> polio<00:04:30.639> virus
allowed us to to eliminate polio virus
allowed us to to eliminate polio virus
does<00:04:31.240> LOF<00:04:31.479> tanza<00:04:31.840> serve<00:04:32.120> breakfast<00:04:32.600> and<00:04:32.759> San
does LOF tanza serve breakfast and San
does LOF tanza serve breakfast and San
Jose<00:04:33.720> well<00:04:33.880> that<00:04:34.000> sounds<00:04:34.320> funny<00:04:34.919> so<00:04:35.120> this<00:04:35.240> is
Jose well that sounds funny so this is
Jose well that sounds funny so this is
which<00:04:35.639> coin<00:04:35.919> you<00:04:36.080> pick<00:04:37.039> and<00:04:37.199> this<00:04:37.320> is<00:04:37.400> the
which coin you pick and this is the
which coin you pick and this is the
twoes<00:04:38.240> so<00:04:38.400> in<00:04:38.560> large<00:04:38.840> scale<00:04:39.120> machine<00:04:39.400> learning
twoes so in large scale machine learning
twoes so in large scale machine learning
we'd<00:04:40.360> like<00:04:40.560> to<00:04:40.800> come<00:04:40.960> up<00:04:41.120> with
computational<00:04:48.120> it<00:04:48.240> turns<00:04:48.520> out<00:04:48.800> maybe<00:04:49.080> not
computational it turns out maybe not
computational it turns out maybe not
surprisingly<00:04:49.919> that<00:04:50.080> students<00:04:50.479> like<00:04:50.759> getting
surprisingly that students like getting
surprisingly that students like getting
the<00:04:51.520> best<00:04:51.800> content<00:04:52.520> from<00:04:52.720> the<00:04:52.880> best
the best content from the best
the best content from the best
universities<00:04:53.680> for<00:04:54.320> free<00:04:55.320> since<00:04:55.560> we<00:04:55.759> opened
universities for free since we opened
universities for free since we opened
the<00:04:56.280> website<00:04:56.759> in<00:04:56.960> February<00:04:57.600> we<00:04:57.759> now<00:04:58.000> have
the website in February we now have
the website in February we now have
640,000
640,000
640,000
students<00:05:00.320> from<00:05:00.520> 190<00:05:01.240> countries<00:05:02.039> we<00:05:02.199> have<00:05:02.360> 1.5
students from 190 countries we have 1.5
students from 190 countries we have 1.5
million<00:05:03.520> enrollments<00:05:04.160> 6<00:05:04.440> million<00:05:04.800> quizzes<00:05:05.360> in
million enrollments 6 million quizzes in
million enrollments 6 million quizzes in
the<00:05:05.639> 15<00:05:06.080> classes<00:05:06.440> that<00:05:06.560> have<00:05:06.680> launched<00:05:07.000> so<00:05:07.160> far
the 15 classes that have launched so far
the 15 classes that have launched so far
have<00:05:07.479> been<00:05:07.680> submitted<00:05:08.360> and<00:05:08.520> 14<00:05:08.960> million
have been submitted and 14 million
have been submitted and 14 million
videos<00:05:09.720> have<00:05:09.880> been
videos have been
videos have been
viewed<00:05:12.080> but<00:05:12.400> it's<00:05:12.600> not<00:05:12.840> just<00:05:13.080> about<00:05:13.320> the
viewed but it's not just about the
viewed but it's not just about the
numbers<00:05:14.240> it's<00:05:14.479> also<00:05:14.759> about<00:05:15.000> the<00:05:15.160> people
numbers it's also about the people
numbers it's also about the people
whether<00:05:16.280> it's<00:05:16.479> a<00:05:16.759> Kos<00:05:17.120> who<00:05:17.280> comes<00:05:17.520> from<00:05:17.680> a
whether it's a Kos who comes from a
whether it's a Kos who comes from a
small<00:05:18.199> town<00:05:18.440> in<00:05:18.639> India<00:05:19.120> and<00:05:19.280> would<00:05:19.479> never<00:05:19.800> have
small town in India and would never have
small town in India and would never have
access<00:05:20.440> in<00:05:20.600> this<00:05:20.800> case<00:05:20.960> to<00:05:21.080> a<00:05:21.199> Stanford
access in this case to a Stanford
access in this case to a Stanford
quality<00:05:22.080> course<00:05:22.600> and<00:05:22.720> would<00:05:22.880> never<00:05:23.080> be<00:05:23.240> able
quality course and would never be able
quality course and would never be able
to<00:05:23.680> afford<00:05:24.039> it<00:05:25.039> or<00:05:25.280> Jenny<00:05:25.759> who<00:05:25.880> is<00:05:26.000> a<00:05:26.120> single
to afford it or Jenny who is a single
to afford it or Jenny who is a single
mother<00:05:26.720> of<00:05:26.919> two<00:05:27.639> and<00:05:27.800> wants<00:05:28.080> to<00:05:28.240> hone<00:05:28.520> her
mother of two and wants to hone her
mother of two and wants to hone her
skills<00:05:29.160> so<00:05:29.280> that<00:05:29.360> she<00:05:29.520> can<00:05:29.800> go<00:05:29.960> back<00:05:30.120> and
skills so that she can go back and
skills so that she can go back and
complete<00:05:30.600> her<00:05:30.800> master's
complete her master's
complete her master's
degree<00:05:32.880> or<00:05:33.600> Ryan<00:05:34.160> who<00:05:34.360> can't<00:05:34.639> go<00:05:34.800> to<00:05:34.960> school
degree or Ryan who can't go to school
degree or Ryan who can't go to school
because<00:05:36.000> his<00:05:36.160> immune<00:05:36.560> deficient<00:05:37.000> daughter
because his immune deficient daughter
because his immune deficient daughter
can't<00:05:38.039> be<00:05:38.199> risked<00:05:38.840> to<00:05:39.039> have<00:05:39.240> germs<00:05:39.680> come<00:05:39.840> into
can't be risked to have germs come into
can't be risked to have germs come into
the<00:05:40.240> house<00:05:40.520> so<00:05:40.680> we<00:05:40.840> couldn't<00:05:41.080> leave<00:05:41.360> the<00:05:41.759> house
the house so we couldn't leave the house
the house so we couldn't leave the house
I'm<00:05:42.919> really<00:05:43.199> glad<00:05:43.440> to<00:05:43.720> say<00:05:44.319> recently<00:05:44.759> we've
I'm really glad to say recently we've
I'm really glad to say recently we've
been<00:05:45.080> in<00:05:45.280> correspondance<00:05:46.000> with<00:05:46.120> Ryan<00:05:46.440> that
been in correspondance with Ryan that
been in correspondance with Ryan that
this<00:05:46.759> story<00:05:47.039> had<00:05:47.160> a<00:05:47.319> happy<00:05:47.560> ending<00:05:48.280> baby
this story had a happy ending baby
this story had a happy ending baby
Shannon<00:05:48.960> you<00:05:49.039> can<00:05:49.160> see<00:05:49.319> her<00:05:49.440> on<00:05:49.560> the<00:05:49.720> left<00:05:50.039> is
Shannon you can see her on the left is
Shannon you can see her on the left is
doing<00:05:50.479> much<00:05:50.639> better<00:05:50.960> now<00:05:51.440> and<00:05:51.600> Ryan<00:05:51.919> got<00:05:52.080> a<00:05:52.280> job
doing much better now and Ryan got a job
doing much better now and Ryan got a job
by<00:05:52.960> taking<00:05:53.199> some<00:05:53.360> of<00:05:53.479> our
by taking some of our
by taking some of our
courses<00:05:55.840> so<00:05:56.080> what<00:05:56.240> made<00:05:56.440> these<00:05:56.639> courses<00:05:57.039> so
courses so what made these courses so
courses so what made these courses so
different<00:05:58.080> after<00:05:58.360> all<00:05:58.639> online<00:05:59.000> course
different after all online course
different after all online course
content<00:05:59.840> has<00:05:59.960> been<00:06:00.120> available<00:06:00.560> for<00:06:00.720> a<00:06:01.240> while
content has been available for a while
content has been available for a while
what<00:06:02.400> made<00:06:02.560> it<00:06:02.759> different<00:06:03.120> is<00:06:03.199> that<00:06:03.400> this<00:06:03.479> was
what made it different is that this was
what made it different is that this was
a<00:06:03.759> real<00:06:04.039> course<00:06:04.560> experience<00:06:05.560> it<00:06:05.680> started<00:06:06.120> on<00:06:06.240> a
a real course experience it started on a
a real course experience it started on a
given<00:06:06.800> day<00:06:07.440> and<00:06:07.720> then<00:06:07.840> the<00:06:08.039> students<00:06:08.440> would
given day and then the students would
given day and then the students would
watch<00:06:09.000> videos<00:06:09.560> on<00:06:09.720> a<00:06:09.840> weekly<00:06:10.280> basis<00:06:10.880> and<00:06:11.000> do
watch videos on a weekly basis and do
watch videos on a weekly basis and do
homework<00:06:11.759> assignments<00:06:12.759> and<00:06:12.919> these<00:06:13.039> would<00:06:13.199> be
homework assignments and these would be
homework assignments and these would be
real<00:06:13.520> homework<00:06:13.919> assignments<00:06:14.599> for<00:06:14.960> real<00:06:15.280> grade
real homework assignments for real grade
real homework assignments for real grade
with<00:06:16.400> a<00:06:16.560> real<00:06:16.840> deadline<00:06:17.639> you<00:06:17.759> can<00:06:17.880> see<00:06:18.080> the
with a real deadline you can see the
with a real deadline you can see the
deadlines<00:06:18.599> in<00:06:18.720> the<00:06:18.840> usage<00:06:19.280> graph<00:06:19.720> these<00:06:19.840> are
deadlines in the usage graph these are
deadlines in the usage graph these are
the<00:06:20.440> spikes<00:06:21.680> showing<00:06:22.680> that<00:06:22.960> procrastination
the spikes showing that procrastination
the spikes showing that procrastination
is<00:06:24.080> a<00:06:24.240> global
phenomenon<00:06:28.800> at<00:06:28.919> the<00:06:29.000> end<00:06:29.160> of<00:06:29.280> the<00:06:29.360> course<00:06:29.960> the
phenomenon at the end of the course the
phenomenon at the end of the course the
students<00:06:30.599> got<00:06:30.840> a<00:06:31.400> certificate<00:06:32.400> they<00:06:32.560> could
students got a certificate they could
students got a certificate they could
present<00:06:33.160> that<00:06:33.360> certificate<00:06:33.840> to<00:06:34.000> a
present that certificate to a
present that certificate to a
prospective<00:06:34.639> employer<00:06:35.280> and<00:06:35.400> get<00:06:35.520> a<00:06:35.680> better
prospective employer and get a better
prospective employer and get a better
job<00:06:36.199> and<00:06:36.319> we<00:06:36.479> know<00:06:36.639> many<00:06:36.840> students<00:06:37.199> who<00:06:37.360> did
job and we know many students who did
job and we know many students who did
some<00:06:38.599> students<00:06:39.039> took<00:06:39.280> their<00:06:39.479> certificate<00:06:39.960> and
some students took their certificate and
some students took their certificate and
presented<00:06:40.599> this<00:06:40.759> to<00:06:40.880> an<00:06:41.039> educational
presented this to an educational
presented this to an educational
institution<00:06:42.039> at<00:06:42.160> which<00:06:42.319> they<00:06:42.400> were<00:06:42.560> enrolled
institution at which they were enrolled
institution at which they were enrolled
for<00:06:43.360> actual<00:06:43.759> college<00:06:44.160> credit<00:06:44.800> so<00:06:45.000> these
for actual college credit so these
for actual college credit so these
students<00:06:45.560> were<00:06:45.720> really<00:06:45.919> getting<00:06:46.240> something
students were really getting something
students were really getting something
meaningful<00:06:47.039> for<00:06:47.240> their<00:06:47.440> investment<00:06:47.880> of<00:06:48.080> time
meaningful for their investment of time
meaningful for their investment of time
and
and
and
effort<00:06:50.240> let's<00:06:50.479> talk<00:06:50.720> a<00:06:50.840> little<00:06:51.080> bit<00:06:51.400> about
effort let's talk a little bit about
effort let's talk a little bit about
some<00:06:51.759> of<00:06:51.880> the<00:06:52.039> components<00:06:52.479> that<00:06:52.599> go<00:06:52.759> into
some of the components that go into
some of the components that go into
these<00:06:53.400> courses<00:06:54.400> the<00:06:54.639> first<00:06:55.479> component<00:06:56.039> is
these courses the first component is
these courses the first component is
that<00:06:56.319> when<00:06:56.479> you<00:06:56.599> move<00:06:56.879> away<00:06:57.319> from<00:06:57.479> the
that when you move away from the
that when you move away from the
constraints<00:06:58.120> of<00:06:58.240> a<00:06:58.400> physical<00:06:58.840> classroom<00:06:59.240> and
constraints of a physical classroom and
constraints of a physical classroom and
design<00:06:59.919> content<00:07:00.440> explicitly<00:07:01.000> for<00:07:01.199> an<00:07:01.360> online
design content explicitly for an online
design content explicitly for an online
format<00:07:02.440> you<00:07:02.560> can<00:07:02.759> break<00:07:03.080> away<00:07:03.800> from<00:07:04.199> for
format you can break away from for
format you can break away from for
example<00:07:04.840> the<00:07:04.960> monolithic<00:07:05.560> 1hour<00:07:06.039> lecture<00:07:07.000> you
example the monolithic 1hour lecture you
example the monolithic 1hour lecture you
can<00:07:07.280> break<00:07:07.560> up<00:07:07.759> the<00:07:07.879> material<00:07:08.360> for<00:07:08.560> example
can break up the material for example
can break up the material for example
into<00:07:09.199> these<00:07:09.440> short<00:07:10.080> modular<00:07:10.599> units<00:07:11.000> of<00:07:11.120> 8<00:07:11.360> to
into these short modular units of 8 to
into these short modular units of 8 to
12<00:07:11.840> minutes<00:07:12.560> Each<00:07:12.720> of<00:07:12.879> which<00:07:13.080> represents<00:07:13.520> a
12 minutes Each of which represents a
12 minutes Each of which represents a
coherent<00:07:14.560> concept<00:07:15.560> students<00:07:15.919> can<00:07:16.080> Traverse
coherent concept students can Traverse
coherent concept students can Traverse
this<00:07:16.720> material<00:07:17.160> in<00:07:17.360> different<00:07:17.639> ways
this material in different ways
this material in different ways
depending<00:07:18.400> on<00:07:18.599> their<00:07:18.800> background<00:07:19.599> their
depending on their background their
depending on their background their
skills<00:07:20.440> or<00:07:20.599> their<00:07:20.800> interests<00:07:21.759> so<00:07:21.960> for<00:07:22.160> example
skills or their interests so for example
skills or their interests so for example
some<00:07:23.080> students<00:07:23.599> might<00:07:23.840> benefit<00:07:24.680> from<00:07:25.199> a
some students might benefit from a
some students might benefit from a
little<00:07:25.520> bit<00:07:25.680> of<00:07:25.840> Preparatory<00:07:26.479> material<00:07:26.919> that
little bit of Preparatory material that
little bit of Preparatory material that
other<00:07:27.280> students<00:07:27.680> might<00:07:27.879> already<00:07:28.240> have<00:07:29.160> other
other students might already have other
other students might already have other
students<00:07:30.120> might<00:07:30.280> be<00:07:30.440> interested<00:07:30.840> in<00:07:30.960> a
students might be interested in a
students might be interested in a
particular<00:07:31.520> enrichment<00:07:32.160> topic<00:07:32.520> that<00:07:32.639> they
particular enrichment topic that they
particular enrichment topic that they
want<00:07:32.879> to<00:07:33.080> pursue<00:07:33.759> individually<00:07:34.759> so<00:07:35.039> this
want to pursue individually so this
want to pursue individually so this
format<00:07:35.800> allows<00:07:36.199> us<00:07:36.759> to<00:07:37.000> break<00:07:37.280> away<00:07:37.680> from<00:07:37.879> the
format allows us to break away from the
format allows us to break away from the
one-sized<00:07:38.759> fits-all<00:07:39.440> model<00:07:39.720> of<00:07:39.879> education
one-sized fits-all model of education
one-sized fits-all model of education
and<00:07:40.879> allows<00:07:41.280> students<00:07:41.639> to<00:07:41.800> follow<00:07:42.080> a<00:07:42.240> much
and allows students to follow a much
and allows students to follow a much
more<00:07:42.560> personalized
more personalized
more personalized
curriculum<00:07:45.080> of<00:07:45.240> course<00:07:45.560> we<00:07:45.720> all<00:07:45.879> know<00:07:46.080> as
curriculum of course we all know as
curriculum of course we all know as
Educators<00:07:46.919> that<00:07:47.080> students<00:07:47.479> don't<00:07:47.720> learn<00:07:48.080> by
Educators that students don't learn by
Educators that students don't learn by
sitting<00:07:48.520> and<00:07:48.759> passively<00:07:49.199> watching<00:07:49.800> videos
sitting and passively watching videos
sitting and passively watching videos
perhaps<00:07:51.159> one<00:07:51.280> of<00:07:51.400> the<00:07:51.520> biggest<00:07:51.919> components<00:07:52.479> of
perhaps one of the biggest components of
perhaps one of the biggest components of
this<00:07:52.919> effort<00:07:53.680> is<00:07:54.240> that<00:07:54.400> we<00:07:54.560> need<00:07:54.759> to<00:07:55.000> have
this effort is that we need to have
this effort is that we need to have
students<00:07:56.479> practice<00:07:57.000> with<00:07:57.120> the<00:07:57.520> material<00:07:58.520> and
students practice with the material and
students practice with the material and
really<00:07:59.560> in<00:07:59.639> order<00:07:59.840> to<00:08:00.000> really<00:08:00.520> understand<00:08:00.680> it
really in order to really understand it
really in order to really understand it
there's<00:08:01.479> been<00:08:01.599> a<00:08:01.759> range<00:08:02.039> of<00:08:02.240> studies<00:08:02.639> that
there's been a range of studies that
there's been a range of studies that
demonstrate<00:08:03.280> the<00:08:03.440> importance<00:08:03.840> of<00:08:04.039> this<00:08:04.520> this
demonstrate the importance of this this
demonstrate the importance of this this
one<00:08:04.879> that<00:08:05.039> appeared<00:08:05.319> in<00:08:05.479> science<00:08:05.919> last<00:08:06.199> year
one that appeared in science last year
one that appeared in science last year
for<00:08:06.639> example<00:08:07.479> demonstrates<00:08:08.000> that<00:08:08.159> even
for example demonstrates that even
for example demonstrates that even
simple<00:08:08.759> retrieval<00:08:09.400> practice<00:08:10.120> where<00:08:10.360> students
simple retrieval practice where students
simple retrieval practice where students
are<00:08:11.039> just<00:08:11.319> supposed<00:08:11.759> to<00:08:12.240> repeat<00:08:12.800> what<00:08:12.960> they
are just supposed to repeat what they
are just supposed to repeat what they
already<00:08:13.319> learned<00:08:14.080> gives<00:08:14.440> considerably
already learned gives considerably
already learned gives considerably
improved<00:08:15.599> results<00:08:16.000> on<00:08:16.199> various<00:08:16.680> achievement
improved results on various achievement
improved results on various achievement
tests<00:08:17.639> down<00:08:17.840> the<00:08:18.039> line<00:08:18.599> than<00:08:18.800> many<00:08:19.039> other
tests down the line than many other
tests down the line than many other
educational
educational
educational
interventions<00:08:22.680> we've<00:08:22.879> tried<00:08:23.120> to<00:08:23.240> build<00:08:23.560> in
interventions we've tried to build in
interventions we've tried to build in
retrieval<00:08:24.280> practice<00:08:24.639> into<00:08:24.879> the<00:08:25.080> platform<00:08:25.560> as
retrieval practice into the platform as
retrieval practice into the platform as
well<00:08:25.840> as<00:08:25.960> other<00:08:26.159> forms<00:08:26.400> of<00:08:26.639> practice<00:08:27.000> in<00:08:27.159> many
well as other forms of practice in many
well as other forms of practice in many
ways<00:08:28.599> for<00:08:28.800> example<00:08:29.159> even<00:08:29.560> our<00:08:29.720> videos<00:08:30.120> are<00:08:30.360> not
ways for example even our videos are not
ways for example even our videos are not
just<00:08:31.360> videos<00:08:32.279> every<00:08:32.519> few<00:08:32.760> minutes<00:08:33.120> the<00:08:33.240> video
just videos every few minutes the video
just videos every few minutes the video
pauses<00:08:34.120> and<00:08:34.240> the<00:08:34.360> students<00:08:34.719> get<00:08:34.919> asked<00:08:35.159> a
pauses and the students get asked a
pauses and the students get asked a
question<00:08:36.880> prospect<00:08:37.279> theory<00:08:37.599> hyperbolic
question prospect theory hyperbolic
question prospect theory hyperbolic
discounting<00:08:38.560> status<00:08:38.839> quo<00:08:39.080> bias<00:08:39.399> base<00:08:39.599> rate
discounting status quo bias base rate
discounting status quo bias base rate
bias<00:08:40.320> they're<00:08:40.599> all<00:08:40.839> well<00:08:41.039> documented<00:08:41.440> so
bias they're all well documented so
bias they're all well documented so
they're<00:08:41.680> all<00:08:41.839> well<00:08:42.000> documented<00:08:42.399> deviations
they're all well documented deviations
they're all well documented deviations
from<00:08:43.399> rational<00:08:43.719> Behavior<00:08:44.640> so<00:08:44.800> here<00:08:44.920> are<00:08:45.000> the
from rational Behavior so here are the
from rational Behavior so here are the
video<00:08:45.480> pauses<00:08:45.920> and<00:08:46.040> the<00:08:46.160> student<00:08:46.519> types<00:08:46.800> in
video pauses and the student types in
video pauses and the student types in
the<00:08:47.120> answer<00:08:47.440> into<00:08:47.680> the<00:08:47.839> box<00:08:48.360> and<00:08:48.680> submits
the answer into the box and submits
the answer into the box and submits
obviously<00:08:50.080> they<00:08:50.160> weren't<00:08:50.440> paying
obviously they weren't paying
obviously they weren't paying
attention<00:08:52.519> so<00:08:52.720> they<00:08:52.880> get<00:08:53.000> to<00:08:53.160> try<00:08:53.839> again<00:08:54.839> and
attention so they get to try again and
attention so they get to try again and
this<00:08:55.399> time<00:08:55.600> they<00:08:55.760> got<00:08:55.920> it<00:08:56.160> right<00:08:56.720> there's<00:08:56.959> an
this time they got it right there's an
this time they got it right there's an
optional<00:08:57.560> explanation<00:08:58.200> if<00:08:58.360> they<00:08:58.480> want<00:08:59.000> and
optional explanation if they want and
optional explanation if they want and
now<00:08:59.480> the<00:08:59.560> video<00:08:59.839> moves<00:09:00.040> on<00:09:00.160> to<00:09:00.320> the<00:09:00.440> next<00:09:00.640> part
now the video moves on to the next part
now the video moves on to the next part
of<00:09:00.880> the
of the
of the
lecture<00:09:03.519> this<00:09:03.640> is<00:09:03.760> a<00:09:03.959> kind<00:09:04.120> of<00:09:04.279> simple
lecture this is a kind of simple
lecture this is a kind of simple
question<00:09:04.959> that<00:09:05.120> I<00:09:05.240> as<00:09:05.360> an<00:09:05.560> instructor<00:09:06.120> might
question that I as an instructor might
question that I as an instructor might
ask<00:09:06.560> in<00:09:06.760> class<00:09:07.240> but<00:09:07.440> when<00:09:07.560> I<00:09:07.680> asked<00:09:08.480> that<00:09:08.600> kind
ask in class but when I asked that kind
ask in class but when I asked that kind
of<00:09:08.839> a<00:09:09.000> question<00:09:09.240> in<00:09:09.440> class<00:09:09.839> 80%<00:09:10.519> of<00:09:10.640> the
of a question in class 80% of the
of a question in class 80% of the
students<00:09:11.240> are<00:09:11.399> still<00:09:11.560> scribbling<00:09:12.040> the<00:09:12.160> last
students are still scribbling the last
students are still scribbling the last
thing<00:09:12.560> I<00:09:12.680> said<00:09:13.480> 15%<00:09:14.440> are<00:09:14.600> zoned<00:09:14.920> out<00:09:15.040> on
thing I said 15% are zoned out on
thing I said 15% are zoned out on
Facebook<00:09:16.480> and<00:09:16.600> then<00:09:16.720> there's<00:09:16.920> a<00:09:17.040> smarty<00:09:17.399> pants
Facebook and then there's a smarty pants
Facebook and then there's a smarty pants
in<00:09:17.800> the<00:09:17.880> front<00:09:18.120> row<00:09:18.640> who<00:09:18.800> blurts<00:09:19.200> out<00:09:19.440> the
in the front row who blurts out the
in the front row who blurts out the
answer<00:09:19.959> before<00:09:20.200> anyone<00:09:20.480> else<00:09:20.680> has<00:09:20.839> had<00:09:20.959> a
answer before anyone else has had a
answer before anyone else has had a
chance<00:09:21.240> to<00:09:21.399> think<00:09:21.600> about<00:09:21.800> it<00:09:22.480> and<00:09:22.760> I<00:09:23.040> is<00:09:23.160> the
chance to think about it and I is the
chance to think about it and I is the
instructor<00:09:23.760> I'm<00:09:24.000> terribly<00:09:24.519> gratified<00:09:25.000> that
instructor I'm terribly gratified that
instructor I'm terribly gratified that
somebody<00:09:25.480> actually<00:09:25.640> knew<00:09:25.880> the<00:09:26.040> answer<00:09:27.000> and<00:09:27.160> so
somebody actually knew the answer and so
somebody actually knew the answer and so
the<00:09:27.800> lecture<00:09:28.200> moves<00:09:28.480> on<00:09:28.920> before<00:09:29.440> really<00:09:29.880> most
the lecture moves on before really most
the lecture moves on before really most
of<00:09:30.160> the<00:09:30.279> students<00:09:30.600> have<00:09:30.760> even<00:09:30.920> noticed<00:09:31.279> that<00:09:31.360> a
of the students have even noticed that a
of the students have even noticed that a
question<00:09:31.800> had<00:09:31.959> been<00:09:32.200> asked
question had been asked
question had been asked
here<00:09:34.680> every<00:09:34.959> single<00:09:35.360> student<00:09:36.079> has<00:09:36.240> to<00:09:36.399> engage
here every single student has to engage
here every single student has to engage
with<00:09:36.839> the
with the
with the
material<00:09:38.519> now<00:09:38.680> of<00:09:38.800> course<00:09:38.959> these<00:09:39.120> simple
material now of course these simple
material now of course these simple
retrieval<00:09:40.000> questions<00:09:40.360> are<00:09:40.560> not<00:09:40.760> the<00:09:40.880> end<00:09:41.040> of
retrieval questions are not the end of
retrieval questions are not the end of
the<00:09:41.320> story<00:09:41.920> one<00:09:42.079> needs<00:09:42.279> to<00:09:42.440> build<00:09:42.680> in<00:09:42.920> much
the story one needs to build in much
the story one needs to build in much
more<00:09:43.240> meaningful<00:09:43.839> practice<00:09:44.320> questions<00:09:44.959> and
more meaningful practice questions and
more meaningful practice questions and
one<00:09:45.360> also<00:09:45.519> needs<00:09:45.760> to<00:09:45.959> provide<00:09:46.240> the<00:09:46.360> students
one also needs to provide the students
one also needs to provide the students
with<00:09:46.920> feedback<00:09:47.680> on<00:09:47.920> those<00:09:48.160> questions<00:09:48.920> now<00:09:49.040> how
with feedback on those questions now how
with feedback on those questions now how
do<00:09:49.279> you<00:09:49.480> grade<00:09:49.839> the<00:09:49.959> work<00:09:50.480> of<00:09:50.839> 100,000
do you grade the work of 100,000
do you grade the work of 100,000
students<00:09:52.120> if<00:09:52.200> you<00:09:52.320> do<00:09:52.519> not<00:09:52.720> have<00:09:52.920> 10,000
students if you do not have 10,000
students if you do not have 10,000
Tas<00:09:55.360> the<00:09:55.519> answer<00:09:55.839> is<00:09:56.000> you<00:09:56.160> need<00:09:56.320> to<00:09:56.560> use
Tas the answer is you need to use
Tas the answer is you need to use
technology<00:09:57.519> to<00:09:57.680> do<00:09:57.800> it<00:09:57.959> for<00:09:58.200> you<00:09:58.920> now<00:09:59.079> for
technology to do it for you now for
technology to do it for you now for
fortunately<00:09:59.880> technology<00:10:00.320> has<00:10:00.480> come<00:10:00.640> a<00:10:00.760> long
fortunately technology has come a long
fortunately technology has come a long
way<00:10:01.480> and<00:10:01.640> we<00:10:01.760> can<00:10:01.880> now<00:10:02.120> grade<00:10:02.440> a<00:10:02.560> range<00:10:02.839> of
way and we can now grade a range of
way and we can now grade a range of
interesting<00:10:03.519> types<00:10:03.720> of<00:10:03.880> homework<00:10:04.839> in
interesting types of homework in
interesting types of homework in
addition<00:10:05.320> to<00:10:05.480> multiple<00:10:05.920> choice<00:10:06.560> and<00:10:06.680> the
addition to multiple choice and the
addition to multiple choice and the
kinds<00:10:07.000> of<00:10:07.079> short<00:10:07.399> answer<00:10:07.800> questions<00:10:08.120> that<00:10:08.240> you
kinds of short answer questions that you
kinds of short answer questions that you
saw<00:10:08.519> in<00:10:08.600> the<00:10:08.760> video<00:10:09.399> we<00:10:09.519> can<00:10:09.720> also<00:10:10.079> grade<00:10:10.839> math
saw in the video we can also grade math
saw in the video we can also grade math
mathematical<00:10:12.240> Expressions<00:10:12.760> as<00:10:12.880> well<00:10:13.040> as
mathematical Expressions as well as
mathematical Expressions as well as
mathematical<00:10:13.880> derivations<00:10:14.880> we<00:10:15.000> can<00:10:15.160> grade
mathematical derivations we can grade
mathematical derivations we can grade
models<00:10:16.160> whether<00:10:16.680> it's<00:10:17.160> um<00:10:17.680> Financial<00:10:18.200> models
models whether it's um Financial models
models whether it's um Financial models
in<00:10:18.760> a<00:10:18.920> business<00:10:19.360> class<00:10:19.800> or<00:10:20.040> physical<00:10:20.480> models
in a business class or physical models
in a business class or physical models
in<00:10:21.000> a<00:10:21.279> science<00:10:21.560> or<00:10:21.720> engineering<00:10:22.279> class<00:10:23.040> and<00:10:23.200> we
in a science or engineering class and we
in a science or engineering class and we
can<00:10:23.519> grade<00:10:23.959> some<00:10:24.240> pretty<00:10:24.519> sophisticated
can grade some pretty sophisticated
can grade some pretty sophisticated
programming<00:10:25.640> assignments<00:10:26.399> so<00:10:26.519> let<00:10:26.640> me<00:10:26.720> show
programming assignments so let me show
programming assignments so let me show
you<00:10:27.000> one<00:10:27.160> that's<00:10:27.399> actually<00:10:27.680> pretty<00:10:27.920> simple
you one that's actually pretty simple
you one that's actually pretty simple
but<00:10:28.560> fairly<00:10:28.920> visual
but fairly visual
but fairly visual
this<00:10:29.959> is<00:10:30.120> from<00:10:30.240> Stanford's<00:10:30.760> computer<00:10:31.040> science
this is from Stanford's computer science
this is from Stanford's computer science
101<00:10:31.880> class<00:10:32.120> and<00:10:32.240> the<00:10:32.360> students<00:10:32.640> is<00:10:32.800> supposed
101 class and the students is supposed
101 class and the students is supposed
to<00:10:33.200> color<00:10:33.519> correct<00:10:33.880> that<00:10:34.000> blurry<00:10:34.440> red<00:10:34.680> image
to color correct that blurry red image
to color correct that blurry red image
they're<00:10:35.880> typing<00:10:36.160> their<00:10:36.360> program<00:10:36.680> into<00:10:36.839> the
they're typing their program into the
they're typing their program into the
browser<00:10:37.720> and<00:10:37.800> you<00:10:37.920> can<00:10:38.000> see<00:10:38.200> they<00:10:38.320> didn't<00:10:38.519> get
browser and you can see they didn't get
browser and you can see they didn't get
it<00:10:38.800> quite<00:10:39.079> right<00:10:39.399> Lady<00:10:39.680> Liberty<00:10:40.040> is<00:10:40.160> still
it quite right Lady Liberty is still
it quite right Lady Liberty is still
seasick<00:10:41.720> and<00:10:41.880> so<00:10:42.120> the<00:10:42.240> student<00:10:42.480> tries<00:10:42.839> again
seasick and so the student tries again
seasick and so the student tries again
and<00:10:43.360> now<00:10:43.519> they<00:10:43.639> got<00:10:43.800> it<00:10:44.040> right<00:10:44.399> and<00:10:44.519> they're
and now they got it right and they're
and now they got it right and they're
told<00:10:45.079> that<00:10:45.360> and<00:10:45.480> they<00:10:45.600> can<00:10:45.720> move<00:10:45.920> on<00:10:46.000> to<00:10:46.160> the
told that and they can move on to the
told that and they can move on to the
next<00:10:47.000> assignment<00:10:48.000> this<00:10:48.279> ability<00:10:48.959> to<00:10:49.200> interact
next assignment this ability to interact
next assignment this ability to interact
actively<00:10:50.160> with<00:10:50.320> the<00:10:50.440> material<00:10:51.040> and<00:10:51.160> be<00:10:51.320> told
actively with the material and be told
actively with the material and be told
when<00:10:51.800> you're<00:10:52.000> right<00:10:52.120> or<00:10:52.279> wrong<00:10:52.560> is<00:10:52.720> really
when you're right or wrong is really
when you're right or wrong is really
essential<00:10:53.639> to<00:10:53.800> Student<00:10:54.600> Learning<00:10:55.600> now<00:10:55.800> of
essential to Student Learning now of
essential to Student Learning now of
course<00:10:56.320> we<00:10:56.480> cannot<00:10:56.920> yet<00:10:57.560> grade<00:10:58.120> the<00:10:58.279> range<00:10:58.560> of
course we cannot yet grade the range of
course we cannot yet grade the range of
work<00:10:58.920> that<00:10:59.040> one<00:10:59.320> needs<00:10:59.560> for<00:10:59.760> all<00:11:00.040> courses
work that one needs for all courses
work that one needs for all courses
specifically<00:11:01.680> what's<00:11:01.920> lacking<00:11:02.240> is<00:11:02.360> the<00:11:02.519> kind
specifically what's lacking is the kind
specifically what's lacking is the kind
of<00:11:02.880> critical<00:11:03.360> thinking<00:11:03.760> work<00:11:04.120> that<00:11:04.240> is<00:11:04.399> so
of critical thinking work that is so
of critical thinking work that is so
essential<00:11:05.120> in<00:11:05.279> such<00:11:05.519> disciplines<00:11:06.040> as<00:11:06.160> the
essential in such disciplines as the
essential in such disciplines as the
humanities<00:11:07.279> the<00:11:07.440> social<00:11:07.800> sciences<00:11:08.320> business
humanities the social sciences business
humanities the social sciences business
and<00:11:09.040> others<00:11:10.040> so<00:11:10.279> we<00:11:10.399> tried<00:11:10.639> to<00:11:10.839> convince<00:11:11.279> for
and others so we tried to convince for
and others so we tried to convince for
example<00:11:11.800> some<00:11:11.920> of<00:11:12.040> our<00:11:12.240> humanities<00:11:12.839> faculty
example some of our humanities faculty
example some of our humanities faculty
that<00:11:13.600> multiple<00:11:14.000> choice<00:11:14.320> was<00:11:14.480> not<00:11:14.680> such<00:11:14.839> a<00:11:14.959> bad
that multiple choice was not such a bad
that multiple choice was not such a bad
strategy<00:11:16.079> that<00:11:16.200> didn't<00:11:16.399> go<00:11:16.560> over<00:11:16.800> really
strategy that didn't go over really
strategy that didn't go over really
well<00:11:18.760> so<00:11:18.920> we<00:11:19.079> had<00:11:19.200> to<00:11:19.320> come<00:11:19.480> up<00:11:19.600> with<00:11:19.720> a
well so we had to come up with a
well so we had to come up with a
different<00:11:20.240> solution<00:11:21.240> and<00:11:21.360> the<00:11:21.480> solution<00:11:21.839> we
different solution and the solution we
different solution and the solution we
ended<00:11:22.160> up<00:11:22.320> using<00:11:22.600> is<00:11:22.800> peer<00:11:23.040> grading<00:11:24.040> it<00:11:24.160> turns
ended up using is peer grading it turns
ended up using is peer grading it turns
out<00:11:25.000> that<00:11:25.240> previous<00:11:25.600> studies<00:11:25.959> show<00:11:26.279> like<00:11:26.480> this
out that previous studies show like this
out that previous studies show like this
one<00:11:26.800> by<00:11:26.920> Sadler<00:11:27.399> and<00:11:27.560> good<00:11:27.920> that<00:11:28.079> peer<00:11:28.320> grading
one by Sadler and good that peer grading
one by Sadler and good that peer grading
is<00:11:28.720> a<00:11:28.839> surprising<00:11:29.480> ly<00:11:29.639> effective<00:11:30.040> strategy
is a surprising ly effective strategy
is a surprising ly effective strategy
for<00:11:30.959> providing<00:11:31.440> reproducible<00:11:32.600> grades<00:11:33.600> it<00:11:33.680> was
for providing reproducible grades it was
for providing reproducible grades it was
tried<00:11:34.160> only<00:11:34.399> in<00:11:34.560> small<00:11:34.959> classes<00:11:35.440> but<00:11:35.720> there<00:11:35.880> it
tried only in small classes but there it
tried only in small classes but there it
showed<00:11:36.399> for<00:11:36.560> example<00:11:37.360> that<00:11:37.519> the<00:11:37.680> students
showed for example that the students
showed for example that the students
assign<00:11:38.399> grade<00:11:38.639> on<00:11:38.760> the<00:11:38.920> y-axis<00:11:39.360> are<00:11:39.600> actually
assign grade on the y-axis are actually
assign grade on the y-axis are actually
very<00:11:40.040> well<00:11:40.200> correlated<00:11:40.680> with<00:11:40.800> the<00:11:40.880> teacher
very well correlated with the teacher
very well correlated with the teacher
assign<00:11:41.519> grade<00:11:41.720> on<00:11:41.839> the<00:11:42.240> x-axis<00:11:43.240> what's<00:11:43.440> even
assign grade on the x-axis what's even
assign grade on the x-axis what's even
more<00:11:43.920> surprising<00:11:44.800> is<00:11:44.959> that<00:11:45.440> self-<00:11:45.839> grades
more surprising is that self- grades
more surprising is that self- grades
where<00:11:46.399> the<00:11:46.560> students<00:11:47.160> grade<00:11:47.440> their<00:11:47.560> own<00:11:47.760> work
where the students grade their own work
where the students grade their own work
critically<00:11:48.519> so<00:11:48.720> long<00:11:48.839> as<00:11:48.959> you<00:11:49.160> incentivize
critically so long as you incentivize
critically so long as you incentivize
them<00:11:49.920> properly<00:11:50.240> so<00:11:50.440> they<00:11:50.560> can't<00:11:50.720> give
them properly so they can't give
them properly so they can't give
themselves<00:11:51.160> a<00:11:51.279> perfect<00:11:51.600> score<00:11:52.600> um<00:11:52.720> are
themselves a perfect score um are
themselves a perfect score um are
actually<00:11:53.279> even<00:11:53.480> better<00:11:53.760> correlated<00:11:54.240> with<00:11:54.360> the
actually even better correlated with the
actually even better correlated with the
teacher<00:11:54.760> grades<00:11:55.279> and<00:11:55.360> so<00:11:55.519> this<00:11:55.639> is<00:11:55.760> an
teacher grades and so this is an
teacher grades and so this is an
effective<00:11:56.519> strategy<00:11:57.040> that<00:11:57.160> can<00:11:57.279> be<00:11:57.399> used<00:11:57.639> for
effective strategy that can be used for
effective strategy that can be used for
grading<00:11:58.120> its<00:11:58.320> scale<00:11:58.920> and<00:11:59.040> is<00:11:59.399> also<00:11:59.720> a<00:11:59.839> useful
grading its scale and is also a useful
grading its scale and is also a useful
learning<00:12:00.600> strategy<00:12:01.079> for<00:12:01.320> the<00:12:01.440> students
learning strategy for the students
learning strategy for the students
because<00:12:02.079> they<00:12:02.240> actually<00:12:02.440> learn<00:12:02.760> from<00:12:02.920> the
because they actually learn from the
because they actually learn from the
experience<00:12:04.279> so<00:12:04.480> we<00:12:04.639> now<00:12:04.920> have<00:12:05.720> the<00:12:05.920> largest
experience so we now have the largest
experience so we now have the largest
peer<00:12:06.760> grading<00:12:07.279> pipeline<00:12:07.760> ever<00:12:08.040> devised<00:12:08.639> where
peer grading pipeline ever devised where
peer grading pipeline ever devised where
tens<00:12:09.279> of<00:12:09.560> thousands<00:12:10.560> of<00:12:10.760> students<00:12:11.079> are
tens of thousands of students are
tens of thousands of students are
grading<00:12:11.600> each<00:12:11.760> other's<00:12:12.079> work<00:12:12.279> and<00:12:12.480> quite
grading each other's work and quite
grading each other's work and quite
successfully<00:12:13.279> I<00:12:13.440> have<00:12:13.560> to
successfully I have to
successfully I have to
say<00:12:16.120> but<00:12:16.279> this<00:12:16.399> is<00:12:16.560> not<00:12:16.839> just<00:12:17.040> about<00:12:17.320> students
say but this is not just about students
say but this is not just about students
sitting<00:12:18.000> alone<00:12:18.279> in<00:12:18.440> their<00:12:18.600> living<00:12:18.880> room
sitting alone in their living room
sitting alone in their living room
working<00:12:19.720> through<00:12:20.040> problems<00:12:20.959> around<00:12:21.440> each<00:12:21.680> one
working through problems around each one
working through problems around each one
of<00:12:21.959> our<00:12:22.160> courses<00:12:22.680> a<00:12:22.839> community<00:12:23.480> of<00:12:23.639> students
of our courses a community of students
of our courses a community of students
had<00:12:24.240> formed<00:12:25.120> a<00:12:25.279> global<00:12:25.720> community<00:12:26.120> of<00:12:26.320> people
had formed a global community of people
had formed a global community of people
around<00:12:27.240> a<00:12:27.360> shared<00:12:27.800> intellectual<00:12:28.360> endeavor
around a shared intellectual endeavor
around a shared intellectual endeavor
what<00:12:29.360> you<00:12:29.440> see<00:12:29.680> here<00:12:30.120> is<00:12:30.480> a<00:12:30.639> self-generated
what you see here is a self-generated
what you see here is a self-generated
map<00:12:31.920> from<00:12:32.120> students<00:12:32.480> in<00:12:32.600> our<00:12:32.800> Princeton
map from students in our Princeton
map from students in our Princeton
sociology<00:12:33.839> 101<00:12:34.360> course<00:12:35.160> where<00:12:35.680> um<00:12:35.800> they<00:12:35.920> have
sociology 101 course where um they have
sociology 101 course where um they have
put<00:12:36.440> themselves<00:12:36.639> in<00:12:36.760> a<00:12:36.880> world<00:12:37.240> map<00:12:37.440> and<00:12:37.560> you
put themselves in a world map and you
put themselves in a world map and you
can<00:12:37.800> really<00:12:37.959> see<00:12:38.199> the<00:12:38.320> global<00:12:38.639> reach<00:12:38.920> of<00:12:39.079> this
can really see the global reach of this
can really see the global reach of this
kind<00:12:39.399> of<00:12:39.959> effort<00:12:40.959> students<00:12:41.519> collaborated<00:12:42.160> in
kind of effort students collaborated in
kind of effort students collaborated in
these<00:12:42.480> courses<00:12:42.800> in<00:12:42.920> a<00:12:43.079> variety<00:12:43.440> of<00:12:43.600> different
these courses in a variety of different
these courses in a variety of different
ways<00:12:45.079> first<00:12:45.320> of<00:12:45.480> all<00:12:45.880> there<00:12:46.000> was<00:12:46.120> a<00:12:46.279> question
ways first of all there was a question
ways first of all there was a question
and<00:12:46.800> answer<00:12:47.120> form<00:12:47.760> where<00:12:48.000> students<00:12:48.639> would
and answer form where students would
and answer form where students would
pose<00:12:49.279> questions<00:12:49.959> and<00:12:50.160> other<00:12:50.440> students<00:12:50.800> would
pose questions and other students would
pose questions and other students would
answer<00:12:51.399> those<00:12:51.639> questions<00:12:52.560> and<00:12:52.680> the<00:12:52.800> really
answer those questions and the really
answer those questions and the really
amazing<00:12:53.519> thing<00:12:53.680> is<00:12:53.959> because<00:12:54.320> there<00:12:54.399> were<00:12:54.600> so
amazing thing is because there were so
amazing thing is because there were so
many<00:12:55.079> students<00:12:55.839> it<00:12:55.959> means<00:12:56.240> that<00:12:56.560> even<00:12:56.720> if<00:12:56.839> a
many students it means that even if a
many students it means that even if a
student<00:12:57.320> posed<00:12:57.680> the<00:12:57.839> question<00:12:58.320> at<00:12:58.480> 3:00<00:12:58.959> in<00:12:59.160> in
student posed the question at 3:00 in in
student posed the question at 3:00 in in
the<00:12:59.320> morning<00:13:00.079> somewhere<00:13:00.519> around<00:13:00.760> the<00:13:00.920> world
the morning somewhere around the world
the morning somewhere around the world
there<00:13:01.639> would<00:13:01.839> be<00:13:02.040> somebody<00:13:02.720> who<00:13:02.880> was<00:13:03.079> awake
there would be somebody who was awake
there would be somebody who was awake
and<00:13:03.959> working<00:13:04.320> on<00:13:04.480> the<00:13:04.639> same<00:13:05.000> problem<00:13:05.760> and<00:13:05.880> so
and working on the same problem and so
and working on the same problem and so
in<00:13:06.560> many<00:13:06.760> of<00:13:06.880> our<00:13:07.160> courses<00:13:07.519> the<00:13:07.639> median
in many of our courses the median
in many of our courses the median
response<00:13:08.720> time<00:13:09.199> for<00:13:09.399> a<00:13:09.560> question<00:13:10.240> on<00:13:10.440> the
response time for a question on the
response time for a question on the
question<00:13:10.800> and<00:13:11.040> answer<00:13:11.279> form<00:13:11.920> was<00:13:12.120> 22<00:13:13.079> minutes
question and answer form was 22 minutes
question and answer form was 22 minutes
which<00:13:14.199> is<00:13:14.320> not<00:13:14.480> a<00:13:14.639> level<00:13:14.839> of<00:13:14.959> service<00:13:15.399> that<00:13:15.519> I
which is not a level of service that I
which is not a level of service that I
have<00:13:15.760> ever<00:13:16.000> offered<00:13:16.279> to<00:13:16.399> my<00:13:16.519> Stanford
have ever offered to my Stanford
have ever offered to my Stanford
students<00:13:19.120> and<00:13:19.240> you<00:13:19.360> can<00:13:19.560> see<00:13:19.839> from<00:13:20.000> the
students and you can see from the
students and you can see from the
student<00:13:20.519> testimonials<00:13:21.320> that<00:13:21.519> students
student testimonials that students
student testimonials that students
actually<00:13:22.360> find<00:13:23.000> that<00:13:23.440> because<00:13:23.720> of<00:13:23.920> this<00:13:24.120> large
actually find that because of this large
actually find that because of this large
online<00:13:24.880> community<00:13:25.639> they<00:13:25.839> got<00:13:26.000> to<00:13:26.199> interact
online community they got to interact
online community they got to interact
with<00:13:26.880> each<00:13:27.040> other<00:13:27.320> in<00:13:27.480> many<00:13:27.760> ways<00:13:28.360> that<00:13:28.519> were
with each other in many ways that were
with each other in many ways that were
deeper<00:13:29.440> than<00:13:29.600> they<00:13:29.760> did<00:13:30.000> in<00:13:30.079> the<00:13:30.240> context<00:13:30.560> of<00:13:30.680> a
deeper than they did in the context of a
deeper than they did in the context of a
physical
physical
physical
classroom<00:13:33.000> students<00:13:33.480> also<00:13:33.760> self-assembled
classroom students also self-assembled
classroom students also self-assembled
that<00:13:34.800> any<00:13:35.040> kind<00:13:35.199> of<00:13:35.399> intervention<00:13:35.959> from<00:13:36.160> us
that any kind of intervention from us
that any kind of intervention from us
into<00:13:37.079> small<00:13:37.320> study<00:13:37.920> groups<00:13:38.920> some<00:13:39.120> of<00:13:39.320> these
into small study groups some of these
into small study groups some of these
were<00:13:39.760> physical<00:13:40.199> study<00:13:40.480> groups<00:13:40.800> along
were physical study groups along
were physical study groups along
geographical<00:13:41.839> constraints<00:13:42.360> and<00:13:42.480> met<00:13:42.760> on<00:13:42.880> a
geographical constraints and met on a
geographical constraints and met on a
weekly<00:13:43.399> basis<00:13:43.720> to<00:13:43.880> work<00:13:44.040> through<00:13:44.279> problem
weekly basis to work through problem
weekly basis to work through problem
sets<00:13:45.279> this<00:13:45.360> is<00:13:45.600> the<00:13:45.920> San<00:13:46.199> Francisco<00:13:46.639> study
sets this is the San Francisco study
sets this is the San Francisco study
group<00:13:47.160> but<00:13:47.279> there<00:13:47.360> were<00:13:47.560> ones<00:13:47.880> all<00:13:48.079> over<00:13:48.320> the
group but there were ones all over the
group but there were ones all over the
world<00:13:49.680> others<00:13:50.040> were<00:13:50.279> virtual<00:13:50.720> study<00:13:51.040> groups
world others were virtual study groups
world others were virtual study groups
sometimes<00:13:51.920> along<00:13:52.320> language<00:13:52.759> lines<00:13:53.079> or<00:13:53.240> along
sometimes along language lines or along
sometimes along language lines or along
cultural<00:13:54.040> lines<00:13:54.680> and<00:13:54.800> at<00:13:54.959> the<00:13:55.079> bottom<00:13:55.399> left
cultural lines and at the bottom left
cultural lines and at the bottom left
there<00:13:56.079> you<00:13:56.199> see<00:13:56.440> our<00:13:56.759> multi-<00:13:57.759> cultural
there you see our multi- cultural
there you see our multi- cultural
Universal<00:13:59.120> study<00:13:59.360> group<00:13:59.560> where<00:13:59.759> people
Universal study group where people
Universal study group where people
explicitly<00:14:00.600> wanted<00:14:00.880> to<00:14:01.040> connect<00:14:01.600> with<00:14:01.759> people
explicitly wanted to connect with people
explicitly wanted to connect with people
from<00:14:02.199> other
from other
from other
cultures<00:14:04.600> there's<00:14:04.839> some<00:14:05.079> tremendous
cultures there's some tremendous
cultures there's some tremendous
opportunities<00:14:06.959> um<00:14:07.199> to<00:14:07.360> be<00:14:07.800> had<00:14:08.120> from<00:14:08.320> this
opportunities um to be had from this
opportunities um to be had from this
kind<00:14:08.680> of<00:14:09.199> framework<00:14:10.199> the<00:14:10.399> first<00:14:10.839> is<00:14:11.079> that<00:14:11.279> it
kind of framework the first is that it
kind of framework the first is that it
it<00:14:11.959> has<00:14:12.240> the<00:14:12.440> potential<00:14:12.920> of<00:14:13.079> giving<00:14:13.360> us<00:14:13.680> a
it has the potential of giving us a
it has the potential of giving us a
completely<00:14:14.720> unprecedented<00:14:15.720> look<00:14:16.120> into
completely unprecedented look into
completely unprecedented look into
understanding<00:14:17.240> human<00:14:17.519> learning<00:14:18.399> because<00:14:18.639> the
understanding human learning because the
understanding human learning because the
data<00:14:19.160> that<00:14:19.360> we<00:14:19.720> can<00:14:19.959> collect<00:14:20.320> here<00:14:20.519> is<00:14:20.839> unique
data that we can collect here is unique
data that we can collect here is unique
you<00:14:22.000> can<00:14:22.240> collect<00:14:22.680> every<00:14:23.160> click<00:14:24.160> every
you can collect every click every
you can collect every click every
homework<00:14:24.880> submission<00:14:25.880> every<00:14:26.120> Forum<00:14:26.639> post
homework submission every Forum post
homework submission every Forum post
from<00:14:27.560> tens<00:14:28.079> of<00:14:28.279> thousands<00:14:28.639> of<00:14:28.759> students
from tens of thousands of students
from tens of thousands of students
so<00:14:30.360> you<00:14:30.519> can<00:14:30.759> turn<00:14:31.160> the<00:14:31.279> study<00:14:31.560> of<00:14:31.720> human
so you can turn the study of human
so you can turn the study of human
learning<00:14:32.680> from<00:14:32.839> the<00:14:33.040> hypothesis<00:14:33.680> driven<00:14:34.079> mode
learning from the hypothesis driven mode
learning from the hypothesis driven mode
to<00:14:35.079> the<00:14:35.240> datadriven<00:14:35.839> mode<00:14:36.240> a<00:14:36.440> transformation
to the datadriven mode a transformation
to the datadriven mode a transformation
that<00:14:37.360> for<00:14:37.519> example<00:14:37.920> has<00:14:38.079> revolutionized
that for example has revolutionized
that for example has revolutionized
biology<00:14:40.320> you<00:14:40.440> can<00:14:40.639> use<00:14:40.920> these<00:14:41.160> data<00:14:41.720> to
biology you can use these data to
biology you can use these data to
understand<00:14:42.519> fundamental<00:14:43.160> questions<00:14:43.920> like
understand fundamental questions like
understand fundamental questions like
what<00:14:44.240> are<00:14:44.399> good<00:14:44.560> learning<00:14:45.079> strategies<00:14:45.759> that
what are good learning strategies that
what are good learning strategies that
are<00:14:46.079> effective<00:14:46.639> versus<00:14:47.040> ones<00:14:47.240> that<00:14:47.360> are<00:14:47.560> not
are effective versus ones that are not
are effective versus ones that are not
and<00:14:48.560> in<00:14:48.680> the<00:14:48.839> context<00:14:49.199> of<00:14:49.440> particular<00:14:49.920> courses
and in the context of particular courses
and in the context of particular courses
you<00:14:50.800> can<00:14:51.040> ask<00:14:51.399> questions<00:14:52.199> like<00:14:52.600> what<00:14:52.759> are<00:14:53.079> some
you can ask questions like what are some
you can ask questions like what are some
of<00:14:53.360> the<00:14:53.519> misconceptions<00:14:54.320> that<00:14:54.440> are<00:14:54.600> more
of the misconceptions that are more
of the misconceptions that are more
common<00:14:55.360> and<00:14:55.519> how<00:14:55.639> do<00:14:55.759> we<00:14:55.880> help<00:14:56.120> students<00:14:56.519> fix
common and how do we help students fix
common and how do we help students fix
them<00:14:57.480> so<00:14:57.639> here<00:14:57.759> is<00:14:57.880> an<00:14:58.079> example<00:14:58.440> of<00:14:58.600> that<00:14:58.800> also
them so here is an example of that also
them so here is an example of that also
o<00:14:59.199> from<00:14:59.320> Andrew's<00:14:59.720> machine<00:14:59.959> learning<00:15:00.320> class
o from Andrew's machine learning class
o from Andrew's machine learning class
this<00:15:01.079> is<00:15:01.320> a<00:15:01.480> distribution<00:15:02.079> of<00:15:02.279> wrong<00:15:02.639> answers
this is a distribution of wrong answers
this is a distribution of wrong answers
to<00:15:03.240> one<00:15:03.360> of<00:15:03.519> Andrew's<00:15:04.199> assignments<00:15:04.759> the
to one of Andrew's assignments the
to one of Andrew's assignments the
answers<00:15:05.320> happen<00:15:05.560> to<00:15:05.720> be<00:15:05.880> pairs<00:15:06.120> of<00:15:06.279> numbers<00:15:06.560> so
answers happen to be pairs of numbers so
answers happen to be pairs of numbers so
you<00:15:06.759> can<00:15:07.000> draw<00:15:07.160> them<00:15:07.279> on<00:15:07.399> this
you can draw them on this
you can draw them on this
two-dimensional<00:15:08.199> plot<00:15:09.000> each<00:15:09.160> of<00:15:09.279> the<00:15:09.399> little
two-dimensional plot each of the little
two-dimensional plot each of the little
crosses<00:15:10.120> that<00:15:10.240> you<00:15:10.360> see<00:15:10.920> is<00:15:11.079> a<00:15:11.240> different
crosses that you see is a different
crosses that you see is a different
wrong<00:15:11.920> answer<00:15:12.920> the<00:15:13.120> big<00:15:13.440> cross<00:15:13.959> at<00:15:14.120> the<00:15:14.360> top
wrong answer the big cross at the top
wrong answer the big cross at the top
left<00:15:15.399> is<00:15:15.560> where<00:15:15.839> 2,000<00:15:16.759> students<00:15:17.480> gave<00:15:17.759> the
left is where 2,000 students gave the
left is where 2,000 students gave the
exact<00:15:18.399> same<00:15:18.639> wrong
exact same wrong
exact same wrong
answer<00:15:20.440> now<00:15:20.639> if<00:15:20.839> two<00:15:21.079> students<00:15:21.440> in<00:15:21.560> a<00:15:21.720> class<00:15:21.959> of
answer now if two students in a class of
answer now if two students in a class of
a<00:15:22.279> hundred<00:15:22.600> give<00:15:22.759> the<00:15:22.880> same<00:15:23.160> wrong<00:15:23.399> answer<00:15:23.800> you
a hundred give the same wrong answer you
a hundred give the same wrong answer you
would<00:15:24.079> never<00:15:24.279> notice<00:15:25.120> but<00:15:25.279> when<00:15:25.440> 2,000
would never notice but when 2,000
would never notice but when 2,000
students<00:15:26.680> give<00:15:26.920> the<00:15:27.040> same<00:15:27.240> wrong<00:15:27.480> answer<00:15:27.800> it's
students give the same wrong answer it's
students give the same wrong answer it's
kind<00:15:28.079> of<00:15:28.199> hard<00:15:28.360> to<00:15:28.519> miss
kind of hard to miss
kind of hard to miss
so<00:15:30.120> Andrew<00:15:30.440> and<00:15:30.560> his<00:15:30.720> students<00:15:31.079> went<00:15:31.319> in
so Andrew and his students went in
so Andrew and his students went in
looked<00:15:31.880> at<00:15:32.000> some<00:15:32.160> of<00:15:32.319> those<00:15:32.519> assignments
looked at some of those assignments
looked at some of those assignments
understood<00:15:34.440> the<00:15:34.959> uh<00:15:35.279> the<00:15:35.399> root<00:15:35.759> cause<00:15:36.040> of<00:15:36.160> the
understood the uh the root cause of the
understood the uh the root cause of the
misconception<00:15:37.319> and<00:15:37.480> then<00:15:37.639> they<00:15:37.839> produced<00:15:38.519> a
misconception and then they produced a
misconception and then they produced a
targeted<00:15:39.160> error<00:15:39.480> message<00:15:39.839> that<00:15:39.959> would<00:15:40.120> be
targeted error message that would be
targeted error message that would be
provided<00:15:41.079> to<00:15:41.319> every<00:15:41.600> student<00:15:42.079> whose<00:15:42.360> answer
provided to every student whose answer
provided to every student whose answer
fell<00:15:42.920> into<00:15:43.199> that<00:15:43.360> bucket<00:15:44.199> which<00:15:44.319> means<00:15:44.600> that
fell into that bucket which means that
fell into that bucket which means that
students<00:15:45.120> who<00:15:45.279> made<00:15:45.519> that<00:15:45.680> same<00:15:45.920> mistake
students who made that same mistake
students who made that same mistake
would<00:15:46.720> now<00:15:46.920> get<00:15:47.199> personalized<00:15:47.800> feedback
would now get personalized feedback
would now get personalized feedback
telling<00:15:48.800> them<00:15:49.000> how<00:15:49.079> to<00:15:49.279> fix<00:15:49.720> their<00:15:50.040> um
telling them how to fix their um
telling them how to fix their um
misconception<00:15:50.839> much<00:15:51.000> more<00:15:51.680> effectively<00:15:52.680> so
misconception much more effectively so
misconception much more effectively so
there's<00:15:53.519> so<00:15:53.720> this<00:15:54.000> personalization<00:15:55.000> is
there's so this personalization is
there's so this personalization is
something<00:15:55.480> that<00:15:55.600> one<00:15:55.800> can<00:15:56.000> then<00:15:56.199> build<00:15:56.839> by
something that one can then build by
something that one can then build by
having<00:15:57.240> the<00:15:57.399> virtue<00:15:57.680> of<00:15:57.839> large<00:15:58.120> numbers
having the virtue of large numbers
having the virtue of large numbers
personalization<00:16:01.399> is<00:16:01.680> perhaps<00:16:02.360> one<00:16:02.480> of<00:16:02.639> the
personalization is perhaps one of the
personalization is perhaps one of the
biggest<00:16:03.199> opportunities<00:16:03.800> here<00:16:04.000> as<00:16:04.120> well
biggest opportunities here as well
biggest opportunities here as well
because<00:16:04.639> it<00:16:04.880> provides<00:16:05.279> us<00:16:05.920> with<00:16:06.160> the
because it provides us with the
because it provides us with the
potential<00:16:07.040> of<00:16:07.240> solving<00:16:07.720> a<00:16:07.880> 30-year-old
potential of solving a 30-year-old
potential of solving a 30-year-old
problem<00:16:09.680> educational<00:16:10.319> researcher<00:16:10.920> Benjamin
problem educational researcher Benjamin
problem educational researcher Benjamin
bloom<00:16:11.680> in<00:16:12.079> 1984<00:16:13.079> posed<00:16:13.480> What's<00:16:13.639> called<00:16:13.839> the
bloom in 1984 posed What's called the
bloom in 1984 posed What's called the
two<00:16:14.199> Sigma<00:16:14.600> problem<00:16:15.279> which<00:16:15.399> you<00:16:15.600> observed<00:16:16.000> by
two Sigma problem which you observed by
two Sigma problem which you observed by
studying<00:16:16.519> three
studying three
studying three
populations<00:16:18.319> the<00:16:18.480> first<00:16:18.839> is<00:16:19.000> the<00:16:19.199> population
populations the first is the population
populations the first is the population
that's<00:16:19.959> studied<00:16:20.319> in<00:16:20.399> a<00:16:20.519> lecture-based
that's studied in a lecture-based
that's studied in a lecture-based
classroom<00:16:22.279> the<00:16:22.440> second<00:16:22.839> is<00:16:23.160> a<00:16:23.319> population<00:16:23.680> of
classroom the second is a population of
classroom the second is a population of
students<00:16:24.120> that<00:16:24.240> studied<00:16:24.560> using<00:16:24.800> a<00:16:24.920> standard
students that studied using a standard
students that studied using a standard
lecture-based<00:16:25.680> classroom<00:16:26.480> but<00:16:26.600> with<00:16:26.720> a
lecture-based classroom but with a
lecture-based classroom but with a
Mastery<00:16:27.319> based<00:16:27.720> approach<00:16:28.319> so<00:16:28.440> that<00:16:28.560> students
Mastery based approach so that students
Mastery based approach so that students
couldn't<00:16:29.199> move<00:16:29.360> on<00:16:29.440> to<00:16:29.600> the<00:16:29.759> next<00:16:30.040> topic
couldn't move on to the next topic
couldn't move on to the next topic
before<00:16:31.279> uh<00:16:31.440> demonstrating<00:16:31.959> Mastery<00:16:32.319> of<00:16:32.399> the
before uh demonstrating Mastery of the
before uh demonstrating Mastery of the
previous<00:16:32.880> one<00:16:33.720> and<00:16:33.920> finally<00:16:34.480> there<00:16:34.639> was<00:16:34.759> a
previous one and finally there was a
previous one and finally there was a
population<00:16:35.480> of<00:16:35.639> students<00:16:36.519> that<00:16:36.920> were<00:16:37.240> taught
population of students that were taught
population of students that were taught
in<00:16:37.600> a<00:16:37.800> one-on-one<00:16:38.600> instruction<00:16:39.040> using<00:16:39.279> a
in a one-on-one instruction using a
in a one-on-one instruction using a
tutor<00:16:40.720> the<00:16:40.880> Mastery<00:16:41.319> based<00:16:41.680> population<00:16:42.120> is<00:16:42.240> a
tutor the Mastery based population is a
tutor the Mastery based population is a
full<00:16:42.680> standard<00:16:43.199> deviation<00:16:43.839> or<00:16:44.120> Sigma<00:16:44.560> in
full standard deviation or Sigma in
full standard deviation or Sigma in
achievement<00:16:45.240> scores<00:16:45.720> better<00:16:45.959> than<00:16:46.120> the
achievement scores better than the
achievement scores better than the
standard<00:16:46.600> lecture-based<00:16:47.440> class<00:16:48.440> and<00:16:48.560> the
standard lecture-based class and the
standard lecture-based class and the
individual<00:16:49.120> tutoring<00:16:49.560> gives<00:16:49.720> you<00:16:49.839> two<00:16:50.120> Sigma
individual tutoring gives you two Sigma
individual tutoring gives you two Sigma
Improvement<00:16:51.240> in<00:16:51.440> performance<00:16:52.279> to<00:16:52.720> understand
Improvement in performance to understand
Improvement in performance to understand
what<00:16:53.199> that<00:16:53.319> means<00:16:53.920> let's<00:16:54.160> look<00:16:54.360> at<00:16:54.480> the
what that means let's look at the
what that means let's look at the
lecture-based<00:16:54.959> classroom<00:16:55.639> let's<00:16:55.800> pick<00:16:56.040> the
lecture-based classroom let's pick the
lecture-based classroom let's pick the
median<00:16:56.639> performance<00:16:57.480> as<00:16:57.600> a<00:16:57.759> threshold<00:16:58.440> so<00:16:58.600> in
median performance as a threshold so in
median performance as a threshold so in
the<00:16:58.920> lecture-based<00:16:59.319> class<00:17:00.160> half<00:17:00.360> the
the lecture-based class half the
the lecture-based class half the
students<00:17:01.040> are<00:17:01.240> above<00:17:01.560> that<00:17:01.720> level<00:17:01.959> and<00:17:02.160> half
students are above that level and half
students are above that level and half
are<00:17:02.880> below<00:17:03.880> in<00:17:04.039> the<00:17:04.319> individual<00:17:04.760> tutoring
are below in the individual tutoring
are below in the individual tutoring
instruction<00:17:06.520> 98%<00:17:07.520> of<00:17:07.679> the<00:17:07.839> students<00:17:08.400> are
instruction 98% of the students are
instruction 98% of the students are
going<00:17:08.760> to<00:17:08.880> be<00:17:09.079> above<00:17:09.400> that<00:17:10.079> threshold<00:17:11.079> imagine
going to be above that threshold imagine
going to be above that threshold imagine
if<00:17:11.799> we<00:17:11.959> could<00:17:12.160> teach<00:17:12.520> so<00:17:12.720> that<00:17:12.959> 98%<00:17:13.959> of<00:17:14.079> our
if we could teach so that 98% of our
if we could teach so that 98% of our
students<00:17:14.919> would<00:17:15.079> be<00:17:15.199> above
students would be above
students would be above
average<00:17:17.640> hence<00:17:18.360> the<00:17:18.520> two<00:17:18.760> Sigma<00:17:19.319> problem
average hence the two Sigma problem
average hence the two Sigma problem
because<00:17:20.559> we<00:17:20.720> cannot<00:17:21.120> afford<00:17:21.600> as<00:17:21.720> a<00:17:21.959> society<00:17:22.720> to
because we cannot afford as a society to
because we cannot afford as a society to
provide<00:17:23.360> every<00:17:23.559> student<00:17:23.839> with<00:17:23.959> an<00:17:24.120> individual
provide every student with an individual
provide every student with an individual
human<00:17:24.799> tutor<00:17:25.720> but<00:17:25.919> maybe<00:17:26.160> we<00:17:26.280> can<00:17:26.480> afford<00:17:26.799> to
human tutor but maybe we can afford to
human tutor but maybe we can afford to
provide<00:17:27.360> each<00:17:27.600> student<00:17:28.120> with<00:17:28.240> a<00:17:28.400> computer
provide each student with a computer
provide each student with a computer
smartphone<00:17:29.919> so<00:17:30.120> the<00:17:30.280> question<00:17:30.600> is<00:17:30.919> how<00:17:31.080> can<00:17:31.240> we
smartphone so the question is how can we
smartphone so the question is how can we
use<00:17:31.640> technology<00:17:32.200> to<00:17:32.480> push<00:17:33.000> from<00:17:33.200> the<00:17:33.400> left
use technology to push from the left
use technology to push from the left
side<00:17:34.240> of<00:17:34.400> the<00:17:34.559> graph<00:17:34.799> from<00:17:34.919> the<00:17:35.000> blue<00:17:35.280> curve<00:17:35.760> to
side of the graph from the blue curve to
side of the graph from the blue curve to
the<00:17:36.080> right<00:17:36.320> side<00:17:36.840> with<00:17:36.960> the<00:17:37.039> green<00:17:37.480> curve
the right side with the green curve
the right side with the green curve
Mastery<00:17:38.960> is<00:17:39.120> easy<00:17:39.320> to<00:17:39.480> achieve<00:17:39.760> using<00:17:40.039> a
Mastery is easy to achieve using a
Mastery is easy to achieve using a
computer<00:17:40.559> because<00:17:40.720> a<00:17:40.840> computer<00:17:41.160> doesn't<00:17:41.400> get
computer because a computer doesn't get
computer because a computer doesn't get
tired<00:17:41.919> of<00:17:42.039> showing<00:17:42.320> you<00:17:42.440> the<00:17:42.559> same<00:17:42.760> video<00:17:43.120> five
tired of showing you the same video five
tired of showing you the same video five
times<00:17:45.160> and<00:17:45.280> it<00:17:45.400> doesn't<00:17:45.799> even<00:17:46.000> get<00:17:46.160> tired<00:17:46.440> of
times and it doesn't even get tired of
times and it doesn't even get tired of
grading<00:17:47.000> the<00:17:47.120> same<00:17:47.360> work<00:17:47.679> multiple<00:17:48.080> times
grading the same work multiple times
grading the same work multiple times
we've<00:17:48.559> seen<00:17:48.840> that<00:17:48.960> in<00:17:49.120> many<00:17:49.320> of<00:17:49.440> the<00:17:49.600> examples
we've seen that in many of the examples
we've seen that in many of the examples
that<00:17:50.120> I've<00:17:50.240> shown<00:17:50.480> you<00:17:51.440> and<00:17:51.679> even
that I've shown you and even
that I've shown you and even
personalization<00:17:53.240> is<00:17:53.400> something<00:17:53.679> that<00:17:53.799> we're
personalization is something that we're
personalization is something that we're
starting<00:17:54.240> to<00:17:54.400> see<00:17:54.600> the<00:17:54.720> beginnings<00:17:55.120> of
starting to see the beginnings of
starting to see the beginnings of
whether<00:17:55.640> it's<00:17:55.919> via<00:17:56.240> the<00:17:56.640> personalized
whether it's via the personalized
whether it's via the personalized
trajectory<00:17:57.679> through<00:17:57.880> the<00:17:58.000> curriculum<00:17:58.919> or
trajectory through the curriculum or
trajectory through the curriculum or
some<00:17:59.440> of<00:17:59.600> the<00:17:59.720> personalized<00:18:00.240> feedback<00:18:00.640> that
some of the personalized feedback that
some of the personalized feedback that
we've<00:18:00.919> shown<00:18:01.159> you<00:18:01.960> so<00:18:02.559> the<00:18:02.760> goal<00:18:03.080> here<00:18:03.320> is<00:18:03.440> to
we've shown you so the goal here is to
we've shown you so the goal here is to
try<00:18:03.760> and<00:18:04.000> push<00:18:04.480> and<00:18:04.600> see<00:18:04.840> how<00:18:05.000> far<00:18:05.200> we<00:18:05.320> can<00:18:05.480> get
try and push and see how far we can get
try and push and see how far we can get
towards<00:18:05.919> the<00:18:06.039> green
towards the green
towards the green
curve<00:18:08.240> so<00:18:08.760> if<00:18:09.000> this<00:18:09.159> is<00:18:09.799> um<00:18:09.919> so<00:18:10.200> great<00:18:10.720> our
curve so if this is um so great our
curve so if this is um so great our
universities<00:18:11.640> now
universities now
universities now
obsolete<00:18:13.799> well<00:18:14.039> Mark<00:18:14.280> Twain<00:18:14.640> certainly
obsolete well Mark Twain certainly
obsolete well Mark Twain certainly
thought<00:18:15.280> so<00:18:16.159> he<00:18:16.240> said<00:18:16.480> the<00:18:16.679> college<00:18:16.960> is<00:18:17.039> a
thought so he said the college is a
thought so he said the college is a
place<00:18:17.400> where<00:18:17.559> a<00:18:17.720> professor's<00:18:18.159> lecture<00:18:18.480> notes
place where a professor's lecture notes
place where a professor's lecture notes
go<00:18:19.000> straight<00:18:19.200> to<00:18:19.320> a<00:18:19.440> student's<00:18:19.840> lecture<00:18:20.159> notes
go straight to a student's lecture notes
go straight to a student's lecture notes
without<00:18:21.159> passing<00:18:21.520> through<00:18:21.720> the<00:18:21.840> brains<00:18:22.159> of
either<00:18:26.960> I<00:18:27.120> beg<00:18:27.360> to<00:18:27.520> differ<00:18:27.840> with<00:18:27.960> Mark<00:18:28.200> Twain
either I beg to differ with Mark Twain
either I beg to differ with Mark Twain
though
though
though
I<00:18:29.919> think<00:18:30.080> what<00:18:30.200> he<00:18:30.280> was<00:18:30.480> complaining<00:18:30.960> about<00:18:31.240> is
I think what he was complaining about is
I think what he was complaining about is
not<00:18:32.120> is<00:18:32.240> not<00:18:32.440> universities<00:18:33.039> but<00:18:33.200> rather<00:18:33.520> the
not is not universities but rather the
not is not universities but rather the
lecture-based<00:18:34.200> format<00:18:34.840> that<00:18:34.960> so<00:18:35.120> many
lecture-based format that so many
lecture-based format that so many
universities<00:18:36.120> spend<00:18:36.400> so<00:18:36.559> much<00:18:36.799> time<00:18:37.000> on<00:18:37.679> so
universities spend so much time on so
universities spend so much time on so
let's<00:18:38.120> go<00:18:38.600> from<00:18:39.000> back<00:18:39.320> even<00:18:39.600> further<00:18:39.960> to
let's go from back even further to
let's go from back even further to
Plutarch<00:18:40.679> who<00:18:40.799> said<00:18:40.960> that<00:18:41.120> the<00:18:41.200> mind<00:18:41.480> is<00:18:41.640> not<00:18:41.760> a
Plutarch who said that the mind is not a
Plutarch who said that the mind is not a
vessel<00:18:42.320> that<00:18:42.440> needs<00:18:42.640> filling<00:18:43.280> but<00:18:43.440> wood<00:18:43.679> that
vessel that needs filling but wood that
vessel that needs filling but wood that
needs<00:18:44.080> igniting<00:18:45.039> and<00:18:45.159> maybe<00:18:45.400> we<00:18:45.520> should<00:18:45.679> spend
needs igniting and maybe we should spend
needs igniting and maybe we should spend
less<00:18:46.320> time<00:18:46.559> at<00:18:46.720> universities<00:18:47.640> filling<00:18:48.080> our
less time at universities filling our
less time at universities filling our
students<00:18:48.760> Minds<00:18:49.120> with<00:18:49.360> content<00:18:50.000> by<00:18:50.159> lecturing
students Minds with content by lecturing
students Minds with content by lecturing
at<00:18:51.000> them<00:18:51.480> and<00:18:51.640> more<00:18:51.919> time<00:18:52.200> igniting<00:18:52.799> their
at them and more time igniting their
at them and more time igniting their
creativity<00:18:53.919> their<00:18:54.159> imagination<00:18:55.159> and<00:18:55.280> their
creativity their imagination and their
creativity their imagination and their
problem<00:18:55.880> solving<00:18:56.280> skills<00:18:57.039> by<00:18:57.400> actually
problem solving skills by actually
problem solving skills by actually
talking<00:18:58.240> with<00:18:58.400> them
talking with them
talking with them
so<00:18:59.520> how<00:18:59.600> do<00:18:59.760> we<00:18:59.880> do<00:19:00.120> that<00:19:00.679> we<00:19:00.840> do<00:19:01.080> that<00:19:01.360> by<00:19:01.919> doing
so how do we do that we do that by doing
so how do we do that we do that by doing
Active<00:19:02.600> Learning<00:19:02.960> in<00:19:03.080> the<00:19:03.480> classroom<00:19:04.480> so
Active Learning in the classroom so
Active Learning in the classroom so
there's<00:19:04.960> been<00:19:05.159> many<00:19:05.440> studies<00:19:05.840> including<00:19:06.320> this
there's been many studies including this
there's been many studies including this
one<00:19:06.640> that<00:19:06.840> show<00:19:07.360> that<00:19:07.480> if<00:19:07.600> you<00:19:07.720> use<00:19:08.039> Active
one that show that if you use Active
one that show that if you use Active
Learning<00:19:09.039> interacting<00:19:09.720> with<00:19:09.880> your<00:19:10.000> students
Learning interacting with your students
Learning interacting with your students
in<00:19:10.400> the<00:19:10.559> classroom<00:19:11.520> performance<00:19:12.200> improves<00:19:12.600> on
in the classroom performance improves on
in the classroom performance improves on
every<00:19:13.000> single<00:19:13.280> metric<00:19:13.760> on<00:19:13.960> attendance<00:19:14.760> on
every single metric on attendance on
every single metric on attendance on
engagement<00:19:15.679> and<00:19:15.799> on<00:19:15.960> learning<00:19:16.400> as<00:19:16.520> measured
engagement and on learning as measured
engagement and on learning as measured
by<00:19:17.039> a<00:19:17.159> standardized<00:19:17.760> test<00:19:18.200> you<00:19:18.320> can<00:19:18.440> see<00:19:18.679> for
by a standardized test you can see for
by a standardized test you can see for
example<00:19:19.200> that<00:19:19.320> the<00:19:19.440> achievement<00:19:19.919> score
example that the achievement score
example that the achievement score
almost<00:19:20.760> doubles<00:19:21.120> in<00:19:21.240> this<00:19:21.480> particular
almost doubles in this particular
almost doubles in this particular
experiment<00:19:23.000> so<00:19:23.200> maybe<00:19:23.559> this<00:19:23.679> is<00:19:23.840> how<00:19:24.000> we
experiment so maybe this is how we
experiment so maybe this is how we
should<00:19:24.280> spend<00:19:24.559> our<00:19:24.799> time<00:19:25.240> at
should spend our time at
should spend our time at
universities<00:19:27.720> so<00:19:27.880> to<00:19:28.080> summarize<00:19:29.000> if<00:19:29.159> we<00:19:29.280> could
universities so to summarize if we could
universities so to summarize if we could
offer<00:19:30.159> a<00:19:30.400> top<00:19:30.760> quality<00:19:31.280> education<00:19:32.000> to
offer a top quality education to
offer a top quality education to
everyone<00:19:32.559> around<00:19:32.760> the<00:19:32.880> world<00:19:33.120> for<00:19:33.320> free<00:19:33.919> what
everyone around the world for free what
everyone around the world for free what
would<00:19:34.280> that<00:19:34.480> do<00:19:35.440> three<00:19:35.919> things<00:19:36.919> first<00:19:37.200> it
would that do three things first it
would that do three things first it
would<00:19:37.520> establish<00:19:37.960> education<00:19:38.400> as<00:19:38.520> a
would establish education as a
would establish education as a
fundamental<00:19:39.240> human<00:19:39.559> right<00:19:40.280> where<00:19:40.480> anyone
fundamental human right where anyone
fundamental human right where anyone
around<00:19:41.120> the<00:19:41.240> world<00:19:41.760> with<00:19:41.919> the<00:19:42.039> ability<00:19:42.600> and
around the world with the ability and
around the world with the ability and
the<00:19:42.960> motivation<00:19:43.960> could<00:19:44.280> get<00:19:44.440> the<00:19:44.679> skills<00:19:44.919> that
the motivation could get the skills that
the motivation could get the skills that
they<00:19:45.200> need<00:19:45.440> to<00:19:45.600> make<00:19:45.720> a<00:19:45.840> better<00:19:46.120> life<00:19:46.320> for
they need to make a better life for
they need to make a better life for
themselves<00:19:47.159> their<00:19:47.360> families<00:19:47.679> and<00:19:47.799> their
themselves their families and their
themselves their families and their
communities<00:19:49.440> second<00:19:49.960> it<00:19:50.080> would<00:19:50.240> enable
communities second it would enable
communities second it would enable
lifelong<00:19:51.080> learning<00:19:51.760> it's<00:19:51.880> a<00:19:52.000> shame<00:19:52.280> that<00:19:52.400> for
lifelong learning it's a shame that for
lifelong learning it's a shame that for
so<00:19:52.799> many<00:19:53.080> people<00:19:53.559> learning<00:19:53.960> stops<00:19:54.320> when<00:19:54.480> we
so many people learning stops when we
so many people learning stops when we
finish<00:19:55.159> high<00:19:55.320> school<00:19:55.559> or<00:19:55.679> when<00:19:55.799> we<00:19:55.919> finish
finish high school or when we finish
finish high school or when we finish
college<00:19:57.000> by<00:19:57.200> having<00:19:57.520> this<00:19:57.760> amazing<00:19:58.200> content
college by having this amazing content
college by having this amazing content
be<00:19:58.880> available<00:19:59.720> we<00:19:59.840> would<00:20:00.039> be<00:20:00.240> able<00:20:00.840> to<00:20:01.120> learn
be available we would be able to learn
be available we would be able to learn
something<00:20:01.919> new<00:20:02.200> every<00:20:02.440> time<00:20:02.600> we<00:20:02.720> wanted
something new every time we wanted
something new every time we wanted
whether<00:20:03.320> it's<00:20:03.480> just<00:20:03.600> to<00:20:03.799> expand<00:20:04.120> our<00:20:04.280> minds<00:20:04.760> or
whether it's just to expand our minds or
whether it's just to expand our minds or
to<00:20:05.200> change<00:20:05.400> our<00:20:05.840> lives<00:20:06.840> and<00:20:07.039> finally<00:20:07.799> this
to change our lives and finally this
to change our lives and finally this
would<00:20:08.120> enable<00:20:08.520> a<00:20:08.679> wave<00:20:08.919> of<00:20:09.120> innovation
would enable a wave of innovation
would enable a wave of innovation
because<00:20:10.440> amazing<00:20:10.919> talent<00:20:11.360> can<00:20:11.520> be<00:20:11.679> found
because amazing talent can be found
because amazing talent can be found
anywhere<00:20:12.760> maybe<00:20:13.080> the<00:20:13.200> next<00:20:13.480> Albert<00:20:13.880> Einstein
anywhere maybe the next Albert Einstein
anywhere maybe the next Albert Einstein
or<00:20:14.840> the<00:20:14.919> next<00:20:15.120> Steve<00:20:15.440> Jobs<00:20:16.039> is<00:20:16.200> living
or the next Steve Jobs is living
or the next Steve Jobs is living
somewhere<00:20:16.799> in<00:20:16.880> a<00:20:17.039> remote<00:20:17.320> Village<00:20:17.600> in<00:20:17.799> Africa
somewhere in a remote Village in Africa
somewhere in a remote Village in Africa
and<00:20:18.760> if<00:20:18.880> we<00:20:19.000> could<00:20:19.240> offer<00:20:19.600> that<00:20:19.760> person<00:20:20.080> an
and if we could offer that person an
and if we could offer that person an
education<00:20:21.280> they<00:20:21.400> would<00:20:21.559> be<00:20:21.679> able<00:20:21.840> to<00:20:22.000> come<00:20:22.159> up
education they would be able to come up
education they would be able to come up
with<00:20:22.440> the<00:20:22.559> next<00:20:22.840> big<00:20:23.080> idea<00:20:23.640> and<00:20:23.799> make<00:20:23.960> the
with the next big idea and make the
with the next big idea and make the
world<00:20:24.280> a<00:20:24.400> better<00:20:24.679> place<00:20:24.840> for<00:20:25.000> all<00:20:25.159> of<00:20:25.280> us<00:20:25.960> thank
world a better place for all of us thank
world a better place for all of us thank
you<00:20:26.280> very
you very
you very
much
[Applause]
[Applause]
[Applause]
[Music]
w
education online education, education, reform, e-learning, coursera, kahn, academy, TED-Ed, TEDEducation, TED, Ed, TED, Daphne, Koller
