6.863J/9.611J Natural Language Processing
 
 
Course home
[  Main  ] [  About ] [ Assignments ]
 

Staff
Prof. Robert C. Berwick
berwick@csail.mit.edu
32-D728, x3-8918
Office hours:  Th 2-3

Course Support
Lynne Dell
lynne@mit.edu
32-D724, 617-324-1543
TA: Igor Malioutov
igorm@mit.edu
32D-740
Office hrs: Fri 10-12pm

Course Time & Place
Lectures: M, W 3-4:30 PM
Room: 4-145,  map

Level & Prerequisites
Undergrad/Graduate; 6.034 or permission of instructor

Policies
Textbooks & readings
Grading marks guide
Style guide

Course Description

A laboratory-oriented course in the theory and practice of building computer systems for human language processing, with an emphasis on how human knowledge of language can be integrated into natural language processing.

This subject qualifies as an Artificial Intelligence and Applications concentration subject, Grad H level credit.
This term it also qualifies as a course 6 AUS subject.

Textbook required for puchase or reference (on library reserve, Barker P98.J87 2009):
Jurafsky, D. and Martin, J.H., Speech and Language Processing
2nd edition, Prentice-Hall: 2008. 
Some of the chapters from the revised edition may be posted in pdf form, as per the schedule shown on the homepage.

For sagar: Mantel2; atkinsstuff;

Announcements:
• Week 12: HKN course evaluation form now available here. Please fill it out! Thanks!
• Week 10: Laboratory 5 released here; due April 27, midnight, EDT.
• Week 8: Laboratory 4 released here; due Sunday April 10, midnight, EDT.
• Week 7: Laboratory 3 now due Friday, April 1, 6 pm EDT
• Week 7: Please read over projects on the projects page, here.

• Week 6: RR #2 released here, due Sunday 6pm EST & then Monday as per usual; in-class discussion Monday.
Reading by Saffran & Newport here.
• Week 6: Lab 3 released here.
• Week 5: IMPORTANT NOTE: DUE DATE for Lab 2 is NOW MONDAY, MARCH 7. LAB 3 not released until then!
• Week 4: Lab 2 released here.
• Week 2: CGW lab
• Week 1: Reading & response 1, available here, due Sunday 6pm & then after Monday in-class discussion.

• Week 1: Fun NLP link of the week: Postmodernist paper generator. Try 'writing' a new paper by following this link.
• Week 1: And then, if you think the 'hard' sciences are immune, you can follow this link.


Class days in blue, holidays in green, reg add/drop dates in orange.

February 2011
Sun
Mon
Tue
Wed
Thu
Fri
Sat
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
March 2011
Sun
Mon
Tue
Wed
Thu
Fri
Sat
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
24
24
25
26
27
28
29
30 31
           
April 2011
Sun
Mon
Tue
Wed
Thu
Fri
Sat
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27 28 29 30
             
May 2011
Sun
Mon
Tue
Wed
Thu
Fri
Sat
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25 26 27 28
29
30 31        
             
Course schedule at a glance
Date
Topic
Slides & Reference Readings
Laboratory/Assignments

2/2
Weds

Introduction: walking the walk, talking the talk
Lecture 1 pdf slides; pdf 4-up; Jurafsky & Martin (JM), ch. 1.
If you don't know Python, read the NLTK book, ch. 1-3; otherwise, skim NLTK book, chs 2–3.
Background Reading (for RR 1): Jurafsky & Martin ch.4 on ngrams. (pp. 83-94; p. 114-116)
Background Reading (for RR 1): Abney on statistics and language.
Background Reading (for RR 1): Chomsky, Extract on grammaticality, 1955.
(Optional) Background chapters on NLP from Russell & Norvig, ch. 22.
Reading & response (RR) 1 OUT
(Ngrams; NLTK Python warmup)

2/7
Mon
RR1 discussion; Bayes' rule and smoothing; from words to parsing
Intro to Competitive Grammar Writing

Reading & response 1 DUE SUN 6 PM; IN-CLASS DISCUSSION & FINAL TURN-IN MON


2/9
Weds
Parts of speech, parsers, and statistical parsing; Parsing & competitive grammar writing I
Bring notebook computer to class (at least 1 per team)
Competitive Grammar Writing slides, pdf; pdf, 2up
• JM, ch. 13 (parsing), pp. 427-435; ch. 14, pp. 459-467
• (Optional) NLTK book on advanced parsing (skim)

Lab 1: Competitive Grammar Writing (CGW): teams assigned; CGW checkpoint OUT WEDS
Read CGW handout
CGW Checkpoint DUE FRI

2/14
Mon
Parsing & competitive grammar writing II

Bring notebook computer to class (at least 1 per team)


Competitive Grammar Writing I
2/16
Weds
Parsing & competitive grammar writing III

Bring notebook computer to class (at least 1 per team)


Competitive Grammar Writing II - Grammars FROZEN
2/22
Tues
Competitive Grammar Evaluation & Wrap-up, Grammy Awards


Competitive Grammar AWARDS
Lab 2 Statistical Language Models OUT

2/23
Weds
Smoothing & language models

Lecture 3 pdf slides; pdf 4-up
• JM ch. 3

 
2/28
Mon

Smoothing; word parsing



3/2
Weds
Word parsing II



3/7
Mon
Context Free parsing I

Lab 2 Statistical Language Models Lab DUE
Lab 3: Computational Morphology OUT

3/9
Weds
Context-free parsing II

Reading & response (RR) 2 OUT
Reading: Saffran & Newport

3/14
Mon
RR #2

• No slides today

 
3/16
Weds

Earley's algorithm

Lecture 8 pdf slides; pdf 4-up; animation of Earley algorithm here; 4upbw Earley here.
3/28
Mon
Modern statistical parsers I
3/30
Weds
Treebank parsers II
Lab 3 DUE FRIDAY
4/4
Mon
Semantics I: the lambda calculus view
4/6
Weds
Semantics II: SQL
Project proposal checkpoint: Paragraph on team & proposal
4/11
Mon

Semantics III: Quantifiers

Laboratory 4 DUE SUNDAY;Laboratory 5-6 OUT
4/13
Weds
Semantics IV: learning words
 
4/20
Weds
4/25
Mon
Lexical Semantics
 
4/27
Weds
Discourse

5/3
Mon
Language Learning
5/5
Weds
Language Learning & Language Change
Laboratory 5-6 DUE
5/9
Mon
Evolution of language
 
5/11
Weds
Evolution of language
Final Projects DUE
 

 

MIT Home