|
|
|
 |
|
Staff
Prof. Robert C. Berwick
berwick@csail.mit.edu
32-D728, x3-8918
Office hours: Th 2-3
Course Support
Lynne Dell
lynne@mit.edu
32-D724, 617-324-1543
TA: Igor Malioutov
igorm@mit.edu
32D-740
Office hrs: Fri 10-12pm
Course Time & Place
Lectures: M, W 3-4:30 PM
Room: 4-145, map
Level & Prerequisites
Undergrad/Graduate; 6.034 or permission of instructor
Policies
Grading marks guide
Style guide
|
|
|
Course Description
A laboratory-oriented course in the theory and practice of building computer systems for human language processing, with an emphasis on how human knowledge of language can be integrated into natural language processing.
This subject qualifies as an Artificial Intelligence and Applications concentration subject, Grad H level credit.
This term it also qualifies as a course 6 AUS subject.
Textbook required for puchase or reference (on library reserve, Barker P98.J87 2009):
Jurafsky, D. and Martin, J.H., Speech and Language Processing
2nd edition, Prentice-Hall: 2008.
Some of the chapters from the revised edition may be posted in pdf form, as per the schedule shown on the homepage.
For sagar: Mantel2; atkinsstuff;
Announcements:
• Week 12: HKN course evaluation form now available here. Please fill it out! Thanks!
• Week 10: Laboratory 5 released here; due April 27, midnight, EDT.
• Week 8: Laboratory 4 released here; due Sunday April 10, midnight, EDT.
• Week 7: Laboratory 3 now due Friday, April 1, 6 pm EDT
• Week 7: Please read over projects on the projects page, here.
• Week 6: RR #2 released here, due Sunday 6pm EST & then Monday as per usual; in-class discussion Monday.
Reading by Saffran & Newport here.
• Week 6: Lab 3 released here.
• Week 5: IMPORTANT NOTE: DUE DATE for Lab 2 is NOW MONDAY, MARCH 7. LAB 3 not released until then!
• Week 4: Lab 2 released here.
• Week 2: CGW lab
• Week 1: Reading & response 1, available here, due Sunday 6pm & then after Monday in-class discussion.
• Week 1: Fun NLP link of the week: Postmodernist paper generator. Try 'writing' a new paper by following this link.
• Week 1: And then, if you think the 'hard' sciences are immune, you can follow this link.
Class days in blue, holidays in green, reg add/drop dates in orange.
|
February 2011
|
|
Sun
|
Mon
|
Tue
|
Wed
|
Thu
|
Fri
|
Sat
|
|
|
|
1
|
2
|
3
|
4
|
5
|
|
6
|
7
|
8 |
9
|
10
|
11
|
12
|
|
13
|
14
|
15 |
16
|
17
|
18
|
19
|
|
20
|
21
|
22 |
23
|
24
|
25
|
26
|
|
27
|
28
|
|
|
|
|
|
|
|
March 2011
|
|
Sun
|
Mon
|
Tue
|
Wed
|
Thu
|
Fri
|
Sat
|
|
|
|
1
|
2
|
3
|
4 |
5
|
| 6
|
7
|
8
|
9
|
10
|
11
|
12
|
|
13
|
14
|
15
|
16
|
17
|
18
|
19
|
|
20
|
21
|
22
|
24
|
24
|
25
|
26
|
|
27
|
28
|
29
|
30 |
31 |
|
|
| |
|
|
|
|
|
|
|
 |
|
April 2011
|
|
Sun
|
Mon
|
Tue
|
Wed
|
Thu
|
Fri
|
Sat
|
|
|
|
|
|
|
1
|
2
|
|
3
|
4
|
5
|
6
|
7
|
8 |
9
|
|
10
|
11
|
12
|
13
|
14
|
15
|
16
|
|
17
|
18
|
19
|
20
|
21 |
22
|
23
|
|
24
|
25
|
26
|
27 |
28 |
29 |
30 |
| |
|
|
|
|
|
|
|
|
May 2011
|
|
Sun
|
Mon
|
Tue
|
Wed
|
Thu
|
Fri
|
Sat
|
|
1
|
2
|
3
|
4
|
5
|
6
|
7
|
|
8
|
9
|
10
|
11
|
12
|
13
|
14
|
|
15
|
16
|
17
|
18
|
19
|
20
|
21
|
|
22
|
23
|
24
|
25 |
26 |
27 |
28 |
|
29
|
30 |
31 |
|
|
|
|
| |
|
|
|
|
|
|
|
Date |
Topic |
Slides & Reference Readings |
Laboratory/Assignments |
|
Introduction: walking the walk, talking the talk |
• Lecture 1 pdf slides; pdf 4-up; Jurafsky & Martin (JM), ch. 1.
• If you don't know Python, read the NLTK book, ch. 1-3; otherwise, skim NLTK book, chs 2–3.
• Background Reading (for RR 1): Jurafsky & Martin ch.4 on ngrams. (pp. 83-94; p. 114-116)
• Background Reading (for RR 1): Abney on statistics and language.
• Background Reading (for RR 1): Chomsky, Extract on grammaticality, 1955.
• (Optional) Background chapters on NLP from Russell & Norvig, ch. 22.
|
|
2/7
Mon
|
RR1 discussion; Bayes' rule and smoothing; from words to parsing
|
Intro to Competitive Grammar Writing
|
Reading & response 1 DUE SUN 6 PM; IN-CLASS DISCUSSION & FINAL TURN-IN MON
|
2/9
Weds
|
Parts of speech, parsers, and statistical parsing; Parsing & competitive grammar writing I
|
|
|
2/14
Mon |
Parsing & competitive grammar writing II |
• Bring notebook computer to class (at least 1 per team)
|
Competitive Grammar Writing I |
2/16
Weds
|
Parsing & competitive grammar writing III |
• Bring notebook computer to class (at least 1 per team)
|
Competitive Grammar Writing II - Grammars FROZEN |
2/22
Tues |
Competitive Grammar Evaluation & Wrap-up, Grammy Awards
|
|
|
2/23
Weds
|
Smoothing & language models |
|
|
2/28
Mon
|
|
|
|
3/2
Weds
|
Word parsing II
|
|
|
3/7
Mon
|
Context Free parsing I
|
|
Lab 2 Statistical Language Models Lab DUE
Lab 3: Computational Morphology OUT |
3/9
Weds
|
Context-free parsing II |
|
Reading & response (RR) 2 OUT
Reading: Saffran & Newport
|
3/14
Mon |
RR #2
|
|
|
3/16
Weds |
|
|
|
3/28
Mon
|
Modern statistical parsers I |
|
|
3/30
Weds |
Treebank parsers II |
|
Lab 3 DUE FRIDAY |
4/4
Mon
|
Semantics I: the lambda calculus view |
|
4/6
Weds |
Semantics II: SQL |
|
Project proposal checkpoint: Paragraph on team & proposal |
4/11
Mon |
Semantics III: Quantifiers
|
|
|
4/13
Weds |
Semantics IV: learning words |
|
|
4/20
Weds |
|
|
4/25
Mon |
Lexical Semantics |
|
|
4/27
Weds |
Discourse |
|
|
5/3
Mon |
Language Learning |
|
|
5/5
Weds |
Language Learning & Language Change |
|
Laboratory 5-6 DUE |
5/9
Mon |
Evolution of language |
|
|
5/11
Weds |
Evolution of language |
|
Final Projects DUE |
| |
|