Spoken Language Processing (CS 4706), Spring 2005 |
|||
Time: | MW 2:40-3:55 | Place | TBA |
Professor: | Julia Hirschberg | Office Hours: | TBA, CEPSR 705 |
Email: | julia@cs.columbia.edu | Phone: | 212-939-7114 |
Teaching
Assistant: |
TBA |
Office
Hours: |
TBA |
Email: |
TBA |
Phone: |
TBA |
Announcements || Academic
Integrity || Description
Resources || Requirements || Syllabus || Readings
This course introduces students to research in spoken language
in computational linguistics, aka natural language processing
(NLP). We will study the different `meanings' that can be conveyed by
the way that
speakers produce sentences, techniques for analyzing spoken language,
methods of developing speech technologies, and
applications of such technologies in the real world, such as
text-to-speech systems,
speech recognizers, spoken dialogue systems, and detectors for various
types of emotional speech. NB: This course can be
counted as a
PhD elective in Advanced AI . It is a requirement for the MS NLP
Track. There are no official prerequisites for this course and no
prior knowledge of NLP will be assumed.
Required readings: Acoustic & Auditory Phonetics by Keith Johnson and selected chapters from Speech and Language Processing by Jurafsky and Martin. Both are available from Morningside Bookstore and will also be on reserve in the library. Other course readings will be available either on the web or in-class handouts. NB: '*' means that the reading is optional.
Midterm and final; 3 lab homeworks; 1 course project on a topic
defined by the student (this may be done in groups).
Copying or paraphrasing someone's work (code included), or permitting your own work to be copied or paraphrased, even if only in part, is not allowed, and will result in an automatic grade of 0 for the entire assignment or exam in which the copying or paraphrasing was done. Your grade should reflect your own work. If you believe you are going to have trouble completing an assignment, please talk to the professor in advance of the due date.
Week | Date | Topic | Readings and Assignments |
1 | Jan 19 |
Introduction to the Course | |
Jan 24 |
Interpreting Speech Variation | Hirschberg03 | |
Jan 26 | Analyzing the Speech Signal | Johnson, Ch. 1-2 |
|
Jan 31 |
Tools for Speech Analysis | Johnson, 3; Praat tutorial | |
Feb 2 | Phonology
and Intonational Variation |
J&M, 4-4.5; Pierrehumbert&Hirschberg '90 | |
Feb 7 |
Conventions for Representing
Intonation |
ToBI labeling conventions and see ToBI examples | |
Feb 9 |
Speech Generation: From Concept and from Text | HLT96-ch5, TTS systems |
|
Feb 14 |
Modeling Pronunciation |
J&M, 4.6 |
|
Feb 16 |
Predicting Accents and
Phrasing |
J&M, 4.7 Pan99, Sun02, Koehn00, Rambow01 |
|
Feb 21 |
Information Status: Focus and Given/New | *Nakatani99, GBrown83, Bard99, Prince92, Dahan02 | |
Feb 23 | Discourse Structure in TTS Systems |
J&M, 18.3, 19.4 |
|
Feb 28 |
Speech Recognition and Understanding | J&M, 7; *HLT96-ch1
|
|
Mar 2 |
Speech Disfluencies | *Brennan&Schober99, Hindle83, Hirschberg&Nakatani?;Bear92 | |
Mar 7 |
Sentence, Speaker, and Topic Segmentation | Shriberg00, Shriberg98 | |
Mar 9 |
Midterm |
||
13 | Mar 21 |
Identifying
Speech Acts |
J&M, 19.2-3 Jurafsky98, Nickerson&Chu-Carroll99 |
14 | Mar 23 |
Spoken Dialogue Systems | J&M, 19 Walkeretal97, Goldberg03, Bell&Gustafson00, Krahmer01 |
15 | Mar 28 |
Turntaking in Spoken Dialogue | J&M,
19.1 Turn-taking in Conversational Analysis (follow links) Sacksetal74 |
16 | Mar 30 |
Corrections and Repairs |
Hirschbergetal04 |
17 | Apr 4 |
Speech Search |
Hirschbergetal01, SCANMail demo |
Apr 6 |
Speech Data
Mining |
Maskeyetal03, Hearst99 | |
Apr 11 |
Speech Summarization |
Barzilay00, Furui02, | |
Apr 13 |
Emotional Speech | Cowie00, Pereira00, Schroeder01, Bosch00, *Burkhardt00, *Ang02 | |
Apr 18 |
Deceptive Speech |
||
Apr 20 |
Charismatic Speech |
||
Apr 25 |
Class project presentations |
||
Apr 27 |
Class project presentations |
||
May 2 |
Class project presentations |
||
May 3-5 |
Study Days |
||
May 6-13 |
Finals |
Announcements || Academic
Integrity || Description
Links to
Resources || Requirements || Syllabus || Text || Thanks