Quick links: Current | Past | Upcoming
The implementation of speech melodies as fundamental frequency contours has been a rich domain for developing models of the phonetics-phonology interface. The first part of this course surveys the phenomena to be modeled and provides students with the opportunity to engage deeply with computational models of speech melodies that have been proposed in the phonetics literature from the 1980s to present day. The second part of the course turns to state-of-the-art end-to-end automatic speech recognizers and self-supervised learning models of speech representations to understand how they may (or may not) inform our understanding of the phonetics-phonology interface for speech melodies.
We have two main learning objectives for this semester:
Week |
Date |
Topic |
Class |
HW to do |
|---|---|---|---|---|
| 09 | Tu 11/03 | No class | ||
| Th 11/05 | Roger on Prosogram model (see code/roger_prosogram/), ho |
Read Ryant et al. (2014) for Mo. 11/09 5pm |
Week |
Date |
Topic |
Class |
HW to do |
|---|---|---|---|---|
| 10 | Tu 11/10 | Intro to neural nets cont'd | ||
| Th 11/12 |
Week |
Date |
Topic |
Class |
HW to do |
|---|---|---|---|---|
| 01 | Tu 09/08 | Intro to prosody and speech tech | Intro | due Mo 9/14 5pm: Read/post on Barnes et al. 2020, watch Ward/Levow lectures 1-3, 24 |
| Th 09/10 | Prosody and speech tech | due We 9/16 5pm: Read/post on Liberman & Pierrehumbert 1984 | ||
| 02 | Tu 09/15 | Vertical phenomena | intro notes | |
| Th 09/17 | announcements, see lp84 Quarto notebook |
Read Ch 1-2 of Pierrehumbert and Beckman (1988), possible lab on LP84 | ||
| 03 | Tu 09/22 | Tonal association and tonelessness | ho | Work through ToDI tutorial by 10/1 class, comments in reading forum |
| Th 09/24 | slides | |||
| 04 | Tu 09/29 | Tonal association and tonelessness cont'd | slides | Work through ToDI tutorial by 10/1 class, comments in reading forum |
| Th 10/01 | KY away: work together on figuring out AM trainer together (download at top "Download" link on webpage). Sample ToBI training audio files in labs/amtrainer/ |
Be ready to report on AM trainer on Tuesday! Read/comment on Arvaniti and Ladd (2009) by Mo 10/05 5pm | ||
| 05 | Tu 10/06 | Horizontal pressures | Report on AM trainer, ToDI discussion | Read/comment on Xu et al. (2015) and Arvaniti and Ladd (2015) by Mo 10/12 5pm |
| Th 10/08 | Tonal coarticulation | |||
| 06 | Tu 10/13 | Landscape of models [ho], qTA | Read Shaw and Kawahara (2018) by Mo 5pm 10/19 | |
| Th 10/15 | PENTA model | ho | ||
| 07 | Tu 10/20 | Shape and temporal detail | Basis functions and shapes (ho) | Set up Matlab access and DCT tutorial files for Thursday |
| Th 10/22 | See code/dct |
Read McMurray and Jongman (2011) for Mo 5pm 10/26 | ||
| 08 | Tu 10/27 | Context and normalization; model wrap-up | Yifan on PENTA for Dutch intonation (see Google folder under code/); Changing the graph paper |
|
| Th 10/29 | see handout, continued | Before 11/05 class: Watch first three 3Blue1Brown neural nets videos: neural nets intro, gradient descent video, backpropagation intro |