Implicit prosody
Anita Soloveva,
Lomonosov Moscow State University,
Universität Tübingen
04.12.2018
?
Intonational phrasing (rhythm, pauses, accents,
amplitude and pitch variations) & sentence processing
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 2/ 28
2/24
(Steinhauer et. al., 1999) : prosody & human parsing performance
(1)
(a) [Peter verspricht Anna zu arbeiten ]IPh1 [und das
Büro zu putzen ]IPh2
‘Peter promises Anna to work and to clean the office’.
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 3/ 28
3/24
(Steinhauer et. al., 1999): prosody & human parsing performance
(1)
(c) *[Peter verspricht ]IPh1 [Anna zu arbeiten ]IPh2 [und
das Büro zu putzen ]IPh3
‘Peter promises Anna to work and to clean the office’.
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 4/ 28
4/24
(Steinhauer et. al., 1999) Methods
Brain response to
a stimulus
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 5/ 28
5/24
(Steinhauer et. al., 1999) Results
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 6/ 28
6/24
(Steinhauer et. al., 1999) Results
[PeterversprichtAnnazuarbeiten]IPh1 [unddasBürozuputzen]IPh2
(Semantic integration)
(Syntax)
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 7/ 28
7/24
(Steinhauer et. al., 1999) Results
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 8/ 28
8/24
(Steinhauer et. al., 1999, 2001) Discussion
Syntactic parser can be influenced by prosodic
information
Syntactic parser & commas ? (2001)
Punctuation
• NOT very strict
• NOT very well known
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 9/ 28
9/24
(Steinhauer et. al., 2001) Introduction
(2)
(a) Since Jay always jogs a mile and a half this seems like
a short distance to him.
(b) Since Jay always jogs a mile and a half seems like a
very short distance to him
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 10/ 28
10/24
(Steinhauer et. al., 2001) Introdution
Preference to Direct Object (DO)
(Mitchell and Holmes, 1985; Mitchell, 1987):
Comma insertion prevents readers from being
led up this garden path
(3) Since Jay always jogs, a mile and a half seems like a
very short distance to him.
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 11/
11 /24
28
(Steinhauer et. al., 2001) Introduction
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 12/ 28
12/24
(Steinhauer et. al., 2001) Data
EXPERIMENT 1 – easy to read or not? + additional test in
punctuation
(4)
(a) Peter verspricht Anna zu arbeiten und das Büro zu
putzen
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 13/ 28
13/24
(Steinhauer et. al., 2001) Data
EXPERIMENT 1 – easy to read or not? + additional test in
punctuation
(4)
(b) Peter verspricht Anna zu entlasten und das Büro zu
putzen
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 14/ 28
14/24
(Steinhauer et. al., 2001) Rules&Participants
OLD PUNCTUATION RULES – Group 1
(5) Peter verspricht Anna(,) zu arbeiten und das Büro zu
putzen
(6) Peter verspricht, Anna zu entlasten und das Büro zu
putzen
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 16/ 28
16/24
(Steinhauer et. al., 2001) Results
4a
4b CNV – contingent negative
4a’ variation;
4b’ CPS – closure positive shift
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 17/
17 /24
28
(Steinhauer et. al., 2001) Discussion
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 18/ 28
18/24
(Steinhauer et. al., 2001) Data
EXPERIMENT 2 only correct punctuation (4a, 4b’) +
(9)
(a/a’) Der Mann sah den Jungen, das Mädchen (,) sah den
Grossvater und ...
‘The man saw the boy, the girl(,) saw the grandfather, and . . ’
(b/b’) Der Mann sah den Jungen, das Mädchen (,) und den
Grossvater, während . . .
‘The man saw the boy, the girl(,) and the grandfather, while . . .’
9a
4a 9b
9a’
4b’
9b’
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 20/
20 /24
28
(Steinhauer et. al., 2001) Data
EXPERIMENT 3 (silent reading & the subvocal prosodic
phrasing) -> separate prosodic and lexical information
Melodies:
• Type A ([Peter verspricht Anna zu arbeiten] …
• Type B ([Peter verspricht] # [Anna zu entlasten] . . .)
Easy to read?
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 21/ 28
21/24
(Steinhauer et. al., 2001) Results
In delexicalized sentence melodies, prosodic boundaries
elicited CPS component
In both mismatch conditions B→(10) and A→(11), a
P600 effect (most prominent in the reversed garden path
B→(10))
A -> (10)
A -> (11)
B -> (10)
B -> (11)
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 22/ 28
22/24
RESULTS
CPS – a universal online reflection of phonological
sentence phrasing (independent of the input modality:
auditory and visual cues)
Commas influence depends on the rule knowledge and
use
An overt prosody in speech and a covert prosody in
written language are related to one another
The larger difficulty in the reversed garden path
condition
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 23/ 28
23/24
Thank You for Your attention!
Literature
Chafe, W. (1988). Punctuation and the prosody of written language. Written Communication, 5, 396–426.
Hill, R. L. (1996). Unpublished doctoral dissertation. University of Dundee, Scotland.
Hill, R. L., & Murray, W. S. (1997). Poster presented at the 10th CUNY Conference on Human Sentence Processing,
Santa Monica, California.
Hill, R. L., & Murray, W. S. (1998). Poster presented at the 11th CUNY Conference on Human Sentence Processing, New
Brunswick, New Jersey.
Mitchell, D. C. (1987). Reading and syntactic analysis. In J. R. Beech & A. M. (Eds.), Colley cognitive approaches to
reading (pp. 87–112). New York: Wiley.
Mitchell, D. C., & Holmes, V. M. (1985). The role of specific information about the verb in parsing sentences with local
structural ambiguity. Journal of Memory and Language, 24, 542–559.
Steinhauer, K., Alter, K., & Friederici, A. D. (1999a). Brain potentials indicate immediate use of prosodic cues in natural
speech processing. Nature Neuroscience, 2, 191–196.
Steinhauer, K., & Friederici, A. D. (2001). Prosodic boundaries, comma rules, and brain responses: The Closure Positive
Shift in ERPs a universal marker for prosodic phrasing in listeners and readers. Journal of Psycholinguistic
Research, 30, 267-295.
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 24/ 28
24/24