Anda di halaman 1dari 24

Prosody and rhythm on the sentence level.

Implicit prosody
Anita Soloveva,
Lomonosov Moscow State University,
Universität Tübingen
04.12.2018

Anita Soloveva Prosodic Boundaries 04.12.2018 1/24


(Steinhauer et. al., 1999)

?
 Intonational phrasing (rhythm, pauses, accents,
amplitude and pitch variations) & sentence processing

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 2/ 28
2/24
(Steinhauer et. al., 1999) : prosody & human parsing performance

(1)
(a) [Peter verspricht Anna zu arbeiten ]IPh1 [und das
Büro zu putzen ]IPh2
‘Peter promises Anna to work and to clean the office’.

(b) [Peter verspricht] IPh1 [Anna zu entlasten] IPh2 [und


das Büro zu putzen] IPh3
‘Peter promises to support Anna and to clean the office’.

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 3/ 28
3/24
(Steinhauer et. al., 1999): prosody & human parsing performance

(1)
(c) *[Peter verspricht ]IPh1 [Anna zu arbeiten ]IPh2 [und
das Büro zu putzen ]IPh3
‘Peter promises Anna to work and to clean the office’.

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 4/ 28
4/24
(Steinhauer et. al., 1999) Methods

 First ERP (event-related potentials) study on influence


of prosody on human parsing (Steinhauer et al., 1999a)

Brain response to
a stimulus

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 5/ 28
5/24
(Steinhauer et. al., 1999) Results

CPS (closure positive shift) is evoked at the IPh boundaries

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 6/ 28
6/24
(Steinhauer et. al., 1999) Results
[PeterversprichtAnnazuarbeiten]IPh1 [unddasBürozuputzen]IPh2

(Semantic integration)

(Syntax)

[Peterverspricht] IPh1[Annazuentlasten] IPh2[unddasBürozuputzen] IPh3


*[Peterverspricht]IPh1[AnnazuARBEITEN]IPh2[unddasBürozuputzen]IPh3
N400 P600

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 7/ 28
7/24
(Steinhauer et. al., 1999) Results

 CPS reflects prosodic phrasing, NOT only related to


the acoustic properties marking the boundary:
 ERP experiment with pause removal

[Peterverspricht] IPh1[Annazuentlasten] IPh2[unddasBürozuputzen] IPh3


*[Peterverspricht]IPh1[AnnazuARBEITEN]IPh2[unddasBürozuputzen]IPh3

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 8/ 28
8/24
(Steinhauer et. al., 1999, 2001) Discussion
 Syntactic parser can be influenced by prosodic
information
 Syntactic parser & commas ? (2001)
 Punctuation
• NOT very strict
• NOT very well known

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 9/ 28
9/24
(Steinhauer et. al., 2001) Introduction

(2)
(a) Since Jay always jogs a mile and a half this seems like
a short distance to him.

(b) Since Jay always jogs a mile and a half seems like a
very short distance to him

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 10/ 28
10/24
(Steinhauer et. al., 2001) Introdution
 Preference to Direct Object (DO)
 (Mitchell and Holmes, 1985; Mitchell, 1987):
Comma insertion prevents readers from being
led up this garden path

(3) Since Jay always jogs, a mile and a half seems like a
very short distance to him.

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 11/
11 /24
28
(Steinhauer et. al., 2001) Introduction

 Reading activates phonological word representations :


‘internal voice’ (Chafe, 1988)
 Punctuation slows down reading locally but readers
profit later in a sentence (Hill and Murray, 1997,
1998; Hill, 1996)

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 12/ 28
12/24
(Steinhauer et. al., 2001) Data
EXPERIMENT 1 – easy to read or not? + additional test in
punctuation
(4)
(a) Peter verspricht Anna zu arbeiten und das Büro zu
putzen

(a’) *Peter verspricht, Anna zu arbeiten und das Büro zu


putzen

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 13/ 28
13/24
(Steinhauer et. al., 2001) Data
EXPERIMENT 1 – easy to read or not? + additional test in
punctuation

(4)
(b) Peter verspricht Anna zu entlasten und das Büro zu
putzen

(b’) Peter verspricht, Anna zu entlasten und das Büro zu


putzen

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 14/ 28
14/24
(Steinhauer et. al., 2001) Rules&Participants
OLD PUNCTUATION RULES – Group 1
(5) Peter verspricht Anna(,) zu arbeiten und das Büro zu
putzen
(6) Peter verspricht, Anna zu entlasten und das Büro zu
putzen

(5) verspricht, Anna


Anna, zu arbeiten
arbeiten, und
(6) verspricht, Anna
Anna, zu entlasten
entlasten, und
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 15/ 28
15/24
(Steinhauer et. al., 2001) Rules&Participants

NEW PUNCTUATION RULES


(7) Peter verspricht Anna(,) zu arbeiten(,) und das Büro zu
putzen
(8) Peter verspricht(,) Anna zu entlasten(,) und das Büro zu
putzen

GROUP 2 -> deviant punctuation

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 16/ 28
16/24
(Steinhauer et. al., 2001) Results

Group 1(influenced by rules) Group 2

4a
4b CNV – contingent negative
4a’ variation;
4b’ CPS – closure positive shift
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 17/
17 /24
28
(Steinhauer et. al., 2001) Discussion

 Reverse garden path (4a’) requiring the mental deletion


of a comma is much harder than the classical garden
path (4b) where a comma was omitted.
 Punctuation habits & comma perception
(G1 &G2)
 Drawback: experimental design, reflecting the
expectation of the disambiguating second verb (“arbeiten”
or “entlasten”) -> Experiment 2

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 18/ 28
18/24
(Steinhauer et. al., 2001) Data
EXPERIMENT 2 only correct punctuation (4a, 4b’) +
(9)
(a/a’) Der Mann sah den Jungen, das Mädchen (,) sah den
Grossvater und ...
‘The man saw the boy, the girl(,) saw the grandfather, and . . ’

(b/b’) Der Mann sah den Jungen, das Mädchen (,) und den

Grossvater, während . . .
‘The man saw the boy, the girl(,) and the grandfather, while . . .’

(,) – no comma is needed, but only in (9a’) it violates


phonological phrasing
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 19/
19 /24
28
(Steinhauer et. al., 2001) Results
Correct punctuation (4a, 4b’) The verb “sah/saw” in condition
Participants did not need to prepare (9a’) is incompatible with the
for a difficult-to-repair structure -> sentence segmentation-> P600.
the expectancy-related CNV was No such effect in (9b’) ->
eliminated, whereas the CPS comma rule violation is not
reflecting subvocal sentence sufficient to explain this effect
phrasing was still elicited.

9a
4a 9b
9a’
4b’
9b’
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 20/
20 /24
28
(Steinhauer et. al., 2001) Data
EXPERIMENT 3 (silent reading & the subvocal prosodic
phrasing) -> separate prosodic and lexical information
 Melodies:
• Type A ([Peter verspricht Anna zu arbeiten] …
• Type B ([Peter verspricht] # [Anna zu entlasten] . . .)

 Silent reading (no commas):


(10) Peter verspricht Anna zu arbeiten und ...
(11) Peter verspricht Anna zu entlasten und ...

Easy to read?

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 21/ 28
21/24
(Steinhauer et. al., 2001) Results
 In delexicalized sentence melodies, prosodic boundaries
elicited CPS component
 In both mismatch conditions B→(10) and A→(11), a
P600 effect (most prominent in the reversed garden path
B→(10))

A -> (10)
A -> (11)
B -> (10)
B -> (11)

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 22/ 28
22/24
RESULTS
 CPS – a universal online reflection of phonological
sentence phrasing (independent of the input modality:
auditory and visual cues)
 Commas influence depends on the rule knowledge and
use
 An overt prosody in speech and a covert prosody in
written language are related to one another
 The larger difficulty in the reversed garden path
condition
Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 23/ 28
23/24
Thank You for Your attention!
Literature
Chafe, W. (1988). Punctuation and the prosody of written language. Written Communication, 5, 396–426.
Hill, R. L. (1996). Unpublished doctoral dissertation. University of Dundee, Scotland.
Hill, R. L., & Murray, W. S. (1997). Poster presented at the 10th CUNY Conference on Human Sentence Processing,
Santa Monica, California.
Hill, R. L., & Murray, W. S. (1998). Poster presented at the 11th CUNY Conference on Human Sentence Processing, New
Brunswick, New Jersey.
Mitchell, D. C. (1987). Reading and syntactic analysis. In J. R. Beech & A. M. (Eds.), Colley cognitive approaches to
reading (pp. 87–112). New York: Wiley.
Mitchell, D. C., & Holmes, V. M. (1985). The role of specific information about the verb in parsing sentences with local
structural ambiguity. Journal of Memory and Language, 24, 542–559.
Steinhauer, K., Alter, K., & Friederici, A. D. (1999a). Brain potentials indicate immediate use of prosodic cues in natural
speech processing. Nature Neuroscience, 2, 191–196.
Steinhauer, K., & Friederici, A. D. (2001). Prosodic boundaries, comma rules, and brain responses: The Closure Positive
Shift in ERPs a universal marker for prosodic phrasing in listeners and readers. Journal of Psycholinguistic
Research, 30, 267-295.

Iuliia
AnitaKocharina
Soloveva Hole Semantics
Prosodic Boundaries November 15, 2018
04.12.2018 24/ 28
24/24

Anda mungkin juga menyukai