Anda di halaman 1dari 10

Examinations

A discourse analysis study of ‘good’ and ‘poor’


communication in an OSCE: a proposed new framework
for teaching students

Celia Roberts,1 Val Wass,2 Roger Jones,2 Srikant Sarangi3 & Annie Gillett1

Background There is still a great deal to be learnt about Findings Analysis revealed important differences in
teaching and assessing undergraduate communication communicative styles between candidates who scored
skills, particularly as formal teaching in this area highly and those who did poorly. These related to:
expands. One approach is to use the summative empathetic versus ‘retractive’ styles of communicating;
assessments of these skills in formative ways. Discourse the importance of thematically staging a consultation,
analysis of data collected from final year examinations and the impact of values and assumptions on the
sheds light on the grounds for assessing students as outcome of a consultation.
‘good’ or ‘poor’ communicators. This approach can Conclusion Detailed discourse analysis sheds light on
feed into the teaching ⁄ learning of communication skills patterns of communicative style and provides an
in the undergraduate curriculum. analytic language for students to raise awareness of
Setting A final year UK medical school objective their own communication. This challenges standard
structured clinical examination (OSCE). approaches to teaching communication and shows the
Methods Four scenarios, designed to assess communi- value of using summative assessments in formative
cation skills in challenging contexts, were included in ways.
the OSCE. Video recordings of all interactions at these Keywords Education, medical undergraduate ⁄ *stand-
stations were screened. A sample covering a range of ards; *communication; educational measurement;
good, average and poor performances were transcribed curriculum; clinical competence; England.
and analysed. Discourse analysis methods were used to Medical Education 2003;37:192–201
identify ‘key components of communicative style’.

communication, explanation, etc. – because of, for


Introduction
example, linguistic and semantic difficulties, a know-
Despite the vast literature on communication between ledge gap or a mismatch between the values and
patients and health care professionals, effective consul- assumptions of the patient and doctor.2,3 These factors
tations are still difficult to achieve. Poor communica- are routinely treated as discrete components of skill and
tion is often associated with poor clinical performance.1 knowledge which do not take into account the context
The quality of communication in doctor–patient inter- of the interaction.
actions may be damaged by several factors. These may The need to enhance doctors’ communication skills
be related to the constraints imposed by the clinical is widely recognised. In the UK, the General Medical
environment such as lack of privacy and time. They may Council (GMC) has emphasised the importance of
also impact on its content – history taking, risk teaching and assessing communication skills in the
undergraduate medical curriculum4 and the ‘concor-
1
dance’ model of doctor–patient communication in
Department of Education and Professional Studies, King’s College
medicines prescribing has been promoted by the Royal
London, UK
2
Guy’s, King’s and St Thomas’ School of Medicine, London, UK Pharmaceutical Society.5 Communication skills teach-
3
Health Communication Research Centre, Cardiff University, Wales, ing is at the core of much generalist training in the
UK
USA6 and of medical curricula in Canada.7
Correspondence: Celia Roberts, Department of Education and Progress has been made in teaching communication
Professional Studies, King’s College London, Franklin Wilkins
Annexe, Waterloo Bridge Road, London SE1 9NN, UK. Tel.: 00 skills ) by moving from role-modelling to explicit
44 207 848 3122; E-mail: celiaroberts@lineone.net training8 ) and in their assessment ) by moving from

192  Blackwell Publishing Ltd ME D I C AL ED U C AT I ON 2003;37:192–201


‘Good’ and ‘poor’ communication in an OSCE: a proposed new framework • C Roberts et al. 193

interactional episode and how it came to be produced,


Key learning points so that the talk of consultations can be analysed in
detail. For this reason we have taken a discourse
Video recordings of OSCEs can be used as
analytic approach,14,15 in which video recordings of
formative tools for improving communication
consultations are transcribed and the language and
skills.
interactional features of the consultations are analysed
Discourse analysis of these recordings sheds light in depth. Aspects of communicative style are identified
on the details of candidates’ ‘communicative across the recorded data to provide both evidence and
styles’ and helps to explain their relatively high or understanding of how broad categories such as ‘estab-
low grades. lishes rapport’ are achieved, or not.
This communicative style depends on how candi-
dates design their questions and responses, how Method
they stage the themes of the consultation and on
the values and ideologies they bring to it. Final year OSCEs

Detailed maps of OSCE consultations give Our research was set in the final examinations on the
students a new analytic language for monitoring Guy’s and St Thomas’ campus of the now merged
their own and others’ communication skills. Guy’s, Kings and St Thomas’ medical school (GKT)
in June 1999. These examinations involved a
24-station OSCE. This included several communi-
the long case to methods such as the objective struc- cation stations, each of 7 minutes duration, using
tured clinical examination (OSCE).9,10 However, there standardised simulated patients. The OSCE ran over
is much more we need to understand about appropriate 2 days.
teaching techniques and assessment methods.11 For We designed four OSCE scenarios to present partic-
example, students’ performance in OSCE communica- ular challenges to final year students and to reflect a
tion stations is assessed on a checklist of criteria, such multicultural student and patient population. The
as ‘establishes rapport’ and ‘uses closed and open scenarios are detailed in Fig. 1. Two stations were
questions appropriately’.12,13 Yet the details of what included each day. Each station was marked by one
makes students good or bad communicators are not examiner, who was experienced in assessing communi-
necessarily obvious. A more fine-grained understanding cation skills, used a checklist of criteria and gave a
of the attributes of good and poor medical communi- global rating, and by the role player, who also awarded
cation is needed to improve communications teaching a global rating. The project was approved by the
and the validity of its assessment. Why not, therefore, relevant local research ethics committees, and informed
look at OSCE performance itself to try and unravel consent was obtained from all students.
these questions? Spencer reminds us of ‘the tremen-
dous gold mine of data that systematic, progressive
Data collection and screening
OSCE-type examinations offer to the researcher’.14
In order to use assessment as a formative (as well as a Sequential audio-visual recordings were made of all
summative) tool and to mine the gold that lies hidden students taking these stations on the successive days. A
in OSCEs, a research approach is needed that will slow total of 179 students took the OSCE and all agreed to
down the whole process and fix our gaze on each be video-recorded. In all, 358 recordings were made,

1. Cancer: an older white woman is advised to have a bronchcoscopy because of possible tumour recurrence, although she denies the
possibility that the cancer may have returned

2. Sexually transmitted disease : a young Muslim women has had unprotected sex and is concerned that she might have caught
something. She also feels very upset about what has happened.

3. Alcohol: a Chinese businessman has come for the results of liver function tests. The results indicate he may be drinking too much.

4. Drugs: a young Afro-Caribbean man is seeking a methadone prescription because he says he has lost the one recently given to him at
the drug rehabilitation centre.

Figure 1 The four OSCE communication stations.

 Blackwell Publishing Ltd M ED I C A L E D UC A T I O N 2003;37:192–201


194 ‘Good’ and ‘poor’ communication in an OSCE: a proposed new framework • C Roberts et al.

but 49 were rejected for technical reasons. This relatively involved or detached they appear, are based
generated a database of 309 7-minute video interac- on styles of communicating. These have developed as
tions (86Æ3% of the total). A total of 28 consultations a result of longterm exposure to networks of relation-
were fully transcribed (just under 10%). These inclu- ships in the home, school and community, so that a
ded consultations by the 12 candidates who were particular communicative style is the product of
judged to have failed at least one of the specially social ⁄ cultural experiences: ‘‘‘style’’ is not something
designed OSCE scenarios, together with equal numbers extra, added on like frosting on a cake. … style refers
of top-rated and middle-ranking encounters. to all the ways speakers encode meaning in language
The 309 video-recorded consultations were all and convey how they intend their talk to be under-
viewed and notes made of each interaction to identify stood.’18 Communicative style therefore relates to talk
emergent patterns in the data, such as particularly and interaction at all levels, from the most fleeting
awkward or responsive moments, formulaic responses intonation pattern to the wider assumptions about
and styles of presentation based on the assumptions how, for example, to relate to patients. These wider
brought along to the encounter. These viewing notes assumptions are part of the ideological values and
formed the basis for identifying the components of principles about professional identity and how to
communicative style and were used to select the 28 conduct oneself in interaction that are brought along
consultations for transcription. The screening of a to any encounter and which appear as evidence in the
relatively large database produced patterns that were data.
confirmed in the detail of the transcribed data as well as Interactional sociolinguistics, in common with most
disconfirming evidence, which led to the reinterpreta- forms of discourse analysis, uses naturally occurring
tion of some aspects of the detailed transcriptions. In examples of talk. The OSCE interactions are, on one
this way, larger data sets and micro-analysis of inter- level, examples of authentic talk in that they represent
actional moments support each other. actual occurrences within a vital examination. At
another level, they are strictly timed role-plays,
institutionally based synthetic encounters, and this
Discourse analysis
puts constraints on both candidates and actor-
Discourse analysis looks at the ways in which speakers patients. Both are working from scripts ) the actor
design the content of each turn at talk, at how is given a set of symptoms and an identity, while the
interactions are sequenced and managed and also at candidate has a set of medical scripts to work from )
speakers’ choices in terms of vocabulary, grammar, but each interaction is subtly (or, in some cases,
intonation and rhetoric. These detailed features con- radically) different, depending on how each partici-
tribute to our understanding of how social relations are pant interprets and responds to the other. The
managed in talk: how the patient and doctor establish interactions are further complicated by the fact that
relations of relative equality, how together, for example, the ‘patients’ are also assessors and often voice
they may use various face-saving strategies and take feelings and attitudes that are either kept hidden or
account of the other’s relative knowledge and emotional managed in more indirect ways in real consultations.
state. The emphasis here is on talk rather than non- These vocal actor-patients tend to trigger more
verbal communication, as the physical setting of the formulaic responses from weaker candidates, who
OSCE and some of the inevitable institutional con- have been trained in rapport words but cannot achieve
straints make it difficult to assess aspects such as body rapport work. This is an example of how the
movement and gaze. institutional constraints of the OSCE can magnify
The approach used here, interactional sociolinguis- differences between weak and poor candidates. How-
tics, draws on ethnography and conversation analysis ever, it also serves to contrast these scenarios with
to look at how individuals differ in the ways in which real patient)doctor communication, and, as such, it
they interact with and understand one another.14)16 could be used to argue against research on synthetic
Understanding presupposes a level of conversational consultations. However, while OSCEs are used to
involvement in which both sides share ways of assess students’ communication skills and while they
interpreting what the other has said. However, there continue to be treated as an adequate way of doing
is also an emotional dimension to involvement, which so, there is a case for analysing the interactional
connects it to rapport and affiliation, and this aspect details which account for relative success or failure in
presupposes a level of understanding. Thus, involve- them. Moreover, gaining understanding of what
ment and understanding go hand in hand.17 Individ- makes for a successful OSCE result is worthwhile
ual differences between speakers, which affect how from the students’ point of view.

 Blackwell Publishing Ltd ME D I C AL ED U C AT I ON 2003;37:192–201


‘Good’ and ‘poor’ communication in an OSCE: a proposed new framework • C Roberts et al. 195

poor communicators. A summary of the classification


Findings
of the components of communicative style is shown in
Detailed analysis of the communicative content of these Fig. 2. Although it is possible to rate a particularly good
four key scenarios showed them to be extraordinarily or weak candidate as having an overall empathetic or
complex, and there is clear evidence that the commu- retractive style, this rating is based on the cumulative
nication skills of a small but significant minority of effect of many often small and subtle features, which, in
students were inadequate. A larger group, who per- the specific context where they occur, lead to relatively
formed at a pass level, still found many aspects of the more involvement or detachment (see the analysis
consultation difficult to perform well. below).
The OSCE students tended to display an overall
communicative style in which their management of
Empathetic and retractive styles
social relations was relatively sensitive or not. This
communicative style accounted for the very different Two examples from the sexually transmitted diseases
interactional climates created by strong and weak scenario illustrate the empathetic and retractive ele-
candidates and this in turn depended on the kinds of ments that contributed to candidates’ communicative
features identified by Tannen.17,18 Students were either styles. Rather than demonstrating an average candi-
relatively empathetic, authoritative and persuasive, date, we have used two highly contrasting examples of
organically building a joint problem-solving framework good and bad performance in order to show
with the patient, or they were relatively ‘retractive’ (our the differences between empathetic and retractive
term), using questions and responses that served to communication clearly. Middle-ranking students
distance them from the patient. tended to show both types of features rather than
Analysis of the transcriptions led to observations on the stark contrasts illustrated here. The particular
differences in communicative style between good and ways in which these two candidates designed their
questions and responses accounted for much of the
overall effect of, on the one hand, solidarity and
1.Empathetic questions and responses: persuasiveness in the strong candidate, and, on the
other, distancing and lack of mutuality in the weaker
* Attentive responding candidate. In these examples we provide extracts of
* Joint problem solving
the transcribed recordings; the transcription conven-
* Contextualising and face saving
tions used are shown in Fig. 3.
2. Retractive questions and responses: Empathetic styles are categorised in three ways. The
first of these is ‘attentive responding’.
* Inappropriate responding
* Schema driven progression and patient labelling Example 1: Attentive responding (lines 52)63)
* Storage failure The patient has explained that she has slept with a man.
* Insensitivity to patients’ levels of understanding She is worried she may have caught something and she
‘feels so dirty’. After asking her what kind of sex she has
3. Thematic staging
had, the candidate continues:
4. Values and assumptions can: so (.) what’s been happening since then have you
had any problems in yourself have you had any prob-
Figure 2 Components of communicative style. lems going to the toilet or anything like that

can: candidate
act: actor-patient
(.) short pause
(( nods etc. )) non-verbal communication
…….. section of the transcription omitted
= word =
= word = overlapping speech i.e. two speakers speaking at the same time
Figure 3 Transcription conventions; e.g. can: did the partner you had sex = with did he have =
simplified version based on Gumperz J & act: = yeah =
Berenz N22. ‘erm’ sound used to fill a pause at the beginning or in the course of an utterance

 Blackwell Publishing Ltd M ED I C A L E D UC A T I O N 2003;37:192–201


196 ‘Good’ and ‘poor’ communication in an OSCE: a proposed new framework • C Roberts et al.

act: no Example 3: Contextualising and face-saving ( lines 61)65)


In the previous example, the candidate sets the context
can: ok have you erm (.) had any discharge from
for the next phase of the consultation when she says:
down below
‘I’m going to ask you some questions’. She contextu-
act: ((shakes head, whispers:)) (no) alises her questions again a little later on, as we can see
by looking again at the first example:
can: so it’s just really that you’re worried that
something’s happened can: ok (.) I’m going to ask you about a bit more
about what (.) went on ok erm (.) what actually
act: ((nods))
happened that day when it all happened
can: ok (.) I’m going to ask you about a bit more
act: er it was like a party
about what (.) went on ok erm (.) what actually
happened that that day when it all happened can: right
Here the candidate attends to the patient’s increas- She sets the context (‘I’m going to ask you …’) and
ingly minimal responses, the last of which is then is careful to refer back to the incident in a general
co-ordinated with head movement and with a lowering way which will not cause embarrassment or loss of face
of volume, and to her earlier expression of self-disgust to the patient. As before, when the patient does not take
in order to arrest the medical agenda and pay attention a turn at the second pause, the candidate makes her
to the patient’s feelings. The candidate does this by contribution more explicit, asking: ‘What actually
reformulating the patient’s indirect messages of anxiety happened?’ This contextualising helps the patient to
into an explicit question: ‘So it’s just really that you’re distance herself from the present emotional trauma.
worried that something’s happened?’ The candidate The event is now seen as belonging to the past, thereby
then shifts to eliciting the patient’s narrative rather than making it easier to narrate. She can talk more openly to
following her own medical agenda. the candidate, which, in turn, helps to bring them
The second empathetic strategy is ‘joint-problem interactionally closer together. Thus, in just two small
solving’. This includes strategies for involving the extracts, a number of empathetic moves are clustered
patient in explanations and reassurances and in aligning together.
the candidate with the patient. Retractive styles are categorised in four ways. The
first of these is defined as ‘inappropriate responding’
Example 2: Joint problem solving ( lines 22)28) and includes minimal responses, inappropriate mood
Near the beginning of the consultation, the candidate and formulaic or trained empathy.
reassures the patient:
Example 4: Inappropriate responding ( lines 23)24)
can: right ok well let me tell you first of all that (.)
whatever we talk about in here is completely confi- act: erm (.) I just (.) ((breath out)) (.) just (.) feel
dential ok (.) you don’t have to worry about anything really terrible about it
like that
can: ok (.) erm (2Æ0) did you use protection at all
act: all right
Here the candidate’s ‘OK’ does not acknowledge the
can: erm I’m going to ask you some questions about patient’s talk or the hesitation and outbreath which
what went on if that’s all right and erm (.) you know reinforce her words. He simply gives a minimal
we can see if we can work something out together response and then moves on to a new topic after a
pause of 2 seconds. This ‘OK’ can be contrasted with
Here the candidate explicitly sets the tone of the
the ‘OKs’ in example 1, which both confirm the
consultation as one where, together, they can solve the
patient’s response. In example 4, the patient makes an
problem, using the pronoun ‘we’ to suggest inclusive-
evaluative comment about her emotional state. An
ness. Both her second and third pauses give the patient
‘OK’ after such an expression of affect shows no
an opportunity to respond, but when the latter does not
recognition of this state.
take up her turn, the candidate upgrades her reassur-
The second type of retractive strategy is defined as
ance: ‘You don’t have to worry’ and her inclusiveness,
‘schema-driven progression and patient labelling’,
from checking agreement to: ‘We can work something
where the candidate drives through the medical agenda
out’.
and often labels the candidate as ‘a worrier’, ‘not telling
The third type of empathetic strategy concerns
the truth’, ‘an alcoholic’ and so on.
‘contextualising and face-saving’.

 Blackwell Publishing Ltd ME D I C AL ED U C AT I ON 2003;37:192–201


‘Good’ and ‘poor’ communication in an OSCE: a proposed new framework • C Roberts et al. 197

Example 5: Schema-driven progression and patient labelling medical checklist concerning pregnancy and so on,
(lines 56)65) which he takes the patient through.
can: any rashes or
Example 7: Insensitivity to patient levels of understanding
act: no don’t think so (lines 46)54)
can: discharge (.) have you yourself had any can: right ok (1Æ0) erm (6Æ0) did (.) this patient have
discharges at all any er overt signs of any sexual disease did he have
any rashes at all or
act: no
act: sorry
can: any erm (.) irritation down there
can: did the (.) did the partner that you had sex ¼
act: no
with did he have ¼
can: any pain when you’re passing water
act: ¼ yeah ¼
act: no
can: any (.) sort of signs of (.) sexually transmitted
can: erm (.) any blood in your urine diseases
act: no act: ((shakes head))
Here the medical agenda is driven through and, The candidate’s initial question confuses the patient
as this happens, the consultation becomes interrog- in a number of ways, including by the slip of the tongue
atory, with the patient giving minimal and categor- where he talks about ‘patient’ instead of ‘partner’.
ical responses that do not allow for any negotiation However, the problems of understanding are due
of meaning. This is in marked contrast to example 1. largely to the medical register in which the question is
The third and fourth types of retractive style concern expressed and to the assumption that the patient would
problems of understanding, sometimes when the can- know what the symptoms of sexually transmitted
didate has failed to take in what the patient is saying diseases are like. Such jargon will distance the candi-
and at others concerning the use of medical jargon. date from the patient. In addition, in his attempt to
Examples 6 and 7 illustrate this, the first demonstrating repair the error, in assuming too much medical know-
what we term ‘storage failure’ and the second providing ledge, the candidate shifts down to give a specific
an example of insensitivity to the patient’s levels of example (‘any rashes’) without showing through words
understanding. or intonation that he is doing so. His attempt at
clarification when the patient fails to understand is no
Example 6: Storage failure (lines 18)22) more helpful because he is still using medical jargon. As
well as these distancing elements of his style, the long
act: no it’s complete one it’s my first time yeah (.)
pauses and repairs seem to produce a degree of
because I come from a traditional muslim culture
interactional discomfort in the patient, as evidenced
can: right by her minimal responses and, finally, only a head
shake.
act: er we don’t have boyfriends in our culture
It is worth stressing that no single question or
can: right response is necessarily empathetic or retractive. An
empathetic move such as ‘responsive listening’, which
(56 seconds later)
often depends on making inferences from the patient’s
can: right erm (.) have you ever ha- been pregnant at remarks, may, in another context, be treated as high
all inferencing and produce the negative labelling of a
patient. For example, a question such as: ‘You’re not
act: no
worried about …’ may be an attentive response to a
Here the candidate fails to take in the fact that the patient’s narrative or may make the patient feel they are
patient has never had sex before and carries on with his being labelled as ‘a worrier’, in which case it may not be
checklist of questions, which includes a question about perceived as empathetic at all. Similarly, one candi-
pregnancy. His failure to remember the earlier infor- date’s reassuring moves, which contribute to an overall
mation may well be reinforced by the schema-driven high grade, may appear as set responses, or what we call

 Blackwell Publishing Ltd M ED I C A L E D UC A T I O N 2003;37:192–201


198 ‘Good’ and ‘poor’ communication in an OSCE: a proposed new framework • C Roberts et al.

‘trained empathy’, in another candidate. The success, visual impression of difference. It also connects a
or not, of a particular remark or question by the typology of the whole with specific examples from the
candidate depends on its location in the whole inter- transcripts. Figure 4 shows two contrasting maps of the
action and the kind of climate which their communi- cancer scenario, again one of a high-rated and one of a
cative style has already established. low-rated candidate.
If we contrast the high-rated candidate (examples Here, an older white woman resists advice to have a
1–3) with the candidate who failed (examples 4–7), it is bronchoscopy to assess whether her cancer has
clear that the overall empathetic or retractive climate returned.
results from a layering of good or bad aspects of The good candidate gradually and sensitively took
communicative style. The weak candidate is interroga- the patient through the consequences of not having a
tory, focuses narrowly on the medical agenda, does not bronchoscopy. She staged her case for this further
use more personal authority to reassure, assumes the investigation so that each time the patient rejected her
patient is concerned about risks or has had abnormal sex advice, she still had some persuasive resources to bring
and is responsible for several misunderstandings. In to the consultation. Examples 8 and 9 are extracted
addition, his overall staging of the consultation means from the maps in Fig. 4 to highlight their differences.
that towards the end, when he does try to show some
empathy, this comes across in a formulaic or trained Example 8: Good thematic staging
way. This staging of themes represents a further The strong candidate sequenced her case for the patient
component of communicative style. having a bronchoscopy as follows:
1 we need to exclude the worst;
Thematic staging 2 we need to investigate in more detail;
3 we would like to do a bronchoscopy;
The global impression of the candidates and the quality
4 we want to exclude the possibility of a tumour;
of their communicative style did not depend only upon
5 you had a tumour before, and
empathetic or retractive questioning and responding.
6 there is the possibility of a recurrence of the tumour.
The issue of how questions and responses were posi-
tioned or sequenced in the consultation to cover By contrast, the weak candidate staged the argument
particular themes was also significant when the whole differently. He introduced the fact that the patient had
interaction was examined. In other words, how the cancer of the kidney much earlier on in the consultation
different themes of the consultation were staged affected and then had no strong reasons left with which to
its overall emotional climate and helped to define the persuade the patient as the consultation continued.
candidate’s communicative style.
Each interaction had a key moment or crux (or, in Example 9: Poor thematic staging
most cases, a number of cruces) around which much of The weak candidate sequenced his case for the patient
the interaction was organised, such as the moment having a bronchoscopy as follows:
when the Chinese businessman asked, ‘Am I an
1 we need to do more investigations;
alcoholic?’; the drug addict asked for a repeat meth-
2 the possible recurrence of the tumour;
adone prescription; the young muslim woman con-
3 the possible recurrence of the tumour;
veyed her feelings of self-disgust, or the bad news was
4 it would be better to have the bronchoscopy, and
broken to the cancer patient. How candidates built up
5 do you have any other worries?
to, realised and followed up these crucial moments
affected the whole climate of the interaction and the Whereas the strong candidate built up to the most
success or otherwise of its outcome. This thematic persuasive argument, the weak candidate brought in the
element contributed to the relatively empathetic or worst case scenario early on (at line 90, 60 lines before the
retractive style of the whole encounter, as well as strong candidate). This produced a confrontational
progressing the medical agenda. response from the patient. The consultation then tailed
In attempting to account for the overall impact of the off as the candidate ran out of persuasive resources, with
role-played encounters, the analysis has to integrate the some general exhortations that ‘it would be better’, and
local, turn-by-turn empathetic and retractive moments an elicitation about any other worries (as if the possibility
with the staging of the whole encounter. In an adapta- of a return of the cancer was not bad enough!).
tion of the sociolinguistic idea of mapping conversa- These contrastive examples show that candidates not
tions,19 interactional maps were made of the 28 only need to design their questions and responses
transcribed scenarios. This mapping gives an immediate sensitively, but need to be aware of the overall staging

 Blackwell Publishing Ltd ME D I C AL ED U C AT I ON 2003;37:192–201


‘Good’ and ‘poor’ communication in an OSCE: a proposed new framework • C Roberts et al. 199

Cand. B
Cand. A
Thematic Retractive Thematic Empathetic
Empathetic
1-10 1-6
Establish identity Establish identity
E1/20
R1/12 7-19
11-34 Negotiating purpose
E3/36 Eliciting
feeling?
worried?
R3/23 20-48
E3/41 Eliciting
What complaining
35-50 about?
E3/48 Result giving
R3/49
49-52
E1/62 51-70 Result giving
Stating intention (treatment)
R1/54
E2/63 53-55
CRUX – 1
Stating intention
(exclude worst)
E2/69 CRUX– 2
R1/63 CRUX - 1
(investigate)
CRUX – 3
E3/69
(bronchoscopy) 55-106
R1/66
Negotiating commitment
E1/79 E2/80
R3/78 CRUX – 2
E3/91 (kidney recurrence-repeated)
70 -131 CRUX – 3 E2/100
Negotiating commitment (bronchoscopy)
E3/116
R1/85 R2/85-93
CRUX – 4
E3/121 (exclude tumour) 107-111
Explaining
E3/132 132-149
Eliciting
112-169
E3/166 R1/113 Negotiating commitmen
t
CRUX – 5
(tumour before)
E2/188 169-174
150-200 Eliciting: other worries; cough
E2/192 Negotiating commitment
CRUX- 6 R1/183
175-182
(tumour recurrence)
Offering treatment
E3/194
(antibiotics)

Figure 4 Contrasting maps of the cancer patient scenario: one of a high-rated and one of a low-rated candidate. E1–3 refer to the
three empathetic styles (see examples 1–3). R1–4 refer to the three retractive styles (see examples 4–7). The number after each of
these codes refers to the line number in the transcription.

of an encounter, particularly where persuasion, nego- ideologies concerning medical expertise, patient-cen-
tiation or reassurance are the focus of the consultation. tredness and authority underpinned their communica-
This awareness may be brought to the encounter by tive style.14,16 At a general level, candidates tended to
either type of candidate, but the candidate with a highly present themselves on a spectrum from a position of
rated communicative style stages the themes in a personal authority and conviction on the one hand to,
responsive way, designing the progress of the consul- on the other, one that relied on the authority of medical
tation to fit the particular local interactional context evidence and procedures. A balance between the two
produced by the patient. seemed the most successful.
Similarly, the candidates managed the notion of
patient-centredness in different ways. There was a
Values and assumptions
contrast between stronger candidates, who were sensi-
A final element in the candidate’s overall communica- tive to patients’ levels of knowledge and understanding
tive style related to the assumptions they brought along and did not label candidates as ‘being worried’ or
to the encounter. These concerned beliefs, values and ‘heavy drinkers’, and weaker candidates, who tended to
ideologies about their relationships with patients, use set or trained elicitations such as ‘How do you feel
together with more deeply held views about social about that?’ too early in the consultation and ⁄ or who
issues related to alcohol, sex and drugs. Candidates’ labelled patients in the way they designed their elicita-

 Blackwell Publishing Ltd M ED I C A L E D UC A T I O N 2003;37:192–201


200 ‘Good’ and ‘poor’ communication in an OSCE: a proposed new framework • C Roberts et al.

tions and responses (see above ‘patient labelling’ as a to the ideological underpinnings of individuals’ styles.
retractive strategy). When these assumptions about the We have used the device of interactional maps, which
patient were made explicit (e.g. ‘We cannot force you to can be readily compared and contrasted, to shed light
take the test’), they were often retractive rather than on the differences in communicative style between
empathetic. strong and weak candidates.
There was also some evidence among weaker candi- We also need to assess the value of this form of
dates that their own moral assumptions influenced the analysis and classification in a teaching context.
design and staging of questions. The most obvious of Recently, preliminary evaluations of the objective struc-
these was a gendered ideology about normal sex. tured video examination (OSVE) have focused on
Several male candidates responded as if the young specific cognitive aspects of communication skills and
Muslim woman’s feelings of disgust and dirt were the their assessment, including students’ recognition and
result of abnormal sex. Thus, for example, when the understanding of the consequences of various commu-
actor-patient expressed these feelings and admitted, ‘It nication skills.20 Our collection of video-recorded
was a massive mistake’, some of the male candidates interactions and the associated analysis could take the
immediately asked, ‘What kind of sex … ?’ instead of OSVE one step further. The taxonomy of communica-
attending to her feelings. The weak candidate illustra- tive style used with examples taken from this OSCE data
ted above displayed these assumptions. In data example can develop students’ analytical skills and provide them
4, he seemed to assume that she felt terrible because she with a new analytic language. This approach should be
had put herself physically at risk, whereas throughout generalisable across consultations, while, at the same
the consultation these negative feelings were clearly time, alerting students to the fine tuning of particular
related to the act of sex itself and the patient’s responses to individual interactions.21 An approach to
emotional response to what she had done. analysing communication which accounts for the
success of the whole and is sensitive to the local context
of interaction is also transferable to naturally occurring
Discussion
consultations. Although the detailed examples may not
This research approach, using interactional sociolin- be relevant, the method, incorporating the analytic
guistics, provides new insights into the fine grain of components and the interactional maps, should also
communication in medical encounters. Whilst high- prove useful in analysing real patient–health profes-
lighting some of the complexity of the use of language, sional communication.
it also enables us to work towards a taxonomy of
communicative style. We are particularly struck by the
Contributors
way in which strong candidates stage their consulta-
tions, and design their turns in context-sensitive ways, Complete and detailed transcriptions of the scenarios
tuning in to the particular moment. This ability to tune referred to in the text are available from Celia Roberts.
in is hard to teach and, certainly, trying to improve Celia Roberts collected and analysed the data and was
communication skills with standard phrases and the lead writer. Val Waas designed the study and was a
‘trained empathy’ appears, from the evidence of our co-author. Roger Jones contributed to the design of the
data, likely to be counter-productive. study and was a co-author. Srikant Sarangi collected
Although we are confident that we have identified the data, contributed to the analysis of the data and was
key components of weak and strong communicators, a co-author. Annie Gillett contributed to data collec-
and are working towards a new taxonomy to accom- tion and analysis.
modate these, we recognise that much further work
needs to be done. We need, for example, to undertake
Acknowledgements
further discourse analysis to establish to what extent we
can map the features of communicative style that we We thank Stevo Durbaba for his invaluable technical
have identified so far onto other scenarios. We are also assistance and all the students who so kindly co-
aware that several of the aspects of empathetic and operated with this study.
retractive styles illustrated here are widely recognised in
the communication skills literature. Where our analysis
Funding
differs, however, is in its attempt to look at good and
poor communicators in the local context of specific This study was supported by a grant from the King’s
interactions, to link specific styles of questions and Fund. We are also grateful to King’s College Teaching
responses to the overall staging of the consultation and Fund for a further grant, which enabled us to make a

 Blackwell Publishing Ltd ME D I C AL ED U C AT I ON 2003;37:192–201


‘Good’ and ‘poor’ communication in an OSCE: a proposed new framework • C Roberts et al. 201

training video entitled Developing Empathy from the performance on an OSCE format examination. Acad Med
teaching material generated by this work. 1998;73:993–7.
13 Schwartz MH, Colliver JA, Bardes CL, Charon R, Fried ED,
Moroff S. Global ratings of videotaped performances versus
References global ratings of actions recorded on checklists: a criterion for
performance assessment with standardised patients. Acad Med
1 Taylor G. Underperforming doctors: a postal survey of the
1999;74:1028–32.
Northern Deanery. BMJ 1998;316:1705–8.
14 Gumperz J. Discourse Strategies. Cambridge: Cambridge
2 Skelton JR, Hobbs FDR. Descriptive study of co-operative
University Press; 1982.
language in primary care consultations by male and female
15 Cameron D. Working with Spoken Discourse. Newbury Park,
doctors. BMJ 1999;318:576–9.
CA: Sage 2001.
3 Hunt K, Emslie C, Watt G. Lay constructions of a family
16 Gumperz J. On interactional sociolinguistic method. In:
history of heart disease: potential for misunderstandings in the
Sarangi S, Roberts C, eds. Talk, Work and Institutional Order.
clinical encounter? Lancet 2001;357:1168–71.
Berlin: Mouton 1999:453–71.
4 General Medical Council. Tomorrow’s Doctors. London:
17 Tannen D. Talking Voices: Repetition, Dialogue and Imagery in
GMC; 1993.
Conversational Discourse. Cambridge: Cambridge University
5 Royal Pharmaceutical Society of Great Britain. From Compli-
Press; 1989.
ance to Concordance. London: RPS; 1997.
18 Tannen D. New York Jewish conversational style. Internat
6 Skochelak S, Thaler S, Gjerde C. The interdisciplinary gen-
Journ Sociol Language 1981;30:133–49.
eralist curriculum project at the University of Wisconsin
19 Green J, Wallat C. Mapping interactional conversations –
Medical School: the Generalist Partners Program. Acad Med
a sociolinguistic ethnography. In: Green J, Wallat C, eds.
2001;76:131–3.
Ethnography and Language in Educational Settings. Norwood,
7 Kurtz SM, Silverman JD. The Calgary-Cambridge observa-
New Jersey: Ablex 1981:161–205.
tion guides: an aid to defining the curriculum and organising
20 Humphris GM, Kaney S. The Objective Structured Video
the teaching in communication training programmes. Med
Exam for assessment of communication skills. Med Educ
Educ 1996;30:83–9.
2001;34:939–45.
8 Humphris GM, Kaney S. Assessing the development of
21 Roberts C, Sarangi S. Mapping and assessing medical
communication skills in undergraduate medical students.
students’ interactional involvement styles with patients. In:
Med Educ 2001;35:225–31.
Spellerman-Miller K, Thomson P, eds. Proceedings of British
9 Harden RM, Gleeson FA. ASME medical education booklet
Association of Applied Linguistics Annual Conference 2001.
no. 8: assessment of medical competence using an objective
London: British Association of Applied Linguistics; 2002:
structured clinical examination (OSCE). Med Educ
99–117.
1979;13:41–54.
22 Gumperz J, Berenz N. Transcribing conversational exchanges.
10 Wass V, van der Vleuten C, Schatzer J, Jones R. Assessment of
In: Edwards J, Lampert M, eds. Transcription and Coding
clinical competence. Lancet 2001;357:945–50.
Methods for Language Research. Hillsdale, New Jersey:
11 Spencer J. Education for communication: much already
Earlbaum Associates Inc; 1993.
known, so much more to understand. Med Educ 2001;35:188–
90.
12 Regehr G, Macrae H, Reznick R, Szalay D. Comparing the Received 20 March 2002; editorial comments to authors 12 June
properties of checklists and global rating scales for assessing 2002; accepted for publication 30 August 2002

 Blackwell Publishing Ltd M ED I C A L E D UC A T I O N 2003;37:192–201

Anda mungkin juga menyukai