There is recognition among research-practitioners that the advancement of marriage and family therapy (MFT) as a viable treatment
option in the larger health care system rests upon research-practitioners ability to provide consumers with descriptions of the clinical
processes of MFT and evidence of the effectiveness of MFT (Sprenkle &
Bailey, 1995; Pinsof & Wynne, 1995). Since many marital and family
therapists (MFTs) have been reluctant to conduct research on the process of their clinical work (Pinsof & Wynne, 1995), there is a significant
knowledge gap concerning the processes of clinician practices in the
MFT literature. Without the model-building potential of process rePeter J. Jankowski, PhD, is Assistant Professor, Department of Psychology, Judson
College, Elgin, IL, 60123 (e-mail: pjankowski@judson-il.edu). David C. Ivey, PhD, is
Associate Professor, Marriage and Family Therapy Program, Texas Tech University,
Lubbock, TX, 79409-1162. Reprint requests should be sent to Peter J. Jankowski, Ph.D.
Contemporary Family Therapy 23(4), December 2001 2001 Human Sciences Press, Inc.
419
420
CONTEMPORARY FAMILY THERAPY
LITERATURE REVIEW
The origin of the systematic study of clinical judgment can be
attributed to Meehls (1954, 1957) comparisons of subjective cognition
(clinical judgment) with objective statistical processes (actuarial judgment). The first subsequent decade of research was concerned with the
processes of prediction and diagnosis. Research results have consistently supported the superiority of actuarial judgment over clinical
judgment in terms of predictive and diagnostic accuracy (Goldberg,
1968; Goldberg & Werts, 1966; Meehl, 1954, 1957; Sawyer, 1966). Research during this period also demonstrated that the subjective judgment of clinicians was no better than that of secretaries (Goldberg,
1959), and that trained clinicians performed only slightly better than
chance and no better than untrained persons in terms of diagnostic
accuracy (Oskamp, 1965).
Despite the fact that research and discussion comparing actuarial
and clinical judgment persists to the present (e.g., Dawes, Faust, &
Meehl, 1989; Garb, 1994; Gardner, Lidz, Mulvey, & Shaw, 1996a,
1996b), another focus emerged during the second decade of research.
Research shifted from simply conducting outcome comparisons to at-
421
PETER J. JANKOWSKI AND DAVID C. IVEY
tempts at understanding how clinicians gather and integrate information (Falvey, 1992). With the emergence of the information-processing
model as the predominant means of conceptualizing clinical judgment
(Falvey, 1992), researchers focused on identifying heuristics and biases
assumed to cause the consistent finding that clinicians make inaccurate
and inferior judgments.
The information-processing model rests on mechanistic philosophical assumptions and does not adequately describe the judgment process
of clinicians (Ivey, Scheel, & Jankowski, 1999; Miller, 1993). The mechanistic orientation of the information-processing model can be seen in
its focus on the internal judgment processes of the clinician to the
neglect of the influence of context and therapist-client interaction (Holt,
1986, 1988; Sarbin, 1986). Another one of the mechanistic assumptions
of the information-processing framework is linear causality. The model
assumes a linear flow of information from the environment and subscribes to the idea that knowledge is a product of sequential processing
(Ivey et al., 1999). Finally, the model also assumes an objective external
reality and that data collection and analysis processes which are free
of error can obtain an exact mental representation of that reality (Ivey
et al., 1999; Mahoney, 1988).
Although efforts have been made to enhance the conceptualization
such that information-processors are seen as active seekers, creators
and users of information (Turk, Salovey, & Prentice, 1988, p. 1), clinical
judgment remains a linear, outside-in process. Furthermore, despite
attempts to conceptualize therapist-client interaction in the judgment
process (Turk et al., 1988), the attempt rests on the notions of transference and counter-transference that rely on the mechanistic assumptions of the objectivity and separation of the observer from the observed.
The term transference, for example, refers to the clients projection of
significant others onto the objectively neutral clinician (Turk et al.,
1988, p. 8).
Mechanistic philosophical assumptions are also evident in the clinical judgment process conceptualized by researchers within the traditional approach. The scientific model of interviewing is believed to
be more immune from error than other models of clinical judgment
(Strohmer, Shivey, & Chiodo, 1990). According to the scientific model
of interviewing, the clinician observes the client, makes inferences
concerning the clients current status and related causal factors, and
then develops a testable hypothesis about the client. The clinician
proceeds to test the hypothesis against additional independent observations of the client and the process continues until the clinician has
422
CONTEMPORARY FAMILY THERAPY
423
PETER J. JANKOWSKI AND DAVID C. IVEY
lum & Russell, 1992; Zygmond & Denton, 1988) can be seen as an
attempt at considering the influence of the larger social context on
clinician and client. Furthermore, the concern with the influence of
family history (Ivey, 1995, 1996) also reflects a consideration of context
on clinician judgment. Thus, MFT research on clinical judgment is an
advancement of the extant literature and its neglect of context on
clinician processes. However, there remains a neglect of therapist-client
interaction factors and a need to clarify and expand the conceptualization of contextual factors on clinical judgment. Furthermore, mechanistic assumptions are inherent within the conceptualization of clinical
judgment. Mechanistic assumptions remain such as a focus on clinician
bias and a concern with the inaccuracy and deficiency of clinician judgments. In addition, there is an absence of research that offers descriptions of the actual processes of clinician judgment.
In an effort to redress the lack of process research on clinical
judgment and to forward the development of models that more fully
consider context and therapist-client interaction, we examined one of
the principle aspects of clinical judgment, problem definition, and employed qualitative methods sensitive to a systemic and contextual perspective. Problem definition refers to the clinicians assessment at any
point during a session of the clients needs based on the perceived
causes, precipitants, and/or maintaining influences of the clients experience. As such, a problem definition is an answer a clinician constructs
to the question what will be the focus of clinical attention? or how
can I be helpful to this client? Thus, a problem definition helps guide
the direction for therapy. The chief purpose of our study was to describe
the processes by which problem definition occurs in marital and family
therapy, thereby advancing existing conceptualizations. The fundamental research question that guided the project was: How do marriage and family therapists arrive at a problem definition(s) in the first
session of therapy?
METHOD
We used a grounded theory approach (Charmaz, 1983; Glaser &
Strauss, 1967; Strauss & Corbin, 1990; Turner, 1981) because we were
generating a tentative theory in an area where there has been an
absence of systematic study (Rafuls & Moon, 1996). Furthermore,
grounded theory methods are appropriate for research questions that
are process oriented (Rafuls & Moon, 1996).
424
CONTEMPORARY FAMILY THERAPY
Data Collection
Data collection and analysis proceeded simultaneously (Charmaz,
1983). We obtained multiple sources of data through the use of observation of face-to-face interaction and semi-structured interviews (Turner,
1981). The use of multiple sources of data collection was a means of
enhancing the validity of the study (Maxwell, 1996).
We gathered observational data using a peripheral membership
role (Adler & Adler, 1994). Clients were informed that a doctoral student was observing the session from behind the one-way mirror and
given opportunity to meet the researcher. The focus of the observation
was on therapist-client interaction and the problem definition process
of the therapist. For observations that did not involve the use of a oneway mirror, observation took place with the researcher in the role of
a silent observer during the therapy session.
The data collection process proceeded through three phases. Initial
observations of therapy sessions were descriptive, unfocused, and general (Adler & Adler, 1994), and consisted of simply writing down the
therapists questions and comments, particularly those comments that
indicated that the therapist was answering the question what will be
425
PETER J. JANKOWSKI AND DAVID C. IVEY
Data Analysis
Data analysis of the field notes and transcriptions followed Charmazs (1983) interpretation and application of Glaser and Strauss
(1967) data analysis procedures. Initial coding consisted of searching
the data, attaching labels to lines or paragraphs of the data, and describing the data at a concrete level (Charmaz, 1983; Turner, 1981). This
426
CONTEMPORARY FAMILY THERAPY
process involved comparing pieces of data with each other for similarities and differences.
Focused coding, in contrast to initial coding, moved the coding
process to a conceptual level. Initial codes became a part of a category
that was abstract enough to subsume it as well as other initial codes.
For example, the statement by the therapist well, I think the fact that
its a hard referral because its coming from the police station was
initially coded as recognizing the source of the referral to indicate
the therapists awareness and use of this fact in the problem definition
construction process. This code was later subsumed under the larger
category of contextual factors, as were initial codes such as recognition of the referral incident and recognition of the larger system
within which the client was embedded.
Finally, writing memos occurred throughout data collection (Charmaz, 1983). The practice of writing memos was used to describe the
categories, and explain how they were or were not related to each other.
Validity was also monitored through the memo writing process by
consistently juxtaposing new understandings of the phenomenon derived from the data with pre-existing understandings of the phenomenon (Chenail & Maione, 1997). The self-reflexive process of juxtaposing
understandings assured that the data was not being conformed to fit
a pre-existing framework, thereby increasing the validity of the study.
After writing the memos, and rather than sorting the memos, categories
were diagrammed in an attempt to pictorially describe the relationship
between categories. The last phase of the data analysis process involved
writing memos that described the relationships between categories
revealed through the process of diagramming. The descriptions contained in this paper first appeared in the form of hand-written memos
that were later compiled and refined.
FINDINGS
Coding of the observations and interviews resulted in the construction of two meta problem definition processes that occurred during the
therapy sessions. The term meta-process is used because as individual
judgment processes were being coded and described it became apparent
that they could be conceptualized as fitting into larger categories. The
larger categories varied by factors used in the judgment formation
process. For example, some of the individual problem definitions were
constructed using therapist-specific and contextual factors; others were
427
PETER J. JANKOWSKI AND DAVID C. IVEY
428
CONTEMPORARY FAMILY THERAPY
FIGURE 1
Diagram of the Scared Problem Definition Process.
429
PETER J. JANKOWSKI AND DAVID C. IVEY
the clinician was answering the question: what will be the focus of
clinical attention? An element of the category of therapist-specific
factors that influenced the problem definition process was the clinicians preconceived notion of how a ten-year-old boy would act. When
the boys behavior was contrary to the clinicians expectation, the clinician got the impression that this client was wondering, whats going
on? or what is this place? Another element of the clinicians worldview that influenced the definition process was the assumption that
feeling safe is an important aspect of therapy. This assumption
stemmed from the clinicians experiences with others that led the clinician to feel safe, and to open up and become less defensive.
Part of the clinicians impression, that this client was holding
back and frightened by the experience of therapy, came from the interactional factors of observing facial expressions and behaviors. For example the statement, he was more quiet and he just kept his jacket on
and just kind of like sitting back in his seat. An additional interactional
element that influenced this particular problem definition was the
clinicians remembrance of previous clinical experiences. Because of
the clinicians previous experiences with police referrals, the clinician
was able to draw upon previous clients experiences of the referral
process and infer some things about this clients behavior.
The context of the therapy also played a role in the clinicians
problem definition process. The clinician was aware of the clients embeddedness within other systems. The clinician knew that there were
problems in the way the referrals were handled which potentially could
lead to feelings of fear and holding back on the part of clients. The
referral process created some of the context within which the therapy
occurred. Thus, the clinicians worldview, the context of the therapy,
and interactional factors led the clinician to determine that this client
was frightened.
Interview Excerpt
Therapist:
430
CONTEMPORARY FAMILY THERAPY
431
PETER J. JANKOWSKI AND DAVID C. IVEY
432
CONTEMPORARY FAMILY THERAPY
FIGURE 2
Diagram of the Traumatic Problem Definition Process.
433
PETER J. JANKOWSKI AND DAVID C. IVEY
ous experiences with other clients and situations; the therapists experience during the session; the therapists perceptions of the referral incident; and reading the clients reactions. Each of these incidents was
found in examples of internal definition processes. However, the main
distinction between internal and conversational problem definition processes was not the elements comprising the categories but the clinicians
making overt their impressions during the session and their attitude
of respect that gave value to the clients ability to determine the helpfulness of a particular problem definition.
Interview Excerpt
Interviewer: I remember you used the word normalizing, . . . and I
was wondering if you could just tell me a little bit about
why you thought it was important to try to help them
feel normal?
Therapist: A couple of things, first of all, I had this feeling that it
was difficult for them to come to the community mental
health system. I think there were some vibes or stigma
about being perceived as being crazy. Ive run into that
with other families, and I think my impression was that
there was some feeling about that. The intake worker
even mentioned that the daughter didnt want to do this,
because she didnt want her friends to know. So I had a
preconceived idea that this was going to be somewhat
difficult for them, or they werent sure, so I think one
layer of the normal piece was the external system, about
that. I think that was evidence early on to me that a lot
of other people had been telling them theyre not behaving
normally, just to go back to work, go back to school,
pretend like nothing happened in your life. It seemed
important for someone to say something traumatic happened in your life here, and youre having realistic responses to it.
Interviewer: One of the other things that stood out was, you used the
phrase PTS, can you tell me a little bit about what made
you use those initials?
Therapist: To be something of the expert, to provide some sort of
explanation or maybe some of my own need to feel like
if I can offer some information to help normalize. My main
goal in this session was to normalize their experiences.
I feel like I did a number of things that were pointed in
that direction and if they had some words or labels or a
434
CONTEMPORARY FAMILY THERAPY
syndrome to put on that, that may or may not be something that they could use as a normal sort of reaction.
And I think unless I misread their reaction to that, when
I alluded to the Vietnamese thing they both nodded their
heads, and said Oh yea. I think there was some value
in introducing that, Im not sure if I would want to stay
there very long, but that was one of my educational tidbits.
SUMMARY
The process of formulating a problem definition involved, in varying combinations: (1) the clinician comparing and contrasting pre-existing knowledge with information obtained from the clients during the
session; (2) using an understanding of how larger contextual factors
affected his or her and the clients experience during the session; and
(3) an awareness of the experiences resulting from interaction with the
client during the session, and determining how those fit with previous
experiences with other clients.
Clinicians engaged in two meta-level problem definition processes.
The distinction between the internal and conversational problem definition processes was that clinicians who engaged in a conversational
problem definition process: (1) made overt their internal problem definition process and incorporated those formulations into the therapeutic
conversation; and (2) relied upon client input about the helpfulness of
an emerging problem definition.
DISCUSSION
Prior to this study, descriptions of the actual judgment processes
of clinicians evidently did not exist. The representative descriptions
provided in this study make concrete what, until now have been only
abstract, theoretical and hypothetical descriptions of clinicians judgment processes. The findings from this study have implications for the
existing mechanistic conceptualizations of clinical judgment within the
traditional and MFT literature, as well as the practice and training of
MFTs.
The findings of this study fundamentally influence the reliance on
the information-processing model of clinical judgment. As mentioned
435
PETER J. JANKOWSKI AND DAVID C. IVEY
earlier, the information-processing model assumes an outside-in, linear flow of information, as well as a conceptualization of judgments
constructed solely within the mind of the clinician, thereby neglecting
contextual and interactional factors. The descriptions of the judgment
processes showed that formulations often involved interactional and
contextual factors. The interactional and contextual factors indicated
that clinicians used more than verbal information obtained from the
client alone. Clinicians judgment formation processes were more dynamic and cyclical than the linear process of the information-processing
model.
It may be that judgments only involving therapist-specific factors,
as conceptualized in this study, would be consistent with an information-processing model. However, none of the clinicians relied solely on
the category of therapist-specific factors when constructing a problem
definition. Clinicians utilized contextual and/or interactional factors
when forming their judgments, thus clinical judgment cannot be seen
as stemming entirely from the mind of the individual clinician. In fact
as shown in the conversational problem definition process, judgments
were often created between clinician and client.
One final implication for existing conceptualizations of clinical
judgment involves the move away from a research focus on outcome
to a process research approach. Traditionally, both without and within
MFT, researchers have focused on identifying errors or pathologies
within clinicians judgment processes and/or the accuracy of their judgment as compared to some objective standard. Since the informationprocessing model assumes the clinician is inherently limited and deficient and in need of adhering to a particular procedure to avoid error,
it makes sense that existing research has focused on pathology. This
study focused more on the process of arriving at particular judgments,
and did not contain an evaluative component as to the rightness or
wrongness of the judgments. The avoidance of a focus on outcome
allows the descriptions of internal and conversational problem definitions to simply be descriptions of different ways of formulating judgments. It was not the intent of this study to state that one mode of
judgment construction is superior to another.
436
CONTEMPORARY FAMILY THERAPY
437
PETER J. JANKOWSKI AND DAVID C. IVEY
FUTURE CONSIDERATIONS
A number of other areas for further study emerged from the coding
process. Further study is needed when it comes to trying to establish
relationships between factors that may influence the ways in which
clinicians formulate problem definitions. Factors that need to be explored include the level of clinician development and how that influences the process of definition construction, as well as specific client
and clinician assumptions about change, people and the world and
how those assumptions influence problem definition processes. Further
exploration of contextual factors such as the location of therapy, the
referral incident and process, and the role larger systems such as
schools, courts, and churches play in problem definition formation processes could also inform existing understandings of clinical judgment.
Finally, examination of the outcomes of various processes including
clients experience of the differing processes could also inform therapy
practice and supervision, particularly if certain processes are found to
be associated with more positive clinical outcomes.
CONCLUSION
By offering a more contextually oriented conceptualization of clinical judgment, it is our hope that marriage and family therapists find
clinical judgment more compatible with their fundamental systemic
orientation. We hope marriage and family therapists will further explore how clinical judgments evolve and influence the clinical endeavor.
The extant literature based on prior empirical studies neglects the
influence of interactional factors on the clinical judgment process. In
addition, conceptual models that currently exist do not capture the
complexity of clinicians problem definition processes. Based on the
findings of this study, clinical judgment is a complex process of makingsense of and utilizing therapist-specific, contextual, and interactional
factors. Thus, there is an evident need to develop theories that consider
the complexity of clinical judgment and it is our hope that we have
initiated progress in that direction.
REFERENCES
Adler, P.A., & Adler, P. (1994). Observational techniques. In N.K. Denzin, & Y.S.
Lincoln (Eds.), Handbook of qualitative research (pp. 377392). Thousand Oaks, CA: Sage.
438
CONTEMPORARY FAMILY THERAPY
439
PETER J. JANKOWSKI AND DAVID C. IVEY
D. C. Turk, & P. Salovey (Eds.), Reasoning, inference, and judgment in clinical psychology
(pp. 155181). New York: The Free Press.
Maxwell, J.A. (1996). Qualitative research design: An interactive approach. Thousand
Oaks, CA: Sage.
McCollum, E. E., & Russell, C. S. (1992). Mother-blaming in family therapy: An
empirical investigation. The American Journal of Family Therapy, 20, 7176.
Meehl, P. E. (1954). Clinical versus statistical prediction: A theoretical analysis and
a review of the evidence. Minneapolis: University of Minnesota Press.
Meehl, P. E. (1957). When shall we use our heads instead of the formula? Journal
of Counseling Psychology, 4, 268273.
Miller, P. H. (1993). Theories of developmental psychology. New York: W. H. Freeman
and Company.
Mishler, E. G. (1986). The analysis of interview-narratives. In T. R. Sarbin (Ed.),
Narrative psychology: The storied nature of human conduct (pp. 233255). New York:
Praeger.
Oskamp, S. (1965). Overconfidence in case-study judgments. Journal of Consulting
Psychology, 29, 261265.
Pinsof, W.M., & Wynne, L.C. (1995). The effectiveness and efficacy of marital and
family therapy: Introduction to the special issue. Journal of Marital and Family Therapy,
21, 341343.
Rafuls, S.E., & Moon, S.M. (1996). Grounded theory methodology in family therapy
research. In D.H. Sprenkle, & S.M. Moon (Eds.), Research methods in family therapy
(pp. 6480). New York: Guilford Press.
Sarbin, T. (1986). Prediction and clinical inference: Forty years later. Journal of
Personality Assessment, 50, 362369.
Sawyer, J. (1966). Measurement and prediction, clinical and statistical. Psychological
Bulletin, 66, 178200.
Sprenkle, D.H., & Bailey, C.E. (1995). Editors introduction. Journal of Marital and
Family Therapy, 21, 339340.
Strauss, A., & Corbin, J. (1990). Basics of qualitative research: Grounded theory
procedures and techniques. Newbury Park, CA: Sage.
Strohmer, D. C., Shivy, V. A., & Chiodo, A. L. (1990). Information processing strategies in counselor hypothesis testing: The role of selective memory and expectancy. Journal
of Counseling Psychology, 37, 465472.
Turk, D. C., Salovey, P., & Prentice, D. A. (1988). Psychotherapy: An informationprocessing perspective. In D. C. Turk & P. Salovey (Eds.), Reasoning, inference, and
judgment in clinical psychology (pp. 114). New York: The Free Press.
Turner, B.A. (1981). Some practical aspects of qualitative data analysis: One way
of organizing the cognitive processes associated with the generation of grounded theory.
Quality and Quantity, 15, 225247.
Weber, S. J. (1986). The nature of interviewing. Phenomenology and Pedagogy, 45,
6572.
Zygmond, M. J., & Denton, W. (1988). Gender bias in marital therapy: A multidimensional scaling analysis. The American Journal of Family Therapy, 16, 262272.