Master Thinker
GEOINT 15
Kathy Pherson
23 June 2015
Agenda
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved 3
Four Cognitive Concepts to
Keep in Mind
1. Greg Treverton
Is our problem a puzzle or a mystery?
System 1: System 2:
Intuitive Purposeful
Source: Kahneman, Daniel, Thinking Fast and Slow,. New York: Farrar,
Straus, and Giroux, 2011.
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved 8
Critical Thinking Is Defined in
Many Ways
• Mental activity that is clear, precise, and
purposeful.
• An ability to evaluate information and opinions
in a systematic, purposeful, and efficient
manner.
• The adaptation of the processes and values of
scientific inquiry to my environment and its
special circumstances.
SYNTHESIS
&
ANALYSIS
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved 10
How Do These Models Relate?
Critical Thinking
Components Analytic
Operational
Environment
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved
12
YOU?
The Real World
has Multiple
Layers of Decision
YOU?
Makers
YOU?
Estimative
Analysis
Evaluative
Analysis
Explanatory
Time Focus
Analysis
What Happens Next?
Descriptive
Analysis
What Does it Mean?
Why?
Who? What? When?
Where?
How? Forecasts
Summarizes, Reports
Reactive
Data-Driven Concept-Driven
Thought Process
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved 16
The Critical Thinking Process
• Asking the right questions.
• Identifying one’s assumptions.
• Reaching out to other sources.
• Evaluating the data for accuracy, relevance, and
completeness.
• Assessing the data and forming hypotheses.
• Evaluating the hypotheses;
looking for conflicting data.
• Drawing conclusions.
• Presenting your findings.
21
Source: Pherson, Randolph. Handbook of
Analytic Tools and Techniques. Reston, VA: 22
Pherson Associates, 2006.
Core Techniques
• Intelligence Training’s “Top Four”:
– Brainstorming
– Key Assumptions Check
– Analysis of Competing Hypotheses
– Indicators
• Business Consulting “Top Six”:
– Key Assumptions Check
– Analysis of Competing Hypotheses
– Quadrant Crunching
– Pre-Mortem Assessment
– Indicators
– What If? Analysis
• Adds rigor
• Fully transparent
• Saves time (over time)
• Makes the analysis more compelling
Can your unit make a Who are the primary Are key drivers and Is the writing clear, Are the graphics
unique contribution? customer(s)? Do we trend lines highlighted? precise, and well- consistent with the
need different versions organized? analysis?
Does the analysis Did I identify contrary
highlight new
of the product?
evidence, and Did I put the bottom line Are key terms well-
up front? defined? Is a glossary
information and further What key questions information gaps? needed?
our understanding? must I answer? Is the credibility of the
Are analytic judgments source(s) clearly Have grammatical
Should an explicit Can I describe the and assumptions articulated? Is denial or errors, typographical
warning message be broader context for this distinguished from the deception a possibility? errors, and misspellings
delivered? topic or issue? underlying intelligence? been corrected?
Are levels of confidence
To whom should I reach Have I identified and Did I consider past in the judgments and Are all markings correct
out at each stage of the challenged my key customer feedback, uncertainties clearly and any handling
process? With whom do assumptions? explore opportunities, expressed? caveats prominent?
I need to coordinate?
Am I changing my
and assess both Is the analysis free of Have I provided proper
benefits and risks? bias, advocacy, and footnotes?
Would the analysis overall analytic line? If value laden terms?
benefit from structured so, did I explain why?
analytic techniques? Did I identify
Can graphics be used
to advance and define alternative
the message? hypotheses and
provide context?
Is there sufficient Do my titles and
Critical Requirements: reasoning and headings
compelling Does each section, effectively capture
Is the Copyright
topic clearly Is the main point evidence to paragraph, and www.pherson.org
the message? Are
2013 Pherson Associates, LLC. All Rights Reserved.
Copyright
relevant2012 Pherson Associates,
to the
www.pherson.org LLC. Alland
prominent support the sentence advance they in synch with
26
Rights Reserved.
mission? www.Pherson.org
clearly stated? judgments? the storyline? the text?
What Are Your AIMS?
A Audience
I Intelligence Question
M Message
2. Why now?
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved 28
Arguments in Intelligence Writing
• Separate information from analysis to focus attention on assessing
what is new or changing; not what is known or is already known to have
occurred.
Information : Facts or evidence
Assumptions : An analyst’s interpretations of evidence and reasoning
Judgments : The most significant analytic points or claims in a paper,
both the “what” and the “so what”
Assessments : Judgments about unknowns such as:
Who is or will be involved
What will happen
When it will take place
Where it will occur
Why it is occurring or will occur
What the implications are or will be
How it is likely to evolve
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved 29
Structure of an Argument
• An argument is comprised of a set of statements, one of which is the
conclusion or claim that is supported logically by the other statements.
The claim is based on reasonable evidence, connected to observable fact,
and characterized by clear, traceable, and fair thinking.
•
Claim: The assertion or point you are making.
•
Reason: How the evidence relates to the claim.
•
Evidence: Facts, data, observations that support your reasons and claim.
•
Assumption: Something that is taken for granted or is accepted as true or
certain to happen.
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved 30
1. Topic Sentence Outline
www.pherson.org
Copyright 2013 Pherson Associates, LLC. All Rights Reserved.
www.pherson.org
2. Argument Map
www.pherson.org
Copyright 2013 Pherson Associates, LLC. All Rights Reserved.
Copyright 2012 Pherson Associates, LLC. All Rights Reserved.
www.pherson.org
www.pherson.org
3. Venn Diagram: Critical Thinking
Issues &
Customer Identification
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved 34
The Story Cycle™
Source: Dr. Clyde Ford, “The Story Cycle Method™,” December 2012
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved 35
Copyright 2012 Pherson Associates, LLC. All Rights Reserved.
www.pherson.org
Five Habits of the Master Thinker
Examples:
• A critical, incriminating piece of evidence is
• valid (i.e., travel records or a translation)
• The DC sniper is single, white, and male, with
military training, and driving a white van.
Source: Heuer, Richards J. Jr. and Randolph Pherson, Structured
Analytic Techniques for Intelligence Analysis, 2nd Edition.
Washington, DC: SAGE/CQ Press, 2014.
Lead Hypothesis:
A domestic extremist group will attempt to stop
construction by disrupting the construction site of the new
highway.
Hybrid
Minivans
Prius or Mass
Transit?
Family
The Size of US Families Family Size
Size <3
>5
• Regional defensive
umbrella secures • Militias integrated into
borders new Iraqi Army
• Insurgency is pure • Jordan brokers deal;
Sunni, internal political economic aid to Sunnis
Ineffective solution? Effective
Security Iraqi Security Capability Security
Capability Capability
• Syria collapses, • Insurgency fragments
influx of new • Refugees flow into Iraq
fighters seeking safe haven
• Civil War
Specificity is Critical!
50,000
Cases
0 10 yrs
Cases Patterns Patterns Hypotheses Create Test
within between Models models
cases cases
www.pherson.org
© 2015 Pherson Associates, LLC. All Rights Reserved 67
Learning Outcomes
• Explain analytic frameworks to structure approaches to solve
intelligence-related problems.
• Recognize and be aware of techniques to mitigate the mental traps and
cognitive biases that leas to misinterpretations and catastrophic errors.
• Systematically challenge key assumptions.
• Consider alternative explanations or hypotheses.
• Look for and take inteo account disconfirming and diagnostic data.
• Identify ways to generate and use key drivers and indicators to track
events and consider alternatives.
• Apply the Impact Matrix to assess the impact of a decision on their
organization.
• Address potential for disruptive changes through the Premortem
Assessment and Structured Self-Critique.
Kathy Pherson
Chief Executive Officer
Pherson Associates, LLC
Office: 703-390-9902
Email: kpherson@pherson.org