Alan Hudson is a Research Fellow at the Overseas Development Institute. His prim
ary research
interests are around issues of accountability, politics and policy processes. Si
nce joining ODI in
2005, Alan has been involved in work on accountability, policy coherence, and de
cision-making
within the European Union. Prior to joining ODI, Alan was the advisor to the UK
Parliament s Select
Committee on International Development. Email: a.hudson@odi.org.uk
Cecilia Luttrell is a Research Fellow with the Rural Policy and Governance Group
at the Overseas
Development Institute. She has over twelve years research and international deve
lopment
experience, and before joining ODI worked in South East Asia and Africa. Her res
earch interests focus
primarily on the natural resource sectors and governance, and she has been invol
ved in the
development of methodologies for economic and political analysis of poverty and
institutions. Email:
c.luttrell@odi.org.uk
Research and Policy in Development Programme
111 Westminster Bridge Road, London, SE1 7JD
Tel: +44 (0)207 922 0300 Email: rapid@odi.org.uk
Executive Summary v
Introduction 1
What is political context and why does it matter? 1
How can political context be mapped? 2
Tools for mapping political context 3
1. Civil Society Index (CIVICUS) 5
What is the Civil Society Index? 5
How does the Civil Society Index work? 5
Elements of the Civil Society Index 6
Key references 7
2. Country Policy and Institutional Assessment (WB) 8
What is a Country Policy and Institutional Assessment? 8
How does a CPIA work? 8
Elements of the CPIA 9
Key references 10
3. Democracy and Governance Assessment (USAID) 11
What is the Democracy and Governance Assessment? 11
How does the Democracy and Governance Assessment work? 11
Elements of the Democracy and Governance Assessment 12
Key references 13
4. Drivers of Change (DFID) 14
What is the Drivers of Change approach? 14
How does the Drivers of Change approach work? 14
Elements of the Drivers of Change approach 14
Key references 16
5. Governance Matters/Country Diagnostics (WBI) 17
What are Governance Matters and Country Diagnostics? 17
How do Governance Matters and Country Diagnostics work? 17
Elements of Governance Matters and Country Diagnostics 18
Key references 20
6. Governance Questionnaire (GTZ) 21
What is the Governance Questionnaire? 21
How does the Governance Questionnaire work? 21
Elements of the Governance Questionnaire 22
Key references 23
7. Power Analysis (Sida) 24
What is Power Analysis? 24
How does Power Analysis work? 24
Elements of Power Analysis 24
Key references 25
8. Stakeholder Analysis 26
What is Stakeholder Analysis? 26
How does Stakeholder Analysis work? 26
Elements of stakeholder analysis 27
Key references 28
9. World Governance Assessment 29
What is the World Governance Assessment? 29
How does the World Governance Assessment work? 29
Elements of the World Governance Assessment 31
Key references 31
Boxes and Figures
This toolkit describes a range of tools that CSOs might use to understand and ma
p political context, in
order to engage more effectively in policy processes.
Political context includes aspects such as the distribution of power, the range
of organisations involved
and their interests, and the formal and informal rules that govern the interacti
ons among different
players. Political context shapes the ways in which policy processes work. If CS
Os can better
understand the contexts for their actions, then they will be in a better positio
n to devise more effective
strategies, which may allow them to have more influence on policy.
This guide introduces a series of tools that have been designed to map various d
imensions of political
context. The tools have been selected because they cover a wide variety of polit
ical dimensions. As
such, they provide a menu of different approaches to mapping political context;
CSOs and others can
select from this menu and make use of the tools according to their own needs.
Some of the tools take the nation-state as the unit of analysis; others can be a
pplied at any scale.
Some tools focus on the mapping of power, others on the mapping of institutions,
organisations and
stakeholders. Some tools focus on formal institutions; others look to map inform
al institutions too. The
tools selected also cover a great deal of ground in terms of the approach they t
ake. Some of the tools
are clearly normative, others strive for objectivity. Some work with qualitative
data, others with
quantitative. Some of the tools can be used quickly and inexpensively, others re
quire large inputs of
time and resources. Some are designed with a very specific purpose in mind, othe
rs are not. Some
enable cross-country comparisons, others do not. In deciding which tool(s) to us
e, CSOs need to think
carefully about the sort of mapping they are interested in. For instance, do the
y want to produce
comparable maps of different contexts, or will a detailed map of one context be
adequate for their
purposes?
Political context matters. By making selective use of the tools presented here,
CSOs will be able to
understand political context better, and engage more effectively in policy proce
sses.
Introduction
Political context shapes the ways in which policy processes work. To engage effe
ctively in policy
processes, civil society organisations (CSOs) and others need to understand poli
tical context. In some
contexts, policymakers are keen to receive evidence and ideas from CSOs: there a
re established
channels through which CSOs can make their inputs. In other contexts, CSOs are e
xcluded from formal
policy processes. To be effective, CSOs need to take different approaches in dif
ferent contexts.
This guide describes a range of tools for understanding and mapping political co
ntext, for those hoping
to engage more effectively in policy processes. The first part of the guide addr
esses two questions:
what is political context and why does it matter? and how can political context be
mapped? , before
introducing some tools for mapping political context. The second section of the
guide provides
information about a number of tools that can be used to map political context.
Most of the tools have been produced for a specific purpose. This guide does not
suggest that CSOs
use these tools strictly in the way their designers intended; in most cases this
would not be sensible or
practical. Rather, this guide highlights those elements of the tools that might
be of interest to CSOs
seeking to understand better the contexts in which they are working, and to act
more effectively.
What is political context and why does it matter?
Context refers to those aspects of the world that are relevant to action: contex
t is the arena for action.
Context matters for policy for a range of interrelated reasons. First, context s
hapes the likelihood of
change a policy reform, for instance taking place. Secondly, context shapes the
positions and
perspectives of those organisations with an interest in the policy reform. And t
hirdly, context shapes
the effectiveness or appropriateness of different actions. In some contexts, it
will be more effective to
act in a certain way; in other contexts, acting in the same way would be ineffec
tive.
Political context refers to the political aspects of the environment that are re
levant to action. This
includes aspects such as the distribution of power, the range of organisations i
nvolved and their
interests, and the formal and informal rules that govern the interactions among
different players. For
development actors seeking to influence policy, political context matters becaus
e it determines the
feasibility, appropriateness and effectiveness of their actions.
For CSOs seeking to influence policy and practice, context shapes the effectiven
ess of particular
strategies. As RAPID s work has shown, the influence of CSOs on policy has been li
mited.1 If CSOs can
better understand the contexts for their actions, then they will be in a better
position to devise more
effective strategies, which may allow them to have more influence on policy (see
Box 1).
ODI s Research and Policy in Development (RAPID) programme aims to improve the use
of research and evidence
in development policy and practice through research, advice and debate.
As part of this programme of work, RAPID has sought to understand better the int
erface between research and
policy. One of the key findings has been that the crucial factor in shaping this
interface that is, shaping the
extent to which research-based evidence feeds into policy processes is political
context.
RAPID s interest in political context is practical, and is based on the view that
by understanding political context
better and then responding appropriately it is possible to maximise the chances
of policy influence.2 For
RAPID, political context and its impact on the research-policy interface can be
understood in terms of five clusters
of factors. These are:
The macro-political context: governance and civil and political freedoms
The specific context of policy formulation and the nature of specific policy pro
cesses
Implementation and the institutional context within bureaucracies
Decisive moments in the policy process
The way policymakers think
It is clear that efforts to map context and to select and use many of the tools
included in this toolkit
must always begin with clear statements of position and purpose.
The possibility of mapping political context
The fact that context is multi-dimensional, and that the relevant dimensions of
context depend very
much on the purpose of action, and the position of the actor, might seem to pres
ent an intractable
problem for context mapping. It is certainly a challenge, and one which may, in
some circumstances,
make it sensible to employ very simple and flexible tools for mapping political
context (see Box 2).
2 Court, J. with L. Cotterrell (2006) What Political and Institutional Context I
ssues Matter for Bridging Research and Policy? A
Literature Review and Discussion of Data Collection Approaches, ODI Working Pape
r 269, London: ODI.
Box 2: A flexible approach to mapping political context
The starting point is to produce a clear statement of the policy reform being pu
rsued.
A fifth component is to complete a policy process matrix to assess, for each sta
ge of the policy process, what
needs to be done to ensure the survival of the proposal for policy reform. NB: S
teps four and five are about
developing an influencing strategy that builds on the mapping of political conte
xt, rather than mapping political
context.
In addition to these five context mapping components, Professor Grindle asks her
students to develop a
communications strategy, thinking carefully about the goal of such a strategy, i
ts audience, and its key
messages.
However, many organisations have developed tools for mapping political context.
In addition, the fact
that these tools, designed often for a particular purpose, embody a range of app
roaches to mapping
different dimensions of context, makes existing tools a good source of ideas and
inspiration.
Maps, in their everyday usage, provide a useful analogy. For any one country, th
e UK for instance, there
is a range of maps, which vary in scale and coverage according to the purpose fo
r which they were
designed. There are maps that cover a very small area and are suitable for navig
ation on foot, as well
as maps that cover a larger area and provide information about, for example, the
location of petrol
stations. This does not make particular maps, or the practise of mapping, any le
ss useful. It simply
means that when selecting a map, or a tool for making a map, it is vital to be c
lear about what it is that
you are intending to do.
Tools for mapping political context
With the challenges of mapping political context in mind, this guide introduces
a series of tools
designed to map various dimensions of political context. The tools have been sel
ected because they
cover a wide variety of political dimensions (see Box 3). As such, they provide
a menu of different
approaches to mapping political context; CSOs and others can select from this me
nu and make use of
the tools according to their own needs.3
3 The World Bank s Tools for Institutional Political and Social Analysis provides
a complementary source of information on
tools for mapping context and policy processes. See www.worldbank.org/tips.
Box 3: Tools for mapping political context: dimensions considered
Civil Society Index (CIVICUS): Civil society s structure, impact, environment and
values
Country Policy and Institutional Assessment (World Bank): Governance institution
s, policies, economic
management
Democracy and Governance Assessment (USAID): Players, interests, resources, obje
ctives, rules,
institutional arenas
Drivers of Change (DFID): Structure, agents, institutions
Governance Questionnaire (GTZ): State-society relations, political system, polit
ical culture, politics and
gender, economic policy and political framework of markets, international integr
ation
Governance Matters (World Bank Institute): Voice and accountability, political s
tability and absence of
violence, government effectiveness, regulatory quality, rule of law, control of
corruption
Power Analysis (Sida): Power and its distribution
Stakeholder Analysis: Stakeholder interests and resources
World Governance Assessment: Participation, decency, fairness, accountability, t
ransparency, efficiency
Some of the tools take the nation-state as the unit of analysis; others can be a
pplied at any scale.
Some tools focus on the mapping of power, others on the mapping of institutions,
organisations and
stakeholders. Some tools focus on formal institutions; others look to map inform
al institutions too. The
tools selected also cover a great deal of ground in terms of the approach they t
ake. Some of the tools
are clearly normative, others strive for objectivity. Some work with qualitative
data, others with
quantitative. Some of the tools can be used quickly and inexpensively, others re
quire large inputs of
time and resources. Some are designed with a very specific purpose in mind, othe
rs are not. Some
enable cross-country comparisons, others do not. In deciding which tool(s) to us
e, CSOs need to think
carefully about the sort of mapping they are interested in. For instance, do the
y want to produce
comparable maps of different contexts, or will a detailed map of one context be
adequate for their
purposes?
Political context matters. Having clarified what they want to achieve, CSOs will
by making selective
use of the tools presented here be able to understand political context better,
and engage more
effectively in policy processes.
1. Civil Society Index (CIVICUS)
A tool for assessing and comparing civil societies, in order to strengthen them
What is the Civil Society Index?
The Civil Society Index (CSI) was developed by CIVICUS, an alliance of civil soc
iety organisations with
members in over 100 countries. The goals of the CSI are to enhance the strength
and sustainability of
civil society and to strengthen civil society s contribution to positive social ch
ange. The strategy for
contributing towards these goals is one of generating and sharing knowledge abou
t the state of
national civil societies. The index uses a standard framework to assess the heal
th and vitality of
national civil societies, and then employs a graphical device the civil society d
iamond to present
this information.
Each dimension has a range of individual indicators scored from 0 to 3. The scor
es are aggregated and
can be graphically represented in the form of the civil society diamond, althoug
h this process of
aggregation necessarily means that some of the richness of the qualitative infor
mation is lost.
The aim is for the CSI country reports to give as rich an account as possible, w
ithout the constraint of
having to quantify or score it. The CSI s designers therefore suggest a citizen ju
ry approach to the
scoring. Assessments have been led by prominent civil society organisations, whi
ch have coordinated
input from a range of stakeholders including government, business, international
agencies, media
and academia. The approach emphasises the importance of moving back and forth be
tween research
and analysis, and involving a range of stakeholders at all stages of the process
. The CSI approach has
been implemented in more than 50 countries.
Elements of the Civil Society Index
Conceptual approach and indicators
With its focus very much on civil society, and its aim of providing both a frame
work for analysis and
a process for building civil society, the CSI will be of considerable interest t
o CSOs.
The approach taken by the CSI is to map civil society according to how close it
is to being a healthy
civil society , characterised by tolerance, human rights, gender equity, sustainab
le development,
social justice, democracy and transparency. This approach, while open to critici
sm, does have the
benefit of making explicit the normative stance taken.
CSOs may find the dimensions and sub-dimensions of civil society considered by t
he CSI index of
use in their own efforts to map context. Starting from a clear statement of purp
ose, CSOs could put
together their own mapping tool making use of a perhaps smaller number of sub-di
mensions.
Impact: influencing public policy; holding state and private corporations accoun
table; responding to social
interests; empowering citizens; meeting societal needs.
4 In some applications of the CSI, environment is used instead of space .
Data
The CSI approach suggests the following data sources: media reviews; stakeholder
consultations;
and community surveys. Such data sources may be of use to CSOs seeking to map co
ntexts for
their own purposes.
The CSI approach is designed to be very interactive, so that the capacity of civ
il society is built in
the process of producing a map of civil society. This provides an additional ben
efit of CSO
involvement in CSI processes.
The CSI approach is designed to be flexible and to encourage in-country adaptati
ons, with an
evaluation of the approach describing it as a contextually flexible and uniquely
participatory tool
(Batliwala, 2003: 1). The loosely structured approach to mapping civil society p
rovides a good
balance between valuing country comparability and acknowledging country specific
ity.
Key references
The CSI tool itself can be found at:
http://www.civicus.org/new/media/improving_understanding_and_strength_of_CS.pdf.
Be ovan, G., S. Zrin cak and M. Vugec (2005) Civil Society in Croatia, Gaining Trust
and Establishing
Partne ships with the State and Other Stakeholders, Zagreb: Centre for Developme
nt of Non-Profit
Organizations (CERANEO).
Until recently, the detailed results and the precise way in which they have been
reached have been
confidential. However, the World Bank has recently fulfilled its promise to make
more information
about CPIA scores available (see How IDA resources are allocated under www.worldba
nk.org/ida).
Data
As with many of the other tools for mapping context, the CPIA relies ultimately
on the judgments of
experts. The ways in which the CPIA process makes use of expert views and seeks
to quantify them
to enable comparison among countries may provide CSOs and others with food for t
hought.
In particular, a preliminary stage in CPIA analysis involves setting regional be
nchmarks to ensure
cross-country comparability. Any CSO context mapping project that seeks to produ
ce results that
can be compared between countries would be well advised to think about the use o
f regional
benchmarks.
The CPIA questionnaire provides suggestions CSOs might themselves use to gather
information
about various dimensions of context. This could be of great value to CSOs seekin
g guidance on
possible data sources.
The most recent version of the questionnaire is the Country Policy and Institutio
nal Assessments
2005 Assessment Questionnaire , Operations Policy and Country Services, online at
http://siteresources.worldbank.org/IDA/Resources/CPIA2005questionnaire.pdf.
Analysis, presentation and recommendations
The CPIA guidelines stress that the meaning of seemingly objective information d
epends on the
particular country case/context. This raises issues regarding the trade-off betw
een country
comparability and the importance of recognising country specificity, a trade-off
with which many
context mapping exercises will need to grapple.
The CPIA, its analysis, and the recommendations for action how much aid to provi
de which it
drives raise another set of important issues as regards context mapping. That is
, attempts to map
context objectively perhaps inevitably embody normative and inherently political
assumptions.
Critics of the CPIA have argued that it has a pro-growth, pro-liberalisation bia
s (Powell, 2004), and
that it gives too much weight to a particular conception of good governance which
revolves
around minimal regulation and strong property rights. It is perhaps more honest
for exercises in
context mapping to be explicit about their assumptions, rather than to pretend t
o be totally
objective.
The CPIA assessments (see How IDA resources are allocated under www.worldbank.org/
ida)
provide CSOs and others with valuable information about the policy and instituti
onal context in the
countries assessed.
Key references
Gelb, A., B. Ngo and X. Ye (2004) Implementing Pe ormance-Based Aid in Africa: T
he Country Policy
and Institutional Assessment, Africa Region, Working Paper Series No. 77, Washin
gton, DC: World
Bank, online at http://www.worldbank.org/afr/wps/wp77.pdf.
Powell, J. (2004) The World Bank Policy Scorecard: The New Conditionality? , Bretto
n Woods Update,
Bretton Woods Project, November, online at http://www.brettonwoodsproject.org/do
c/knowledge/
cpia.PDF.
3. Democracy and Governance Assessment (USAID)
This technique is less intellectually ambitious than some of the other approache
s. It does address
some comparable aspects of context, but the map produced is more selective in th
e features it chooses
to explore. It is designed to provide an entry-point analytical overview for tho
se considering actions to
promote democracy in a given country. As USAID s Democracy and Governance Assessme
nt for
Tanzania states: The methodology is not intended to produce an exhaustive descrip
tion of recent
political history, but rather to enable small field teams to provide a political
-economic snapshot ,
intended to surface principal structural dilemmas, political dynamics and, to th
e extent possible,
identify trends (ARD and USAID, 2003: 1).
How does the Democracy and Governance Assessment work?
USAID missions are responsible for submitting strategic plans for their use of p
rogramme funds. They
are expected to use the framework to inform this process as they see fit. The fr
amework is not
prescriptive. The assessment framework is divided into four steps:
An analysis of the kind of political game that characterises the country and of th
e problems
relating to the transition to or consolidation of democracy.
A more specific analysis of actors, interests, resources, and strategies leading
to an understanding
of how the political game is actually being played in the country.
An analysis of the institutional arenas (legal, governmental and civil society)
in which the game
is played.
The interests and resources of the donors, including USAID.
The first three steps are aimed at generating a range of possible strategies for
support or intervention.
The fourth step is concerned to understand the feasibility of putting these poss
ible strategies in place.
In effect, Steps 1 to 3 provide a map of possible routes; Step 4 assesses the ro
utes that might
realistically be taken.
The methods of data collection and analysis are primarily a combination of desk
research and
interviews or focus group sessions with key country stakeholders. The amount of
time and resources
required varies but research for each of the three studies included in the Key R
eferences was
coordinated by a team of three people (USAID staff and consultants) over a perio
d of approximately
one month.
Elements of the Democracy and Governance Assessment
Conceptual approach and indicators
USAID s characterisation of context as a political game involving players, interes
ts, resources,
objectives, rules, arenas, and ways of playing may provide CSOs with a useful me
taphor for
understanding their own contexts. The questions suggested by USAID to explore th
e dimensions of
the political game (see Box 5) may also be of use.
Data
USAID stresses the importance of a preparatory phase reviewing what material/inf
ormation is
available prior to embarking on mapping context. CSOs would be well advised to f
ollow this
approach. They might also find the range of ways to collecting data which are ou
tlined in the USAID
approach meetings with key representatives of society, including politicians, ac
tivists,
researchers, NGOs and donors to be of use.
USAID stresses that along with desk research, mapping country context requires e
xtensive
consultation with people with an intimate knowledge of the context. For local CS
Os, this should not
be a problem, but international CSOs seeking to understand contexts other than t
heir own should
take heed.
Key references
The assessment tool itself can be found at:
USAID (2000) Conducting a DG assessment: a Framework for Strategy Development , Cen
tre for
Democracy and Governance, USAID, Washington, DC, online at http://www.usaid.gov/
our_work/
democracy_and_governance/publications/pdfs/pnach305.pdf.
Kay Smith, Z., T. Longman, J. P. Kimonyo and T. Rutagengwa (2002) Rwanda Democrac
y and
Governance Assessment , Management Systems International, Washington, DC.
ARD and USAID (2003) Democracy and Governance Assessment of Tanzania Transitions
from the
Single-Party State , ARD, Burlington, Vermont, submitted to USAID, online at
http://pdf.dec.org/pdf_docs/Pdacd437.pdf.
4. Drivers of Change (DFID)
An approach for understanding the forces that bring about change and the key pol
icy and institutional drivers
for poverty reduction
What is the Drivers of Change approach?
Drivers of Change (DoC) is an approach developed by DFID to address the lack of
linkages between a
country s political framework and the operations of development agencies. The appr
oach focuses on
the interplay of economic, social and political factors that support or impede pov
erty reduction (OECD
DAC, 2005). The evolution of this approach has gone hand-in-hand with an approac
h to development
that emphasises that: i) the way development happens, or does not happen, is sha
ped by political
context; and ii) to be effective, donors country strategies must be based on a so
und understanding of
historical and political context. More specifically, DoC is rooted in a concern
to better understand how
to make change happen in specific country contexts:
Usually, we have a good idea about what needs to be done to achieve poverty redu
ction, but are much
less clear about why it s not happening. All too often, we attribute slow or no pr
ogress to lack of political
will It s this black box of lack of political will that DOC analysis unpacks. This
should result in this
phrase disappearing from the risk column of a Country Assistance Plan or Regiona
l Assistance Plan
(Suma Chakrabati, DFID Permanent Secretary, quoted in Thornton and Cox, 2005: 2)
.
How does the Drivers of Change approach work?
DoC analyses are initiated and carried out by DFID country offices, usually by s
electing expert
consultants (international and local) to coordinate the process and write the re
ports. Practical and
methodological support to the country teams carrying out the studies has been pr
ovided by a DoC
Team in DFID headquarters. Over 20 such analyses have been carried out so far.
DoC is not a highly standardised approach. The framework sets out broad guidelin
es, but it is designed
to be led at the country level. There is enormous variation in the scope of the
studies and reports, and
the resources and time allocated for their completion. The duration of the studi
es ranges from 15 days
to over two years. Costs have varied from GBP4000 for Georgia to GBP2.1 million
for Nigeria (Thornton
and Cox, 2005).
Each DoC report identifies specific drivers. Certain themes recur frequently in
the reports. These include
corruption and elite capture, the role of civil society, the role of the media,
and the importance of
political opposition and the middle classes.
Elements of the Drivers of Change approach
Conceptual approach and indicators
The approach focuses on power relationships and the institutional and structural
factors affecting
the lack of political will. It is based around a three-part conceptual model of
structures, individual
agents, and mediating institutions, and is coupled with an emphasis on how to ef
fect change. As a
result, this tool is better suited than many others to capturing the importance
of informal
institutions and relationships. The approach of identifying structures, agents a
nd institutions is
one which CSOs could readily employ.
Analysis, presentation and recommendations
The type of information produced is of a qualitative nature. This, combined with
the considerable
flexibility of the approach, hinders cross-country comparison. CSOs need to be a
ware of the tradeoff
that all approaches to context mapping make between allowing flexibility and ena
bling
systematic comparison.
Many of the Drivers of Change studies have not been made publicly available. A g
ood place to find
those which are available is http://www.gsdrc.org/go/topic-guides/drivers-of-cha
nge.
As an approach to mapping context, the uses of DoC are numerous. A recent DFID b
riefing (DFID,
2005b) reports that country offices have found a variety of uses for the process
of undertaking a
DoC study and for the findings produced. These have included:
o Informing the planning process;
o Improving the quality of engagement and influence with partner governments;
o Analysing the risk of interventions and suggesting ways of mitigating these;
o Strengthening harmonisation processes with other donors.
Key references
DFID (2005a) Lessons Learned: Planning and Undertaking a Drivers of Change Study ,
How To Note,
DFID, London, online at http://www.gsdrc.org/docs/open/DOC84.pdf.
DFID (2005b) Using Drivers of Change to Improve Aid Effectiveness , Briefing Note,
DFID, London,
online at http://www.gsdrc.org/docs/open/DOC83.pdf.
OECD DAC (2005) Lessons Learned on the Use of Power and Drivers of Change Analyse
s in
Development Cooperation , DAC Network on Governance (GovNet), OECD, Paris, online
at
http://www.gsdrc.org/docs/open/DOC82.pdf.
Moore, M. (2001) Types of Political Systems , a practical framework for DFID staff.
Thornton, N. and M. Cox (2005) Review of the Uptake of the Drivers of Change Appr
oach , Agulhas
Development Consultants, London.
Warrener, D. (2004) The Drivers of Change Approach , Synthesis Paper, ODI, London,
online at
http://www.odi.org.uk/RAPID/Projects/R0219/docs/Synthesis_3_final.pdf.
5. Governance Matters/Country Diagnostics (WBI)
Governance Matters and Country Diagnostics are two components of the World Bank
Institute s approach to
understanding and improving governance. The former aggregates existing data to c
ome up with governance
assessments. The latter enable more detailed country-specific analysis of govern
ance.
What are Governance Matters and Country Diagnostics?
The Governance Matters framework and Country Diagnostics have been developed by
the World Bank
Institute (WBI). Governance Matters is a project that aggregates existing measur
es of governance to
produce a dataset that enables cross-country comparisons. Country Diagnostics re
present a separate
component of the World Bank Institute s approach to understanding and improving go
vernance. It is a
set of tools surveys that can be used to throw light on the specific governance
challenges faced by
individual countries. Both approaches are based on the view that better governan
ce leads to more
development (and vice-versa), that governance ought to be improved, and that mea
suring governance
is a useful first step in identifying strategies for its enhancement.
How do Governance Matters and Country Diagnostics work?
Governance Matters
Governance matters measures governance using cross-country perceptions data. The
approach covers
six dimensions of governance, 209 countries or territories, and runs from 1996-2
004. The measures of
governance are made by aggregating existing measures of governance produced by a
wide range of
different organisations. In the latest version of the project, 37 separate data
sources are used,
constructed by 31 different organisations. The philosophy of Governance Matters
is that all these
various measures of governance provide useful information, and that by aggregati
ng them, and
weighting them according to how reliable they are, even better measures of gover
nance can be made.
Governance Matters presents its use of subjective perceptions data asking people
what they think
as a strength. The argument is that such measures are more precise than objectiv
e measures because
they include elements of informal rules, and because people act on the basis of
perceptions.
Country Diagnostics
Country Diagnostics are conducted using a set of three surveys: of households wh
ich use public
services; of enterprises; and of public officials. These follow a prescribed for
mat and collect both
qualitative and quantitative information. The analysis aims to address questions
such as the following.
What is the cost and consequences of mis-governance to firms, users, and public
finances? How does
mis-governance affect poor users and small firms? What effect does mis-governanc
e have in public
service delivery? What are the causes of institutional vulnerability? What are t
he fundamental issues on
which a reform programme designed to improve governance and reduce mismanagement
should
focus?
Elements of Governance Matters and Country Diagnostics
Conceptual approach and indicators
CSOs and others making use of Governance Matters and Country Diagnostics dataset
s and
approaches should be aware that they are based on the view that there is a two-w
ay causal
relationship between governance and development; better governance leads to more
development
and vice-versa. It is also important to note that the World Bank Institute s view
of what constitutes
good governance is not value-free; for instance, its regulatory burden indicator
clearly shows a
preference for markets.
The Governance Matters approach does not provide an off-the-shelf methodology th
at can be
utilised in full. It does, however, provide indicators for six dimensions of gov
ernance, which might
be of interest to CSOs:
o Voice and accountability: political, civil and human rights;
o Political instability and violence: likelihood of violent threats to, or chang
es in, government,
including terrorism;
o Government effectiveness: competence of the bureaucracy and the quality of pub
lic service delivery;
o Regulatory burden: the incidence of market-unfriendly policies;
o Rule of law: quality of contract enforcement, the police, and the courts, as w
ell as the likelihood of
crime and violence;
o Control of corruption: the exercise of public power for private gain, includin
g both petty and grand
corruption and state capture.
Data
In contrast with most approaches to mapping context, Governance Matters relies o
n a statistical
procedure to aggregate existing measures of governance. In a field where most ma
pping exercises
start by collecting new data, this is an interesting approach. Prior to collecti
ng their own data, CSOs
ought to explore whether there are existing datasets including those collated by
Governance
Matters which might be useful.
The data produced under the Governance Matters framework and the Country Diagnos
tics
themselves are a rich data source. All relevant data sources, including methodol
ogy papers,
interactive charts and world maps, are available at http://www.worldbank.org/wbi
/
governance/data.html.
The interactive tools on the World Bank s website at http://info.worldbank.org/gov
ernance provide
a simple and accessible way to use the data collected to assess quickly the basi
c aspects of
governance of relevance to particular situations. They can generate charts and m
aps to show
governance characteristics in individual countries (see Figure 5) and to enable
cross-country
comparisons in relation to a particular dimension of governance (see Figure 6).
Figure 5: Governance in Sudan top bars compared with countries at the same incom
e level
Country Diagnostics provides a set of very suggestive surveys of which CSOs and
others might
make use to map their own contexts. In particular, they include a scenario element
, which asks
the respondent to rate a particular course of action paying a bribe to a policem
an in the event of a
traffic offence, or paying a bribe to gain access to education in terms of its l
ikelihood of
occurrence. The surveys can be found at http://www.worldbank.org/wbi/governance/
capacitybuild/diagnostics.html.
Analysis, presentation and recommendations
The Governance Matters datasets provide a useful set of results the aggregated g
overnance
measurements from a range of other surveys which can be used for tracking govern
ance over time
in specific countries, or for comparing governance across a range of countries.
Country Diagnostics provide more specific information about the governance chall
enges in specific
countries. They could be useful to CSOs seeking to think strategically about whi
ch institutions they
might target for reform. They provide useful data about the perceptions of diffe
rent groups of
people. And in providing information about how different groups perceive particu
lar institutions
they might form a good basis for stakeholder analyses.
Key references
Kaufmann, D., A. Kraay and M. Mastruzzi (2005a) Governance Matters IV: Governance
Indicators for
1996-2004 , World Bank Institute, Washington, DC, online at http://worldbank.org/w
bi/
governance/pubs/govmatters4.html.
Kaufmann, D., A. Kraay and M. Mastruzzi (2005b) Measuring Governance Using Cross-
Country
Perceptions Data , World Bank Institute, Washington, DC, online at http://www.worl
dbank.org/wbi/
governance/pdf/MeasuringGovernancewithPerceptionsData.pdf.
Kaufmann D., A. Kraay and P. Zoido-Lobatón (2000) Governance Matters: From Measurem
ent to
Action , Finance and Development Vol 37, No 2, June, online at http://www.imf.org/
external/
pubs/ft/fandd/2000/06/pdf/kauf.pdf.
The approach varies significantly from other tools as it takes the view that pol
itical reform processes
are strongly influenced by informal values, norms, customs and processes, rather
than following formal
rules (DFID/World Bank, 2005). This is thought to apply particularly in new demo
cracies or weakly
institutionalised political systems (Faust and Gutiérrez, 2004). It also explicitl
y sets out to employ a
multi-disciplinary approach, combining political science, law, economics, legal
anthropology and
empirical social research.
10 to 15 people are recommended per study. This is a fairly small sample, but a
workable and realistic
figure. The questionnaire can be completed in written form or used as a guide fo
r structured but openended
interviews. Similarly, the questions can be answered simply (yes; partly; no), o
r can be
expanded using additional filter questions, multiple answers, or by providing reas
ons for answers. As
such, variations on the Governance Questionnaire can be used to map context at d
ifferent levels of
detail.
Elements of the Governance Questionnaire
Conceptual approach and indicators
The Governance Questionnaire highlights the importance of understanding power re
lationships
and structures between state and society and, in so doing, takes into account tr
ends and barriers
to political and institutional reform. It provides a full list of the six politi
cal arenas, their subarenas,
and questions designed to provide information on the individual components of th
ose subarenas.
For example, for the first political arena, relationship between state and societ
y , the
following sub-arenas and components are listed in Figure 7 below.
Data
The questionnaire, or elements of it, could be employed by CSOs seeking to gain
a better
understanding of political context. The fact that the questionnaire can be condu
cted using a small
sample of people, and at varying levels of detail, might make it particularly ap
pealing to those
CSOs that are short of time and money.
Key references
Faust, J. and M. Gutiérrez (2004) Governance Questionnaire: An Instrument for Analy
sing Political
Environments , State and Democracy Division, GTZ.
Key discussions/reviews
DFID and World Bank (2005) Tools for Understanding Institutional, Political and S
ocial Analysis (TIPS) ,
DFID, Poverty Analysis and MDGs Team, and World Bank, Social Development Divisio
n, online at
https://www.worldbank.org/tips.
OECD DAC (2005) Lessons Learned on the Use of Power and Drivers of Change Analyse
s in
Development Cooperation , DAC Network on Governance (GovNet), OECD, Paris, online
at
http://www.gsdrc.org/docs/open/DOC82.pdf.
7. Power Analysis (Sida)
Power analysis studies are initiated by country offices and carried out by count
ry experts. There is
much scope for the analysts to adapt the approach and define the areas of focus.
The analysis is
centred on desk reviews and secondary research, but it is often complemented by
interviews and
questionnaires. The level of resources and time required varies, but with an emp
hasis on desk
research, interviews and qualitative analysis, the costs are limited largely to
person-time.
A recent review of power analysis in its experimental phase suggested that the a
bstract nature of the
concepts concerned and the broad scope for consultants to interpret the Terms of
Reference for each
analysis may produce results that are hard to compare and not necessarily as dis
tinctive as had been
hoped (Moore, in Sida, 2005). This may be problematic, but it is important to re
cognise the utility of
country-specific knowledge, which is of great value even if not easily comparabl
e between countries.
Elements of Power Analysis
Conceptual approach and indicators
Conceptualising power as being central to poverty reduction is an obvious but ne
vertheless
important insight that CSOs might take away from Power Analysis. However, if the
y are tempted to
employ the concept of power, they should ensure that they think carefully about
what it means,
and how they intend to map it. Otherwise, putting power at the centre of analysi
s may be
problematic (see Moore, in Sida, 2005).
The emphasis of Power Analysis on understanding the formal and informal politica
l landscape is a
useful corrective to approaches that focus largely on formal political rules and
institutions. Its
acknowledgement of aspects of context, such as culture, convention, and systems
of shared belief,
might also be taken up by CSOs seeking to map their own contexts (Vaughan and Tr
onvoll, 2003).
Data
Power Analysis provides little guidance in terms of data collection, sources and
methods. Analysts
can make use of existing data sources, or collect their own data.
Ways of collecting data about power its constitution, distribution, exercise and
control might
include panels of independent experts, surveys of well informed people, public o
pinion polls, and
focus group discussions.
Key references
DFID and World Bank (2005) Tools for Understanding Institutional, Political and S
ocial Analysis (TIPS) ,
DFID, Poverty Analysis and MDGs Team, and World Bank, Social Development Divisio
n, online at
https://www.worldbank.org/tips.
Hyden, G. (2005) Why Do Things Happen the Way They Do? A Power Analysis of Tanzan
ia , Sida online
at http://hei.unige.ch/news/files/Goran_Hyden_Power_analysis.pdf.
Hyden, G. (2006) Beyond Governance: Bringing Power into Development Policy Analys
is , paper
presented to the Danida/GEPPA Conference on Power, Politics and Change in Weak S
tates,
Copenhagen, 1-2 March, online at http://www.geppa.dk/files/activities/Conference
%202006/
Goran%20Hyden.pdf.
OECD DAC (2005) Lessons Learned on the Use of Power and Drivers of Change Analyse
s in
Development Cooperation , DAC Network on Governance (GovNet), OECD, Paris, online
at
http://www.gsdrc.org/docs/open/DOC82.pdf.
Sida (2005) Methods of Analysing Power A Workshop Report , Division for Democratic
Governance,
Sida, online at http://www.sida.se/shared/jsp/download.jsp?f=SIDA4712en_Methods+
web.
pdfanda=3485.
Stakeholders with high interest but low power need to be kept informed; if organ
ised, they may form
the basis of an interest group or coalition that can lobby for change. Those wit
h high power but low
interest should be kept satisfied and ideally brought around as patrons or suppo
rters for the proposed
policy change.
If time and resources permit, further analysis can be carried out that explores
in more detail i) the
nature of the power and its position and ii) the interests that give it that pos
ition. This helps the project
to better understand why people take certain stands and how they can be bought a
round.
Stakeholder analysis is very flexible. The selection of the stakeholders and the
characteristics mapped
can be tailored to any situation. DFID suggest that it can be undertaken at any
stage of an activity
cycle , and that it should be undertaken at the identification, design and apprais
al stages of activities.
Elements of stakeholder analysis
Conceptual approach and indicators
A stakeholder analysis is concerned with effects and interests in relation to a
particular policy
reform rather than with understanding underlying political dynamics. As such, it
is very different
from approaches such as Power Analysis or Drivers of Change, which aim to provid
e a broad picture
of the context for reform rather than a detailed analysis of how different group
s might view and
respond to a particular course of action.
Data
The process and data requirements depend on the type of analysis chosen. There a
re, however,
three phases to most stakeholder analyses. These are:
o Phase 1: Define the policy change, and outline the likely consequences of such
a change.
o Phase 2: Identify, map, profile, and communicate with stakeholders. This is a
data gathering phase.
o Phase 3: Identify the power, position and perspectives of stakeholders. This i
s the analytical phase,
in which stakeholders will be prioritised and analysed, using, for instance, a S
trengths, Weaknesses,
Opportunities and Threats analysis (Bianchi and Kossoudji, 2001; see Start and H
ovland, 2004, for a
simple guide to SWOT analysis).
Stakeholder analysis can include a range of forms of analysis, from the very sim
ple to the more
sophisticated:
o A very simple stakeholder analysis technique is the Readiness/Power Matrix. Th
is assesses, on an
incremental scale from zero to high, how ready different stakeholders are to par
ticipate in an activity
and how much power they have to influence its success. This is simple and easy t
o use, but will also
produce only simple and limited knowledge about context (DFID, 2002).
o A Stakeholder Table can be combined with an Importance/Influence Matrix. The T
able is used to set
out the primary and secondary stakeholders, detail the interests of each and ass
ign a value to the
priorities of these interests (relative to the aims/priorities of the action bei
ng contemplated), and to
assess the likely impact of any activity on them. The matrix takes the stakehold
ers and, using the
data from the table, situates them in a two-by-two grid where one axis ranges fr
om low to high
importance, and the other from low to high influence. This can help inform strat
egies and priorities
for engaging with various stakeholders (DFID, 2002).
o Rather than relying on qualitative assessments of stakeholder preferences, the
World Bank s
Expected Utility Stakeholder Model aims to provide a consistent, systematic modell
ed framework
for analysis of stakeholder perceptions and potential policy outcomes . One claime
d use is to
determine how a change in a stakeholder s initial policy position might affect eith
er the likelihood of
reform or the level of consensus going forward . This is essentially a game-theore
tic analysis,
designed to add analytical rigour to traditional stakeholder approaches to analy
sing political
incentives. Using expected utility forecasting techniques to simulate negotiatio
ns, it nevertheless
obtains most of its data on perceptions from country expert interviews (World Ba
nk, 2004).
Key references
Bianchi, R. and S. Kossoudji (2001), Interest Groups and Organisations as Stakeh
olders, Social
Development Paper No. 35, Washington, DC: World Bank.
Buse, K., N. Mays and G. Walt (2005) chapter 10 of Making Health Policy, Maidenh
ead: Open University
Press.
DFID (2002) Tools for Development , Performance and Effectiveness Department, DFID,
London, online
at http://www.dfid.gov.uk/pubs/files/toolsfordevelopment.pdf.
Start, D. and I. Hovland (2004) Tools for Policy Impact: a Handbook for Research
ers, London:
RAPID/ODI (this publication includes some other simple tools for assessing polit
ical context), online at
http://www.odi.org.uk/RAPID/Publications/Documents/Tools_handbook_final_web.pdf.
World Bank (2004) Operationalizing Political Analysis: the Expected Utility Stake
holder Model and
Governance Reforms , World Bank PremNotes, No. 95, online at http://www1.worldbank
.org/prem/
PREMNotes/premnote95.pdf.
9. World Governance Assessment
An approach which measures governance by collecting expert views on six key prin
ciples of governance
What is the World Governance Assessment?
The World Governance Assessment (WGA) was initiated in 1999 by a team led by Jul
ius Court of ODI,
with three main objectives:
To generate systematic data to enhance understanding of the relationship between
governance and
development at a country level;
To provide policymakers and NGOs with insights into how governance can be improv
ed; and
To help develop the capacity to undertake governance assessment in countries.
The WGA uses a specific indicator for each point on a matrix (see Figure 8) link
ing the two sets of
dimensions: the principles of governance and the arenas of governance.
Freedom of
association
Society free
from
discrimination
Freedom of
expression
Respect for
governing
rules
Freedom of
the media
Input in
policymaking
Political
society
Legislature
representative
of society
Policy
reflective of
public
preferences
Peaceful
competition
for political
power
Legislators
accountable to
public
Transparency
of political
Parties
Legislative
function
affecting
policy
Government
Intragovernmental
consultation
Adequate
standard of
living for
citizens
Personal
security of
citizens
Security forces
subordinated
to civilian
government
Government
provides
accurate
information
Best use of
available
resources
Bureaucracy
Higher civil
servants part
of
policymaking
Equal access
to public
services
Civil servants
respectful
towards
citizens
Civil servants
accountable
for their
actions
Clear
decision
making
process
Merit-based
system for
recruitment
Economic
society
Consultation
with the
private sector
Regulations
equally
applied to all
firms
Governments
respect for
property
rights
Regulating
private sector
in the public
interest
Transparency
in formulating
economic
policy
Obtaining
licenses free
from
corruption
Judiciary
Non-formal
processes of
conflict
resolution
Equal access
to justice for
all citizens
International
human rights
incorporated
in national
legal practice
Judicial
officers held
accountable
Clarity in
administering
justice
Efficiency of
the judicial
system
The WGA publishes a dataset showing the full breakdown of scores by indicator fo
r each country as
well as the aggregate ratings (see Figure 9 for the average ratings for all 16 c
ountries in 1996 and
2000). The country reports incorporate additional comments and qualitative data
in order to provide a
richer assessment of the country context. After the pilot phase of the project (
which included 16
countries), a second phase was initiated in 2005 with a refined survey and a mor
e rigorous approach,
this time covering 10 countries, but with around 100 respondents per country.
Data
The readily accessible datasets and country reports produced by the WGA project
can be of use to
CSOs seeking to understand their own political contexts. Easy and comprehensive
access to the
data and the low cost of conducting surveys makes this a comparatively accessibl
e tool.
By collecting data on 36 indicators, the WGA provides a more detailed picture th
an many
alternative approaches.
Key references
Court, J., G. Hyden and K. Mease (2002) Governance Pe ormance: the Aggregate P c
ture, World
Governance Survey Discussion Paper, Tokyo: UNU.
Hyden, G., J. Court and K. Mease (2001) Assessing Governance: Methodological Cha
llenges, World
Governance Survey Discussion Paper, Tokyo: UNU.
Hyden, G., J. Court and K. Mease (2003a) Making Sense of Governance: the Need fo
r Involving Local
Stakeholders, Development Dialogue, London: ODI.
Hyden, G., J. Court and K. Mease (2003c) Conclusions from Phase I, World Governa
nce Survey
Discussion Paper 10, Tokyo: UNU.
Online resources
The tool can be found at: World Governance Assessment, About WGA , online at
http://www.odi.org.uk/WGA_Governance/About_WGA.html.
All country reports, publications (including the references detailed above) and
datasets are available
from the WGA website at http://www.odi.org.uk/WGA_governance.