A research proposal by
Demis Kunje
Dorothy C Khonje
Nellie M Mbano
July, 2005
1
Introduction
In Malawi, free primary education was introduced in 1994 soon after attaining a
democratic government. Enrollments soared from 1.2 million in 1994 to 3.0 million
in 1997. This rapid increase in enrollment brought about an unprecedented stress on
the existing resources in the sector. Pupil-teacher ratios, pupil-classroom ratios,
pupil-text book ratios and most other educational indicators reached unacceptable
levels. The quality of education was thus seen as having plummeted while increased
access seemed to have been the only gain. In an effort to address the problem MoE
recruited about 20,000 temporary teachers and gave them a two week orientation
course before sending them into schools. Development partners were sympathetic
to the situation and they assisted the government in various ways. Policy documents
such as the PIF, the MPRSP, the HIV/AIDS in Education Policy and others have
been crafted to direct and support the Free Primary Education effort and the eventual
attainment of EFA goals.
In 2004, a decade later gains such as a decrease in the number of untrained teachers,
decreasing disparities between boys and girls, increased access and provision of text
books are noteworthy. However drop-out rates (15%), completion rates (30%),
attendance rates (12%) and pass rates (30%) seem to have remained at unacceptable
levels. The system seems little able to keep children in school and the children are not
able to reach acceptable levels of literacy and numeracy even when they stay on in
school. With efforts by various players to improve the quality of education it is
imperative that these are directed in a manner which brings about positive changes. This
requires deep insights into how the various efforts or inputs into education sector are
being integrated at the school level and how, among various variables, achievement is
being affected. In this study inputs to schools will be categorized as infrastructure,
community participation, school feeding, in-service training, teaching and learning
materials and advisory services. To study how these interact to affect achievement both
quantitative and qualitative approaches will be used.
2
Research Questions
To answer these questions the study will take both a quantitative and a qualitative
approach to address the problem.
This study has several limitations which may affect the generalisability of the results.
First, some of the inputs may have aged as they may not be usable in some situations.
For example, teachers who went on specific in-service may not be using the training
because they are not given opportunity to use it. Secondly, the study may be limited in
3
its analysis because of limited information gathered from the respondents due to their
inability to provide profound views of the situation at the teaching and learning
processes. Thirdly, some activities which occur at specific periods of the school calendar
may not be captured during the short period of visit by the research team. These and
other confounding circumstances may limit our understanding of the results but these are
generally overwhelmed and controlled by the research design.
Theoretical Framework
The causal status of relationships between school characteristics and effects is small
because of the correlative nature of research, lack of theory and flaws in
conceptualizations. Methods employed in research have a bearing on how much we can
judge school performance and policy concerns. Judgements about school performance
and relative effectiveness require careful analyses. For example school effectiveness
need to be specific as to what outcomes we are searching for, what time period and in
whose eyes. So school effectiveness may be seen as being relative to out comes, time
frame and student group. Therefore cause – effect relationships need adequate control of
other factors, a choice of a given range of outcomes, careful sampling and recognition of
the processes that are involved. This study intends to explore some of these through both
quantitative and qualitative analyses.
Review of literature
In principal the MoE relies and supports four main sources of research findings. First,
the MoE uses its own Planning Department to collect various data for its data base.
Secondly, the Ministry commissions research studies to be carried out on its behalf by
research institutions in the university or any other competent research bodies which may
include governmental education institutions. Thirdly, the Ministry makes use of findings
submitted by various stakeholders such as NGOs, development partners, the civil society
and other ministries as well.
In the past decade the research agenda for the education sector has mainly been guided by
the Policy Investment Frame work and the Malawi Poverty Reduction Strategic Paper
(MPRSP) which are the two main policy documents. Recourse was also made to address
issues which have also been highlighted in other national policy documents which dwell
on cross-cutting issues such as the National Decentralization Policy, the National
4
HIV/AIDS Policy and the National Gender Policy. Cooperating partners in the sector
have their own agendas on which researchers base their studies to inform the
stakeholders.
Past research
A multitude of research studies have been conducted so far in areas of teacher education,
girls’ education, HIV/AIDS and education, conditions of schooling, private provision of
education, policy analyses, evaluations of education programmes, classroom practice and
decentralization. Notable outcomes of these studies are the various sector documents
which out line new policies and strategies. The MoE has been able to reorganize itself
partly because of recommendations from such research studies. Furthermore the
curriculum has been undergoing review in response to similar findings. Therefore MoE
has witnessed changes in recent times meant to improve its effectiveness mainly through
such recommendations.
Of particular interest to this study is research that has focussed on school effectiveness.
Several initiatives have been undertaken to measure the levels of literacy and numeracy
of pupils at different levels both in primary school and in secondary schools. In 2001 and
2004, SACMEQ investigated pupil, teacher and school factors and how they related to
the achievement of minimum levels of literacy and numeracy. The main findings were
that the majority of the pupils in Malawi primary schools are performing below minimum
and desirable levels of reading and mathematical skills. When compared to pupils at
similar levels in the Southern African Region, pupils’ achievement in Malawi has always
been at the bottom of the list. A similar study by MIE(2005) in 12 districts shows that
learner achievement in four subjects at the primary school level was below expected
levels and that less than 10% of the learners were adequately prepared for the next higher
class they were to move into. NIPDEP(2003) showed that there were slight increases in
performance in mathematics and English after JICA introduced some interventions such
as infrastructure, teacher in – service and teacher support in schools. However the
achievement levels remained disturbingly low. The same study showed that class
teachers had problems getting right all tasks set for the pupils. However, PLAN(2005)
report of some increases in the percentages of pupils gaining mastery in Chichewa after
teachers in two districts had undergone some specific training. This shows that there is
some hope that achievement can be influenced in some ways and this provides a basis for
further enquiry into what best represents positive influences on achievement in the
Malawian context.
What is deficient in these studies is that they fall short of identifying how much each of
the interventions is influencing the changes. This study intends to isolate pupil, teacher
and school factors and determine the extent to which these factors influence achievement
in primary schools in Malawi. Such an analysis will go a long way in helping to
prioritorise school inputs in the quest for improved quality of education.
In conclusion, research is one of the tools which the Ministry is prepared to use in policy
formulation and to improve practice. Specifically research from a self – reliant
5
perspective stands to provide the Ministry of Education with valuable insights into the
issue of sustainability especially in basic education.
Methodology
The research will be done in two phases and will use both quantitative and qualitative
methodologies. The first phase will use quantitative methods in order to investigate the
relationship between educational inputs and achievement. This will enable researchers
identify if there is any association between inputs and achievement. Apart from data
which will be collected specifically for this project, raw data from SACMEQ and
MLALP will be sought and subjected to similar statistical analyses in order to provide
solid evidence regarding school effectiveness. In the second phase case studies of
successful and less successful schools will be carried out in order to investigate how
various inputs in a school are utilised to improve the quality of education. It is hoped that
the use of a combination of survey and case studies will enable the researchers to get a
broad picture of how inputs may be impacting on achievement, and a deeper
understanding of the process of implementation at school level.
The aim of this phase is to find out if there is any relationship(s) between education
inputs and achievements in primary schools. Thus a survey approach will be used to
document school profiles and achievements in literacy and numeracy after 5 and 7 years
of primary education. The data will be analysed to give general levels achievement.
Furthermore exploratory statistical data analysis techniques will be employed to find out
if there is any association between some school factors and achievement. Data from
SACMEQ and MLALP will be treated in a similar manner and the results will be
compared in order to verify the validity of any claims.
6
Donor supported
DIVISION (1) Urban(20 schools) Unsupported
Donor supported
The Sample
Firstly, one out the six education divisions which has a large prevalence of urban schools
will be used in order to compare with the large rural school population. From this
division a random sample of 180 schools will be selected. The sample from each category
will reflect the proportion of the schools in the categories. (South Western Division has
the largest proportion of urban schools compared to the other five Divisions. There are
536 rural schools and 68 urban schools giving a ratio of 8:1)
Instruments
The data to be collected will be teacher and pupil bio data, school characteristics and
pupils’ achievement. The following instruments will be used to collect this data:-
Data Analysis
First, descriptive statistics will be used to describe levels of achievement in literacy
(English and Chichewa) and numeracy in the sampled schools. Exploratory multi-level
statistical data analysis will be used to find out if there are any associations between the
various additional inputs and achievement.
7
PHASE 2: HOW ARE THE VARIOUS INPUTS IN A SCHOOL UTILISED TO
IMPROVE RATES OF ACHIEVEMENT
The aim of the second phase is to study how schools utilize the resources available to
improve achievement in primary schools. Case studies of eight schools, one for each
category shown in Table 2 below will be carried out. Each school will be studied in-
depth for a period of one week.
The research team will conduct one to one and focus group interviews with stakeholders
in the school such as head-teachers, teachers, pupils, parents and community leaders.
Furthermore they will conduct non-participant observation of what happens in the
classroom and the school in general. The focus of the study will be to understand how a
school manages the additional inputs in order to improve completion rates and
achievement. Table 3 gives a summary of the issues to be studied and the corresponding
instruments to be used.
Focus Methods
Community participation Interviews and Focus group discussion
Management Interviews and Focus group discussion
Teaching and learning Observations, Interviews and Focus group
discussion
In-service training Interviews with teachers
Use of resources Observations, Interviews and Focus group
discussion
Data analysis
The information collected from the various interviews and group discussions will be
triangulated, verified and organized thematically to bring out issues in the
8
implementation. In the case of classroom observations the interactions will be analysed
using teacher and pupil activity profiles.
Time Frame
Phases
Year/phase Activity
1 Quantitative Study: Relationship between educational inputs and
achievement
2 Qualitative study: How inputs in the schools are utilized to improve
quality
3 Dissemination of findings to stakeholders
Phase 1
9
10