Anda di halaman 1dari 77

Report

End of Project Evaluation for


Rolling Out Psychosocial Support
Capacity Building Project

Social Action Trust Fund (SATF)

Prepared by AMCA Inter-Consult Limited

February 2013

Table of Content
Abbreviation......................................................................................................................3
Executive summary.......................................................................................................4
1.0. Introduction.............................................................................................................9
2.0: Methodological Approach................................................................................9
2.1: Evaluation Framework.............................................................................................9
2.2: Study Area...................................................................................................................11
2.3: Data Collection..........................................................................................................11
2.3.1 Literature Review...................................................................................................11
2.3.2 Key Informant Interview......................................................................................11
2.3.3 Focus Group Discussion.......................................................................................12
2.3.4 Observation..............................................................................................................13
2.3.5 Challenges during evaluation............................................................................13
3.0: Evaluation Findings...........................................................................................13
3.1: Performance of the Project....................................................................................13
3.1.1: Relevance of the Objectives.............................................................................13
3.1.2: Effectiveness of the Project..............................................................................16
3.1.3: Efficiency of the Project......................................................................................20
3.2: Impact of the Project...............................................................................................21
3.2.1Overall impact of the SATF/FCS funded project..........................................21
3.2.2 Sustainability of the Projects.............................................................................39
3.2.3Lessons Learnt.........................................................................................................40
3.2.4Challenges.................................................................................................................41
3.3 Performance of the Partners..................................................................................41
3.3.1Performance of FCS................................................................................................41
3.3.2Performance of SATF..............................................................................................42
3.3.3 Performance of NGO Implementing Partners..............................................43
4.0 Discussion.................................................................................................................43
5.0 Recommendations...............................................................................................44
Annexes..............................................................................................................................46
Annex 1: List of Respondents Iinterviewed at Partners Level...........................46
Annex 2: List of Consultants and Data Collectors involved in the
assignment...........................................................................................................................47
Annex 3: Data Collection Tool.......................................................................................48

Abbreviation
AIDS
Acquired Immunodeficiency Syndrome
CEO
Chief Executive Officer
FCS
Foundation for Civil Society
HIV
Human Immunodeficiency Virus
KARADEA Karagwe Development Association
LISAWE
Lindi Support Agency for Welfare
MKUKI
Mkakati wa Kubidhibiti UKIMWI Kilimanjaro
MKUKUTA Mkakati wa Kukuza Uchumi na Kupunguza Umaskini Tanzania
MOU
Memorandum of Understanding
MVC
Most Vulnerable Children
NEREFO
Neema Resource Foundation
NCPA
National Costed Plan of Action
NGO
Non Government Organization
NSGRP
National Strategy for Growth and Reduction of Poverty
PADI
Tanzania Mission to the Poor and Disabled
PSS
Psychosocial Support
SATF
Social Action Trust Fund
SADC
Southern Africa Development Cooperation
TOT
Training of Trainers
VSI
Vijana Simama Imara (Youth stand firm model)

Executive summary
The Rolling out of PSS support capacity building project in 13 Regions of
Tanzania was built on the lessons learnt from the PSS project that was
funded by FCS in 2007. The lessons learnt is the result of the findings from
the monitoring and evaluation which indicated that majority of caregivers
at the community level did not have the knowledge on how to provide PSS
services to MVCs. Therefore, the project aimed at building the capacity of
caregivers through partner NGOs providing PSS to support Orphans and
vulnerable children.
The overall objective of the assignment was to assess the impact of
project activities from project inception to completion. The
evaluation team employed the outcome model which assisted
in capturing different project elements which included:
Relevance, Efficiency, Effectiveness, Impact, Sustainability,
Lessons Learned and Documentation of Success Stories. The
evaluation also assessed the achievements and impacts
through different three program areas which included;
performance of the program, Impact of the Program and
Performance of the Partners.
Different methods were also employed to collect the data from
respondents which included literature review, key informant
interview, FGD guide, and Observation. In summary, the
evaluation activities involved review of relevant documents
such as narrative reports, review of national policies and
strategies, meeting with FCS and SATF officials, field data
collection in six districts, data analysis and report writing.
Findings from the evaluation
Relevance of the project:
SATF-PSS project aimed at building the capacity of Implementing partners,
caregivers on how best they can support Most Vulnerable Children who
were exposed to the devastating effects of poverty, conflicts and HIV and
AIDS and were in need of care for their emotional, intellectual, physical,
spiritual and social well-being. The aim of the project aligned with several
national policies, laws, strategies and project that focusing on addressing
the needs and priority of children and their linkages to national
development. These includes; The Law of the Child Act, 2009, The child
Development Policy, 1996 as revised in 2008, The Tanzania Development
Vision 2025 and The education and Training Policy, 1995. The project also
aligns with the National Strategy for Growth and Reduction of Poverty
(NSGRP), The National Costed Plan of Action for MVC, 2012-2016, The
National Costed Plan of Action for MVC, 2007-2010 and Tanzania Health
Policy, 1990.
Effectiveness of the project: Overall achievement on project outcomes
is very good; the project managed to perform remarkably in almost all
areas as explained in further detail in the main body of the report in the
progress towards log frame indicator page 16-18
4

Efficiency of the project: The project employed a participatory and


partnership methodology approach during implementation of the project.
All beneficiaries at all levels of implementation were involved. Also, as a
step towards capacity building and efficient implementation of the project,
SATF introduced a mentorship programme to its staff for the purposes of
ensuring every staff is conversant with the project and can play role
during implementation of the project. Also, to ensure efficient
management of funds, FCS disbursed funds in every quarter upon
receiving successful narrative and financial report of the previous quarter.
Impact of the project
Changes in behaviors and attitude related to PSS among
community members to MVC
The findings from the evaluation indicated that over 85% of respondents
interviewed commended that the project had remarkably changed their
behaviors and attitude towards addressing PSS related needs to MVCs.
The findings also indicates that the SATF PSS Capacity building Project
implemented in the project area have performed tremendously in
ensuring that knowledge on behaviors and attitutde related to the support
of MVCs in term of PSS is impacted to community members hence
improving their wellbeing.
Improving the knowledge and skills to partner NGOs
It is evident from the evaluation that majority of respondents who were
interviewed from Partner NGOs applaud the efforts made by SATF to
provide them with the PSS training. The training not only increased the
knowledge and builds their capacity in supporting MVCs and Caregivers
but also helped them to mainstream PSS in their policies and plannining.
Improving the knowledge and skill of Caregivers
The findings from the evaluation indicated that 97.1% of caregivers
interviewed commended on the content and techniques used during
training. They commend that the training improved their knowledge in
terms of identifying MVCs, their needs and the modality of supporting
them to address their problems. They also commended that majority of
them can now serve MVCs in their surrounding communities by providing
them with comprehensive PSS services.
Improving the knowledge and skills to District Official through
PSS advocacy meeting
The findings indicates that majority of district officials who attended an
advocacy meeting reported that the knowledge they have acquired from
the meeting real changed their lives. They commended that the meeting
helped them as they are now incorporating
PSS issues into their
departmental plans and budgets.
Improving well-being through delivery of PSS service of caregivers to MVC
The data from the evaluation revealed that 68.4% had received the
support from caregivers and the supports they have received have helped
5

in changing their behaviors as compared to before receiving the support,


their families have changed as they are now supporting them by providing
them with all necessary support required for school.
Improving MVC well-being through VSI model
The data obtained during evaluation indicated that VSI model is one of the
best methods that can be used to generate income among children and
youth
Mainstreaming of PSS in the core activities of Partner NGOs and District Plan
The findings from the evaluation indicates that majority of respondents
interviewed reported that through the PSS knowledge, they have not only
mainstreamed PSS in their planning and budgeting, but also are using
PSS knowledge to translate some of their activities.
Community mobilization
Still a lot need to be done to mobilize community in order to create a
sense of ownership and increase commitment to parents and guardians.
Community mobilization will help in reaching as many MVCs who are need
of support.
Sustainability of the projects
Building the capacity of caregiver through implementing partners
To ensure sustainability, SATF PSS project built in the capacity of
caregivers in terms of imparting the knowledge and skills where these
caregivers continue supporting MVC identified in their areas. This also
ensures continuity but as well ownership.
Mainstreaming PSS activities in to Planning and implementation
of Organization services
Mainstreaming of PSS activities in to planning and implementation of the
Organization services is another potential for sustainability. SATF PSS
project conducted various advocacy meetings with district official and
implementing partners to advocate for the inclusion of PSS issues in their
planning and budgeting. This enhanced commitment among official and
partner to incorporate PSS in to their daily undertakings
The role of TOT in supporting the implementation of PSS services
The evaluation team observed that, the existence of TOT among
implementing partners ensures sustainability of the project. TOTs have
been potential in building the skills and knowledge to caregivers in their
operating areas. Therefore, maintaining these TOTs or continuing
mentoring TOT is potential to continuity of the project.
Introduction and implementation of VSI model to partners
The team during evaluation observed that some of the organizations that
adapted the VSI model have remarkably made changes in the lives of
MVCs. As MVC can generate their own income hence satisfies their need
(school needs). This ensures continuity of the project even after
withdrawal of the donor support.
6

Commitment of Partners staff


The team, during evaluation, observed that the SATF/Partners
management has been very supportive to ensure that the project is
implemented as planned. The only challenges majority of partners are
facing are lack of incentives such as allowance to motivate staff and
ensure improved performance to continue supporting MVCs.
Collaborations and networking
SATF through its PSS project has managed to build partnerships and
networks in the course of its work. These partners include among others,
implementing partners such as NEREFO, TIKVAH, KARADEA, PADI, LISAWE,
MKUKI and other many partners in different Regions. Other partners
includes district local Authority(department of social welfare, community
development, Agriculture, Police gender desk), Local NGOs such as
Humuliza, and as well International NGOs such as World Vision in some
areas i.e. NEREFO-Morogoro. The partners are very important in ensuring
sustainability of SATF PSS project in the sense that they also works in
addressing PSS needs in their localities hence share the knowledge and
learning experiences which can assist in its continuity.
Lessons learnt
Lesson learnt from beneficiaries
The PSS has increased the knowledge with regards to addressing the
needs of children in the areas where caregivers are supporting
children
Due to increased knowledge on PSS, in some areas there are also
increased numbers of children who are rolling to school.
Through VSI initiative, Economic groups have been formulated
among youth which have helped them to generate income to support
their needs and family.
The knowledge they have acquired through VSI initiative, builds self
esteem, confidence, keeps
children and youth physically and
psychologically fit and also builds strong convening power to protect
their rights
Linking economic empowerment with PSS education on the
elimination of all forms violence enhanced children to raise their
voice to be heard
Lesson learnt from Project
Assessing project progress as well as experiences, lessons learned
can be shared effectively through regular monitoring meetings. This
contributes to the projects effectiveness.
Capacity building programme done by the project is a powerful tool
towards successful implementation of the programme. This
contributes to effective implementation and also enhances
sustainability of the project.
Commitment of SATF staff during implementation of the project has
contributed to the success of the programme.

Involvement and participation of partner and beneficiaries in


implementation of activities leads to ownership and successful
implementation of the project
Lesson learnt from Partners
Partnership and networking is the powerful tool for sharing of
knowledge and experience among partners hence ensure
comprehensive provision of PSS services
Advocacy meeting is powerful tool towards increasing commitment
to implementation of PSS activities
Mainstreaming of PSS in to planning, budgeting and implementation
of core activities ensures sustainability of the project
Recommendations
The evidence from the evaluation indicated that PSS need not a
standing alone project and therefore calls for the inclusion of other
seven needs as outlined in the National Strategy for addressing the
needs of MVC.
Creating Safe Space for Children/Recreational centre for MVC to share
their experience and challenges
SATF need to scale up the project to other areas where the project was
not implemented.
Continue strengthening coordination, cooperation and relationship with
local authority leaders and partner organization in the operation areas.
Continues documenting of good practices, case studies and lessons
learned.
Strengthening leadership commitment within the district. This will
enhance implementation and continuation of the programme and
ensures allocation of resources in terms of time, finance and human
resources within the district
Encourage motivation for caregivers. The provision of motivation
ensure sustainability even after the withdrawal of donor funding
Encourage full participation of all community members. This will
promote ownership of the project and enhance participation of
community
Strengthening MVC families with economic empowerment activities.
Continue supporting MVCs through Education project to higher
education.
SATF to set mechanism that ensures continuity of funding support
instead of one- off supporting mechanism

1.0. Introduction
About Rolling out PSS Capacity Building Project
The Rolling out of PSS capacity building project in 13 Regions of Tanzania
was built on the lessons learnt from the PSS project that was funded by
Foundation for Civil Society (FCS) in 2007/08. The project aim was to build
the capacity of partner NGOs, district officials and caregivers to provide
PSS to Orphans and Vulnerable Children (OVC) that were supported under
the SATF MVC education Programme.
However, during the 2007/08 monitoring and evaluation of the project,
SATF and its implementing partners learnt that, despite the great need of
providing PSS to OVC most Caregivers at the community level did not
know the PSS needs faced by children and how to help them cope with the
PSS problems. Also caregivers believed that material support was most
important for OVC and often did not care about their psychological
wellbeing.

On the other hand during evaluation they found that, despite the training
provided to partner NGOs, they had not been able to adequately provide
PSS to OVC as they were yet to mainstream the PSS component into their
policies and plans.
Therefore taking into account the lessons learnt from the previous project
implementation, SATF with funding support from FCS, rolled out a three
years (2009-2012) PSS capacity building project at District level to ensure
its sustainability. The objective of the project was to at least reach 52
members from 26 NGOs with TOT training and train 520 Caregivers at
community level. Also at District level to sensitize at least 260 District
Officials from departments namely: Community development, Health and
Social welfare, Education, Police gender desk, on the importance of
mainstreaming Psychosocial Support in their District plans. The other aim
of the project was to ensure that all 26 Implementing Partners are
supported to mainstream PSS issues into their support. The project also
adapted the Vijana Simama Imara model as one of the initiative to
empower young people to generate income.
2.0: Methodological Approach
2.1: Evaluation Framework
The programmes relevance, efficiency, effectiveness, impact and
sustainability were assessed using the outcomes model depicted below

Figure 1: Outcomes Model


Inputs
Activities

Baseline
Information

OUTPUTS

Objectives

OUTCOMES

Human Resources
Financial
Resources
10

Output Indicators
MEASUREMENT

Outcome
Indicators

Baseline values Vs. Targets


Baseline Values Vs. Actual Values
The model was applied in capturing different project elements which
include: Relevance, Efficiency, Effectiveness, Impact, Sustainability,
Lessons Learned and Documentation of Success Stories
Relevance: Details of the projects significance with respect to specific
needs and its relevance to country strategies that focusing on improving
wellbeing of MVCs were assessed. Specifically the following areas were
looked at how the project contributed towards projects goal: review and
comment on the relevance of the project in relation to the government
policy and the real needs of the intended beneficiaries. Also the
assessment looked at whether the developed strategies are creative or
innovative ones and are relevant in realizing the goals and whether SATF
and Implementing Partners perceived core business is in line with its
strategy, programme capacity and expected results and outcomes and
whether the PSS project are interlinked or reinforcing each other.
Effectiveness: Under this category we looked at whether things were
done in right ways. Therefore, the evaluation team assessed on whether
the interventions objectives were responding to the needs and priorities
of MVC, whether the objectives of the programme were clear enough to
support the achievement of the project, and also assess whether the
activities were sufficient to achieve the objectives.
Efficiency: The assessment on whether activities were implemented in a
cost effective way, whether project management/staff capable, work
properly was made. Also the assessment on whether beneficiaries were
satisfied with the quality delivery of services provided and if not, why was
also made. How far funding, and personnel, regulatory, administrative,
time, other resources and procedures contributed to or hindered the
achievement of results.
Impact: The team assessed on how far the intended outputs and results
were achieved in relation to targets set. Under this we look at how the
project impacts had been improved, assess the extent to which changes
that have occurred as a result of the project, what difference has been
made to the lives of those involved in the project. Also the evaluation
team assessed on the major factors (Internal or external) which influenced
the achievement of the objectives. How the overall PSS needs have been
addressed from the inception of the project in 2009.
Sustainability: The assessment was done on the potential for the
continuation of the impact achieved and of the delivery mechanisms,
following the withdrawal of external support. Under this the team looked
at programme sustainability. Assessment was done on the extent to which
partners have the possibility to generate their own resources to finance
11

PSS project, assess the aspects of the project which are most and least
sustainable, and finally assess if the project has Potential Avenue for
continuity after withdrawal of the donor support.
2.2: Study Area
The evaluation was conducted in PSS Project catchment areas in six
districts which include Dodoma Municipal Council, Moshi rural District
council, Lindi Municipal council, Songea Municipal council, , Karagwe
District council and Morogoro rural district council. In each district, one
implementing partner was involved in the evaluation. These include
TIKVAH in Dodoma, MKUKI in Moshi Rural, LISAWE in Lindi Urban, PADI in
Songea, KARADEA in Kagera and NEREFO in Morogoro.
2.3: Data Collection
2.3.1 Literature Review
Various literatures were reviewed to form the base for argument on the
relevance, efficiency, effectiveness, impact and sustainability of the
project and the documents reviewed included but not limited to: project
proposal, project reports for 2012, 2011, and 2009 respectively. National
documents were reviewed as well including Laws, policies, and strategies.
These are: The Law of the Child Act, 2009, the child Development Policy,
1996 as revised in 2008, The Tanzania Development Vision 2025 and the
education and Training Policy, 1995. Other documents reviewed were the
National Strategy for Growth and Reduction of Poverty (NSGRP), The
National Costed Plan of Action for MVCI, 2007-2010, The National Costed
Plan of Action for MVC II, 2013-2017 and the Tanzania Health Policy, 1990.
Also the evaluation team reviewed National and International reports,
guidelines and conventions to support the argument. These included The
Tanzania Human Rights Report, 2008, National Guidelines for Improving
Quality of Care, Support and Protection for Most Vulnerable Children in
Tanzania,2009, UN Convention on child Rights, 2009 and the African
Charter on the Rights and Welfare of the Child 1990.
2.3.2 Key Informant Interview
A total of 95 key informant interviews were conducted with District
officials, that is Heads of community development, social welfare,
education, Health departments and Gender Desk in the Police Force.
Other respondents included NGOs heads, Training of Trainers (PSS TOTs)
participants, and Caregivers who received PSS training from
implementing partners. The Information obtained from the key informant
interview was supplemented with the quantitative data, particularly on
how the project was implemented and results obtained, which were
collected from official files and reports.

Table 1: Number of Key Informant Respondents Disaggregated By


Sex
12

Participants
FCS
SATF staff
REPSSI
District Officials
Partner NGOs
TOT
Caregivers
Total
Source: Field data

KI Informants
Male
Female
1
3
1
16
2
2
15
40

Total
1
2
1
19
5
7
20
55

2
5
2
35
7
9
35
95

2.3.3 Focus Group Discussion


A total of 25 Focus Group Discussions were conducted with MVC
beneficiaries. In some areas, MVCs below the age of seven who could not
express themselves were represented by their parents or guardians who
also received PSS services in their areas. The evaluation team managed to
discuss with 133 beneficiaries (MVCs) and 19 parents/guardians in all six
districts. The discussion included how the project contributed to raising
knowledge, skills and awareness on issues relating to PSS, how the
project changed the behaviors and increasing awareness of beneficiaries
on the need to protect their rights and advocate for their rights when
denied, how could parents take care of their rights but as well what is
their roles to their families as children. The information obtained was
used to triangulate the quantitative information which was also obtained
from the reports.
Table 2: Number of MVC FGD Participants Disaggregated by Sex
SN

NGO
Male

1
2
3
4
5
6
Total
Source:

TIKVAH
MKUKI
PADI
LISAWE
NEREFO
KARADEA

FGD
Female
7
12
4
14
10
11
58

TOTAL
14
10
11
11
15
14
75

21
22
15
25
25
25
133

Field data

13

Table 3: Number of Parents/Guardian FGD Participants


Disaggregated by Sex
SN

NGO
Male

1
2
3
4
5
6
Total
Source:

TIKVAH
MKUKI
PADI
LISAWE
NEREFO
KARADEA

FGD
Female
0
5
0
0
1
9
0
4
0
0
0
0
1
18

TOTAL
5
0
10
4
0
0
19

Field data

2.3.4 Observation
The team observed if there were any visible information (i.e. Leaflets,
brochures, outdoor banners/posters and T-shirts etc.) done by SATF
Implementing partners with regards to its objectives of addressing PSS
services . This was done during visiting to the Implementing partners
NGOs, community groups and in schools where MVC are receiving their
education services.
2.3.5 Challenges during evaluation
Busy schedule of some of district officials due to district budget
preparation
Some of district official who were trained on PSS had retired from Public
Services e.g. three officials in Karagwe Districts
Some of district official who were trained on PSS were on study leave
and some were on leave
Resistance to participate in the interview to some of MVCs
parents/guardian who received PSS support from caregivers demanding
to be paid before being engaged in the interview.
Some of MVCs supported were not available at the time of evaluation
assignment

3.0: Evaluation Findings


3.1: Performance of the Project
3.1.1: Relevance of the Objectives
Project Aligned With SATF Objectives
SATF has been supporting the PSS project which puts emphasis on efforts
that focused on building the capacity of district officials, Implementing
partners and caregivers on how best they can support Most Vulnerable
Children hence improving their wellbeing. The PSS project objectives
aligns with SATF primary objective, which is to make grants to Non
14

Governmental Organizations (NGOs) registered in Tanzania in order to


assist Orphans and Vulnerable Children (OVC) to become productive
members of the society. Also, the project objective aligns with SATF vision
and mission. The SATF mission calls for mobilizing adequate resources to
transform MVC to become healthy, secure, motivated and productive
members of the society.
SATF work is focusing on providing PSS to children who are exposed to the
devastating effects of poverty, conflicts, HIV and AIDS and are especially
in need of care for their emotional, intellectual, physical, spiritual and
social wellbeing. Also they focus to support children who have lost parents
and families, stigmatized, experienced deprivation and abuse and also
suffered overwhelming grief.
Project Alignment with National Policies
The project aimed at building the capacity of District officials, partner
SATF organizations and also enabling caregivers at the grassroots level to
develop a practical instrument that could support them in the provision of
psychosocial services to MVCs, enhance capacity of partner organization
in providing training to caregivers to understand MVCs psychosocial
problems. This also aligns with several National Polices, Laws, Strategies
and Programmes that focus on promotion and supporting households
particularly those with MVC, to reduce the incidence of risk and the impact
of shocks, and protect the rights of the most at-risk, vulnerable or
chronically poor children in the country.
National policies focus to ensure that all childrens social protection
components of child wellbeing are well addressed; these include adequate
nutrition, quality education, appropriate healthcare and child protection.
The Policies include the National Costed Plan of Action for MVC I, 20072010, , The National Costed Plan of Action for MVC II, 2013-2017the Law
of the Child Act, 2009, The National support services for Primary Schools
in Tanzania, 2011, The Child Development Policy, 1996 as revised in 2008,
The Tanzania Development Vision 2025 and The Education and training
Policy, 1995. Other policies includes National Strategy for Growth and
Reduction of Poverty (NSGRP) II, 2010 and National Multisectoral Strategic
Framework on HIV and AIDS, 2008-2012
The project also aligns with the National Strategy for Growth and
Reduction of Poverty (NSGRP) II known in Kiswahili as MKUKUTA that
focusing on improving the quality of social services (education, survival,
health and nutrition, clean water, sanitation, decent shelter and a safe
and sustainable environment) to the majority of poor and vulnerable
groups. Also the projects aligns with MKUKUTA that focuses on reducing
income poverty through promoting inclusive, sustainable and employment
enhancing growth and development. Through the introduction and
adoption of VSI model which is part of the PSS project whereas economic
empowerment activities were initiated to support children and their
household families living below the basic needs poverty lines hence
improving the well-being of children. Living below the basic needs poverty
15

lines implies that such households do not command income sufficient


even to provide enough food to satisfy their basic minimum nutritional
requirement, with consequences for physical and mental development,
economic and social wellbeing, and their contribution to national
development of which many children are therefore clearly affected by this
generalized insecurity.
More so, the project aligns with the National Costed Plan of Action for Most
Vulnerable Children I 2007-2010 which indicates that most organizations
that provide care, support and protection services to MVC have not been
properly trained in providing PSS support for children of different ages and
families and cultural background and therefore calls for capacity building
program to enhance the provision of PSS services to MVC.
The project also aligns with the National Costed Plan of Action for MVC II,
2013-2017 which provides an insight of building capacity of community
members with a focus of empowering the community and families in a
combination of economic, material and psycho-social support to children
so that they can live longer in a better and quality life . The project also
aligns with the National Development Vision 2025 in Tanzania which
promotes the high quality livelihood. The project built the capacity in
terms of skills and knowledge to implementing partners and caregivers
through adoption of the VSI model to facilitate and support MVC and their
families in improving their well-being. The establishment of small income
generating projects such as agriculture, beekeeping, poultry keeping and
small business ensured good productivity hence increased family income
to support children in need.
Education and training Policy, 1995 also recognize the importance of early
pre-school years in the child physical, social, mental functioning and
personality development and formation and therefore guarantees access
to free primary education to all children with the age required to attend
school. The PSS project also focused on ensuring that all children in need
get the psychosocial support which could support them in one way to roll
back to school for those who dropped from school, but for those who were
at school but having psychosocial needs could be supported to improve
their performance.
Furthermore, the project aligns with the Tanzania Health Policy, 1990 as
revised in 2002 which emphasizes the need and importance of improving
the health and wellbeing of all people in Tanzania with special focus on the
most at risk population. The Policy emphasizes the importance of
adequate intake of nutritious food which is essential for promotion and
maintenance of physical and mental health. Towards this the Government
is emphasizing on promotion of community activities which ensures
household food security, availability of adequate food in quality and
quantity among vulnerable groups, proper feeding practices in infants and
young children and development of appropriate ways of storing food at all
levels. This aligns with the PSS project focus when referring to the PSS
cycle that targets on how to support children through their families and
16

communities in the areas of Physical needs, mental needs, social needs


etc.
PSS Project is also aligned with the Child Development Policy, 1996 and
revised in 2008. The policy underscored five basic rights of the child
similar to those in the United Nations Convention on the Rights of the
Child of 1990 that include: survival, development, protection, participation
and the right not to be discriminated against. The Policy also recognize
that basic rights of the child need to be protected by the community,
parents and guardians from violations due to factors such as poor
economic situations, poor education, lack of child care education, negative
traditions and customs, environment and deficiencies in enforcement of
the laws concerning child rights. The Policy also address among other
things protection of school children from harmful acts curtailing their
studies, to protect children from destructive information, and exploitation
from child labor. These rights also referred to the PSS cycle which focusing
on Physical, emotional, mental, social and spiritual needs that may in one
way affect the children if not well addressed.
The project also was aligned with the Law of the Child Act, 2009 which
also promotes the rights of children in all undertakings. Some of the
section under the act provides an instruction on how the child should be
taken care of by observing all the rights pertaining to this child but as well
the role and duty of the child. This give the room for children voice to be
heard and also compel their parents to ensure they provide all necessary
support required for the child in the course of his/her life hence ensures
the wellbeing.
Generally, the SATF PSS Project activities aligned in their project plans
support the National efforts by contributing to increased knowledge and
skills on addressing the needs and improving wellbeing of MVCs. The
project also supports the national efforts for creating conducive
environment for easy access to services in their localities. The project also
aligned with the National policies such as MKUKUTA through economic
empowerment activities initiated to MVC through the VSI project model
that focusing on generating income at MVC level hence at family level.
3.1.2: Effectiveness of the Project
Evaluating the effectiveness of PSS project required quantitative
measurements authenticated with qualitative data. These measurements
assessed the extent to which the objectives of the project were achieved.
Effectiveness in this evaluation was used to answer the following
questions: What outcomes were observed? What do the outcomes
mean? and Did the program make a difference? Therefore in this
evaluation, the consultant examines the extent to which the projects
major objectives as understood and achieved at project completion.

17

Progress towards Activity Indicators


Objectives of
Programme

the Objectively
verifiable
activity
indicators
of
achievement as indicated in
the project (in 2008)
Contribute to the improvement of wellbeing of OVC
OVC Children in 13 Regions
To build the Capacity 52 Staff from Implementing
of
Implementing partner Organization trained
partners in order to as TOT
to support the
improve their work implementation
of
PSS
performance
in services at the grassroots
providing
PSS level
services
Exchange
visit
for
knowledge sharing, gaining
experience and adopting the
VSI model to 34 members of
partner NGOs to Humuliza
hence mainstreamed into
their routine activities

Progress against indicators(At the


time of evaluation)

Remarks

through impacting PSS skills to OVC caregivers and provide PSS to


52
staff
from
implementing Target reached
partners received PSS TOT training
More TOTs need to be trained
based
on
community
demand
Exchange visit was done to some
of implementing partners. Partners
such as NEREFO, KARADEA, MKUKI
visited at HUMULIZA for learning
purposes

Exchange visit for knowledge


sharing have helped the
organization to acquire new
skills,
experiences
and
materials which are relevant
to the organization activities.
The VSI model have now
been replicated to Partners
activities where MVCs are
equipped with knowledge on
how to run their self-directed
income generating projects
and
life
skills(Building
confidence, leadership skills
and sense of ownership)
The exchange visit should be
18

ongoing exercise for gaining


more experience.
18
Partner
NGOs
capacitated
through
knowledge sharing on how
to implement VSI model and
prepare plan for replication
10 Partner NGOs supported
with Grant to replicate VSI
model which is one of the
initiatives to support MVCs
in 10 districts

Partner NGOs mainstream


PSS in their core activities

To build the Capacity


of
caregivers in
order
to
provide
comprehensive PSS
services
to
MVC

520 OVC caregivers at


grassroots level enabled to
develop
a
practical
instrument that helps them
to provide PSS to MVC in 26

32 staff from 18 implementing Target reached.


partners have increased their
knowledge and skills on addressing Still
more
implementing
PSS issues.
partners need to learn the
VSI model experience so as
to impart this knowledge to
their core activities.
SATF
supported
the
10 Target not reached due to
implementing partners with 2 the fact that IPs did not come
million grant each to replicate VSI with proposals or tangible
model in their implementing areas VSI proposals
More grant need to be
provided to suit the demand
and
needs
of
MVCs
supported by implementing
partners
Partners are now mainstreaming Target reached
PSS
into
planning
and
implementation of their core More emphasis should be
activities
done at district level to
increase commitment on the
inclusion of PSS activities
into their plans
520 caregivers identified and Target reached
received PSS training
Due to increase in demand,
SATF should plan of scaling
up of the project
by
19

children

districts
520 OVC caregivers at
grassroots level enabled to
identify
MVCs
to
be
supported in their areas

2600 MVCs with PSS need


identified and supported on
PSS in 21 District in 12
Regions
365 MVCs capacitated and
provided with Grant to
implement the VSI model as
one of the initiative to
generate income through
partner NGOs
Strengthening
collaborations
and
networking through
lobbying
and
advocacy

26
Districts
Councils
sensitized
on
the
importance
of
mainstreaming PSS in their
district plans
260 Staff from departments
namely:
Community
Development, Health and

supporting
implementing
partners to increase the
number of caregivers
520 caregivers identified 2600 Target reached.
MVC (Each caregiver identified 5
MVC in her/his vicinity.
There are more MVCs in the
community who still need
more PSS support. Therefore
SATF PSS project should plan
on
how
to
continue
supporting
partners
to
produce
more
caregivers
who will support more MVCs
2600
MVCs
identified
and Target reached
supported
365 MVCs identified and supported
(MKUKI 20, WOY 25, UHAI 100,
MEDI 20, USHIVIMWA 30, AOPN 20,
TAHEA-Shinyanga 25, KIDI 80, HWF
20 and KARADEA 30)

No specific target were set


from the inception, However,
365 MVC from among 10 IPs
were reached.

26 District council reached through More commitment is needed


advocacy meeting
from
district
official
to
mainstream PSS activities
into their plans.
260 Staff(10 staff from
district) trained on PSS

each Target reached

20

Social Welfare, Education


department
and
Police
Gender Desk, agriculture,
Planning reached through
Advocacy meeting in 21
districts in 12 Regions

21

3.1.3: Efficiency of the Project


This referred to the extent to which the project achievements and benefits
were commensurate with inputs and be sure if the project added value.
The approach used to implement the programme
Participatory approaches were used during implementation of the project.
That is, implementing partners were involved during the capacity building
programme that aimed at strengthening their planning and coordination
mechanism. After the training, partners were involved in the modality of
selecting caregivers who were also trained on PSS ready for supporting MVCs
in their areas. No reported information on involvement of beneficiaries from
the inception of the project by designing the modality of implementing the
project. There was also no any information documented or reported for the
change of modality of implementation in the middle of the project.
Management arrangements
Management of Personnel
Information obtained during field work has shown that the project was
managed by the Project coordinator under the supervision of the SATF Chief
Executive Officer. Also from the reports and information obtained during
interview with the CEO and the project coordinator, it is showing that SATF
had internal capacity building and mentorship program on PSS for its staff.
This ensured stable implementation of the project as everyone in the
Organization had the capacity to implement the project.
Management of Budgets
It was revealed during evaluation that the fund is managed as per the MOU
signed between FCS and SATF. All activities planned were implemented as
per the implementation plan. Though there was a bit of delay in the
implementation of the project activities due to either delay in the submission
of the report from SATF or delay in disbursement of funds from FCS. This was
revealed during interview with FCS team that the delays was due to ever
changing and adjustment of the budget done by SATF submitted to FCS
pending for approval to complement the price fluctuation and inflation as
the budget was prepared in 2008. During the interview with FCS team, it
was also revealed that despite the delay in submission of report or
disbursement of fund, all planned activities were managed as per the plan.
During the interview with SATF finance personnel, it was revealed that the
fund is managed by professional finance personnel with background in
finance and accounting. Also it was revealed that FCS has been releasing the
funds on quarterly basis and this has been done upon receiving the
satisfactory report of the previous quarters. This system ensured

accountability in reporting within the Organization as no funds for the next


quarter could be released before receiving the implementation report of the
previous quarter. The Evaluation team also revealed that SATF has got the
standard financial package which is used for all financial reporting systems.
Involvement of Beneficiaries
SATF worked well with the beneficiaries who were involved at all levels of
project implementation. At SATF level, staff were involved from the inception
of the programme, during implementation of the programme and during
evaluation. The evaluation team managed to interview beneficiaries
regarding whether they were involved from the beginning of the programme.
It is evident that the majority of beneficiaries were involved from the
identification and selection process to attending the capacity building
training as part of their involvement. The involvement has also enabled
beneficiaries and the community as whole to engage them in campaigning
about supporting MVC in improving their wellbeing which is a central focus of
the organization.
3.2: Impact of the Project
Evaluating the impact of the SATF PSS Project requires assessing the
changes in the lives of beneficiaries at the time of the evaluation. Therefore,
assessment was looking at the extent PSS interventions have contributed to
the changes of their lives and sustainability of these changes. Therefore,
under this category, the evaluation team assessed the impact basing on the
following main domains that is overall impact and overarching factors of
sustainability.
3.2.1 Overall impact of the SATF/FCS funded project
Knowledge and skills on PSS
To determine the contribution of the SATF PSS works in areas where the
project has been implemented, the evaluation team established different
definition as defined by different scholars and compare with the focus of the
SATF PSS Project. The aim was to establish the foundation for the discussion
on the knowledge, skills and awareness of PSS with the IPs and community
perspective. The term Psychosocial refers to the dynamic relationship
that exists between our psychological world and the social world around us.
It is made up from two words: psycho and social whereas Psycho refers to
our thoughts (mental and spiritual), feelings, emotions, beliefs, attitudes and
values. These are the things that exist inside the human being. More so,
Social refers to our relationships with our family, community, workplace and
friends. It is the context or environment in which we live. The psycho and the
social parts of a person interact and influence each other all the time (IASC,
2007).
23

Scholars continued to elaborate the meaning by giving example of the term


PSS that, if you are experiencing a difficult relationship with a teenage child,
this would influence your internal world of feelings and emotions. This is why
a person has both psycho and social needs. If these needs are not met,
the psychosocial wellbeing of a person is affected. It is further and commonly
acknowledged that psychosocial support (PSS) should reinforce and
strengthen individuals existing coping strategies, support them in recovering
from stressful and traumatic experiences, and contribute to building
resilience in individuals, families and communities(IASC, 2007).
REPSSI, 2011 defined psychosocial that it underlines the close relationship
between psychological and social effects of experiences as well as the
continuous influence of the two on each other. REPSSI continued defining PSS
as the term that stands for love, care and protection. It is for the emotional
and social aspects of a childs life, so that they can live with hope and
dignity. This means that all services for children can and should be delivered
in a way that takes account of their psychosocial wellbeing. Furthermore,
according to the REPSSI Wheel Model of psychosocial support (2008),
childrens needs are defined into five different categories which includes;
Social, emotional, mental, physical and spiritual. These five categories
defined by REPSSI Wheel model suit the PSS Cycle as defined by SATF PSS
Project which includes; social, emotional, mental, physical and spiritual.
Definitions were then converted into SATF PSS project concepts with the aim
of understanding if beneficiaries were aware of PSS support. During
evaluation, beneficiaries were asked to give their views on how and what
they see the project had contributed and address the needs and priorities
related to PSS which affect children from their areas. Since there were no
baseline information that was set before the inception of the project to
compare with the findings during the evaluation, the evaluation regarded the
project started from Zero and therefore rated the findings from the
evaluation as remarkable changes. It is evident from the discussion with
District officials, IPs, Caregivers, children and parents or guardians who
received support from caregivers and those who participated in the
evaluation that PSS project made remarkable changes in the lives of MVC
families and communities. They were able to give testimony that the project
has raised their knowledge and awareness as before the project they were
not aware of how they are supposed to handle their children by addressing
their needs. The following were some of the remarkable observations
resulted from the knowledge obtained from the project:
a) Changes in behaviors and attitude related to PSS among
community members to MVC
24

SATF PSS Project central focus was to ensure children wellbeing at family
levels are well observed and taken care of by their parents or guardians.
Therefore, the PSS capacity building training was meant to enhance
caregivers to understand MVCs psychological problems and therefore offer
MVCs with a better assistance at both individual and family level.
During evaluation, respondents were asked whether the PSS Project have
changed their behaviors relating to how they can care for their children by
observing the children rights and needs and as well as those children they
were supporting. It is evident that Majority (Over 85%) of respondents at all
level that is district officials, NGOs, TOTs and Caregivers commended that to
the great extent the PSS training they have received have changed their
behaviors at individual level. The histogram below indicates the percentage
of response from different groups on how they recognized PSS training in
changing their behaviors

Fig 1: Percent of Respondents Reported that the Project Changed


Their Behaviors

Source: Field data


25

This is supported by one of the District officials who commended on the


project that it has added value and changed behaviors at individual level. As
of now those who recieved training knows how they can care for families
especially their children. She commended the training by saying;
Ukweli mimi mwenyewe mafunzo haya yamenibadili tabia,
maana nilikuwa sijui jinsi ya kuongea na watoto wangu na kuwa
karibu nao kama rafiki japo mimi ni mtaalam wa maendeleo ya
jamii lakini sikuwa na uelewa mkubwa kama baada ya kupata
mafunzo. Nawashukuru sana MKUKI na SATF kwa mafunzo
haya Community development officier Moshi
This means To be honest, I commend MKUKI and SATF for the
PSS training they have provided to us as the knowledge
obtained from the training helped to change my behaviors. I
was not real aware on how can I talk, be close and friend to my
children even though Iam an expert on community
development. But after the training, the knowledge obtained
have added value as I know how to care for my children
Another response also supported the statement and also applaud the efforts
made by SATF through the PSS project to build the capacity of individual and
enhance them to change their behavior on caring for their children hence
provide PSS services at their family level but as well MVCs and the general
community. She had this to say;
Nawashukuru sana SATF kupitia programu yao ya PSS, kwanza
imeniongezea uelewa na kunibadili tabia jinsi ya kuwalea watoto
wangu. Ni elimu muhimu kama wanajamii wote wangeweza
kuipata natumai tusingekuwa na kizazi cha watoto walio katika
mazingira magumu
Education officer Dodoma-Secondary
school
This means Thanks for the SATF PSS Project, as through the
training, I have gained the knoweldge which resulted on
changing my behavior on how to care for my children. The PSS
Programme is an important component if well disseminated to all
community members, then we could not have the MVC
generation in the community
The findings indicates that the SATF PSS Capacity building Project
implemented in the project area have played a great role in ensuring that
26

knowledge on behaviors related to support MVCs in term of PSS is impacted


to community members hence improving their wellbeing
b) Improving the Knowledge and Skills to Partner NGOs
One of the objectives of the project was to build the capacity of partner
NGOs to implement PSS activities at grassroots level, and also providing
them with the capacity to train caregivers and hence identify MVC and
provide them with knowledge on how they can support MVC by providing
them with PSS services. During field visit,the evalaution team wanted first to
know if SATF conducted capacity assessment of every organization to assess
their capacity in implementing PSS before being trained. From the field, the
findings indicate that no organization capacity assessment was conducted
before the support. It is also evident that during the evaluation majority of
respondents who were interviewed from Partner NGOs applauded the efforts
made by SATF to provide them with the PSS training as the training not only
built their capacity in supporting MVC and Caregivers but also helped them
to mainstream PSS in their policies and plannining.
This is also supported by one of the NGOs heads who reported that even
though they were supporting children in different projects, the knowledge
they have acquired from PSS training have added value and increased
understanding on how they can comprehensively provide the services to
children. She had this to say;
Kwa kweli nashukuru sana kwa mafunzo tuliyoyapa ya PSS,
japo kabla ya mafunzo tulikuwa tunawahudumia watoto walio
katika mazingira magumu, lakini hatukujua mambo mengine
anayopaswa kupatiwa mtoto. Tulikuwa tunawapa misaada ya
vifaa vya shule kama uniform, kulipa ada n.k lakini unakuta
bado mtoto haendi shule. Lakini baada ya kupata mafunzo,
yametufungua tukajua kuwa kumuhudumia mtoto ni zaidi ya
kumpa msaada tuliozoea kutoa NEREFO-Morogoro
We thank you for the PSS training we received as before the
training we used to support children by providing them with
School materials but still some of children were not attending
classes. But after the PSS training we realized that supporting
these chlidren is not only providing them with school materials
as there are other Psychosocial problems that needs to be
fullfilled
Also another respondent interviewed commended to the programme that
real the PSS training they were provided with have improved her knowledge
27

and skills on how to care for her family. She also commended that despite
being the chairperson for the Organization, she is also caring for orphans at
her family. Therefore the PSS training was provided on the right time as she
is now an expert on caring for orphans.
Elimu hii ya PSS imesaidia kuongeza uelewa wangu wa
kuwasaidia watoto. Japokuwa mimi ni mwenyekiti katika shirika,
pia nalea watoto yatima pale nyumbani kwangu, na sasa najua
jinsi ya kuwalea vizuri kwa kuwapa mahitaji yote ya msingi na
najua jinsi ya kuwafanya wajisikie sehemu ya jamii. TIKVAH
Dodoma
This means, the PSS education has improved my knowledge in
terms of providing better services to my children. Despite being
a chairperson for TIKVAH Organization am also caring for
orphans in my family. Therefore the PSS knowledge have made
me not only to provide better services but also to make them
feel part and parcel of the community
Furthermore, other respondents applauded the effort made by SATF PSS
Project and the changes the project brought to staff and the general
community. He said that before the training he was in the opinion that no any
MVC support that can be provided without having money. But after the
training he realized that there are other programmes and services that can
be provided even without incurring any cost.
Kabla ya mradi wa PSS, hapa Lisawe kama shirika tulikuwa
tunatoa huduma bila kujua kama kuna baadhi ya huduma
ambazo zinaweza kutolewa bila ya hata kuingia gharama. Lakini
baada ya elimu, tumeweza kuona kuwa ni jambo
linalowezekana na tumeweza kufanikiwa Chairperson Lisawe
Lindi
Before PSS project, LISAWE as an organization were providing
support to MVC without knowing that there is another support
which we can offer without incurring money, but after training
we have managed to do that and we have succeeded
The finding is also supported by other respondents who gave the testimony
that the training has improved the organization working relations with other
partners, MVC who are supported as well as the community in general.
Despite improving in the working relationship with other partners, the
knowledge obtained from the training helped in improving the service
delivery. As before the project they used to believe that providing material
28

support only satisfies the needs of MVC. But after the training they realized
that material support not only satisfy the needs and priority of the child
rather they need also to be provided with other psychological support.
Hapo awali kabla ya kupata elimu tulihisi vitu tunavyopewa ndio
kitu cha muhimu kwa mtoto. Kumbe elimu ya saikolojia kwa
mtoto ni muhimu zaidi kwa sababu inamjenga zaidi kuliko kumpa
material thing pekee. Baada ya elimu tukaelimika na sasa
tunatoa pia elimu ya PSS kwa watoto, jambo lilichangia kuongeza
uelewa na kujiamini kwa watoto. Ahsante sana kwa SATF na
mradi wao. Chairperson, KARADEA Karagwe
At the beginning we believed that material things are the only
thing which satisfies the needs of a child. But psychosocial
education is more important to the development of a child than
providing only material support. After attending the training we
have improved our services to PSS to children and this improved
childs knowledge and confidence.
c) Improving the knowledge and skill of Caregivers
During the evaluation, caregivers interviewed were asked if real the PSS
training they have received have improved their knowledge in providing PSS
to MVCs in their surrounding areas. It is evident from the evaluation that
SATF PSS project objective of building the capacity of caregivers through
training was well implemented as majority (97.1%) of caregivers interviewed
commended the content and techniques used during training. Only 2.9%
were not satisfied with the way the programme was implemented. 97.1%
also commended that the knowledge they have acquired from the training
have helped them to first be in a position to know and identify themselves
who they are and how they can care for their children. Also they are
knowledgeable on the criteria they can use to select MVCs to be supported
as well as know the problems facing children and the type of the services
they should provide to them. For those who were not satisfied were asked
why they are not satisfied. They responded that they expected to see
material support as one of the contribution

Figure 2: Percent of Caregivers who Commended that the Training


have Improved their Knowledge
29

Source: Field data


This is supported by one of the caregivers who received training on PSS that
the knowledge they acquired from the training have changed their behaviors
and mindsets on MVCs. She commended that before receving the training
she mistreated her children as she could slap them even when they would
have not done any mistakes. But after the training she came to realize that
she was doing wrong to her children and now she is living closely and
friendly with her children. This also helped her to learn on how to care for
those children who are living in families with psychosocial problems. She had
this to say;
Mimi nashukuru sana kwa mafunzo niliyoyapata ya PSS pale
LISAWE, maana kabla ya mafunzo niliwalea vibaya watoto wangu,
niliwachapa hata pale ambapo hawakufanya makosa. Ila baada ya
kupata mafunzo, yameniongezea uelewa na sasa nimekuwa rafiki
na mama bora wa watoto wangu na hata wale niliowachagua
kuwahudumia naona mambo yanaenda vizuri. Caregiver-Lindi
This means Thanks for the LISAWE PSS training, as before the
training I was badly treating my children, I would strike them even if
they have not done any mistake. But the knowledge I have acquired
30

through the PSS training helped me to know how to live with my


children and those select MVC whom I am taking care of
Another respondent who is a Pastor also trained as a caregiver also
commended on the knowledge he acquired from the training. As before the
training he used to provide PSS to his followers through giving them the
spiritual support only. He did not know about other PSS components such as
physical, mental etc. After attending the training, the knowledge he obtained
have helped him in providing a comprehensive services not only to MVCs but
as well to his followers in Church and the surrounding community in general.
He said;
Mimi ni Mchungaji wa Pentekoste, na kwa miaka mingi nimekuwa
natoa huduma ya msaada wa kisaikolojia kwa waumini wangu,
lakini niligundua kuwa nilikuwa natoa huduma ambayo
haijakamilika baada ya kupata mafunzo ya PSS. Nilikuwa nawapa
waumini wangu huduma ya kiroho tu kumbe kuna huduma nyingine
ambazo sikuzijua kama huduma ya Physical na mental ambayo
niliona nikisha mtu huduma ya kiroho nimemaliza. Sasa natoa full
dose baada ya kuelimika. Nawashukuru sana TIKVAH na SATF kwa
elimu hii nzuri kwa jamii Caregiver from Mpunguzi Dodoma
This means; I am a Pastor from Pentecost Church whom for many
years I have been providing psychosocial support to my followers,
But I came to realize once I attended the PSS training organized by
TIKVAH that what I was providing to my followers was only one
among the five components of the PSS which spiritual support. I
didnt know if there are other components such as physical, mental
etc. Am now providing a full dose of PSS services to my followers
and families of the MVCs am supporting. Thanks TIKVAH and SATF
for this good programme which meant to educate the whole
community
Also during interview with caregivers in Moshi rural district, they were asked
whether the training has made changes in their life and the community in
general. One of the caregiver responded by saying that the training has
tremendously changed his life and the way he can continue supporting the
community. He said:
Ndiyo mafunzo ya PSS yamesaidia kuniongezea uelewa, kabla
ya hapo nilikuwa nafanya kazi kama bwana shamba na nilikuwa
nawafundisha masuala ya kilimo, lakini baada ya kupata
mafunzo haya nimekuwa nawasidia watoto kutumia elimu ya PSS
kujitambua na kutumia elimu kuwafundisha mbinu mbalimbali za
31

kilimo bora ili waweze kujitegemea. Tumeweza kuanzisha


mashamba ya vijana na tukipata mavuno inawasidia
wanagawana wao wote Caregiver, Moshi
This means that the PSS training helped to improve my
knowledge as before the training I was working as Extension
officer, training community members on the best ways of
improving their agricultural product. After the training, I have
been using the PSS knowledge to educate children on how to
identify and know themselves and use the PSS knowledge to
transform their lives through modern agriculture. We have
established a modern farming of which when we harvest all
children divide what have been harvested equally.
The findings indicates that SATF PSS Project implemented in the area have
remarkably played a great roles in ensuring that the knowledge impacted to
caregivers helps in providing comprehensive PSS services to those children
in need and the general community as whole.
d) Improving the Knowledge and Skills to District Official through
PSS Advocacy Meeting
Advocacy is the process of standing alongside an individual or a groups who
is in need of support and seeking out of their behalf in a way that represents
the best interest of the person even if that cause or interest does not
necessarily coincide with ones own beliefs, opinion, conclusion or
recommendations. QADA,s framework,2004
It is a call for the Government that all stakeholders supporting MVCs should
ensure the incorporation of PSS components in their plans and budget..
During review of the literature the evaluation team found that one one of the
objectives of the SATF PSS project was to mainstream PSS activities into
planning, budgeting and implementation at implementing partners level and
the districts as well. The evaluation team observed that this was done
through advocacy meeting that was conducted in all districts of the project
implementation area.
SATF narrative reports indicate that 260 staff from the department of Health
and Social welfare, community devlopment, Education and Police gender
desk and other related departments(Agriculture and Planning) recevided the
knowledge on PSS through advocacy meetings.
During field visit conducted in the selected Districts, the Evaluation Team
interviewed the heads and departmental staff who attended advocacy
32

meeting and received PSS knowledge. One of the question they were asked
was if they ever heard about PSS project. It is evident that majority of
respondents who responded to this question said that they are aware of the
PSS . When further asked , if the PSS knowledge they received have any
added value to their lives and daily undertakings, majority of them reported
that the knowledge they have acquired from the training real changed their
lives
One of the respondent supported the statement and also applaud the efforts
made by SATF through the PSS project to build the capacity of individual and
enhance them to provide PSS services at their family level but as well MVCs
and the general community. She said;
Nawashukuru sana SATF kupitia programu yao ya PSS, kwanza
imeniongezea uelewa wa jinsi ya kuwalea watoto wangu. Ni
elimu muhimu kama wanajamii wote, wangeweza kuipata
natumai tusingekuwa na kizazi cha watoto walio katika
mazingira magumu Education officer for secondary schoolsDodoma
This means Thanks for the SATF PSS Project, as through the
training, I have gained the knoweldge on how to care for my
children. The PSS Programme is an important component if well
disseminated to all community members, then we could not
have the MVCs generation in the community
She also commended that through the PSS knowledge, she is now able to
include the PSS issues in the departmental plans and budget. She said
Kupitia mafunzo haya ya PSS nimeweza kujua umuhimu wa
kuhuisha maswala ya PSS kwenye mipango na bajeti yetu ya
idara ya elimu kwa upande wa secondary
This means that; Through PSS advocacy meeting, I now know
how to mainstream PSS issues in the departmental plans and
budget for the secondary section
Another respondent also supported the statement that PSS is an important
component in the provision of comprehensive services to MVC. Therefore the
need to incorporate this component into our plans, budgets and
implementation of activities is paramount. He said he gained more
knowledge on the important components and how to incorporate them in the
departmental plans. He said
33

PSS in kipengele muhimu tunapozungumzia kumuhudumia na


kumwezesha mtoto anayeishi katika mazingira magumu.. Hivyo
naona ni muhimu kuitiririsha katika mipango yetu ili kuleta
ufanisi katika kumuhudumia mtoto huyu. CDO-Karagwe
This means; PSS is an important component when supporting
MVCs. Therefore, it most important to incorporate PSS issued in
the departmental plans in order to comprehensively provide PSS
services
During field visit, the evaluation team observed that despite the fact that
heads and staff in the selected departments were capacitated through
advocacy meeting, there is still low commitment to some of staff when it
comes to the issue of incorporating PSS issues in their plans. The only
challenge is that majority of staff interviewed were facing the budget deficit
at the district level to support the planned PSS activities. One of the officials
said
Tulijifunza kutiririsha/kukondoisha PSS kwenye mipango yetu.
Lakini tunakutana na changamoto moja, kuwa unaweza ukaplan
na kubajeti kazi za PSS lakini mwaka wa fedha ukaisha hata bila
kupata fedha kusupport MVC. Hii pia inatokana na vipaumbele
vya serikali SWO-Lindi
This means that We learnt on how to mainstream PSS in our
plans. But the only challenge we have been facing is that, you
can plan and budget for PSS but you may not even get budget to
support even a single MVC activity. May be this is due to
Government priorities
Despite the efforts to mainstream PSS, still a lot have to be done at the
district level to enhance commitment. This call for a concerted effort and
more advocacy meetings that should be convened to ensure they enforce
the implementation of the PSS activities
Improving Wellbeing through Delivery of PSS Service to MVC
One of the problems that has been facing majority of caregivers and the
community in general in the project implementation areas is to have a
comprehensively knowledge of defining psychosocial wellbeing of the MVCs.
SATF PSS project objectives defined the PSS through the PSS cycle which
includes supporting MVCs through addressing emotional, physical, social,
spiritual and intellectual needs hence ensure well-being of MVCs. Taking into
account the SATF PSS concepts and what it suffice to provide MVC support
34

and ensure well-being of these MVCs, it is evident that PSS is not a standing
alone programme. It needs to be supported with other programmes in order
to improve the wellbeing of these MVCs.
WHO, 2009, defined psychosocial wellbeing as a state of complete physical,
mental and social well-being and not merely the absence of the disease or
infirmity. WHO continued defining that psychosocial well being of an
individual or community is best interpreted with respect of three core
domains which includes; Human capacity which refers to physical and mental
health of an individuals knowledge, capacity and skills; Social ecology which
refers to social connections and support including relationship, social
networks and support systems of individual and the community and finally
the culture and values which refers to cultural norms and behaviors that are
linked to the value systems in each society together with individual and
social expectations. Therefore, psychosocial well being depends on the
capacity to draw on resources from these core domains in response to the
challenge of experienced events and conditions.
Also SADC, 2011 defined psychosocial well-being as an integral part of a
comprehensive service delivery for children and youth. It is influenced by all
the factors that affect human and social development which are: the
material, cognitive, emotional, cultural and spiritual aspects of an individual,
and the socio-cultural, economic and political environment in which people
live. Therefore, availability of psychosocial well-being enables vulnerable
children and youth to: make appropriate decisions that benefit their
development in the short and long term; assume and maintain social
responsibility and healthy social relationships and behaviors; and maintain a
condition of mental capacity and a reduction or absence of temporary or
long-term mental impairment. SADC concluded that psychosocial support
should not be a standing alone services rather it should be provided in
combination with any other services that are required by children and youth.
The National Guideline for improving quality of care, support and protection
for Most Vulnerable Children in Tanzania, 2009 identified eight key
components/services for addressing the needs of MVCs. These include food
and nutrition, shelter, family-based care and support, social protection and
security, primary health care, psychosocial care and support, education and
vocational training and household economic strengthening. When all these
needs are met then satisfies the wellbeing of MVC. SATF PSS Project
objectives focused only on one component the psychosocial support.
During evaluation, children were asked to state whether they have received
any support from caregivers. The data from the evaluation revealed that
35

68.4% had received the support from caregivers and 31.6% reported that
they have not received any support from caregivers.
Figure 3: MVC received support from caregivers

Source: Field data


When asked to state a type of services they have received, majority of
respondents mentioned material supports which include school uniforms,
school fees, shoes and other materials which were provided by caregivers. It
is evident during discussion with children who were involved in the
discussion that they were not well aware of the PSS support they have
received from caregivers. As they perceived tangible things as the only
support provided which are in terms of material. They did not consider PSS
as one of the supports when provided can help them in improving their wellbeing.
When further asked on the type of services they have provided with apart
from material support, majority were able to respond that they have received
counseling services, educated on their rights(right to respect and be
respected, right to play, right to education) from caregivers.
36

For those who received the support from caregivers, they were then asked to
state how the support they have received have helped in changing their wellbeing, they responded that real the support they have received from
caregivers helped some of the children to change their bullying behaviors
they used to have before they received the counseling support from
caregivers. Others were able to respond that they have experienced changes
in their families as of the time when the evaluation was conducted their
families were taking good care of them. Some of the testimonies from
children were as;
Nashukuru sana kupata huduma ya ushauri toka kwa Kaka
Barton(Cargiver) amenisaidia sana kubadili tabia na sasa naona
naweza kusoma vizuri na nafanya vizuri darasani.MVC Mpunguzi
Dodoma
Thanks for the counseling services from Mr. Barton. He helped to
change my behaviors and I am now rolled back to school and am
performing well in class.
Another MVC supported the achievement from support they acquired from
caregivers that it has helped her with her family as before their parents used
to treat them badly but after meeting a caregiver then they have changed
and they even engage her in family matters. She said
Naona kuna mabadiliko makubwa sana katika familia yangu.
Kabla Yule mlezi hajaja mama alikuwa akinichapa sana hata
kama sijafanya kosa, hadi ikafikia hatua nikachukia kukaa
nyumba. Lakini baada ya kuwapa ushauri wakaona umuhimu wa
kukaa na mimi na kunishauri ninapokosea. Sasa naona mambo
yamekuwa mazuri.MVC Karagwe
This means I have seen changes within my family. Before
caregiver came to my home, my mother used to slap me every
time even when I have not done mistake. This resulted for me
stay away from home for quite sometimes. After my family got
counseling services from the caregiver, they have now changed
and they have seen the importance of engaging me in decision
relating to family matters. Things now better so better than it
was before.
The other respondent (MVC) Interviewed reported that she is applauding the
counseling support she received on psychosocial. As when she was attending
her primary education, her life was full of discouragement and punishment
as she was raised with her step mother. So the mother was treating her
37

miserably. But she received the counseling support from the caregiver which
helped her to tolerate any punishment from her step mother. She is now
attending secondary school education and performs better. She had this to
say
Mimi naishi na mama wa kambo baada ya mama yangu
kufariki. Nilipokuwa shule ya msingi mama alikuwa akinitesa na
kunipiga sana kiasi nikawa sina furaha na hata shuleni sikuwa na
amani kabisa. Nilipokutana na mshauri akanipa ushauri na
kunieleza kuwa haya ni mambo ya kupita tu jambo la msingi ni
kuzingatia masomo na kweli hiyo ilinibadili tabia nikaanza
kusoma hadi nikafaulu mtihani na sasa nipo kidato cha pili.
Namshukuru mshauri wangu.-MVC,Maharaka Morogoro
I am currently living with my step mother after the death of my
biological mother. When I was in primary school, my mother
punished me seriously which resulted for me to live unhappy live
both at home and school. After meeting and having counseling
services with the caregiver, she advised me to concentrate with
school and ignore the mistreatment from my mother. The advice
from the caregiver helped to draw me back to my normal life and
also improve my academic performance. I am now in form two.
Many thanks to my counselor.
Although MVC gave out their views on how they see the support they have
been provided with caregivers, the evaluation team wanted also to get the
feelings of caregivers on how they see as changes to MVCs they have been
supporting. When asked if the PSS services they have been providing have
made remarkable changes in the lives of MVCs, majority of them responded
that the PSS have real made changes to majority of children they have been
supporting.
One of the caregiver interviewed supported the statement that she has been
receiving messages in writings and some through sms from MVC and their
parents appreciating the support they have been receiving. One of the
messages was as follows:
Mama umekuwa msaada mkubwa kwangu kwa kipindi hiki
ambacho ni kigumu sana. Nakushukuru kwa kunifanya na mimi
kuwa mtu.MVC, TIKVAH Dodoma
Mother, you have been very supportive during the hard time that
I am passing through. Thanks for making me looking the way I
am.
38

Other caregivers also supported the statement that they have been
observing some changes in the lives of MVCs as there is some of MVC who
dropped from school due to psychological problems. But after receiving the
PSS services they have now drawn back to school, behaviors have changed
and their performance in school has improved. She said
Kwa kweli mimi naona mabadiliko mengi kwa watoto
ninaowapa huduma ya msaada wa kisaikolojia. Wengi wao
walikuwa wameacha shule na wengine walikuwa wapweke baada
ya kuondokewa na wazazi wao jambo lililofanya waache shule.
Baada ya kuwapa elimu ya msaada wa kisaikolojia nimegundua
wameweza kurudi shule na wanasoma vizuri, wanacheza na
wenzao na kwa kweli maendeleo yao ni mazuri sana
darasani.Caregiver, Lindi
This means that I have seen a lot of changes among childrens I
have been supporting through PSS. Before the services, majority
of them dropped from school and some were lonely due to the
death of their parents. After providing them with education on
PSS, I discovered that majority was rolled back to school, they
are interacting with their colleagues and as well they have
improved their academic performance.
Despite all the achievements that resulted from PSS, still caregivers have
been experiencing lots of challenge in ensuring that they provide
comprehensive PSS services hence improving the well being of children. One
of the challenges they have been experiencing at the family level is the
resistance of MVC family members to cooperate with caregivers. Also, some
of the family members have now withdrawn their parental roles to leave it to
caregivers. This is due to the fact that they assume these caregivers were
given financial support to provide to these children and therefore, they have
to take the role of caring for their children. This is an indication that some of
family members are still not aware of what they are supposed to do when it
comes to the issue of caring for their children
Improving MVC Wellbeing through VSI Model
According to HUMULIZA, 2006 the VSI Vijana Simama Imara (Youth stand
firm) is an instrument for enabling children and young people to participate
in finding solutions for their own problems. Children/youths organize
themselves in groups for the purpose of supporting each other socially,
economically and psychologically which helps them to build their self
esteem.
39

Through VSI, youth are encouraged to formulate small groups to invest in


small business which demand little investment e.g. selling small dried fish,
running small kiosk, selling kerosene, raising chicken for selling eggs or
chicken, establish small farms for horticulture farming such as growing
vegetables(Tomato, carrots, Mchicha etc). The money generated from the
small business is then saved through VSI account within Partner
Organization. The VSI saving helps children to cultivate the culture of saving,
and access small loans to facilitate the business that youth are
implementing.
As the initiative to strengthen and ensure sustainability of the PSS services in
the community, SATF PSS Project also introduced the VSI model to its
implementing partners as one of the model they can adapt to continue
supporting children and their families. Through VSI activities in a group,
different activities are conducted (Meetings, training sessions, playing and
singing together) which not only provide a sense of acceptance but also
builds confidence, a common identity and a sense of purpose which relieved
much of the grief and stress. Also VSI creates a range of friendships and the
strong-social cooperation which increase as sense of self respect and social
acceptance.
During evaluation, implementing partners were asked if they ever had an
opportunity to visit at HUMULIZA Organization and learn the VSI Model, some
of implementing partners reported to have an opportunity to visit HUMULIZA
and learn about VSI Model. These includes; NEREFO in Morogoro, MKUKI in
Kilimanjaro and KARADEA in Kagera. When asked how the knowledge they
have acquired from the HUMULIZA VSI model in changing the lives of
children, they were able to give testimonies that the models have real
influenced change among children.
One of the Partners who was interviewed and asked to give experience after
visiting HUMULIZA and acquired the knowledge on the implementation of VSI
model, she was able to say that, she organized youth/children to formulate
small income generating groups whereas through the NGO, these groups
were capacitated to establish small garden (growing vegetables) and some
of the groups were supported to start the bee farming. She said;
Elimu ya VSI niliyoipata kutoka humuliza imenisaidia na
kuniongezea uelewa na sasa nimeweza kuorganize vikundi ya
ujasiriamali. Tumeviwezesha vikundi hivi kuanzisha shughuli za
kuwaingizia kipato. Kabla ya kuanzisha shughuli zao, walipata
mafunzo kupitia mashamba darasa ya mboga na ufugaji wa
nyuki na baada ya hapo tukawawezesha kuanzisha miradi.
40

Mfano kundi la vijana wanaofuga nyuki tuliwawezesha kupata


mizinga 20 ya kunzia na baada ya hapo wajiendeleze wenyewe
kupitia mapato watakayoyapa. Chairperson-NEREFO
The knowledge I have acquired through VSI Model at Humuliza
have helped me to organize and coordinate small
entrepreneurship groups. Before these groups starting their
activities, they were capacitated on how they can sustain their
gardens and thereafter they started implementing the activities.
Some of the groups are growing vegetables, some have the bee
keeping project and some established the poultry project. We
can now see some changes among children and you supported.
Another respondent interviewed also supported the statement that he can
how these children/youth are becoming confident through the self reliance
activities. They get their money, they can sustain their school needs etc.
Kupitia VSI, vijana wameweza kunufaika na wamekuwa jasiri.
Wanapata kipato kinachowawezesha kununua mahitaji yao ya
msingi na wakati mwingine wanasaidia familia zao kwa hicho
kipato kidogo wanachokipata. Chairperson Karadea
Through VSI, children/youth are benefiting on the project and
they are becoming confidents. They are getting a good income
to sustain their school needs and some of the amount to support
their families
When children asked on the VSI model, they were able to support the model as it builds their
confidence, identity and knowledge on how they can depend on themselves through the income
generating activities. They pointed out that some of the things they learnt from the VSI that are
learning to love, respect and working as a team.
VSI imenifunza kuwaheshimu marafiki. Hii pia imetuwezesha
kuheshimiana and kuwa kitu kimoja VSI Member-NEREFO
VSI has taught me respect to my fellows. We respect each other
and cooperate in many things.
Another youth supported that through the VSI groups they learn to love and
be loved
VSI imenifundisha kupenda na kupendwa. Nimefundishwa jinsi
ya kuishi kwa upendo katika jamii na sasa naishi kwa
amaniMKUKI
41

VSI has helped me to learn about love and be loved. I learned


love from the way we members stayed and am now living in
peace and harmony.
Another respondent illustrated that the VSI knowledge he have acquired
have helped him to get income from keeping goat, chicken and doing small
business
Napata kipato kutokana na uzalishaji. Mfano, nafuga mbuzi,
kuku na kufanya biashara ndogondogo na sasa najisikia amani
kutokana na kipato ninachokipa. Pia kupitia semina za VSI,
zimenisaidia kuondoa woga na sasa naweza kuthubutu kufanya
MVC KARADEA
I got an income from producing. For example am producing
through goat keeping, chickens, and other kinds of businesses
which make me feel comfortable. Also through VSI meetings, I
have learned to be confident and eliminate fears.
Mainstreaming of PSS in the core activities of Partner NGOs and District
Mainstreaming is a process that enables the institution to strengthen the way
in which they address the causes and consequences of the problem and
therefore adapting and improving both their existing works and practices.
Mainstreaming requires an understanding of the impact of PSS services
within institutions and the community in general, and adapting development
and humanitarian programmes to respond effectively.
During evaluation, SATF through PSS project has also puts more emphasis
towards responding to the call for incorporating the MVC PSS issues into the
core mandate of their work to every implementing partner. The project
objectives were to ensure that at least every implementing partner
mainstream PSS in their policy and Planning. It is evident during the
evaluation that majority of implementing partners not only mainstreamed
PSS in their planning and budgeting, they are now using the PSS knowledge
to translate some of their activities. Therefore incorporating the PSS issues
in the planning and budgeting is the commitment by the decision making
level in the organization level in terms of committing resources (Human and
financial) towards addressing the PSS problems within the community
It was also noted that, despite the government effort and calls for every
actor to mainstream MVC issues in their core activities and advocacy
meeting held by SATF in promoting the inclusion of PSS issues in planning
and budgeting, at the district level there is still low response. Maybe this is
42

due to lack of commitment of district departmental officials responsible for


planning and budgeting. This call for more advocacy training to ensure all
officials responsible for the planning and budgeting are committing their time
and resources to support MVCs
Community Mobilization
Community mobilization is a strategy for involving community members in
the process of defining and transforming social problems. It also involves
introducing ideas, processes and concrete mechanisms within the
community to raise awareness, inspire action and support positive change. In
the context of PSS, it is a long-term process aimed at creating social change
within the community in order to change the attitudes and behaviors that
perpetuate PSS. While PSS support is the project ultimate goal, community
mobilization involves addressing root issues such as childrens low status,
gender inequity and rights. This work engages a cross section of individuals
from women and men at the grassroots to leaders and local institutions that
exist in the community. The process involves strategic thinking, building
relationships within the community and strengthening the communitys
capacity to respond to PSS.
Experience gained from other Organization working in addressing PSS issues
in Tanzania shows that community mobilization approach is one of the best
approaches to use and address PSS needs as it involves communities at
large. The mobilization can be done through organizing and conducting
family dialogue, community dialogues, public events, community theatre,
video shows and impromptu discussions within their own families and
communities. The ultimate goal of the event is to create dialogue and action
against MVC problems within the community.
One of the major focuses of the SATF implementing partners is to mobilize
community to form different groups ranging from economic, production,
sports and entertainment as a way of enhancing development but as well
participate in PSS activities and therefore address PSS needs. Therefore,
SATF through implementing partners created as many opportunities as
possible to ensure that PSS needs are addressed. They initiated the
community to formulate an economic empowerment groups, sports, theatre
groups whereas these groups were used to discuss PSS issues and address
the needs to children.
Despite all efforts of implementing partners in addressing PSS to the
community through caregivers, majority of children in need are yet to be
reached and this call for partners to allocate more resources to scale up the
project in order to meet the demand of majority of children who are need of
support.
43

3.2.2 Sustainability of the Projects


The team evaluated the project sustainability by looking on how beneficiaries
and other stakeholders were consulted on the objectives from the outset and
whether they agreed with them and remained in agreement throughout the
duration of the programme;
Evidence of continuation of programme element
a) Building the capacity of caregiver through implementing partners
To ensure continuity of the programme even after the donor withdrawal,
SATF PSS project built in the capacity of caregivers in terms of knowledge
and skills where these caregivers continue supporting MVC identified in their
areas. This also ensures continuity but as well as ownership.
b) Mainstreaming PSS activities in to Planning and implementation
of Organization services
Mainstreaming of PSS activities in to planning and implementation of the
Organization services is another potential for sustainability. SATF PSS project
conducted various advocacy meetings with district official and implementing
partners to advocate for the inclusion of PSS issues in their planning and
budgeting. This enhanced commitment among officials and partners to
incorporate PSS into their daily undertakings
c) The Role of TOT in supporting the implementation of PSS services
The evaluation team observed that, the existence of TOT among
implementing partners ensures sustainability of the project. TOTs have been
potential in building the skills and knowledge to caregivers in their operating
areas. Therefore, maintaining these TOTs or continuing mentoring TOT is
potential to continuity of the project.
d) Introduction and implementation of VSI model to partners
The team during evaluation observed that some of the organizations that
adapted the VSI model have remarkably made changes in the lives of MVCs.
As MVC can generate their own income hence satisfies their need (school
needs). This ensures continuity of the project even after withdrawal of the
donor support.
e) Commitment of Partners staff
The team, during evaluation, observed that the SATF/Partners management
has been very supportive to ensure that the project is implemented as
planned. The only challenges majority of partners are facing, are lack of
44

incentives such as allowance to motivate staff and ensure improved


performance to continue supporting MVCs.
Collaborations and Networking
SATF through its PSS project has managed to build partnerships and
networks in the course of its work. These partners include among others,
implementing partners such as NEREFO, TIKVAH, KARADEA, PADI, LISAWE,
MKUKI and other many partners in different Regions. Other partners includes
district local Authority(department of social welfare, community
development, Agriculture, Police gender desk), Local NGOs such as
HUMULIZA, and as well International NGOs such as World Vision in some
areas i.e. NEREFO-Morogoro. The partners are very important in ensuring
sustainability of SATF PSS project in the sense that they also work in
addressing PSS needs in their localities hence share the knowledge and
learning experiences which can assist in its continuity.
3.2.3 Lessons Learnt
Lessons learnt helps to mirror the achievements and problem areas that
need reforms and determine the performance of the project at the level of its
impacts. From the field, the evaluation informed the main dominant lessons
on the aspect of things where the project worked well, and these were as
follows:
Lesson learnt from beneficiaries
The PSS has increased the knowledge with regards to addressing the
needs of children in the areas where caregivers are supporting children
Due to increased knowledge on PSS, in some areas there are also
increased numbers of children who are rolling to school.
Through VSI initiative, Economic groups have been formulated among
youth which have helped them to generate income to support their
needs and families.
The knowledge they have acquired through VSI initiative, have built
self-esteem, confidence, kept
children and youth physically and
psychologically fit and also builds strong convening power to protect
their rights
Linking economic empowerment with PSS education on the elimination
of all forms violence enhanced children to raise their voice to be heard
Lesson learnt from Project
Assessing project progress as well as experiences, lessons learned can
be shared effectively through regular monitoring meetings. This
contributes to the projects effectiveness.
45

Capacity building programme done by the project is a powerful tool


towards successful implementation of the programme. This contributes
to effective implementation and also enhances sustainability of the
project.
Commitment of SATF staff during implementation of the project has
contributed to the success of the programme.
Involvement and participation of partner and beneficiaries in
implementation of activities leads to ownership and successful
implementation of the project
Lesson learnt from Partners
Partnership and networking is the powerful tool for sharing of
knowledge and experience
among partners
hence ensure
comprehensive provision of PSS services
Advocacy meeting is powerful tool towards increasing commitment to
implementation of PSS activities
Mainstreaming of PSS in to planning, budgeting and implementation of
core activities ensures sustainability of the project
3.2.4 Challenges
3.2.4.1 Challenges during project implementation
Lack of incentives to caregivers
One -off funding mechanism to support the project was also a challenge
to implementing partners
No refresher training for implementing partners and caregivers
Low leadership commitment to some of district officials
More MVC still need PSS support. SATF PSS Project covered just part of
MVC in the community compared to existing number
More support other than PSS still needed to majority of MVC
3.3 Performance of the Partners
This criterion assessed how well each partner fulfilled the role expected of
them. The performance of each partner was examined and reported
separately but it is their coordinated and composite performance that
influenced the success or failure of the project.
Briefly follows a one by one account of how these partners faired in terms of
their roles towards supporting the project.
3.3.1 Performance of FCS
It is evident that FCS supported the project as per the agreed terms and
condition. FCS approved TShs.299, 787,000 for three years disaggregated by
46

TShs.100 million for year one, TShs.100 million for year two and TShs.99,
787,000 for year three. It is also evident that during the implementation, the
funds were released on quarterly basis upon receiving the narrative and
financial report of the previous quarter from SATF.
During discussion with FCS team, it was revealed that sometime SATF
delayed in submitting the report both narrative and financial as per the
agreed calendar. This was due to ever adjustment of budget done by SATF
due to increased price and cost of implementing activities. This was also
supported by SATF management that the project budget that was prepared
in 2008 could not feature the price fluctuation and inflation. Therefore they
were compelled to adjust the budget time to time to feature the market
price. This also interferes with the terms and condition that was set before
between FCS and SATF
3.3.2 Performance of SATF
We assessed the extent to which support provided by SATF ensured sound
project design; facilitated participation project beneficiaries; resulted in a
realistic appraisal proposal with an appropriate strategy; supported
implementation effectively; ensured arrangements were adequate during the
implementation of the project, and provided a participatory evaluation,
learning partnerships and adoption of lessons.
Reports from SATF narrative report from May 2009 to September 2012
indicated that several capacity building activities were conducted for
partners. This includes training on PSS to 26 partners, 52 staff from NGOs
implementing partners who were trained as TOTs.
SATF also conducted advocacy training to District heads of departments in all
districts where the project was implemented. The departments included;
community development, Health and social welfare, Education, Police gender
desk and in some areas the agriculture department. It is evident that 260
heads of departments and other departmental staff were sensitized on the
importance of PSS and how to mainstream in to planning and implementing
PSS in their core activities
The other activity conducted by SATF was also to train 260 staff that is 10
staff from each district involved in the implementation of the project (2 staff
from each of the five departments). They were trained on the needs and
commitment to continue supporting the PSS activities through
mainstreaming PSS in to planning and budgeting.
Based on the above assessment from project reports and interviews with
partners, it can be noted that the services provided by SATF were adequate
47

and ensured sound project implementation. Despite the adequacy of the


project, the one support funding mechanism seems to affect the
achievement of the project. The participation of project partners and
beneficiaries in the implementation of the project was also well facilitated.
The timely delivery and adequacy of the services were adequate for the
implementation of the project
3.3.3 Performance of NGO Implementing Partners
Assessment was also done to implementing partners to see their contribution
towards successful implementation of the PSS Project. The role of
implementing partner was to ensure that after receiving training on PSS,
each was instructed to at least select 20 caregivers and provide them with
PSS training. After the training, caregivers were instructed to select five MVC
in their surrounding community.
It is evident that, to most partners where the evaluation team visited
managed to identify 20 caregivers who were then trained on the PSS
specifically the PSS cycle. Also from the SATF reports, it is evident that in all
Districts where the project was implemented managed to train caregivers as
planned. Therefore in all 26 districts, a total of 520 caregivers were trained
on PSS.
The other activity that was conducted by partners was to facilitate in
collaboration with caregivers the identification and selection process of MVCs
to be supported by caregivers. From narrative reports, it is evident that the
project managed to reach the intended number of 2600 MVC that is 100
MVCs served by 20 caregivers from each partner NGOs.
Another activity that was done by partners was to ensure that PSS is
mainstreamed in their core activities. It is evident that majority of partners
visited had mainstreamed PSS in to planning and implementation of their
core activities. Some of partners have gone further to use the PSS knowledge
to transform it to different activities.
Also some few partners used the VSI knowledge which was introduced as
part of the PSS activity to formulate small groups of MVCs and facilitate them
with the capacity to implement an income generating activities. This
increased confidences, identity and trust among children and youth.
4.0 Discussion
It was revealed that the project approach was effective and efficient in
delivering the envisaged outputs. The successful factors that facilitated the
efficiency and effectiveness of the programme included partnerships and
48

collaboration between FCS, SATF, Partner Organization such as NEREFO,


PADI, LISAWE, KARADEA, MKUKI and TIKVAH. Also the partnership and
collaboration created with district officials and beneficiaries ensured
successfully implementation of the project.
Partnership and collaboration among partners increased ownership of the
project. Also SATF management arrangements that are management of
personnel and budget during implementation of the project and involvement
of both beneficiaries during implementation of the project facilitated the
effective and efficient implementation of the project.
The findings revealed that the project had contributed to increasing
knowledge and skills to partners and caregivers on the causal and effect of
denying the rights and needs of children when not properly addressed. It was
also noted that behaviors and attitudes towards support MVCs have
increased among. Due to the increased knowledge and awareness on
addressing the needs and priority of children, there is an observable changes
among children themselves and as well their families. School attendances
have increased to majority of MVCs who previously dropped from school due
to PSS problem.
The findings also found that through PSS Project, partners has been
performing well in addressing PSS problems through different forms such as
establishment of VSI economic empowerment groups where PSS problems
are discussed.
It is also evident that the Project also established the mechanism which
ensures sustainability of the Organization. These are increasing knowledge
and skills through training of caregivers, increased leadership and
commitment of decision makers through advocacy meetings. The PSS project
initiated a good working relationship with partners at all levels.

5.0 Recommendations
The evidence from the evaluation indicated that PSS need not to be a
standing alone project and therefore calls for the inclusion of other seven
needs as outlined in the National Strategy for addressing the needs of
MVC. These includes Food and Nutrition, Shelter, Family based care and
support, Social Protection and security, Primary Health care, Education
and vocational training and household economic strengthening.
Creating Safe Space for Children/Recreational centre: One of the
challenge that have been facing children or MVC in Tanzania is for them to
have enough space for them to share experience, feeling and thoughts
49

about the challenges of life and how to address them. This was also
revealed during evaluation that there is no centre/space where MVC can
share their experiences. This call for SATF to continue supporting partners
on the need to establish safe space for them to meet.
The findings from the evaluation indicated that, despite the fact that SATF
have supported 520 caregivers who are providing services to 2600 MVC in
their community, still the demand is very high as majority of MVCs are yet
to be reached. Therefore, there is need for SATF to scale up the project to
other areas where the project was not implemented. This will ensure
many children are reached and supported.
Continue strengthening coordination, cooperation and relationship with
local authority leaders and partner organization in the operation areas.
This will create a strong working relationship as they understand the
project and build the base for sustainability.
Continues documenting of good practices, case studies and lessons
learned. This will enhance the experiential learning of partners whereby
good practices are continuously built on and improved on an ongoing
basis
Strengthening leadership commitment within the district. It was observed
during evaluation that there is lack of commitment among districts official
to implement the PSS activities. Therefore, commitments from leaders
enhances implementation and continuation of the programme and
ensures allocation of resources in terms of time, finance and human
resources within the district
Encourage motivation for caregivers. The findings from the evaluation
indicated that caregivers have been working on voluntary basis that is
without any support of resources i.e. incentives etc. The provision of
motivation ensure sustainability even after the withdrawal of donor
funding
Encourage full participation of all community members towards
achievement of the SATF PSS overall objectives of increasing knowledge
and awareness on provision of PSS services hence improving MVC
wellbeing. This will promote ownership of the project and enhance
participation of community
Strengthening MVC families with economic empowerment activities. It
was revealed that one of the major drawback facing MVC and their
families is the lack of income to support needs of MVCs despite the
introduction of the VSI model in some areas. Therefore economic
empowerment activities will enhance families with stable income to
support the needs of their children
Continue supporting MVCs through Education project to higher education.
One of the problems observed during evaluation which faces some of
MVCs and results into PSS problem is withdrawal of support (Education
support) especially for those children completing primary education and
50

need to continue with secondary education or higher education. This has


been affecting psychologically majority of children. SATF should look on
the means to continue supporting these children to their higher education
in order to continue addressing PSS needs.
It is evident from the evaluation that SATF had a one off funding support
mechanism to partners. This is in one way or the other could affect the
achievement of the project. This calls for SATF to set mechanism that
ensures continuity of funding support instead of supporting once and for
all.

Annexes
Annex 1: List of Respondents Iinterviewed at Partners Level
SN
Name
Title
NGOs
1

Isihaka Msingwa

CEO

PADI

Rachel Sephen

Programme Manager

Mrs Mlay

Director

Dr. Minja

Programme Manager

M/s Milenia

Executive Secretary

Karadea

Rev.
Alphonce
Mushenyela

Mrs Winfrida

Executive Chairperson

NEREFO

Caroline Kisinza

Chairperson

Huruma
Women Group

Necksan William

Chairperson

TIKVAH

MKUKI

51

10

Prisca Hunga

Secretary

LISAWE

11

Asha Fundi

Chairperson

LISAWE

52

Annex 2: List of Consultants and Data Collectors involved in the


assignment
SN
Name
Title
1

Fredrick Ananga

Team Leader

Patrick
Kanyamwenge

Co-Team
Leader

Sarah Pambe

Data
Collection

Edna Barongo

Data
Collection

Michael Sigstance

Data
Collection

Amini Mikidadi

Data
Collection

53

Annex 3: Data Collection Tool


SOCIAL ACTION TRUST FUND
End of Evaluation for Rolling Out of Psychosocial Support Capacity
Building Project
SATF has been implementing a three years Psychosocial Support (PSS) Capacity
Building Project in 21 Districts in 12 Regions from 2009-2012. The project was
funded by Foundation for Civil Society and it builds upon PSS Project which was
implemented in 2008 with funds from the same Organization.
The Project goal was to contribute to the improvement of the wellbeing of Orphans
and vulnerable children in Tanzania. This was done through enabling care givers at
the grassroots level to use a practical M&E tool to provide PSS services to MVC. The
project also build the capacity of partner NGOs in providing training to care givers
to increase their understanding of OVCs psychosocial problems and offer them
better assistance and enable partner NGOs to mainstream PSS in their policies,
planning and interventions.
As the project is reaching its end January 2013, SATF has planned to conduct final
evaluation of the PSS project and AMCA INTER-CONSULT LTD has been contracted to
undertake the assignment which include assessing the impact and achievement as
a result of project implementation.
Therefore, the attached questionnaire seeks specific information pertaining to your
knowledge and understanding of the PSS project and also your views and
recommendation for improving the project in future.
We are therefore requesting you to participate in this important assignment. The
discussion will take not more than 30 minutes. However we assure you that all the
information provided in this questionnaire will remain confidential and we guarantee
complete anonymity. It is our expectation that you have decided on your own
without any pressure to participate in this assignment.
We would like to thank you very much for your cooperation.

Would you
participate?

be

willing

to
Yes

No
54

If you have any doubts or questions please contact SATF Programme


Manager- Mr. Nicholous D.Ndenzako: 0713083907/0788 399 940
Thank you.

Key informant tool for SATF Staff, Partner NGOs and District Official

(District Executive Director, Community development officer, Social


Welfare Officer, Education officer, Gender Desk Officer-Police Force, NGOs
Heads, TOT, SATF staff and management)
SATF Management and Staff
Introductory session:
When did this project start?
What is the coverage of the project?
Who are the beneficiaries?
How many beneficiaries were reached by this project? (Direct; NGOs staffTOT, district officials and care givers who received training on PSS from SATF
and indirect are those community members who received training from direct
beneficiaries)
1) Relevance
Relevance of the project with respect to specific needs and relevance to
country strategy for improving the wellbeing of Orphans and vulnerable
children in Tanzania

How were you involved in the formulation of the project?


_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________________________________________

How beneficiaries (NGOs, Care givers and District officials) were engaged
from the beginning of the project and end?

The engagement includes the identification process of


MVC to be supported, specific services provided,
recommendation on the best ways of supporting these
MVCs and as well barriers if any

___________________________________________________________________________
___________________________________________________________________________

55

___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
_____________________________

Did the project achieve what it set out to achieve? If yes, How?(Probe to
get more information)
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
_____________________________
How are the implemented interventions responding to the needs and
priorities of most vulnerable children?
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________
How did implementing partners contribute towards SATF projects goal
(Building the capacity of partner NGOs in PSS so that they can provide PSS
to MVC hence improving their wellbeing)? If yes, How? (Probe to get
more information: Probe more on their supervisory roles and
provision of technical assistance to care givers)
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________
Did the project contribute to any Government policy? If yes, How? (Probe
to get more information on the contribution of the project to
relevant MVC national documents such as Laws, Policies,
Strategies and Plans)
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
_____________________________
2) Effectiveness
Extent to which project realized outputs and results as set out in the log
frame

Did the interventions objectives respond to the needs and


priorities? If yes, how? Probe to get more information
56

_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________
Were the objectives of the project clear? Please elaborate
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
Were the planned and implemented activities sufficient to achieve
the objectives/Output? If yes, how? Please explain
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
What factors influenced the achievement or non achievement of the
objectives/outputs?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________
Do you think the project achieved the intended objectives? If yes,
how could it have been done differently?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________
Did the project have any monitoring and evaluation framework? If
yes, how often was this changed if ever changed? What reasons
necessitated the changes?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________

3) Efficiency

Extent to which project inputs (resources) affected implementation.


57

Can you explain how the project was managed? Do you think this affected
the project implementation in any way? (explain) How could it have been
made better?
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
_
Do you think SATF project management/staffs were appropriate for the
task? (Probe for training, qualification, attitude, remuneration/motivation
etc)
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___
Was the project cost effective? Were the project funds managed
satisfactorily? (explain) How could it have been made better? Were the
project funds sufficient? Were funds released on time as planned? (Probe
for any bottlenecks)
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___
Did the project reach the expected number of beneficiaries? Were they
involved in project management? Was this beneficial? (Probe for any
difficulties experienced), were beneficiaries satisfied with the quality and
delivery of services? What would have been done differently to meet their
expectations?
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___
How do you see the working relationship between SATF, Partner NGOs and
Government officials/district (good, poor, bad, very good) and other
partners
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___
Were there any observable risks during implementation? If yes, how were
they managed or anticipated?
___________________________________________________________________________
___________________________________________________________________________

58

___________________________________________________________________________
________________________________________________________________________
4) Impact
What change did the project bring to children who are the most affected
groups and the community in general?

To what extend did the project address the target group? Was the
coverage adequate as per plan/objective? (Probe on how the
identification and selection process of care givers who were
trained to provide PSS was conducted).
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________

What change has occurred to community members and


beneficiaries in the course of implementation of the project?
Probe on how the project increased knowledge and
awareness of PSS among partner Organizations and
District staff
Probe on how the project improved service delivery
approaches among children
Probe on how the project improved livelihood of MVCs
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________
To what extent do you attribute this change to the project?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________

5) Sustainability
Potential avenues for project continuation after donor withdrawal

Is the project sustainable? If yes, what measures are in place for


sustainability of the project after donor support? Probe for more
information.
59

_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________
Did the Organization create Potential Avenue for continuity after the
end of donor support? If yes, Give examples
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
For partner NGOs
Consider those NGO supported in year 1 of implementation
(MKUKI in Moshi Rural Kilimanjaro),
Consider those NGO supported in Year 2 of implementation
(NEREFO in Morogoro Rural-Morogoro and KARADEA in
Karagwe-Kagera)
Consider those NGO supported in Year 3 of implementation
(Huruma Women Group in Dodoma Municipal-Dodoma,
LISAWE in Lindi Municipal-Lindi and PADI in SongeaRuvuma)

_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________
Was there a sustainability plan drawn beforehand? If yes, please
share with us if any.
This includes also mainstreaming of PSS issues in the
core mandate of the partner organizations and district
plans
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________________________________________

60

To
what
extent
did
you
collaborate
with
other
partners/stakeholders? Can this contribute towards project
sustainability? Give examples.
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________________________________________

6) Lessons learnt
What lessons do we learn from this project that can be adopted to
implement future programmes

Did the project change any of its strategies at any stage? If yes,
what are the reasons that led to these changes? Can these changes
provide useful lessons for application elsewhere?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_________________________________________________________
To what extend did the project design change based on lessons
learned during implementation?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________
Any lessons learned from the project?
Also ask about the lessons learnt from the study tour
to HUMULIZA-VSI Model
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_________________________________________________________

7) Potential for replication

Explore possible replication of project innovations61

Did the project have any innovations during implementation? If yes,


please give examples. Can these be replicated elsewhere?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________

Partner Organization
Introductory session:
When did this project start?
What is the coverage of the project? (Probe for more information on PSS
interventions that was supported by SAFT in their implementing areas)
Who are the beneficiaries?
How many beneficiaries were reached by this project? (Probe for more
information on those care givers who
received training on PSS from
Implementing partners and MVC reached by care givers)
1) Relevance
Relevance of the project with respect to specific needs and relevance to
country strategy for improving the wellbeing of most vulnerable children in
Tanzania

How were you involved in the formulation of the project?


62

_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________________________________________
How beneficiaries (Care givers and MVC) were engaged from the
beginning of the project and end?

The engagement includes the identification process of


MVC to be supported, specific services provided,
recommendation on the best ways of supporting these
MVCs and as well barriers if any

___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
_____________________________

Did the project achieve what it set out to achieve? If yes, How?(Probe to
get more information)
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
_____________________________
How are the implemented interventions responding to the needs and
priorities of most vulnerable children?
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________
How did implementing partners contribute towards SATF projects goal
(Building the capacity of partner NGOs in PSS so that they can provide PSS
to MVC hence improving their wellbeing)? If yes, How? (Probe to get
more information: on their supervisory roles and provision of
technical assistance to care givers)
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________

63

Did the project contribute to any Government policy? If yes, How? (Probe
to get more information on the contribution of the project to
relevant OVC national documents such as Laws, Policies,
Strategies and Plans)
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
_____________________________
2) Impact
What change did the project bring to children who are the most affected
groups and the community in general?

To what extend did the project address the target group? Was the
coverage adequate as per plan/objective? (Probe on how the
identification and selection process of care givers who were
trained to provide PSS was conducted).
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________

What change has occurred to community members and


beneficiaries in the course of implementation of the project?
Probe on how the project increased knowledge and
awareness of PSS among partner Organizations and
District staff
Probe on how the project improved service delivery
approaches among children
Probe on how the project improved livelihood of OVCs
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________
To what extent do you attribute this change to the project?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________

64

_____________________________________________________________________
___________________________________________________________
3) Sustainability
Potential avenues for project continuation after donor withdrawal

Is the project sustainable? If yes, what measures are in place for


sustainability of the project after donor support? Probe for more
information.
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________
Did the Organization create Potential Avenue for continuity after the
end of donor support? If yes, Give examples
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
For partner NGOs
Consider those NGO supported in year 1 of implementation
(MKUKI in Moshi Rural Kilimanjaro),
Consider those NGO supported in Year 2 of implementation
(NEREFO in Morogoro Rural-Morogoro and KARADEA in
Karagwe-Kagera)
Consider those NGO supported in Year 3 of implementation
(Huruma Women Group in Dodoma Municipal-Dodoma,
LISAWE in Lindi Municipal-Lindi and PADI in SongeaRuvuma)

_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________
Was there a sustainability plan drawn beforehand? If yes, please
share with us if any.

65

This includes also mainstreaming of PSS issues in the


core mandate of the partner organizations and district
plans
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________________________________________
To
what
extent
did
you
collaborate
with
other
partners/stakeholders? Can this contribute towards project
sustainability? Give examples.
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________________________________________

4) Lessons learnt
What lessons do we learn from this project that can be adopted to
implement future programmes

Did the project change any of its strategies at any stage? If yes,
what are the reasons that led to these changes? Can these changes
provide useful lessons for application elsewhere?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_________________________________________________________
To what extend did the project design change based on lessons
learned during implementation?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________
Any lessons learned from the project?
Also ask about the lessons learnt from the study tour
to HUMULIZA-VSI Model

66

_____________________________________________________________________
_____________________________________________________________________
________________________________________________________________
What are your recommendations for improving the programme in
future?

District Official
1) Relevance
Relevance of the project with respect to specific needs and relevance to
country strategy for improving the wellbeing of most vulnerable children in
Tanzania
Have you ever heard about the PSS project? If yes, what have you heard
or what do you know about the project?
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________

How were you involved in the formulation of the project?


_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________________________________________
67

How beneficiaries (Implementing partners and MVC) were engaged from


the beginning of the project and end?

The engagement includes the identification process of


OVC to be supported, specific services provided,
recommendation on the best ways of supporting these
OVCs and as well barriers if any

___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
_____________________________

How are the implemented interventions responding to the needs and


priorities of most vulnerable children? (district officials will be asked
this question if they were engaged in implementation)
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________
Did the project contribute to any Government policy? If yes, How? (Probe
to get more information on the contribution of the project to
relevant OVC national documents such as Laws, Policies,
Strategies and Plans)
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
___________________________________________________________________________
_____________________________
2) Impact
What change did the project bring to children who are the most affected
groups and the community in general?

To what extend did the project address the target group? Was the
coverage adequate as per plan/objective? (Probe on how the
identification and selection process of care givers who were
trained to provide PSS was conducted).
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________
68

What change has occurred to community members and


beneficiaries in the course of implementation of the project?
Probe on how the project increased knowledge and
awareness of PSS among partner Organizations and
District staff
Probe on how the project improved service delivery
approaches among children
Probe on how the project improved livelihood of MVCs
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________
To what extent do you attribute this change to the project?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________

3) Sustainability
Potential avenues for project continuation after donor withdrawal

Is the project sustainable? If yes, How? Probe for more information.


_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________
Did the District have any potential avenue to support the continuity
of the project after the end of donor support? If yes, Give examples
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
_____________________________________________________________________
_______________________________________________________
Was there a sustainability plan drawn beforehand? If yes, please
share with us if any.
69

This includes also mainstreaming of PSS issues in the


core mandate of the partner organizations and district
plans
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________________________________________
To
what
extent
did
you
collaborate
with
other
partners/stakeholders? Can this contribute towards project
sustainability? Give examples.
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________________________________________

4) Lessons learnt
What lessons do we learn from this project that can be adopted to
implement future programmes

Any lessons learned from the project?


_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________________________________________
Any challenges

_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
Any recommendation for future improvement of the programme
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________
70

Guiding questions for duty bearers


(Caregivers of the children who received PSS training, children:
MVC, parents/guardians/Teachers, Religious leaders, Community
leaders-VEO, WEO, and Councilor)
NB: The highlighted category were not part of the project, but
since the project was focusing on building capacity of NGOs
working to support MVCs, this category are key to this
evaluation therefore, they might be asked to respond on how
they see the impact and potential of the project in the
implementation area
1) Relevance

Are you aware of SATF/(name of the Partner NGO) project that


focused on building the capacity of NGOs, district officials and
caregivers to implement PSS hence improving the wellbeing of
MVC? (Probe for more information on);
Improving skills of care givers before and after the
training
PSS Problems/needs related to children (i.e. emotional
needs, social needs, intellectual needs, spiritual needs
and physical needs)
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
Did the SATF/ (name of partner NGO) project contribute to improve
the wellbeing of MVCs in this area? If yes, how? If not why?
(explain)
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
71

What change did the project bring to children (MVCs) and other
community members in terms of improving the wellbeing of MVCs in the
community? Probe for changes in terms of;
Emotional change
Social change
Intellectual change
Spiritual change
Physical change

_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________

Were the beneficiaries (At this level we mean MVCs who received
support from care givers) engaged from the beginning to the end of
the project? If yes, please explain how they were engaged?
The engagement includes the identification process of
MVC to be supported, specific services provided,
recommendation on the best ways of supporting these
MVCs and as well barriers.
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________

2) Impact

To what extent did the project address the target group?


_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
__________________________
What change has occurred to community members and
beneficiaries in the course of implementation of the project?
Probe on how the project increased knowledge and
awareness of PSS among care givers
Probe on how the project improved service delivery
approaches among children
Probe on how the care givers supported MVCs to
improve live s
72

_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
To what extent do you attribute this change to the project?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
3) Lessons learnt
What lessons do we learn from this project?
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
___

Any challenges faced in the course of implementing your roles.


What could be done differently to improve the service delivery

_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
What are your recommendations for future improvement of the
programme?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
____________________________
For Children: Who received the direct PSS support from care givers
Consent form
SOCIAL ACTION TRUST FUND

End of Evaluation for Rolling Out of Psychosocial Support Capacity


Building Project
To be consented by Guardian or parents with assistance of the consultant

73

SATF has been implementing a three years Psychosocial Support (PSS) Capacity
Building Project in 21 Districts in 12 Regions from 2009-2012. The project was
funded by Foundation for Civil Society and it builds upon PSS Project which was
implemented in 2008 with funds from the same Organization.
The Project goal was to contribute to the improvement of the wellbeing of Orphans
and vulnerable children in Tanzania. This was done through enabling care givers at
the grassroots level to use a practical M&E tool to provide PSS services to MVC. The
project also build the capacity of partner NGOs in providing training to care givers
to increase their understanding of OVCs psychosocial problems and offer them
better assistance and enable partner NGOs to mainstream PSS in their policies,
planning and interventions.
As the project is reaching its end January 2013, SATF has planned to conduct final
evaluation of the PSS project and AMCA INTER-CONSULT LTD has been contracted to
undertake the assignment which include assessing the impact and achievement as
a result of project implementation.

Confidentiality and consent: I would like to ask your children some few
questions about the support he/she has received from care giver. His/her
answers will be completely confidential. His/her name will not be written in
this form, and will never be used in connection with any of the information
he/she tell me. Her/his participation to this assignment is voluntary and
therefore the child may respond or reject to any questions that will be asked.
However, her/his response to these questions will help us better understand
the impact of the support she/he has received from the caregiver. The
interview will take about 20 minutes. Would you be willing to allow and
consent for your children to participate in this important assignment?
Yes ___________________________________________________________(Signature of
interviewer certifying that informed consent has been given verbally by
respondent)
No ____________________________________________________________ (If no please
look for replacement of other respondent)
N
o

1.

Question /Issue

Techniques
for
interviewing
children and documentation
Introduction
What is the evaluation is all about?
How long it will take. Do the children
consent to take part?
Throwing a ball and introducing
themselves/ Kurudishiana mpira
Have you received any support Raise up of hands/Kuonyesha
from care givers? If yes, what vidole (to capture number of those
support did you receive from care who know about the support they were
givers? Probe for the support provided )
74

related to PSS services


NB: For children directly received
who PSS support (Probe on
the following)

Brainstorming
(to
capture
information to what extent and how
they have received the support from
care givers
Dala dala (capture numbers of those
who mention in support of same
responses)

Ice break at the beginning, in


the mid and at the end of the
discussion

Song/dance by children/ throwing a


ball and other ice break as may be
instructed by the field team

Emotional support
Social support
Intellectual support
Spiritual support
Physical support

2.

Did the support you receive from


care givers in any way change
your life? If yes, how did the
support change your life?
NB: For children directly received
who PSS support (Probe on
the following):

Brainstorming impact at individual


level(This might be went back to
school, given school uniform, given
food at school etc)
Dala dala (capture numbers of those
who mention in support of same
responses received from care givers
Probe for
changes before and changed their lives)
after receiving the support from Brainstorming for each on what form
care givers
of assistance gained from caregiver if
Probe for changes in terms of;
any.

3.

Emotional change
Social change
Intellectual change
Spiritual change
Physical change

What lessons do we learn from


the support you received from
care givers? Document any
story from children
NB: This can be positive or
negative
What could be done differently to
improve the support?
What are your recommendations

Song/dance by children

Look
for interesting
quotations if any.

cases

and

Brainstorming; note down responses


on flip chart if the chart will be
available

Brainstorming; note down responses


on flip chart if the chart will be
available
Then vote then comment

For parents or guardians with MVC who received PSS support


Have you received any support from care givers? If yes, what
support did you receive from care givers? Probe for the support
related to PSS services
Emotional support
75

Social support
Intellectual support
Spiritual support
Physical support
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
Did the support you receive from care givers in any way change
your family life/children? If yes, how did the support change your
life? Probe for
Probe for changes before and after receiving the support from care
givers
Probe for the changes in terms of
Emotional change
Social change
Intellectual change
Spiritual change
Physical change

_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
What lessons do we learn from the support you received from care
givers? Document any story from Parents/guardian

NB: This can be positive or negative


_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
What are your recommendations for future improvement of the
programme?
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
_____________________________________________________________________
___________________________
76

77

Anda mungkin juga menyukai