2. Yale Program for Recovery and Community Health, Department of Psychiatry, Yale
Address of correspondence:
Page 1 of 20
Abstract
interventions. For this reason, some mental health anti-stigma campaigns offer prior
The main objective of this work is to understand the impact that the training
activists was used for this study. A total of thirty-nine participants were included in the
longitudinal calculations. Twenty-seven participants did not complete the total training
found with basal internalized stigma, meaning greater changes in those participants with
Our results show the importance of addressing the internalized stigma in this type
of training, since it seems a feature that has a great interaction with the well-being of the
participants, and thus their recovery process, which is their greatest weapon to overcome
stigma.
Wellbeing
Page 2 of 20
Introduction
The fight against the stigma of mental illness, and especially the interest on the
evidence of the impact of anti-stigma interventions, has blossomed in the last 15 years (Link
& Stuart, 2017). Global programmes such as Opening Doors (Gaebel & Baumann, 2003;
Stuart & Sartorius, 2017); and local ones such as Like Minds, Like Mine in New Zealand
(Vaughan & Hansen, 2004); Time to Change in England, UK (Evans-Lacko, Corker, Williams,
Henderson, & Thornicroft, 2014; Henderson et al., 2012; Henderson & Thornicroft, 2009);
See Me in Scotland, UK (Mehta, Kassam, Leese, Butler, & Thornicroft, 2009); Opening Minds
in Canada (Stuart et al., 2014a, 2014b); Obertament in Catalonia, Spain (Aznar-Lou, Serrano-
Blanco, Fernández, Luciano, & Rubio-Valera, 2015; Rubio-Valera, Aznar-Lou, et al., 2016;
Svensson, 2016); One of us in Denmark (Bratbo & Vedelsby, 2017); or See Change in Ireland
(Coyle, Lowry, & Saunders, 2017); have disseminated a wide range of evaluations on the
The interventions carried out by these campaigns, could be broadly classified into
mass media social marketing, and those targeted on specific groups, including educational
workshops and/or contact with (ex)service users. However, there may be some overlap
between these two broad categories, as many media campaigns use service users’ videos
for their spots. That is, in both cases the true characteristics of the people who have
overcome a disorder and their recovery history are made visible. Mass media interventions
appear to be efficacious to reduce prejudice, but effects on discrimination are not clear
(Clement et al., 2013). Regarding targeted interventions, although evidence tends to point
Page 3 of 20
that contact has a higher impact than educational interventions at reducing stigma for
adults (Corrigan, Scott Morris, Michaels, Jennifer Rafacz, & Rüsch, 2012; Griffiths, Carron-
Arthur, Parsons, & Reid, 2014), the opposite pattern seems to apply for adolescents
(Corrigan et al., 2012). In addition, there is still not enough evidence of the persistence of
Although these results are difficult to interpret given the wide heterogeneity of
interventions and sociocultural differences in the populations in which they are applied,
there is a strong interest in improving the quality of contact-based interventions. For this
reason, campaigns such as Obertament offer prior training to their "first-person" activists,
with the aim that messages, whether in mass media or in face-to-face activities, may have
a greater impact.
mobilisation in mental health, impacts not only aspects of identity as in other types of
activism, but also the well-being of participants (Montague & Eiroa-Orosa, 2017). Activism
For all the aforementioned reasons, after several evaluations of the impact of its
Aznar-Lou, et al., 2016; Rubio-Valera, Fernández, et al., 2016), the Catalan alliance against
stigma, the main objective of this work is to understand the impact that the training
activities have on the activists. We have decided to operationalize this exploration around
the concepts of well-being (as opposed to psychological distress) and internalized or self-
Page 4 of 20
stigma. This last variable has been chosen since our perception is that the training not only
improves the communication skills and the knowledge of the activists, but also reduces the
Methods
stigmatised group without the voice of the members of that group. For this reason, the
Obertament training for mental health “first person” activists intends to empower people
who have had an experience of severe mental distress, so they can be themselves who lead
the action against their stigma and discrimination. The project aims to weave a network of
activists against stigma by means of training activities and coordination with target groups
such as journalists, police officers or physicians. Developing the project in this way, the
Valera, Serrano-Blanco, & Sabés Figuera, 2015) leading to a social participation movement.
technician together with the media and spokespersons technician, and consists of four six-
hour training sessions. The training's main objective is to provide the necessary skills to
carry out the fight against stigma and discrimination through the story of one's own
experience. The training has been divided into three blocks: introduction, awareness and
communication:
During the introductory block, relevant concepts in mental health, stigma and
discrimination are addressed. In addition, work with the perception of these three
Page 5 of 20
concepts is done to visualize and identify the various manifestations of discrimination
and stigma.
The awareness block reflects on the various strategies to combat stigma and
discrimination. The work with life stories as a tool for oral rapporteur's own experience
is initiated. Likewise, activists are prepared so that they can carry out and stimulate
awareness activities.
The communication block focuses on the mass media as a specific target for
sensitization and as a tool to spread the fight against stigma and normalise the vision of
mental disorders.
Participants
A convenience sample of 68 activists in training was used for this study. Eligible
participants had been voluntarily enrolled in the Obertament trainings through their
website, distribution email list or related first-person associations. All participants of five
editions of the course carried out in four different locations in Catalonia (Barcelona twice,
Sabadell, Berga and Amposta) were offered to participate in the study. All participants
signed informed consent and were given information about the study. The protocol of the
Measures
For this study we used the Internalized Stigma of Mental Illness Inventory (ISMI,
Ritsher, Otilingam, & Grajales, 2003), to measure self-stigma. The Spanish version if the
Page 6 of 20
inventory contains 29 1-4 Likert-scaled items. The different subscales of this instrument
and Stigma Resistance. This scale is considered the gold standard for the measurement of
internalized stigma in the world, having been translated into more than 50 languages (Boyd,
The Pemberton Happiness Index (PHI, Hervás & Vázquez, 2013), a 21-item scale was
used to measure eudemonic, hedonic, social and recently experienced wellbeing. The
eudemonic, hedonic and social constructs and Experienced wellbeing (PHI-EW), more
related to concrete events. The PHI-RW is made of 11 questions, scored on a 10-point Likert
scale. The PHI-EW comprises 10 dichotomous (‘yes’, ‘no’) questions that measure wellbeing
in the preceding 24 hours. This scale was chosen because of the naturalness with which it
Procedure
before the first day of training and then again after the last. From an initial pool of sixty-
calculations. Twenty-seven participants did not complete the total training schedule and
were only included in cross-sectional baseline calculations. Finally, one participant did not
attend the first session and another did not agree to complete all the questionnaires and
Page 7 of 20
Analyses
A description of the sample was carried using frequencies, means and standard
deviations. The whole sample of participants was used to compare wellbeing and self-
stigma scores between those who completed the schedule from those who not. Regarding
longitudinal calculations, with the aim of achieving the main objective of this study, paired
samples t-tests were performed using the entire sample of participants who completed the
training. Changes in self-stigma and wellbeing were correlated using Pearson’s r. Aiming to
further analyse baseline internalized stigma interaction with the effect of the training on
wellbeing, two groups were created. Participants were divided according to their basal level
of self-stigma using the median of this score in our sample (1.88). Sociodemographic
characteristics were compared between these groups using Chi squared tests and t-tests. A
repeated measures general lineal model (GLM) was used to determine the interaction of
Results
Baseline characteristics
The mean age of participants was forty-five years of age. Fifty-seven per cent of the
participants were women, 69.1% did not have couple, 41.8% were living alone (vs. 25% with
family of origin and 32.4% with own family), 47.8% had university studies, 55.9% were paid
a disability pension and 52.2% identified themselves as middle class (mean=3.16, range 1-
5). Baseline outcome scores were compared between completers and non-completers
completers=6.07±2.23, range 2-10), although the effect size found was low (t=2.224,
Page 8 of 20
p<0.05, d=0.548, r=0.264). The correlation between the total scores for wellbeing and self-
stigma was r=-.604 (p<.0001) and r=-.622 (p<.0001) respectively for the whole sample and
by baseline level of internalized stigma. The same calculations were done for those who
completed the whole training schedule. In addition to similar differences regarding baseline
wellbeing, results within this group showed statistical differences regarding employment,
with 42.3% of participants receiving a disability pension in the ‘low’ versus 57.7% in the
‘high’ group (OR=.22. 95%C.I.=.049-.993, p<.05) and age (‘low’ M=44.52±8.62, ‘high’
Longitudinal calculations
Results of the related samples t-tests can be seen in table 2. Statistical significant
differences were found for the total score of Internalized Stigma as well as for Alienation,
wellbeing were found to be statistically different. Correlations between the changes of self-
stigma and wellbeing scores yielded statistical significance just for the reduction of
Alienation with experienced (r=.364, p<.05) and total (r=.413, p<.001) wellbeing, with
The time by baseline internalized stigma group interaction can be seen in figure 1.
Time by group interaction was found for Remembered (F(1,37)=4.409, p=.043, ηp2=.106),
Page 9 of 20
but not for experienced (F(1,37)=1.522, p=.225, ηp2=.040) and total wellbeing
Discussion
To our knowledge this is the first study evaluating the impact of a mental health
educated, middle class, single people receiving a disability pension. Completion was
groups, although differences in employment status and age were found between those
groups when just taking into account participants who have completed the training
especially Alienation, and Discrimination Experience but also Stereotype Endorsement, and
its total score) and wellbeing (including Experienced and Total scores) for the whole sample.
further analysis of time by group interaction showed how the group of participants with
lower levels of baseline internalized stigma remained at the same levels, while their
The implications of this study are manifold. On the one hand baseline experienced
wellbeing could be understood as a mild predictor of course dropout. The lack of vital
enjoyment could lead to a lack of motivation for some participants. Lack of enjoyment has
classically been identified as a risk factor for dropout in a wide range of activities such as
Page 10 of 20
sports (Crane & Temple, 2015). However, with the information we have, although we know
that the general level of vital enjoyment was lower in this group of participants, we cannot
know if the reason for their abandonment was because they also found no enjoyment in
On the other hand, alienation feelings play a key role in the experience of becoming
a mental health activist, as can be seen in the great decrease in the alienation subscale and
its interaction with wellbeing increase. Indeed, the interaction between alienation and
wellbeing has been studied in relation with the mediational effect of resilience. For
instance, Ifeagwazi, Chukwuorji, & Zacchaeus (2015), found that resilience might buffer the
that a process of social participation, in which participants can speak openly about the
prejudices on the very problem that has caused their alienation, decreases the latter while
It also seems important to take into account the need to address the initial levels of
internalized stigma in this type of training, since this feature has a great interaction with the
increase of well-being among the activists. The fact that participants with higher levels of
self-stigma increased their well-being more clearly has to be analyzed in light of the
different pattern for Remembered and experienced wellbeing. Within participants with
lower levels of self-stigma, Remembered wellbeing did not change unlike their counterparts
with higher levels. In contrast, experienced wellbeing increased in both groups. Somehow
we could understand that the ability to change deep visions of our worldviews, ourselves
and our relationships with others has a non-linear relationship with wellbeing (Helgeson,
Page 11 of 20
Reynolds, & Tomich, 2006). That is to say, it is necessary to be in a moment though enough
to ask certain questions, but not so much as to find ourselves completely blocked. However,
the increase in well-being-enabling daily activities is probably due to the training itself, as it
We should also discuss the limitations of this study. As in many similar contexts, the
design used did not allow us to extract causal relationships. Nevertheless, adding a
randomization would not only have been logistically complicated, since, as can be seen by
the dropout rate, it is difficult to keep the participants of these courses, but would also
question the spirit of the Obertament alliance. Our goal was to ensure that these training
activities, in addition to providing activism tools, help to decrease self-stigma and increase
well-being, and to explore the interaction between these two variables. We did not aim to
demonstrate the effectiveness of these training activities, since they are not considered a
treatment or intervention.
Finally, we consider it important that campaigns against stigma at the global level
should adequately analyze not only the skills that their activists acquire, but also
References
Aznar-Lou, I., Rubio-Valera, M., Serrano-Blanco, A., & Sabés Figuera, R. (2015). [Impact of
Públiques (IVÀLUA).
Page 12 of 20
Aznar-Lou, I., Serrano-Blanco, A., Fernández, A., Luciano, J. V., & Rubio-Valera, M. (2015).
Boyd, J. E., Adler, E. P., Otilingam, P. G., & Peters, T. (2014). Internalized Stigma of Mental
231. http://doi.org/10.1016/j.comppsych.2013.06.005
Bratbo, J., & Vedelsby, A. K. (2017). ONE OF US: The National Campaign for Anti-Stigma in
Denmark. In The Stigma of Mental Illness - End of the Story? (pp. 317–338). Cham:
Clement, S., Lassman, F., Barley, E., Evans-Lacko, S., Williams, P., Yamaguchi, S., …
Corrigan, P. W., Scott Morris, P. B., Michaels, P. J., Jennifer Rafacz, M. D., & Rüsch, N.
http://doi.org/10.1176/appi.ps.005292011
Coyle, K., Lowry, S., & Saunders, J. (2017). See Change: The National Mental Health Stigma
Reduction Partnership in Ireland. In The Stigma of Mental Illness - End of the Story?
3-319-27839-1_19
Page 13 of 20
Crane, J., & Temple, V. (2015). A systematic review of dropout from organized sport
among children and youth. European Physical Education Review, 21(1), 114–131.
http://doi.org/10.1177/1356336X14555294
Evans-Lacko, S., Corker, E., Williams, P., Henderson, C., & Thornicroft, G. (2014). Effect of
stigma among the english population in 2003-13: An analysis of survey data. The
Gaebel, W., & Baumann, A. E. (2003). Interventions to reduce the stigma associated with
severe mental illness: Experiences from the open the door program in Germany.
Griffiths, K. M., Carron-Arthur, B., Parsons, A., & Reid, R. (2014). Effectiveness of programs
http://doi.org/10.1002/wps.20129
Hansson, L., Stjernswärd, S., & Svensson, B. (2016). Changes in attitudes, intended
71–79. http://doi.org/10.1111/acps.12609
Helgeson, V. S., Reynolds, K. A., & Tomich, P. L. (2006). A meta-analytic review of benefit
finding and growth. Journal of Consulting and Clinical Psychology, 74(5), 797–816.
Page 14 of 20
http://doi.org/10.1037/0022-006X.74.5.797
Henderson, C., Corker, E., Lewis-Holmes, E., Hamilton, S., Flach, C., Rose, D., … Thornicroft,
457. http://doi.org/10.1176/appi.ps.201100422
Henderson, C., & Thornicroft, G. (2009). Stigma and discrimination in mental illness: Time
6736(09)61046-1
Hervás, G., & Vázquez, C. (2013). Construction and validation of a measure of integrative
well-being in seven languages: the Pemberton Happiness Index. Health and Quality of
Link, B. G., & Stuart, H. (2017). On Revisiting Some Origins of the Stigma Concept as It
Applies to Mental Illnesses. In The Stigma of Mental Illness - End of the Story? (pp. 3–
27839-1_1
Mehta, N., Clement, S., Marcus, E., Stona, A.-C., Bezborodovs, N., Evans-Lacko, S., …
related stigma and discrimination in the medium and long term: systematic review.
Page 15 of 20
http://doi.org/10.1192/bjp.bp.114.151944
Mehta, N., Kassam, A., Leese, M., Butler, G., & Thornicroft, G. (2009). Public attitudes
towards people with mental illness in England and Scotland, 1994-2003. The British
http://doi.org/10.1192/bjp.bp.108.052654
Montague, A. C., & Eiroa-Orosa, F. J. (2017). Exploring the Role of Engagement on Well-
Ritsher, J. B., Otilingam, P. G., & Grajales, M. (2003). Internalized stigma of mental illness:
http://doi.org/10.1016/j.psychres.2003.08.008
Rubio-Valera, M., Aznar-Lou, I., Vives-Collet, M., Fernandez, A., Gil-Girbau, M., & Serrano-
http://doi.org/10.1177/1049731516641492
Rubio-Valera, M., Fernández, A., Evans-Lacko, S., Luciano, J. V., Thornicroft, G., Aznar-Lou,
I., & Serrano-Blanco, A. (2016). Impact of the mass media OBERTAMENT campaign on
the levels of stigma among the population of Catalonia, Spain. European Psychiatry,
Stuart, H., Chen, S.-P., Christie, R., Dobson, K., Kirsh, B., Knaak, S., … Whitley, R. (2014a).
Page 16 of 20
Revue Canadienne de Psychiatrie, 59(10 Suppl 1), S8–S12.
http://doi.org/10.1177/070674371405901S04
Stuart, H., Chen, S., Christie, R., Dobson, K., Kirsh, B., Knaak, S., … Whitley, R. (2014b).
http://doi.org/10.1177/070674371405901S05
Stuart, H., & Sartorius, N. (2017). Opening Doors: The Global Programme to Fight Stigma
http://doi.org/10.1007/978-3-319-27839-1_13
Vaughan, G., & Hansen, C. (2004). “Like minds, like mine”: A New Zealand project to
counter the stigma and discrimination associated with mental illness. Australasian
Page 17 of 20
Table 1. Sociodemographic and baseline wellbeing scores by baseline internalized stigma
Page 18 of 20
Table 2. Results of the paired samples t-tests (n=39).
M SD M SD t p d r
Wellbeing
Remembered wellbeing 7.17 1.64 7.48 1.50 -1.983 .055 -.202 -.098
Experienced wellbeing 7.20 1.88 7.94 1.70 -2.326 .025 -.408 -.196
TOTAL wellbeing 7.18 1.52 7.71 1.25 -2.720 <.01 -.382 -.184
Internalized Stigma
Stereotype Endorsement 1.89 .44 1.74 .39 2.189 .035 .350 .169
Discrimination Experience 2.10 .46 1.86 .46 3.600 <.001 .541 .256
Social Withdrawal 1.94 .66 1.83 .47 1.614 .115 .206 .100
Stigma Resistance 2.42 .55 2.47 .45 -.188 .852 -.108 -.053
TOTAL Internalized Stigma 1.95 .46 1.73 .34 4.044 <.0001 .554 .262
Page 19 of 20
Figure 1. Time by baseline internalized stigma group interactions.
Page 20 of 20