RESEARCH
DOCUMENT ANALYSIS
What?
Object: Documents/Texts
Why?
How?
Qualitative Content Analysis as Mixed Methods Approach with Seven steps are
differentiated (Mayring, 2014)
1
data is not feasible. The data (contained in documents) have already been
gathered; what remains is for the content and quality of the documents to
be evaluated.
Lack of obtrusiveness and reactivity: Documents are ‘unobtrusive’ and
‘non-reactive’—that is, they are unaffected by the research process.
(Previous studies found in documents are not being considered here.)
Therefore, document analysis counters the concerns related to reflexivity
(or the lack of it) inherent in other qualitative research methods. With
regard to observation, for instance, an event may proceed differently
because it is being observed. Reflexivity—which requires an awareness of
the researcher’s contribution to the construction of meanings attached to
social interactions and acknowledgment of the possibility of the
investigator’s influence on the research—is usually not an issue in using
documents for research purposes.
Stability: As a corollary to being non-reactive, documents are stable. The
investigator’s presence does not alter what is being studied (Merriam,
1988). Documents, then, are suitable for repeated reviews.
Exactness: The inclusion of exact names, references, and details of events
makes documents advantageous in the research process (Yin, 1994).
Coverage: Documents provide broad coverage; they cover a long span of
time, many events, and many settings (Yin, 1994).
Insufficient detail: Documents are produced for some purpose other than
research; they are created independent of a research agenda. (Again,
previous studies located in documents are not being considered here.)
Consequently, they usually do not provide sufficient detail to answer a
research question.
Low retrievability: Documentation is sometimes not retrievable, or
retrievability is difficult. As Yin (1994) has noted, access to documents may
be deliberately blocked.
Biased selectivity: An incomplete collection of documents suggests ‘biased
selectivity’ (Yin, 1994, p. 80). In an organisational context, the available
(selected) documents are likely to be aligned with corporate policies and
procedures and with the agenda of the organisation’s principals. However,
they may also reflect the emphasis of the particular organisational unit that
handles record-keeping (e.g., Human Resources).
Analisis Isi
The central idea of Qualitative Content Analysis is to start from the methodological
basis of Quantitative Content Analysis (cf. chapter 3.1) but to conceptualize the
process of assigning categories to text passages as a qualitative-interpretive act,
following content-analytical rules (will be further explained in chapter 4 and 6). In this
respect, the Qualitative Content Analysis is a mixed methods approach: assignment of
categories to text as qualitative step, working through many text passages and analysis
of frequencies of categories as quantitative step.
Furthermore, we formulate strict content-analytical rules for the whole process and
for the specific steps of analysis. In this respect, our approach is dedicated to the
common research criteria approach formulated above. But the Qualitative Content
Analysis itself is to be understood as a data analysis technique within a rule guided
research process, and this research process is bound to common (qualitative and
quantitative) research standards as shown in the next chapter.
On this basis we try to develop a step-by-step model of the research process which
is valuable for qualitative and quantitative (and mixed methods) research. The model
starts from traditional research processes of quantitative approaches and reformulates
and expands them for qualitative approaches. Seven steps are differentiated (cf.
Mayring 2001; 2012).
2
(Cohen, Manion, & Morrison, 2007)
3
(Mayring, hal. 9-10)
4
(Mayring, 2014, hal. 10-13)
Step 1: Step 2:
Concrete research question Linking research question to Step 3
(relevance to praxis; eventually theory (state of the art, Definition of the research design
hypotheses; formulation and theoretical approach, (explorative, descriptive,
explication of the researcher’s preconceptions for relational, causal, mixed)
standpoint) interpretations)
Step 4 Step 6
Step 5
Defining of the (even small) Processing of the study,
Methods of data collection and
sample or material and the presentation of results in respect
analysis, pilot tested
sampling strategy to the research question
Step 7:
Discussion in respect to quality
criteria
5
P. Mayring, Qualitative content analysis. Theoretical foundation, basic procedures and software solution.
(Klagenfurt, Austria: Philipp Mayring, 2014), h. 15. (hal. 15)
2. Anchor samples
Concrete passages belonging in particular categories are cited as typical examples
to illustrate the character of those categories.
3. Coding rules
Where there are problems of delineation between categories, rules are formulated
for the purpose of unambiguous assignment to a particular category.
Test extracts are taken from the material to check whether the categories are at
all applicable and whether the definitions, anchor samples and encoding rules make
categorical assignment possible.
This trial run-through, like the proper main run-through, is sub-divided into two
steps of operation. First of all the text passages in the material are marked in which the
category concerned is addressed. These "points of discovery" (cf. Hausser, Mayring &
Strehmel, 1982) can be marked by noting the category number in the margin of the text
or through differently colored underlining or marks in the text itself. In the second step
the material thus marked is processed in accordance with the structuring intention (see
below) and copied out of the text.
As a rule this trial run-through results in a revision and partial reformulation of the
category system and its definitions.
Now the main material run-through can finally begin, again split up into the two
stages of marking the points of discovery and extracting and processing them. In
accordance with the type of structuring (see below), the results of this run-through must
then be summarized and analyzed.
This general description of a structuring content analysis can be shown in a
procedural model as follows:
DESIGN
“In discussing design, we have to be true to our admonition that the research
question drives the design, not vice versa. To simplify matters, the committee
recognized that a great number of education research questions fall into three
(interrelated) types: description—What is happening? cause—Is there a
systematic effect? and process or mechanism—Why or how is it happening?”
… The first question —What is happening?— invites description of various
kinds, … to properly characterize a population of students, understand the
scope and severity of a problem, develop a theory or conjecture, or identify
changes over time among different educational indicators ... Description also
can include associations among variables, such as the characteristics of schools
...” (Shavelson & Towne, 2002, hal. 99)
“To yield credible results, such data collection usually depends on a random
sample (alternatively called a probability sample) of the target population. The
validity of inferences about population characteristics based on sample data
depends heavily on response rates, that is, the percentage of those randomly
selected for whom data are collected. The measures used must have known
reliability—that is, the extent to which they reproduce results. Finally, the value
of a data collection instrument hinges not only on the sampling method,
participation rate, and reliability, but also on their validity: that the
questionnaire or survey items measure what they are supposed to measure”
(Shavelson & Towne, 2002, hal. 102-103) .
Relevant to the purpose and research question above, a qualitative study which
embraced characteristics of several research methods was employed. Based on the
classification of research designs from Nunan (1992), this research can be
characterised as a qualitative program evaluation because in this study the researcher
created and then implemented a teaching program. In the course of the program, she
evaluated the value and the effectiveness of the program, through ongoing assessment
of students’ achievements (done by herself and her colleague who was involved in this
study) relevant to the objectives of the program. This assessment was valuable “to
assist the researcher in deciding whether the teaching program needed to be modified
or altered in any way so that objectives may be achieved more effectively” (Nunan,
1992, p. 185).
However, this research also has similar characteristics to a case study. First, like a case
study, it was carried out in “a small scale, a single case” (Stake, 1985, p. 278). It
“focused on one particular instance of educational experience or practice” (Freebody,
2003, p. 81), that is, a teaching program, where “the researcher acted as teacher”
(Stake, 1995, p. 91). The second characteristic, which constitutes the important aspect
of case study, as Yin (1993, p. 32) suggests, is that this research employed “multiple
sources of evidence – converging from the same set of issues” (Yin, 1993, p. 32) or
“multiple data collections and analytic procedures” (Freebody, 2003, p. 83) to allow
for “in-depth study” (Ary, Jacobs and Razavieh 1972; Connole, 1993) or “down to
earth” study (Cohen and Manion, 1985, see also Cohen, Manion and Morrison, 2000).
Multiple data gatherings aimed to enhance the construct validity of the study (Yin,
1993, p. 39-40) and to gain more rounded and complete accounts to test the values
and effectiveness of the teaching program implemented in this study, as mentioned in
the purpose of the study above. The third characteristic is that this study used text
analysis, which is another method of qualitative case study (Travern, 2001; Freebody,
2003), using SFG, which provides a powerful analytical tool, and constitutes “one of a
variety of linguistic approaches that have been well developed in the area of education”
(Freebody, 2003, p. 185).
EVALUATOR/PENELITI
“Perhaps the only person who could satisfy demands of both credibility and
competence is the L2 specialist who devotes her energies to external
evaluation” (Beretta, 1989, hal. 159).
DOCUMENT
“analisis isi kualitatif” (Qualitative Content Analysis)6 dari Mayring untuk “menggali
permasalahan … dan mengembangkan pemahaman mendalam”7 atas fenomena ‘tingkat
berpikir’ yang menjadi fokus perhatian dalam kajian ini. Analisis isi adalah sebuah “proses
pengorganisasian informasi dalam kategori terkait dengan pertanyaan utama penelitian,”8 dan
merupakan sebuah metode penelitian yang berada di bawah payung kajian analisis dokumen
(document analysis).9
Metode penelitian analisis dokumen merupakan seperangkat prosedur sistematik yang
bertujuan mereview ataupun mengevaluasi dokumen, baik dalam bentuk materi cetak maupun
elektronik, untuk memahami makna, memperoleh pemahaman, serta mengembangkan
pengetahuan empirik tentang objek kajian tersebut10.
Metode penelitian analisis isi kualitatif merupakan kajian dokumen yang berada di
bawah payung penelitian mix-methods di mana pendekatan kualitatif akan digunakan untuk
menetapkan kategori dari satuan analisis dalam teks yang menjadi objek penelitian dan
pendekatan kuantitatif digunakan untuk menganalisis frekuensi kemunculan kategori-kategori
tersebut11.
6
P. Mayring, Qualitative content analysis. Theoretical foundation, basic procedures and software solution.
(Klagenfurt, Austria: Philipp Mayring, 2014).
7
Creswell, op. cit., h. 16.
8
G. A. Bowen, Document analysis as a qualitative research method. Qualitative research journal, 2009, Vol. 9(2),
h. 32.
9
Ibid, h. 27-40.
10
Ibid, h. 29.
11
Mayring, op. cit., h. 10.
Metode Analisis Isi Kualitatif dari Mayring mencakup langkah-langkah penelitian
berikut12:
12
Mayring, op. cit., h. 15.
13
Philip Mayring, Qualitative Content Analysis Forum Qualitative Research, (2004), h. 9.
(http://www.qualitativeresearch.Net/fqs-texte/Z-OU4-vAmayring-e-htm ).
memperoleh makna kesetaraan gender.
REFEENCES
Ary, D. J., Sorensen, C., & Walker, D. (2010). Introduction to research in education (8th ed.).
Belmont, CA: Cengage Learning.
Beretta, A. (1989). Who should evaluate L2 programs? Dalam C. Brumfit, & R. Mitchell
(Penyunt.), Research in the language classroom. ELT Documents 133 (hal. 155-160).
Modern English Publication & The British Council.
Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative
research journal, 9(2), 27-40.
Brumfit, C., & Mitchell, R. (Penyunt.). (1989). Research in the language classroom. ELT
Documents 133. Modern English Publication & The British Council.
Cohen, L., Manion, L., & Morrison, K. (2007). Research Methods in Education (6th ed.). New
York: Routledge.
Creswell, J. W. (2012). Educational Research: Planning, Conducting, and Evaluating Quantitative
and Qualitative Research (4th ed.). Boston: Pearson Education, Inc.
Denzin, N. K., & Lincoln, Y. S. (Eds.). (2011). The SAGE Handbook of Qualitative Research.
Thousand Oak: SAGE.
Emilia, E. (2005). A critical genre based approach to teaching academic writing in a tertiary EFL
context in in Indonesia. Unpublished PhD thesis, University of Melbourne, Dept of
Language, Literarcy and Arts Education, Melbourne.
Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2012). How to design and evaluate research in
education (8th ed.). New York: McGraw-Hill.
Gall, M. D., Gall, J. P., & Borg, W. R. (2003). Educational Research: An Introduction (7th ed.).
Boston: Pearson Education.
Gay, L. R., Mills, G. E., & Airasian, P. (2012). Educational Research: Competencies for Analysis
and Applications (10th ed.). Boston: Pearson Education.
Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989). Toward a Conceptual Framework for
Mixed-Method. Educational Evaluation and Policy Analysis, 11(3), 255-274.
Hudson, S. M. (2011). Preservice teachers’ perceptions of their middle schooling teacher
preparation: a sample of the Australian context (Doctoral dissertation, Southern Cross
University). http://eprints.qut.edu.au/57068/1/Hudson_Sue_Thesis.pdf. Southern Cross
University. Diambil kembali dari
http://eprints.qut.edu.au/57068/1/Hudson_Sue_Thesis.pdf
KEMENDIKNAS. (2013). Permendiknas Nomor 81A Tahun 2013 Tentang Implementasi
Kurikulum. Jakarta: KEMENDIKNAS. Retrieved from
http://hukor.kemdikbud.go.id/asbodoku/media/peruu/permen_tahun2013_nomor81a.
zip
Labuschagne, A. (2003). Qualitative Research - Airy Fairy or Fundamental? The qualitative
report, 8(1), 100-103. Diambil kembali dari http://nsuworks.nova.edu/tqr/vol8/iss1/7
Mayring, P. (2000, June). Qualitative content analysis. Forum: Qualitative Social Research [On-
line Journal],, 1(2). Diambil kembali dari http://qualitative-research.net/fqs/fqs-e/2-
00inhalt-e.htm
Mayring, P. (2014). Qualitative content analysis. Theoretical foundation, basic procedures and
software solution. Klagenfurt, Austria: Philipp Mayring.
Nunan, D. (1992). Research methods in language learning. Cambridge: CUP.
Shavelson, R. J., & Towne, L. (2002). Scientific research in education. Washington, DC:
National Academy Press.
Ary, D., Jacobs, L. C., and Razavieh, A. (1972). Introduction to research in education. New
York: Holt, Rinehart and Winston
Cohen, L., and Manion, L. (1980). Research methods in education. (1st Ed). London:
Croom Helm.
Cohen, L., and Manion, L. (1985). Research methods in education. (2nd Ed). London:
Croom Helm
Cohen, L., Manion, L., and Morrison, K. (2000). Research methods in education. 5th edition.
London: Routledge
Connole, H. (1993). ‘The research enterprise.’ In Connole, H., Smith, J., Wiseman, R.
(1993) (Eds). Research methodology 1: Issues and methods in research. Study guide. Melbourne:
Deakin University
Freebody, P. (2003). Qualitative research in education. Interaction and practice. London:
SAGE Publications
Nunan, D. (1992). Research methods in language learning. New York: Cambridge
University Press
Stake, E. (1985). ‘Case study.’ In Nisbet, J., Mergary, J., and Nisbet, S. (1985). (Eds).
World yearbook of education 1985. Research, policy and politics. London: Nicholas Publishing
Company
Travers, M. (2001). Qualitative Research Through Case Studies. London: SAGE
Publications in, R. K. (1993). Applications of case study research. Newbury Park, California: SAGE
Publications.
Yin, R. K. (1984). Case study research. Beverly Hills, California: SAGE Publications