Bab ini
membahas cara menulis dan menyusun laporan penelitian dan bagaimana mengevaluasi
kualitas laporan ini. Ini menekankan pentingnya audiens, menyusun laporan Anda untuk
audiens Anda, menulis dengan cara yang tidak diskriminatif, etis, dan ilmiah, dan
menggunakan kriteria evaluasi yang diterima untuk menilai kualitas laporan Anda.
Maria mempersembahkan penelitiannya yang lengkap kepada komite sekolah dan penasihat
fakultasnya dalam program pascasarjana. Dia akan menulis laporannya secara berbeda untuk
dua pemirsa ini. Untuk komite sekolah, dia akan menekankan hasil, meremehkan metode, dan
menyoroti implikasi praktis. Untuk penasihat fakultasnya, Maria akan menekankan penelitian
dan perhatiannya yang cermat terhadap pengumpulan dan analisis data untuk menghasilkan
jawaban yang bijaksana atas pertanyaan penelitiannya. Menulis dengan fokus pada audiens
merupakan inti dari pendekatan Maria, seperti juga penekanannya pada kepekaan terhadap
siswa dan guru yang termasuk dalam studinya. Pada akhirnya, komite sekolah dan
penasihatnya akan mengevaluasi penelitiannya. Dia sekarang perlu membicarakan dengan
mereka berdua kriteria yang akan mereka gunakan untuk menilai kualitas penelitiannya.
265
APA ITU LAPORAN PENELITIAN DAN APA SAJA JENISNYA?
Langkah-langkah dalam proses penelitian berakhir dengan pengembangan laporan tertulis dari
penelitian Anda. Sebuah laporan penelitian adalah studi selesai yang melaporkan
penyelidikan atau eksplorasi masalah; mengidentifikasi pertanyaan yang harus ditangani; dan
termasuk data yang dikumpulkan, dianalisis, dan ditafsirkan oleh peneliti. Ini dikomposisikan
untuk khalayak, bervariasi dalam panjang dan format, dan berbeda untuk penelitian kuantitatif
dan kualitatif.
TABEL9.1
Audiens untuk Penelitian
Audiens Standar
Peninjau jurnal • Penggunaan standar yang diterbitkan biasanya dicetak sekali untuk setiap volume
• Standar terpisah dapat diterbitkan untuk penelitian kuantitatif dan kualitatif
• Editor harus merekonsiliasikan pendapat yang berbeda di antara
peninjau
Reviewer makalah konferensi • Apakah peneliti telah mengirimkan materi yang tepat
• Apakah proposal sesuai dengan yang disampaikan tema atau prioritas untuk
konferensi
• Apakah ringkasan proyek ditulis dengan jelas, diorganisir, dan membahas pedoman
untuk ringkasan
GAMBAR 9.1
Catatan Maria Tentang Audiens untuk Laporannya
GAMBAR 9.2
Format Kuantitatif dan Proposal Kualitatif
Artikel Jurnal Anda menyiapkan artikel jurnal untuk pembaca publikasi ilmiah serta editor
dan individu yang mengulas penelitian ini. Sebuah artikel jurnal adalah, laporan penelitian
lebih pendek dipoles yang Anda kirim ke editor jurnal. Editor mengatur dua hingga tiga
pengulas untuk memberikan komentar tentang penelitian ini. Editor kemudian membuat
keputusan berdasarkan komentar pengulas, yang biasanya jatuh ke dalam salah satu dari tiga
kategori: menerima, merevisi dan mengirim kembali, atau menolak. Biasanya, ketika pengulas
menerima naskah sementara, mereka melakukannya berdasarkan antisipasi keberhasilan
revisi oleh penulis. Jika artikel itu diterima, editor menerbitkannya dalam edisi jurnal.
Artikel jurnal jauh lebih pendek daripada tesis atau disertasi karena batasan halaman yang diberlakukan
oleh penerbit dan editor jurnal. Namun, artikel jurnal kualitatif jauh lebih panjang daripada
artikel kuantitatif karena kutipan yang luas dan diskusi panjang mengenai deskripsi dan tema.
Format artikel jurnal kuantitatif dan kualitatif bervariasi dari satu jurnal ke jurnal lainnya.
uatu norma penelitian adalah bahwa individu secara
Makalah Konferensi dan Proposal S
publik membagikan laporan penelitian mereka sehingga informasi dapat diakses oleh
komunitas pendidikan umum. Salah satu cara untuk melakukan ini adalah dengan
mempresentasikan makalah pada konferensi asosiasi profesional.
Sebuah makalah konferensi adalah laporan penelitian disajikan kepada penonton pada konferensi
negara, regional, nasional, maupun internasional biasanya disponsori oleh berorganisasi
profesional (misalnya, AERA, Amerika Asosiasi Guru Pendidik). Mengembangkan dan
mempresentasikan makalah konferensi dari studi penelitian membantu untuk mempublikasikan
studi, menyediakan entri penelitian untuk resume, membantu memajukan pekerjaan penulis
dalam komunitas riset pendidikan, dan membangun pengetahuan di antara para peneliti yang
mengeksplorasi topik tersebut. . Audiensi untuk konferensi dapat berupa peneliti, praktisi, atau
pembuat kebijakan. Peneliti menyiapkan makalah konferensi untuk audiens yang menghadiri
konferensi serta individu yang meninjau dan menerima makalah untuk presentasi. Biasanya,
panjang makalah konferensi hampir sama dengan artikel jurnal — sekitar 25 halaman plus
tabel, angka, dan lampiran.
Sebuah proposal konferensiproposal singkat untuk menyajikan sebuah studi di sebuah konferensi.
Biasanya, proposal ini memiliki panjang sekitar tiga halaman, dan pengulas menggunakannya
untuk menentukan apakah mereka akan menerima penelitian penulis untuk presentasi di
konferensi.
Proposal konferensi harus sesuai dengan pedoman yang disediakan oleh asosiasi konferensi.
Selama atau setelah selesai belajar, proses penyajian makalah konferensi dimulai.
Seorang peneliti mengirim proposal ke penyelenggara konferensi, yang telah mengeluarkan
"Panggilan untuk Proposal" beberapa bulan sebelum konferensi. Panggilan ini mengundang
para peneliti untuk mengajukan proposal tentang penelitian mereka untuk kemungkinan
presentasi di konferensi. Menanggapi panggilan ini, penulis mengembangkan proposal singkat
tentang penelitian dan mengirimkannya untuk ditinjau. Jika proposal diterima, penulis
berkewajiban untuk menghadiri konferensi dan mempresentasikan makalah berdasarkan
proposal. Setelah penerimaan, penulis mengembangkan makalah yang lengkap,
mempresentasikannya di konferensi, dan membagikannya kepada peserta konferensi. Pada
konferensi tersebut, panitia konferensi sering mengelompokkan tiga atau empat makalah
penelitian ke dalam satu sesi dan masing-masing penulis memiliki sekitar 15 hingga 20 menit
untuk mempresentasikan studinya. Atau, penyelenggara dapat menawarkan simposium
sebagai format untuk mempresentasikan makalah penelitian. Format ini terdiri dari beberapa
makalah penelitian dari individu yang berbeda yang membahas tema yang sama.
◆ Tujuan atau tujuan ◆ Perspektif (s) atau kerangka teori ◆ Metode, teknik,
atau mode penyelidikan ◆ Sumber data atau bukti ◆ Hasil dan / atau
kesimpulan / sudut pandang ◆ Pendidikan atau kepentingan ilmiah dari
penelitian ini (AERA, 1999, hal. 33).
Anda mengirim ringkasan ini ke koordinator program untuk salah satu divisi topikal
AERA atau berbagai kelompok minat khusus (SIG). Untuk memutuskan divisi apa yang akan
Anda kirimi materi, Anda dapat menghubungi kantor pusat AERA (www.aera.net). Dua hingga
tiga pengulas yang tidak tahu identitas Anda akan meninjau proposal Anda. Proses peninjauan
dapat memakan waktu 2 hingga 3 bulan, pada saat itu koordinator konferensi akan memberi
tahu Anda apakah proposal Anda telah diterima atau ditolak untuk presentasi.
Laporan untuk Pembuat Kebijakan atau Personel Sekolah Jenis laporan penelitian
akhir adalah laporan yang Anda berikan kepada praktisi yang berada dalam posisi tanggung
jawab dalam pendidikan. Orang-orang ini dapat menjadi pembuat kebijakan di pemerintah
negara bagian dan federal atau pemimpin di sekolah, seperti pengawas, kepala sekolah,
direktur kurikulum, dan guru. Laporan penelitian yang dipresentasikan kepada individu-individu
ini mungkin mengikuti pedoman ini (lihat Muffo, 1986):
Pertimbangkan situasi Maria. Dia perlu mempresentasikan penelitiannya kepada komite sekolah.
Mengikuti saran-saran di atas, tuliskan langkah-langkah yang harus diikuti Maria:
Sebuah studi dengan struktur yang jelas mudah dipahami dan mudah dibaca, meskipun materi
pelajarannya mungkin kompleks. Seorang penulis yang dikenal secara nasional mengenai
masalah penulisan, Natalie Goldberg (2000), telah menekankan pentingnya memahami
struktur fisik suatu proyek penulisan. Strukturfisik dari sebuah penelitian adalah tion
organiza- mendasari topik yang membentuk struktur untuk laporan penelitian. Pikirkan tentang
artikel jurnal yang baru saja Anda baca. Apakah sulit atau mudah dimengerti? Apakah Anda
dapat membacanya dengan cepat, atau apakah Anda bersusah payah?
1. Pendekatan termudah adalah dengan memeriksa berbagai tingkat judul yang digunakan
dalam sebuah penelitian. Judul-judul ini adalah rambu jalan yang digunakan oleh seorang
penulis untuk menyampaikan poin-poin utama dalam sebuah penelitian. Meskipun beberapa
judul adalah deskriptor konten yang lebih baik daripada yang lain, memeriksa mereka
membantu Anda mengidentifikasi struktur studi. 2. Carilah enam langkah dalam proses
penelitian. Semua laporan, baik kuantitatif atau kualitatif, harus mengandung masalah
penelitian, literatur, pernyataan tujuan dan pertanyaan atau hipotesis, pengumpulan data,
analisis dan interpretasi data, dan format pelaporan. 3. Cari pertanyaan penelitian (atau
hipotesis) dan jawaban yang dikembangkan peneliti untuk pertanyaan ini (atau hipotesis).
Untuk setiap pertanyaan yang diajukan, peneliti harus mengajukan jawaban. Mulailah
dengan bagian pengantar (yaitu, "Pengantar")
dan kemudian lihat bagian akhir laporan (yaitu, "Hasil" atau "Diskusi") untuk melihat
bagaimana penulis menjawab pertanyaan. 4. Akhirnya, menjadi akrab dengan struktur
berbagai jenis laporan, terutama
pendekatan menggunakan penelitian kuantitatif dan
kualitatif.
GAMBAR 9.3
Bagian Depan, Badan, dan Bagian Belakang dari Studi
Kuantitatif Bagian
reliabilitas dan validitasnya Intervensi (jika
Depan Materi Judul halaman Abstrak digunakan) Prosedur pengumpulan data Analisis
penelitian (opsional) dari data
Bab 1 Pengantar Studi Bab 2 Jalan ke Presidensi Bab 3 Kejutan dan Tantangan Awal Bab 4
Membangun Hubungan Bab 5 Peran Presiden Bab 6 Memberikan Visi dan Kepemimpinan
Bab 7 Memulai Perubahan Bab 8 Konstituen Eksternal Bab 9 Perjuangan dan Kesulitan Bab
10 Peran Pasangan Bab 11 Ringkasan, Kesimpulan, dan Implikasi Struktur 11-bab
menekankan pada tema-tema yang muncul selama penelitian. Itu tidak termasuk bab terpisah
pada tinjauan literatur atau prosedur spesifik penelitian.
Anda dapat melihat struktur fleksibel yang ditemukan dalam disertasi Miller juga dalam artikel jurnal
kualitatif dan makalah konferensi. Seperti halnya ada beberapa perspektif dari peserta dalam
sebuah penelitian, ada juga banyak variasi dalam cara para peneliti melaporkan temuan
mereka. Beberapa bentuk laporan kualitatif akan menekankan deskripsi, sedangkan yang lain
akan fokus pada tema atau interpretasi pribadi dari temuan oleh penulis. Format pelaporan
yang fleksibel ini tidak diragukan lagi membuat membaca penelitian kualitatif sulit bagi mereka
yang baru mengenal pendekatan ini. Meskipun struktur pelaporan terus muncul, mengetahui
beberapa variasi penting akan membantu Anda mulai melihat fokus penulis ketika mereka
melaporkan penelitian mereka.
Pertimbangkan bentuk-bentuk alternatif untuk menulis penelitian
kualitatif:
◆ Sebuah pendekatan ilmiah i ni mirip dengan studi kuantitatif di mana semua atau
sebagian besar dari lima bagian (-Introduction, ‖ -Review dari Sastra, ‖ -Methods, ‖
-Results, ‖ dan - Diskusi‖) hadir. ◆ P endekatan mendongeng dapat memiliki struktur
yang bervariasi. Penulis menggunakan perangkat sastra
(misalnya, metafora, analogi, plot, klimaks) dan penulisan kreatif yang persuasif untuk
mempresentasikan penelitian. ◆ Pendekatan tematik t ermasuk diskusi yang luas tentang
tema-tema utama yang muncul dari analisis database kualitatif. Seringkali, pendekatan ini
menggunakan kutipan luas dan detail kaya untuk mendukung tema. Seringkali tema-tema
ini saling terkait dan dimasukkan ke dalam desain kualitatif spesifik seperti teori grounded,
etnografi, atau desain naratif. ◆ Pendekatan deskriptif menggabungkan penjelasan rinci
tentang orang dan tempat untuk membawa narasi. Sebuah studi dalam mode ini mungkin
menyampaikan "hari biasa dalam kehidupan" seorang individu. ◆ Pendekatan teoritis
adalah ketika penulis baik dimulai dengan teori (misalnya, menganut teori retically
berorientasi studi kasus), berakhir dengan teori (misalnya, grounded theory), atau memodi-
FIEs teori yang ada berdasarkan pada pandangan peserta. ◆ Pendekatan eksperimental,
tau kinerja dapat mencakup laporan penelitian kualitatif dalam bentuk puisi,
alternatif, a
cerita fiksi, drama, atau akun yang sangat personal, yang disebut autoethnography (lihat
Denzin, 1997, atau Richardson, 2000) . Sebagai contoh, daripada menulis laporan
penelitian standar,kualitatif
penanyamengembangkan permainan yang menangkap materi pelajaran yang
―sangat sulit, multisited, dan sarat emosi better lebih baik daripada penulisan
standar (Richardson, 2000, p. 934).
FIGURE 9.4
The Front, Body, and Back Matter of a Scientific Qualitative Structure
Data-gathering strategies Data analysis
Front Matter Title page Preface and approach
acknowledgments (optional) Table of contents indings
(optional) List of tables (optional) List of figures Description of site or individuals
(optional) Abstract of the study (optional) Analysis of themes
◆ I use the analogy of two railroad tracks going in the same direction to help visual-
ize the structure of a study. ◆ I look at the study and examine the headings closely to learn about the
structure.
They are good road signs to help me understand the research. ◆ Realizing that researchers compose
all educational studies with six process steps,
I search for a research problem, a question, data collection, data analysis, and
interpretation. ◆ When reading a study I could give emphasis to both, to learn about the
results or
findings in a study as well as to see t he research procedures so that I could criti- cally
evaluate the study.
FIGURE 9.5
The Front, Body, and Back Matter of a Qualitative Storytelling Structure
◆ Are sensitive to individuals and use language that reduces bias ◆ Use appropriate
research terms ◆ Write and report the findings ethically ◆ Employ a point of view
consistent with quantitative and qualitative approaches ◆ Balance research and
content ◆ Interconnect parts of a study ◆ A
dvance a concise title
1. Describe individuals at an appropriate level of specificity. This means that you need
to use specific terms for persons that are accurate, clear, and free of bias. For example:
• Be specific:
Poor: man or woman Preferred: men and women Poor:
over 62 Preferred: ages 63–70
his means calling people names they prefer and
2. Be sensitive to labels for individuals or groups. T
acknowledging that preferences for names change over time. Writers should not use their own
group as the standard against which to judge others. For example:
• Use adjectival forms.
Poor: the gays Preferred: gay men
• Put ―people‖ first, followed by a descriptive phrase.
Poor: schizophrenics Preferred: people diagnosed with schizophrenia
• Use parallel nouns that do not promote one group as a standard or dominance over
another group.
Poor: man and wife Preferred: husband and wife 3. Acknowledge participation of people in a study.
You need to specifically identify participants based on the language they use. For example:
• Use impersonal terms.
Poor: subjects Preferred: participants Poor: informants
Preferred: participants
• Use nonstereotypical and unbiased adjectives.
Poor: woman doctor Preferred: doctor Poor: nonaggressive women
Preferred: nonaggressive participants
• Use specific cultural identity.
Poor: American Indians Preferred: Cherokees
• Put people first, not their disability.
Poor: mentally ill person Preferred: person with mental illness
Encode Scholarly Terms into Your Research
As these guidelines for reducing bias suggest, certain terms are preferred over others for
referring to participants in a study. Likewise, in the field of research, certain terms need to be
included to convey your understanding of research. Others will partly judge your research
based on the appropriate use of standard quantitative and qualitative terms. For example, to
call the sampling ―random‖ instead of ―purposeful‖ in qualitative research shows your
lack of understanding of the basic differences between the two approaches. When you read a
research report, you can examine the level of the author's research understanding through the
choice of words. The glossary at the end of this text and the key terms (words in bold type)
throughout the chapters provide useful words to use in your research report.
Here are some additional ideas that might be helpful in building your vocabulary and using research
words:
◆ As you write your study, consult a dictionary of terms, such as the quantitative
dictionary of terms by Vogt (2005) and the qualitative dictionary of terms by Schwandt
(2007). ◆ When writing a research report, encode your writing with the language of
research.
In this case, encoding is the intentional use by an author of specific terms to convey
ideas. This practice will enhance the acceptability of your research to graduate
committees, publishers, and conference attendees. For example, the terms compare
re good words to use in quantitative research, and the terms explore and
and relate a
discover are good terms to use in qualitative research.
◆ Honest reporting requires that researchers not falsify data to support a hypothesis or
research question or omit troublesome results to present a more convincing story. This
practice means that researchers should not create artificial data, fig- ures, or tables in their
reports, or create or attribute quotes to individuals that are not accurate. ◆ Data sharing
means that researchers need to provide copies of their reports
to participants. These reports may be in oral or written form and directed toward those
participants who helped recruit participants (Brabeck & Brabeck, 2009). The report
should be as jargon-free as possible to enable a wide audi- ence to read and
understand your report. Also, reports should not sit unpub- lished and should be shared
despite contrary findings. For most audiences, it is necessary as well to make the report
convey practical significance. This is especially important when community members
are involved directly in the research. For example, as American Indian tribes take over
the delivery of services to their members (eg, day care centers, Head Start, K–12
schools, and tribal colleges and universities), they are reclaiming their right to determine
what research will be done and how it will be reported (LaFrance & Crazy Bull, 2009).
They challenge whose voice is speaking and the accuracy of the reporting of facts and
their interpretation. The knowledge that is shared may be based on that handed down
from generations, gained through careful observation from multi- ple vantage points,
and revealed through dreams, visions, and spiritual protocols (Brant-Castellano, 2000).
Thus, the sharing of data, and making it available is important for qualified scholars,
community members, and professionals. The issue of power dynamics in research
situations surfaces when the results are dis- seminated to a select audience (Ginsberg
& Mertens, 2009). To counter this, for example, results might be posted to a Web site
for distribution to a wide audi- ence. To make the results available, the APA (2010) style
manual recommends that authors keep the raw data for a minimum of five years after
publication of the research. ◆ When researchers publish their results, another ethical
issue is to refrain from
duplicate and piecemeal publication of data. Reports must reflect the indepen- dence of
separate research efforts. Researchers cannot submit the publication material that has
been previously published. Conference papers, unless published in conference
proceedings, are not considered to be published mate- rial. The key in understanding this
is whether the manuscript has been published elsewhere ―in substantially similar form or
with substantially similar content‖ (APA, 2010, p. 13). ◆ Plagiarism is the use of
someone else's work without giving them credit for the
information. Another ethical issue is that researchers should not claim that the words
and ideas they use from others are their own; credit needs to be given using
quotation marks. Whenever you paraphrase another author, you need to give them
credit. A related idea, self-plagiarism, is when researchers present their own
previously published work as new scholarship. An acceptable length of duplicated
material varies, but the new document needs to constitute an original contribution.
When material is duplicated, citations to the other works are
needed. Authors might use comments such as ―as I have previously discussed . . .‖
(APA, 2010, p. 16) to signal when the material duplicates other material. ◆ Conducting a
research study also raises the potential ethical issue of a conflict of
interest. Conflict of interest, such as personal (commercial, economical) interests, leads
to bias in a research report. More and more campuses are asking authors to sign forms
that indicate that they do not have a conflict of interest in conduct- ing the research. The
question of who will profit from the research is an ethical concern that needs to be
asked. ◆ For graduate students and faculty, another ethical issue is not giving credit for
authorships and not reflecting this credit in the specific order of authorship (APA,
2010). Researchers should take credit for work for which they have actually per-
formed or to which they have substantially contributed. Such contribution may consist
of formulating the problem or research questions, designing the methods, gathering
or analyzing the data, interpreting the results, or writing a major portion of the paper.
Credit for authorship needs to be established early in a project, and it is especially
important for graduate students and their advisors to assess author- ship credit for
publications emanating from student research. Such issues arise because students
may need added supervision in conducting their research due to a lack of training or
the need for additional analyses. Student-faculty author- ship for publications needs
to be assessed and reassessed during the evolution of the project. An equally
important topic is the order of authorship for publications with the individual providing
the greatest contribution listed as the first or senior author. This order should reflect
the relative contribution of each author.
Also, a quantitative writer seldom mentions the first names of individuals in a study and also
emphasizes objectivity of the results.
In qualitative r esearch, however, the researcher is typically present and in the fore- ground in the narrative
report of the study. This is seen in the use of the first-person pro- noun I ( or the collective we)
and in the personal experiences of the author that are written directly into the report (eg, the
author's difficulty in collecting data, the reflection on themes derived from the data). The author
may present sidebars that interpret the personal meaning of themes or personal statements
about experiences. The qualitative researcher also seeks to present a persuasive story and
often writes in a lively manner using meta- phors, similes, analogy, contradictions, and ironies.
The study may end with questions that remain unanswered, much like many novels or short
stories. Further, qualitative inquirers
mention first names of participants (typically using aliases to protect the identity of individ-
uals), and the level of detail, especially in the description, brings the writer and the reader
close together.
The good model includes comments by the researcher that not only convey an
understanding of adequate survey research methods but also inform the reader about the
subject matter (the study of chairpersons) of the actual study.
◆ The major independent and dependent variables in a study, typically listed in order
from independent to dependent ◆ The participants in a study ◆
The research site or location for the study
Both during the process of conducting a study as well as at its conclusion, you need to be
mindful of the quality of the research. The improvement of practice, the quality of policy
debates, and the advancement of knowledge all call for high-quality educational
research. It becomes important, then, to consider the evaluation of research by asking ―What
criteria should I use?‖
◆ Does the research meet the standards for publication? ◆ Will the research be useful in our
school? ◆ Will the research advance policy discussions in our region? ◆ Will the research
add to our scholarly knowledge about a topic or research problem? ◆ Will the research help
address some pressing educational problem?
These are important questions, and the answers will shape how we evaluate a research report.
Because of the various audiences involved, we have no single standard for research.
Moreover, standards for quantitative and qualitative research differ because the two
approaches to research differ.
Quantitative Standards
In a study by Hall, Ward, and Comer (1988), the authors had a panel of judges rate 128
rticles. The specific shortcomings of these articles, in order of their
educational quantitative a
importance, were:
As you can see, quantitative evaluators were most concerned about aspects related to the
data collection, the analysis, and the reporting of results of a study—the research design
phase of the projects.
Another perspective on evaluating the quality of quantitative research is available from
Tuckman (1999). As shown in Table 9.2, the standards follow the research process with an
emphasis on the quality of the hypotheses and variables, the control of extraneous vari- ables,
and the importance of the discussion and its implications for research and practice.
Qualitative Standards
Turning to qualitative research, the criteria for a good research report vary depend- ing on your
emphasis as a researcher. When we examine current perspectives about
TABLE 9.2
Quantitative Criteria for Evaluating Quantitative Research
Research Problem:
• Is it stated?
• Is it clear?
• Is it complete and accurate?
• Does it offer theoretical and practical value?
Design:
• Was the study design identified?
• Were the scores from the measures valid and reliable?
• Were the statistics the right choice?
judging qualitative research, ideas within each of the three themes—philosophy, pro- cedures,
and participation/advocacy—combine to form our evaluation criteria. For example, as one
interested in the philosophical ideas behind qualitative research, you might draw from
perspectives about what constitutes knowledge (eg, an evolv- ing design) or reality (eg,
subjective experiences). As a procedural researcher, you might emphasize the importance of
rigorous data collection (eg, multiple forms of data) and analysis (eg, multiple levels of
analysis). As a participatory/advocacy writer, you might stress the importance of collaboration
(eg, researcher collaborates on equal terms with participants) and persuasive writing (eg, does
it seem true to participants?).
Let's examine three sets of criteria for evaluating qualitative research developed by three authors within a
6-year time frame. As seen in Table 9.3, the standards reflect both overlap and differences.
They all speak to the importance of the par- ticipant in the research study, as well as standards
set within research communities. Writing persuasively and with respect for participants is also
paramount in all three standards. Writing from a point of self-awareness and being sensitive to
reciprocity and the impact of the study (eg, emotionally and intellectually) on readers differs.
TABLE 9.3
Three Sets of Standards for Evaluating the Quality of Qualitative Research
honesty or authenticity about its own
Lincoln's (1995) stance and about the position of the
Philosophical Criteria: author.
s (2007) Procedural
• Community: All research takes place in,
is addressed to, and serves the
Richardson's (2000) Participatory and purposes of the community in which it
Advocacy Criteria was carried out.
Richardson's (2000) Participatory and
Advocacy Criteria • Voice: Participants' voices must not be
silenced, disengaged, or marginalized.
• Standards set in the inquiry community
• Critical subjectivity: Researchers need to
such as guidelines for publication.
have heightened self- awareness in the
• Positionality: The “text” should display research process and create personal and
social transformation. up the text and invite interpretive responses?
Is the text artistically shaped, satisfying,
• Reciprocity: Reciprocity must exist
complex, and not boring?
between the researcher and those being
• Aesthetic merit: Does this piece succeed
researched.
aesthetically? Does the use of practices open
• Sacredness of relationships: The researcher up the text and invite interpretive responses?
respects the sacredness of the relationships Is the text artistically shaped, satisfying,
and collaborates on equal terms with complex, and not boring?
participants. • Aesthetic merit: Does this piece succeed
aesthetically? Does the use of practices open
• Sharing privileges: The researcher shares up the text and invite interpretive responses?
rewards with persons whose lives they Is the text artistically shaped, satisfying,
portray. complex, and not boring?
ys rigorous data collection, which • Aesthetic merit: Does this piece succeed
multiple forms of data, extensive aesthetically? Does the use of practices open
a long period in the field collecting up the text and invite interpretive responses?
Is the text artistically shaped, satisfying,
complex, and not boring?
sistent with the philosophical
ons and characteristics of a • Reflexivity: How did the author come to write
e approach to research. These this text? Is there adequate self-awareness and
n evolving design, the presentation of self-exposure for the reader to make judgments
erspectives, the researcher as an about the point of view?
t of data collection, and the focus on • Reflexivity: How did the author come to write
ts' views. this text? Is there adequate self-awareness and
self-exposure for the reader to make judgments
ys a tradition of inquiry, such as case
about the point of view?
nography, grounded theory, or
• Reflexivity: How did the author come to write
nquiry as a procedural guide for the
this text? Is there adequate self-awareness and
self-exposure for the reader to make judgments
with a single focus on a central about the point of view?
non rather than a comparison or • Reflexivity: How did the author come to write
ip (as in quantitative research). this text? Is there adequate self-awareness and
self-exposure for the reader to make judgments
en persuasively so that the reader about the point of view?
es being there.
• Impact: Does this affect me? Emotionally?
consists of multiple levels of Intellectually? Move me to write? Move me
o portray the complexity of the to try new research practices? Move me to
enomena. action?
• Impact: Does this affect me? Emotionally?
rative engages the reader because
Intellectually? Move me to write? Move me
ected ideas and believable and
to try new research practices? Move me to
formation.
action?
es strategies to confirm the • Impact: Does this affect me? Emotionally?
of the study. Intellectually? Move me to write? Move me
• Substantive contribution: Does this to try new research practices? Move me to
piece contribute to our understanding of action?
social life? • Impact: Does this affect me? Emotionally?
• Substantive contribution: Does this Intellectually? Move me to write? Move me
piece contribute to our understanding of to try new research practices? Move me to
social life? action?
• Aesthetic merit: Does this piece succeed • Expression of a reality: Does this text embody
aesthetically? Does the use of practices open a fleshed out sense of lived experiences?
Does it seem “true”? a fleshed out sense of lived experiences?
• Expression of a reality: Does this text embody Does it seem “true”?
a fleshed out sense of lived experiences? • Expression of a reality: Does this text embody
Does it seem “true”? a fleshed out sense of lived experiences?
• Expression of a reality: Does this text embody Does it seem “true”?
In combination, they all offer philosophical, procedural, and reflexive standards for you to use in evaluat- ing
qualitative inquiry.
Problem Statement
Does it indicate an educational issue to study? Has the author provided evidence that this issue is
important? Is there some indication that the author located this issue through a search of past literature or
from personal experiences? Does the research problem fit a quantitative approach? Are the assumptions of
the study consistent with an approach?
Data Collection
Does the author mention the steps taken to obtain access to people and sites? Is a rigorous probability
sampling strategy used? Has the author identified good, valid, and reliable instruments to use to
measure the variables? Are the instruments administered so that bias and error are not introduced into
the study?
Writing
Is the structure of the overall study consistent with the topics addressed in a quantitative study? Are
educational and social science terms carefully defined? Are variables labeled in a consistent way
throughout the study? Is the study written using extensive references? Is the study written using an
impersonal point of view? Is the study written appropriately for intended audience(s)?
FIGURE 9.7
Checklist for Evaluating the Process of a Qualitative Study
Problem Statement
Does it indicate an educational issue to study? Has the author provided evidence that this issue is
important? Is there some indication that the author located this issue through a search of past literature or
from personal experience? Does the research problem fit a qualitative approach? Are the assumptions of
the study consistent with a qualitative approach?
Data Collection
Has the author taken steps to obtain access to people and sites? Has the author chosen a
specific purposeful sampling strategy for individuals or sites? Is the data collection clearly
specified and is it extensive? Is there evidence that the author has used a protocol for
recording data?
Writing
Was the account written persuasively and convincingly? Was the overall account consistent with one of the
many forms for presenting qualitative research? Was the account written to include literacy approaches, such
as the use of metaphor, surprises, detail, dialogue, and complexity? Was it written using a personal point of
view? Is the study written appropriately for intended audience(s)?
REEXAMINING THE PARENT INVOLVEMENT AND
MOTHERS' TRUST IN PRINCIPALS STUDIES
Let's examine one final time the parent involvement study (Deslandes & Bertrand, 2005) and
the mothers' trust in principals case study (Shelden et al., 2010). Both of these stud- ies are
actual reports of research found in journal articles. They are aimed at scholarly audiences. As
research studies, they address problems or issues, raise questions, and por- tray the collection
of data to answer the questions. Further, as should be apparent, they both reflect the six-step
research process introduced in this text. They include a research problem, the use of literature,
the collection and analysis of data, interpretation of the meaning of the data, and a format for
writing the report. This process constitutes a struc- ture (or organization) for each study.
Looking at the headings, you can see this structure. This structure provides a road map to the
article and helps you to read, understand, and potentially use the findings. Looking closely at
the physical structure of both articles, we see that they are both scientific in structure. This may
be due to their publication in the same journal, The Journal of Educational Research, a nd its
orientation. In other qualita- tive articles, we would likely see other alternative forms for the
structure of qualitative articles.
Both articles illustrate scholarly writing. The encoding of terms for the quantitative study about parent
involvement can be seen in use of words such as ―influences‖ (Para- graph 03) and
―measures‖ (Paragraph 16). In the mothers' trust in principals qualitative study, the encoding
appears especially in their discussion about research design (Para- graphs 15 and 16). In the
quantitative parent involvement study, the researchers report results in an objective way and
they remain largely in the background of the study. They do, however, use the personal
pronoun ―we‖ (see Paragraph 24) as they talk about their data collection and discuss the
major results (see Paragraph 32). Still, after reading this article, we do not know if the authors
had children in the seventh, eighth, or ninth grades or had past experiences with being a
parent to adolescents at home or in helping with their schoolwork. We also did not learn how
they felt about parent involvement on a personal level. In short, the study is written in a
quantitative way, with objective report- ing by the authors.
A different approach is used in the mothers' trust in principals qualitative study. In that study, we learn
about the personal difficulties the researchers had in recruiting par- ticipants (Paragraph 18).
Overall, the writing approach for both studies was similar with a key difference in how the
results were presented from a more statistical discussion in the quantitative parent involvement
study (see Paragraphs 25–43) to a more quote-based thematic discussion in the mothers' trust
in principals qualitative study (see Paragraphs 29–57).
For an educational research study of your choice, provide an outline of the structure of your
quantitative or qualitative study. For this type of report, indicate the audience(s) that will
receive the report, and discuss writing strategies that you plan to use to make the report
acceptable to that audience. List the approaches you will use to enhance the scholarly
language of your report if your audience consists of individuals on college and university
campuses.
THRE
◆ Chapter 10: Experimental Designs ◆
Chapter 11: Correlational Designs ◆
Chapter 12: Survey Designs ◆ Chapter 13:
Grounded Theory Designs ◆ Chapter 14:
Ethnographic Designs ◆ C hapter 15:
Narrative Research Designs ◆ Chapter 16:
Mixed Methods Designs ◆ Chapter 17:
Action Research Designs