The PURPOSE

Research Problem
What is it?
Is it easy to locate?
Yes__ No__
Is it clear?
Yes__ No__
Does it allow for
further research?
Yes__ No__
Is it
significant/relevant
to the field of
study?
Yes__ No__
Research Question
Are the
variables
identified?
Yes
IV:


DV:

Were confounding variables
present?
Yes__ No__
If yes...How were they controlled?
Is the
population
of interest
specified?
Yes
Population:

Hypothesis
Is it stated?
Yes
Is there a
relationship
between
two or more
variables?
Yes__
No__
If yes...
Directional__
(or)
Non-
Directional__
Is it
justifiable?
from a
theory?
Yes__
No__
from
previous
research?
Yes__
No__
No
Is its
absence
justified?
Yes__
No__
If yes...
How?
INTRODUCTION
Was background literature reviewed?
Yes
Was it thorough?
Yes__ No__
If yes...
Does it include all major
studies on the topic?
Yes__ No__
Does it include recent
research?
Yes__ No__
Was it clear?
Yes__ No__
Was it organized?
Yes__ No__
Does it support the need
for this study?
Yes__ No__
If yes...
Is there a theoretical
framework?
(based on a theory)
Is there a conceptual
framework?
(clarify/identify
concepts, assemble to a
common theme)
What is it?
Are the concepts
defined?
Yes__ No__
Are the measures
identified?
Yes__ No__
No
INTRODUCTION
What is the study design?
Experimental
-RCT: groups only differ
on the randomized
variable
Were randomization
procedures explained?
Yes__ No__
If yes...
Were the groups
comparable prior to the
intervention?
Yes__ No__
Quasi-Experimental
Is there justification for
not randomizing?
Yes__ No__
Were the groups
comparable prior to the
intervention?
Yes__ No__
Nonexperimental
-Case-Control: useful for
rare outcomes
-Cohort: measures
incidence of outcome
Was this design essential?
(experimental work not
possible)
Yes__ No__
If not...
Is there justification for
not manipulating the IV?
Yes__ No__
Were the groups being
compared similar with
regard to confounding
characteristics?
Yes__ No__
Ask yourself...
Does the question being studied, fit the
selected design?
METHODS
Restrictive inclusion
criteria may benefit
internal validity
Sampling
Was the population identified?
Yes__ No__
Was the population described?
Yes__ No__
Is the sample size, sample
selection, sample
representation adequate?
Yes__ No__
N=___

Was the sample size
determined by conducting a
power analysis?
Yes__ No__
Power=___
(the higher, the better)
Inclusion criteria:

Exclusion criteria:
What type of sampling was used?

Did it yield a representative sample?
Yes__ No__
Nonprobability
(convenience, quota,
consecutive, purposive)
Probability
(random)
Ethics
Is there approval from an
ethics committee or
institutional review board?
Yes__ No__
Human Subject considerations:
full disclosure?
confidentiality?
voluntary participation?
Was informed consent
obtained?
Yes__ No__
Was blinding used to avoid
biases?
Were appropriate steps taken
to remove, prevent, or
minimize subject harm?
Yes__ No__
If yes...
The study has
external validity
METHODS
The range for is .00 to
+1.00
higher values reflect higher
internal consistency
Data
Measurements
Is the instrument suitable
for measuring the
variables?
Yes__ No__
Does the instrument
yield high-quality data?
Yes__ No__
Is the instrument reliable?
Yes__ No__
Is Cronbach's alpha reported?
If yes... =___
Is the instrument valid?
Yes__ No__
Were the instument
scoring techniques
clearly explained?
Yes__ No__
Collection
What method was used for
collecting data?
(self-report, observational, or
biophysiologic measures)
For self-report and
observational...
Did the method minimize
or control biases?
Yes__ No__
For biophysiologic
measures...
Was the researcher
skilled for proper
interpretation?
Yes__ No__
Could the study be
replicated?
Yes__ No__
RESULTS
http://www.microsiris.com/Statis
tical%20Decision%20Tree/
Data Analysis
Was a statistical package
used and/or reported?
(SPSS, SAS, etc.)
Yes__ No__
Are the tests used to
analyze data included?
Yes__ No__
What statistical test
was used?
Were the selected
statistical tests
appropriate?
(level of measurements
and research
question/hypotheses)
Yes__ No__
Results
Were the statistical test
findings significant?
Yes__ No__
Were the statistical test
findings nonsignificant?
If yes...
Is it due to Type II errors
Were the tables...
clear?
accurate?
appropriate?
RESULTS


Discussion
Conclusion
Are the conclusions...
drawn from the results?
consistent with the results?
discussed in relation to the
theoretical/conceptual framework?
reported in context of what is already known
about the topic?
Have all the
questions/hypotheses been
answered?
Yes__ No__
Assumptions/Limitations
Were the assumptions
documented?
Yes__ No__
Were the limitations
addressed?
Yes__ No__
Are the limitations and bias
enough to question the
validity?
Yes__ No__
Professional Context
Are there any conflicts of
interest?
Yes__ No__
Are implications for
practice clearly stated?
Yes__ No__
Will this study have an
impact in your...
daily practice?
department?
DISCUSSION