See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/285865084

Correcting for the distorting effects of study artifacts in

meta-analysis

Article · January 2009

CITATIONS READS
21 2,658

3 authors:

Frank L. Schmidt Huy Le

University of Iowa University of Texas at San Antonio
246 PUBLICATIONS   34,231 CITATIONS    61 PUBLICATIONS   4,157 CITATIONS   

SEE PROFILE SEE PROFILE

In-Sue Oh
Temple University
74 PUBLICATIONS   3,276 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Beyond Questionable Research Methods: The Role of Intellectual Honesty in Research Credibility View project

All content following this page was uploaded by Frank L. Schmidt on 11 April 2016.

The user has requested enhancement of the downloaded file.

 HANDBOOK
OF RESEARCH
SYNTHESIS
META-ANALYSIS
AND

2ND EDITION

Edited by

HARRIS COOPER, LARRY V. HEDGES,

AND JEFFREY C. VALENTINE

RUSSELL SAGE FOUNDATION NEW YORK

 CONTENTS

Foreword xi
About the Authors xv

PART I INTRODUCTION 1
1. Research Synthesis as a Scientific Process 3
Harris Cooper and Larry V Hedges

PART II FORMULATING A PROBLEM 17

2. Hypotheses and Problems in Research Synthesis 19
Harris Cooper
3. Statistical Considerations 37
Larry V Hedges

PART III SEARCHING THE LITERATURE 4 9

4. Scientific Communication and Literature Retrieval 51
Howard D. White
5. Using Reference Databases 73
Jeffrey G. Reed and Pam M. Baxter
6. Grey Literature 103
Hannah R. Rothstein and Sally Hopewell

PART IV CODING THE LITERATURE 127

7. Judging the Quality of Primary Research 129
Jeffrey C. Valentine

vii
viii CONTENTS

8. Identifying Interesting Variables and Analysis Opportunities 147

Mark W. Lipsey
9. Systematic Coding 159
David B. Wilson
10. Evaluating Coding Decisions 177
Robert G. Orwin and JackL·Vevea

PART V STATISTICALLY DESCRIBING STUDY OUTCOMES 205

11. Vote-Counting Procedures in Meta-Analysis 207
Brad J. Bushman and Morgan C. Wang
12. Effect Sizes for Continuous Data 221
Michael Borenstein
13. Effect Sizes for Dichotomous Data 237
Joseph L Fleiss and Jesse Α. Berlin

PART VI STATISTICALLY COMBINING EFFECT SIZES 2 5 5

14. Combining Estimates of Effect Size 257
William R. Shadish and C. Keith Haddock
15. Analyzing Effect Sizes: Fixed-Effects Models 279
Spyros Konstantopoulos and Larry V Hedges
16. Analyzing Effect Sizes: Random-Effects Models 295
Stephen W. Raudenbush
17. Correcting for the Distorting Effects of Study Artifacts in
Meta-Analysis 317
Frank L· Schmidt, Huy Le, and In-Sue Oh

PART VII SPECIAL STATISTICAL ISSUES AND PROBLEMS 3 3 5

18. Effect Sizes in Nested Designs 337

Larry V. Hedges
19. Stochastically Dependent Effect Sizes 357
Leon J, Gleser and Ingram Olkin
20. Model-Based Meta-Analysis 377
Betsy Jane Becker

PART VIII DATA INTERPRETATION 3 9 7

21. Handling Missing Data 399
Therese D. Pigott
22. Sensitivity Analysis and Diagnostics 417
Joel B. Greenhouse and Satish Iyengar
23. Publication Bias 435
Alex J. Sutton
 CONTENTS iX

PART IX TYING RESEARCH SYNTHESIS TO SUBSTANTIVE ISSUES 4 5 3

24. Advantages of Certainty and Uncertainty 455
Wendy Wood and Alice H. Eagly
25. Research Synthesis and Public Policy 473
David S. Cordray and Paul Morphy

PART X REPORTING THE RESULTS 4 9 5

26. Visual and Narrative Interpretation 497
Geoffrey D. Borman and Jeffrey A. Grigg
27. Reporting Format 521
Mike Clarke

PART XI SUMMARY 5 3 5
28. Threats to the Validity of Generalized Inferences 537
Georg E. Matt and Thomas D. Cook
29. Potentials and Limitations 561
Harris Cooper and Larry V Hedges

Glossary 573
Appendix A 585
Appendix Β 591
Index 595
View publication stats