Most referee reports must ultimately lead to a decision by a JME editor not to publish the
manuscript. (Because of space constraints, at least 80% of submitted manuscripts cannot
not be published.) At the same time, it is important that the referee and editorial
evaluation provide the author with useful feedback on his manuscript even if it is not to
be published in the JME.
The four week deadline for JME reports is a firm one. If you know that you will not be
able to make it when you receive a review request, please decline the assignment. If you
later learn that you will not be able to hit the deadline, please contact the editor that is
handling your manuscript, with a copy to Susan North at the editorial office
(north@simon.rochester.edu).
In the discussion below, it is assumed that you are preparing a report on an initial
submission. Writing Reports on Resubmissions provides instructions and advice for
reports on second-round manuscripts.
A. The Audience
The starting point of any writing project is deciding on the audience. For a JME report,
there are really three audience members: (a) the editor; (b) the author; and (c) yourself,
as an expert and a representative of the economics community. In the discussion below,
we will make suggestions about how to provide the necessary information to each
member of the audience.
Start by reading the paper quickly so as to get the key ideas. As you go, jot down a few
notes about what the authors are doing and the literature context of the paper. Then,
think for a while about the big picture -- what are the authors trying to do, are they
taking the best approach, and how successful are they at their approach -- and then jot
down some further notes about the paper and highlight any major concerns that you had
on this first reading.
Then, read the paper carefully, as if it were one written by a colleague or student. As
you go through the paper, you should make notes on the following, perhaps on the
margins of the paper itself:
1. The key substantive ideas that the author is seeking to convey to the reader: (a) the
topics that are being studied, (b) the tools used; (c) the logical arguments made; (d)
the conclusions reached; and (e) the contribution to the literature that is being
http://people.bu.edu/rking/JME_files/guide_for_referees.htm 4/20/2011
Guide for Referees Page 2 of 6
2. Central problem areas in the paper. For theoretical papers, these are places where
(a) the description of the topics is inappropriate to the actual material in the paper;
(b) the theoretical constructss are being used inappropriately; (c) the logical
argument is not tight, including incorrect application of economic concepts or
erroneous mathematical derivations; (d) the conclusions are incorrectly made or
expressed; and (e) the contribution to the literature is inaccurately described. For
empirical papers, these are places where (a) the description of the topics is
inappropriate to the actual material in the paper; (b) the econometric tools are
being used inappropriately; (c) there is only a loose link between the economic
model and the empirics; (d) the conclusions are incorrectly made or expressed; and
(e) the contribution to the literature is inaccurately described.
3. Smaller difficulties with the paper. For theoretical papers, these are (a) areas
where the author's line of thought is hard to follow; (b) spots with spelling and
grammatical problems; (c) areas where mathematical notation is inconsistently used
or excessively complicated; (d) references to the literature that are missing or
incorrect. For empirical papers, these are (a) areas where the author's line of
thought is hard to follow; (b) spots with spelling and grammatical problems; (c)
missing data sources and poorly constructed tables or figures; (d) references to the
literature that are missing or incorrect.
C. Summarizing the paper: Write a brief summary of the paper, at most one or two
pages. In this summary, you have three objectives, one for each of the three audience
members.
1. The referee: when you summarize the paper, without evaluation, write neutrally as
you might if you were recording information for yourself or for a member of a
research team that you were working in. We do this task routinely in our work. It is
part of reviewing the literature for a research project that we may be undertaking
or a class that we may be preparing or a review article that we may be writing. The
key is that this part of your report is like notes that you would put in your files to
answer the question: "what did the author of this paper view himself as doing?".
2. The editor: your summary of the paper may well be the place that the editor starts
his review process, along with reading the introduction to the manuscript itself.
You are providing thus providing the editor with an alternative introduction to and
summary of the paper.
3. The author: your summary of the paper is a way of establishing your credibility with
the author, who wants to know that you have carefully studied his paper. This takes
work on your part, but avoids unnecessary hard feelings if you must later be critical
of the work. You are also providing the author with an alternative introduction to
and summary of his work. We all know that it is sometimes hard to keep
perspective on where our work fits into a field, so that your summary may be very
useful to the author, even if your report is subsequently critical. For both of these
purposes, credibility and information transfer, it is important to be careful with the
details of your presentation, just as you would if you were preparing your own
http://people.bu.edu/rking/JME_files/guide_for_referees.htm 4/20/2011
Guide for Referees Page 3 of 6
D. Evaluating the paper: The critical question to be answered in your report is "has this
manuscript made an important contribution to its chosen area?". There are three aspects
of this evaluation that are worth stressing:
2. If there are critical problems that you see with the manuscript in that the author's
analysis is incorrect in some manner, then it is important to state these problems
clearly in your evaluation. It is also important to state whether you see an internal
inconsistency (a proof is wrong because there are contradictory elements) or an
incompleteness (a proof does not cover all claimed cases).
3. Your report should not include a recommendation about the decision category or
discuss whether the manuscript is appropriate for JME in terms of its chosen area.
E. Providing Feedback to the Author: it is important that the author benefit from the
hard work that you have put into reviewing the paper. Depending on the nature and
status of the paper, this feedback might include:
1. Comments on areas where the logical argument in the paper was hard to follow,
important mathematical derivations were obscure, or empirical work was
incompletely described.
After you have prepared these elements, assemble them into the referee report, using
the format below.
Referee Report
Journal of Monetary Economics, Manuscript Number
Manuscript title
A. Summary
B. Evaluation
1. Larger issues
http://people.bu.edu/rking/JME_files/guide_for_referees.htm 4/20/2011
Guide for Referees Page 4 of 6
http://people.bu.edu/rking/JME_files/guide_for_referees.htm 4/20/2011
Guide for Referees Page 5 of 6
Q2: If most manuscripts are going to be rejected, why should I spend my time writing
detailed reports that recommend how to revise the paper?
A2: Detailed referee reports are very important. For an editor to allow a “revise and
resubmit” decision, he must think that there is at least a 50% chance that a manuscript
will ultimately be published in JME. To decide whether the paper falls above or below
the critical level, it is necessary for him to a good bit of detailed information about what
form a revision might take. As an expert in this field, you are in a good position to
recommend a revision path.
Further, by providing the author with detailed revision advice, you are helping him figure
out how to best revise his paper for another journal, if it is rejected. Each year, the JME
receives many emails from authors that are grateful for the referee reports and editorial
feedback that they received on their rejected papers. Typically, authors say something
like “it was not good news that my paper was rejected, but I learned a lot about how to
make the paper better and, in that way, the submission to JME was very valuable to me
even though my revised paper will be sent elsewhere.”
http://people.bu.edu/rking/JME_files/guide_for_referees.htm 4/20/2011
Guide for Referees Page 6 of 6
http://people.bu.edu/rking/JME_files/guide_for_referees.htm 4/20/2011