Despite the large amount of research on mail questionnaires, there has been
littleefforttoward the developmentof a questionnaire responsetheory that might
guide the design of mail survey research. The authors conceptualize mail
questionnaire responseas a series of responses to a set of stimuli rather than a
single decision to respond or not respond. A review of the mail survey response
literature is provided and cognitive dissonance theory is used to explain why
particular techniques are effective. Four types of nonrespondents are identified
and suggestions are providedfor the use of incentives, prenotification,follow-up
contacts, type of postage, and cover letter treatments.
Manipulating
Dissonance
to hnprove
Mail h w e y
Response
David H. Fume
David W. Stewart
conclude that there is very limited evidence upon which many widely
accepted techniques are based (Linskey, 1975; Kanuk & Berenson, 1975).
The only two that have been demonstrated to be consistently effective are
follow-upletters with a copy of the questionnaire (Suchman & McCandless,
1940, Kephart & Bressler, 1958; Levine & Gordon, 1958; Scott, 1961;
Watson, 1965)and monetary incentives enclosed with the mail questionnaire
(Hancock, 1940; Kephart & Bressler, 1958; Frankel, 1960; Newman, 1962;
Watson, 1965; Wotruba, 1966; Erdos, 1970; Blumberg, Fuller, & Hare,
1974; Huck & Gleason, 1974; Armstrong, 1975).'
The problem typically associated with mail surveys is low return
rates, which causes concern for two reasons. The first is that a low response
rate decreases the accuracy with which the sample can be considered
representative of the total population. The second is that nonrespondents
will differ in nonrandom ways from those who do respond (Suchman &
McCandless, 1940;Baur, 1947; Franzen & Lazarsfeld, 1945; Goode & Hatt,
1952;Wallace, 1954; Suchman, 1962;Robins, 1963;Vincent, 1969;Ognibene,
1970; Wilcox, 1977). Mail questionnaires, however, have the advantage of
being less expensive than other methods, allowing the researcher to obtain
information from a greater number of people. They allow privacy to the
respondent, making them potentially more appropriate for collecting sensi-
tive information (McDonagh & Rosenblum, 1965; Knudson, Pope, & Irish,
1967; Wiseman, 1972). They avoid biases that potentially accompany the
interaction between respondents and interviewers (Selltiz,Jahoda, Deutsch,
& Cook, 1951; Boyd & Westfall, 1955,1965,1970; Schyberger, 1967). And,
they may be more valid than interviews in some circumstances because
they allow respondents to check information by consulting records or other
family members (Kahn & Cannell, 1966; Rosenthal, 1966). If the problem
of low response rates can be overcome, mail questionnaires have some very
clear advantages.
In a recent review of the nonresponse problem, Wiseman and
McDonald (Note 1) have emphasized the need for a theory or model of the
decision process prospective respondents use in determining whether to
participate in a survey. Few efforts have been made toward generating such
a theory, although some candidate theories have been identified (Linskey,
1975). Among theories that have been suggested as a framework for under-
standing mail questionnaire response are reference-group theory, exchange
theory, socialization and balance theory, and cognitive dissonance theory.
1. Other techniques with some consistent evidence are preliminary notification by mail or
phone (Waisanen, 1954; Stafford, 1966; Ford, 1968; Myers & Haug, 1%9), follow-up postcards,
(Eckland, 1965; Nichels & Meyer, 1966), follow-up telephone calls or telegrams (Barnette,
1950; Levine & Gordon, 1958), type of postage on the outgoing and return envelopes,
(Clausen & Ford, 1947; Robinson & Agisim, 1951; Kephart & Bressler, 1958; Gullahorn &
Gullahorn, 1963), noncash premiums enclosed with the questionnaire (Knox, 1951), the
identification of the sponsoring organization (Hammond, 1959; Scott, 1961), and the title
of the person signing the cover letter (Roeher, 1963).
80 SUMMER 1984
MAh’IpuwlwG DISSONANCElcont.
82 S U M M E R 1984
MANIPUUTING DISSONANCE/conr.
day 15, the two groups’ response rates were 90% and 80%,respectively.
Hackler and Bourgette attributed the high response rates to the ability of
the dollar to induce cognitive dissonance in respondents.
An alternative explanation of their findings might be that the use of
money was effective because it provided compensation for responding
rather than because it created a state of dissonance. However, research has
consistently shown that a monetary reward even as small as 25 cents or less
enclosed with a questionnaire is effective. Also, enclosed rewards are
consistently more effective than a promised reward, even when the prom-
ised reward is greater (Scott, 1961; Blumberg, Fuller & Hare, 1974; Gelb,
1975; Hancock, 1940; Wotruba, 1966; Furse, Stewart, & Rados, 1981). If
money acts only as compensation, there is no compelling reason to believe
that a promised incentive should be less effective than an incentive enclosed
with the questionnaire. Indeed, a promised incentive should work better
since it is clearly contingent upon performance, and an enclosed incentive
involves no such contingency. Something more is involved than the simple
compensation of respondents for their services.
TABLE 1
Effects of Monetary Incentives in
Initial and Follow-up Mailings
Group
Resmnse No Incentive 509 Incentive
~ ~~~ ~
*Follow-up response rates are calculated as the number of follow-up responses expressed as
a percentage of follow-up mailings.
A more recent test of the dissonance hypothesis was carried out by
Furse, Stewart, and Rados (1981) in a mail survey of 900 residential tele-
phone customers. The effects of a 50 cent incentive enclosed with a mail
questionnaire were tested in an initial and a follow-up mailing. One treat-
ment group received a 50 cent coin and a second received no monetary
incentive in the initial mailing. In the follow-up mailing, half of the
nonrespondentsin each group received a 50 cent incentive with the follow-up
letter and questionnaire, and half received no incentive. As expected, the
response rate was significantly higher when a follow-up incentive was
added for the group receiving no initial incentive, but there was no effect of
either repeating or dropping the 50 cent incentive for the group that had
received the 50 cents initially (see Table 1). The authors concluded that the
PSYCHOLOGY 81 MARKETINGNOL 1 NO 2 83
M A N I P W I N G DISSONANCE/conf.
84 SUMMER 1984
MANIPULNIYNG DISSONANCE/cont.
Receipt of Questionnaire
Throw Away
q K T h r o w Away
2 Request
Fill Out/
Return
Decision
W
Nonrespondent
Segments
1
NR,
Never opened
envelope
1NR,
Fill Out/Return Later
Opened envelope
but did not read
1NR3
Read letter and
questionnaire instructions,
f
NR,
Read letter and
instructions
letter or instructions but put off decision and decided
not to respond
FIGURE 1
Response Decision Process
than adequate compensation for the effort. Research has consistently demon-
strated that promised rewards are relatively ineffectual. The key to generat-
ing high response rates in mail surveys at an affordable cost lies not in
attempting to compensate respondents, but in creating dissonance among
those considering nonresponse at each stage of the response decision
process. A review of the most effective techniques for increasing response
suggests that different techniques have their effect at different stages.
Linskey (1975) and Kanuk and Berenson (1975) in major reviews of
mail survey research concluded that there is evidence that the following
techniques are effective for increasing response rates:
The few studies that have treated cover letter appeal offer no insights into
the most appropriate formulation (Kanuk & Berenson, 1975, p. 450). Since
the effectiveness of alternative cover letter appeals will vary for different
populations, generalizations may be difficult to formulate.
For those who put off filling out or returning the questionnaire ( 0 4 ) ,a
reminder postcard or telephone contact may be effective. Reminders are
typically most effective if they are conducted within a few days after the
questionnaire is received and before it has been misplaced or discarded
(Erdos, 1970), or if the follow-up includes another copy of the question-
naire (Kanuk & Berenson, 1975).
Nonresponse Segments
Four types of nonrespondents to the initial mailing have been
identified. First, there are those who throw away the mailing without
opening it (see Figure 1, NRI). Second there are those who open the
mailing but discard it without really evaluating the request (NR2). Third
are those who evaluate the task, but put off filling out the questionnaire
until they lose it or discard it, possibly after concluding that it is now too
late to respond (NR3).Fourth are those who evaluate the task, but elect
not to respond (NR4). Since each nonresponse segment drops out at a
different stage of the response process, each is likely to be responsive to
different techniques for increasing response. Table 3 relates follow-up
techniques to the potential segment most likely to respond.
~~
TABLE 3
Dissonance-Inducing Techniques in Follow-up
Contact with Nonrespondents
Follow-up Techniques Type of Nonresponse
NR 1 NR2 N R 3
Telephone contact X
before follow-up
mailing
Increase postage X
on follow-up
Use enclosed incentive X
if none used in
initial mailing or
increase enclosed
reward if initial
response low
Enclose copy of X X X
questionnaire in
follow-up
Enclose shorter
version of
questionnaire
Change cover
letter ameal
M A N I P W I N G DISSONANCE/cont.
Those who would throw away the initial mailing without opening it
(NRZ)are most likely to respond to a level of postage greater than that
used on the initial mailing or to a telephone or mail precontact.
Nonrespondents who may open the initial mailing but discard it because
it is not immediately apparent there is something in it of interest to them
(NR2) should be more likely to respond to an enclosed reward, or perhaps
to a significant increase in the amount of the reward in the follow-up
mailing if the initial incentive was small. Furse (1979)analyzed the response
rates in 60 mail surveys using enclosed monetary incentives and suggests
that when initial response rate is low, the effect of increasing the enclosed
incentive in the follow-up is substantial, while at higher response rates to
the initial mailing, the effect is minimal.
1
70%
60
50
i-
40
30
20
10
I 10 2 0 3 0 4 0 5 0 6 0 7 0 8 0 9 0 %
Initial Response (R,)
*Follow-upresponse expressed as the percentage of those receiving the follow up mailing
FIGURE 2
Simple Regressions Fitting Response Data
for 60 Mail Suweys
more nonrespondents of the NR2 type (opened the letter but discarded it
without reading), so response to the follow-up is high. When the initial
response rate is high, meaning that the initial incentive has been effective
at converting this potential nonresponse segment, there are fewer people
left who will be responsive to this appeal. Increasing the incentive in the
follow-up has no effect.
Those who put off responding (NR3)should be most responsive to a
follow-up request by telephone or a mail reminder. They are reminded of
their original decision to respond later and of the dissonance of that
decision with their current nonrespondent status. On the other hand,
increasing the monetary incentive would have little additional effect on
this segment. The fourth segment, those who evaluated the request but
still decided not to fill out the questionnaire (NR4), will be the most
difficult to convert. An approach most likely to be effective with this
nonresponse segment is to simplify the task requested. Erdos (1970), for
example, has reported good success with follow-ups involving a shortened
version of the original questionnaire. A change in the appeal made in the
cover letter or a personal appeal by telephone may also have some effect.
Of course, dedicated nonrespondents in this segment may never respond
under any conditions.
90 SUMMER 1984
MAh'IPU"G DISSONANCE/cont.
ACKNOWLEDGMENTS: The authors acknowledge the support of the Dean's Fund for
Faculty Research at the Owen School, which facilitated the completion of this paper.
REFERENCE NOTES
Baur, E. Jackson. Response bias in a mail survey. Public Opinion Quarterly, 1947, 11,
594-600.
Blumberg, H. H., Fuller, C., & Hare, A. I? Response rates in postal surveys. Public Opinion
Quarterly, 1974,38, 113-123.
Boyd, H. W., Jr., & Westfall, R. Interviewers as a source of error in surveys. Journal of
Marketing, 1955,19,311-324.
Boyd, H. W., Jr., & Westfall, R. Interviewer bias revisited. Journal of Marketing Research,
1965,2, 58-63.
Boyd, H. W., Jr., & Westfall, R. Interviewer bias once more revisited. Journal of Marketing
Research, 1970, 7, 249-253.
Brehm, J. W., & Cohen, A. R. Explomtions in cognitive dissonance. New York: Wiley, 1962.
Carlsmith, I. M., Collins, B. E., & Helmreich, R. L. Studies in forced compliance: I. The
effect of pressure for compliance on attitude change produced by face-to-face role
playing and anonymous essay writing. Journal of Personality and Social Psychology,
1966,4, 1-13.
Clausen, A., & Ford, R. N. Controlling bias in mail questionnaires. Journal of The American
Statistical Association, 1947,42,497-511.
Cohen, A. R. An experiment on small rewards for discrepant compliance and attitude
change. In I. W. Brehm & A. R. Cohen (Eds.), Explomtions in cognitive dissonance.
New York: Wiley, 1962.
Drachman, D., & WorGhel, S. Misattribution of arousal as a means of dissonance reduction.
Sociometry, 1976,39, 53-59.
Eagley, A. H., & Himmelfarb, S. Attitudes and opinions. In M. R. Rosenzweig & L. W.
Porter (Eds.),Annual Review of Psychology, 1978,29, 517-554.
Eckland, Bruce. Effects of prodding to increase mail back returns. Journal of Applied
Psychology, 1965,49, 165-169.
Erdos, Paul L. Professional mail surveys. New York: McGraw-Hill, 1970.
Festinger, L. A theory of cognitive dissonance. Stanford: Stanford University Press, 1957.
Festinger, L. The theory of cognitive dissonance. In W. Schramm (Ed.), The science of
human communication. New York: Basic Books, 1963.
Festinger, L. Conflict, decision, and dissonance. Stanford: Stanford University Press, 1964.
Festinger, L., & Aronson, E. The arousal and reduction of dissonance in social contexts. In
D. Cartwright & A. Zander (Eds.), Group dynamics (2nd ed.). Evanston, IL: Row,
Peterson, 1960,pp. 214-231.
Festinger, L., & Bramel, D. The reactions of humans to cognitive dissonance. In A. Bachrack
(Ed.), The experimental foundations of clinical psychology. New York: Basic Books,
1962,pp. 254-219.
Festinger, L., & Carlsmith, I. M. Cognitive consequences of forced compliance. Journal of
Abnormal and Social Psychology, 1959,58, 203-210.
Festinger, L., & Freedman, J. L. Dissonance reduction and moral values. In f! Worchel &
D. Byrne (Eds.),Personality change. New York:Wiley, 1964,pp. 220-243.
Ford, N. M. Questionnaire appearance and response rates in mail surveys. Journal of Advertising
Research, 1968,8 (Sept.), 43-45.
Frankel, L. R. How incentives and subsamples affect the precision of mail surveys. Journal of
Advertisinn Research, 1960,1, (Sept.), 1-5.
Franzen, R., & k f e l d , I? E Mail questi6nnaks as a research problem. Journal of Psychology,
1945.20, 293-320.
Furse, D. Toward a theory of mail questionnaire response. In Advances in Advertising
Research and Management: Proceedings of the American Academy of Advertising,
1979, pp. 161-166.
Furse, D., Stewart, D. W., & Rados, D. Effects of foot-in-the-door, cash incentives and
follow-ups on survey response. Journal of Marketing Research, 1981,18, 473-478.
Gelb, B. Incentives to increase survey returns: Social class considerations.Journal of Marketing
Research, 1975,12, 107-109.
Goode, W. J., & Hatt, I? K. Methods in social research. New York: McGraw Hill, 1952.
Gullahorn, I., & Gullahorn, I. G. An investigation of the effects of three factors on response
to mail questionnaires. Public Opinion Quarterly, 1963.27, 294-296.
Hackler, J., & Bourgette, E Dollars,di&nance,and survey returns. Public Opinion Quarter&,
1973,37, 276-281.
MANIPULATING DISSONANCE/cont.
Wallace, D. A. Case for and against mail questionnaires. Public Opinion Quarterly, 1954,
18, 40-52.
Watson, J. J. Improving the response rate in mail research. Journal of Advertising Research,
1965,s (June), 45-50.
Wilcox, J. B. The interaction of refusal and not-at-home sources of non-response bias.
Journal of Marketing Research, 1977,14, 592-597.
Wiseman, E Methodological bias in public opinion surveys. Public Opinion Quarterly, 1972,
36, 105-108.
Wotruba, T R. Monetary inducements and mail questionnaire response. Journal of Marketing
Research, 1966,3, 398-400.
Zanna, M. I?, & Cooper, J. Dissonance and the attribution process. In J. H. Harvey, W. J.
Ickes & R. E Kidd (Eds.), New directions in attribution research (Vol. 1). New York:
Wiley, 1976,pp. 199-217.
Zanna, M. I?, Higgins, E. T,& Taves, €? A. Is dissonance phenomenologically aversive?
Journal of Experimental Social Psychology, 1976,12, 530-538.
94 SUMMER 1984