.
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of
content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms
of scholarship. For more information about JSTOR, please contact support@jstor.org.
Academy of Management is collaborating with JSTOR to digitize, preserve and extend access to The Academy
of Management Journal.
http://www.jstor.org
Different
Goal
TFreatments
Performance
Setting
and
and
Their
Job
Effects
On
Satisfaction
JOHN M. IVANCEVICH
University of Houston
1977
Ivancevich
407
The purpose of the present study was to investigate the goal setting
process among nonmanagerial personnel in a field setting. Specifically,
the study had four objectives. First, it tested three hypotheses which emerge
from the goal setting theory and research literature, focusing on the implied
superiority of participative over assigned and "do your best" goal setting
treatments. Second, the study attempts to expand our knowledge about
how nonmanagerial personnel react to formal goal setting training. While
research is available on college student subjects (Locke, Bryan & Kendall,
1968), medical center personnel (Latham & Baldes, 1975), and typists
(Latham & Yukl, 1976), little is known about the impact of goal setting
training on skilled technicians. Third, the study involves the setting of
multiple hard performance goals simultaneously. Few previous field studies
have investigated nonmanagerial personnel setting more than one or two
goals simultaneously. In addition, most of the previous goal setting research
involves setting goals on simple tasks (Locke & Bryan, 1966) or on one
performancedimension (Latham &Yukl, 197 6). Finally, the study attempts
to examine the long-term (one year) effects, if any, of formal goal setting
training.
SELECTED GOAL SETTING RESEARCH
There has been a limited number of field studies which attempt to assess
the effects of different amounts of subordinate participation in goal setting.
French, Kay, and Meyer (1966) studied the assigned versus participative
goal setting practices employed in a performance appraisal program for
lower-level supervisors. In addition to the experimental manipulation of
participation, the perceived participation of the supervisors and observer
judgments of the amount of participation during the appraisal sessions also
were assessed, as well as the supervisors' perception of the usual amount
they previously had been allowed. The researchers concluded that: (a)
Subordinates who received a high participation level in the performance
appraisal interview in general achieved a higher percentage of their goals;
and (b) subordinates who worked in a high participation work setting
performed best on goals they set for themselves, while subordinates who
worked in a low participation work setting performed best on goals that
their immediate supervisor set for them.
Latham and Yukl (1975a) conducted a field experiment on the effects of
assigned and participative goal setting among logging personnel. A number
of crews were randomly assigned to a participative goal setting condition,
an assigned goal setting condition, or a "do your best" condition. The
findingsindicated that educational background was an important moderator
of the goal setting condition-performance relationship. In the sample of
educationally disadvantaged crews, the participative condition revealed
higher performance over the other two forms of goal setting. In the sample
of educated crews, performance, goal attainment, and average goal level
408
September
1977
Ivancevich
409
The goal setting literature,research, and specifically the field studies cited
above suggest a number of hypotheses which are examined in the present
study. These are:
Hypothesis I-The skilled technicians in the assigned and participation goal setting groups will perform more effectively and be more
satisfied than the comparison ("do your best") group of skilled technicians.
410
AcadenivY of Manageiiient
Journal
September
TABLE 1
Demographic and Organizational Characteristics of Skilled Technicians
Par ticipationi
(i58)
Characteristics
Education level
Tenure in present job
Age
Average number of
technicians reporting
to supervisor in
department
Average nuimber of
years experience as
a technician
Location of plant
Unionization
12.8 (2.7)
7.3 (2.1)
36.4 (5.1)
Planit III
Comparison-
Planit II
Planit I
Assigned
(it =
59)
( i-
62)
13.2 (3.0)
6.8 (2.4)
38.1 (5.3)
12.7 (3.0)
7.0 (2.1)
38.6 (4.9)
7.8(2.3)
7.1 (2.8)
7.6 (3.1)
10.4 (2.9)
Stuburbs of lar-ge city
11.1 (2.9)
Large uirban city
10.0 (3.3)
Large urban city
Yes
Yes
Yes
'
of
technicians
a
Standard deviations are reported in parentheses. None of the differences in the characteristics are statistically significant at p < .05.
Research Design
The present study used four data collection points which are designated
pretreatment, six months, nine months, and 12 months. The pretreatment
measure specifies a baseline period before any of the training in participation and assigned goal setting occurred. Six months after the pretreatment measure, which was approximately five months after the formal
training, the second (six months) set of data was collected. The third set
of data was collected nine months after the pretreatment measure and the
final set about 12 months after the pretreatment measure. Thus, the time
range from the pretreatmentto the fourth data collection point was approximately 12 months. Previous goal setting research suggested that a time lag
of more than three months would occur before post-training improvements
in performance and satisfaction would begin to appear (Ivancevich, 1974).
Therefore, the six-month data point was the first manipulation check for the
impact of goal setting training.
The Participation Training Program
Ivancevich
1977
411
412
A cademy
of Aanzagement
Journ1al
September
collecting hard performance data than to just select a day or short period of
time and use it as the indicator.
Unexclusedabsenteeism was the amount of time a technician was absent
from work without permission. It was measured as a proportion of hours
absent to total hours worked for each data collection period examined.
A service complaint index was used to assess the quality of the technicians'
work. A high service complaint index suggested that the technicians were
not performingtheir job satisfactorily. A service complaint system had been
in use for the past six years. If an equipment operator was dissatisfied with
the work of the technician, he or she filed a complaint. The complaint was
checked by the supervisor, and if it was valid, a file record was made.
The cost of performance was determined by developing a ratio of the
direct cost of a job completed by the technician to the recommended cost.
Those cases which were neither routine nor inspections were not included
in this performance index.
The low incidence of work related accidents did not warrant the collection of data in the same manner as that used for the other three performance
criteria. The safety index was obtained by substracting technician time off
from the job because of a work related accident (e.g., eye injury) from the
time expected to be on the job. The pretreatment measure was developed
by examining records for six months prior to this data collection point. The
six-month collection point used the pretreatment to six-month time frame.
There were no nine-month data collected. The 12-month safety index
designated the safety record from the six-month data point to the 12-month
point.
Before the pretreatment measure was taken and the research hypotheses
tested, the reliability of the major dependent variables was determined.
The unexcused absenteeism average for weeks one, three, five, seven, and
nine, prior to the pretreatment, was correlated with the unexcused absenteeism average for weeks two, four, six, eight, 10. The correlation
coefficient was .83 (p < .001), which indicated substantial stability in this
performance criterion. Similar correlation analysis revealed a coefficient of
.70 (p < .001 ) for service complaints and .80 (p < .001 ) for costs. Safety
records were not complete enough to determine the stability of this
criterion.
Job Satisfaction Measures
Two scales from the Job Descriptive Index (JDI) (Smith, Kendall, &
Hulin, 1969) were used to assess the job satisfaction of the skilled technicians. The satisfaction with work and with supervision scales were considered relevant for providing insight about the effects of the goal setting
treatments. Other attitudinal scales were used in this study, but only the two
JDI scales are reported in this paper. The Spearman-Brownreliabilities were
.87 (work) and .86 (supervision) for the participative technicians, .75
(work) and .81 (supervision) for the assigned technicians, and .80 (work)
1977
Ivancevich
413
and .71 (supervision) for the comparison or "do your best" subjects. These
levels of reliability for both JDI scales are within reasonable levels of acceptability (Nunnally, 1967).
RESULTS
A
Adjiusted
Means h
Prereeatwenit
6 MoAllnts
9 Monlthls
12 Months
.082
.064
.058
.0(2
.001
.061
.041
.001
.063
.074
.054
.068
.047
.032
.054
8.71
7.91
8.03
7.01
6.01
7.98
7.14
5.32
8.12
7.21
6.92
8.02
7.17
5.58
7.86
1.41
1.50
1.39
1.40
1.18
.70
1.40
1.43
1.04
1.46
1.29
.98
1.40
73.6
78.1
79.1
61.7
62.4
81.2
---
72.0
79.1
80.4
64.2
72.8
76.9
Untexcused
1.1(
1.46
414
September
72.8
Pretreat-
A djuisted
Meanls
6 Monitlis
9 MonIt/is
12 Mo1itlhs
33.7
34.6
32.9
38.1
39.4
33.0
40.0
41.3
32.4
33.8
37.0
33.2
37.0
39.0
32.7
36.7
36.2
36.8
43.6
44.9
36.7
42.9
45.0
37.2
37.0
42.7
36.9
40.1
43.9
36.8
meiit
Work
Participation
Assigned
Comparison
Super vision
Participation
Assigned
Comparison
The means for the first two satisfaction measures and the three goal setting posttreatment
periods adjustedby the covariance analysis.
b
1977
Ivancevich.
415
F
9.87, p < .01). As hypothesized (I), both the participation and assigned goal setting groups reported higher levels of work and supervision
satisfaction than the comparison subjects.
Planned comparisons of the participation group versus the assigned goal
setting group were made for each of the four performance criteria. Contrary to hypothesis II, the assigned goal setting group revealed better performance improvement than their participation counterparts. For service
complaints, the assigned group (M' -5.58)
revealed significantly fewer
complaints than the participation group (M'
7.17). The difference was
statistically significant (F = 8.10, p < .04). On the other hand, the participation group showed a better safety record (M' - 64.2 versus M'72.8; F - 6.03, p < .05). There were no significant differences with regard
to unexcused absenteeism between the participation and assigned goal
setting groups.
A planned comparison of the participation group versus the assigned
group on the satisfaction variable showed no significant difference (M' 37.0 versus M'- 39.0, F = 1.03, ns). However, the assigned group reported more satisfaction with supervision, M' -43.9, than the participation
group, M' -40.19. These differences are significant, F = 5.68, p < .03.
Thus, the assigned goal setting participants report more satisfaction with
supervision.
The data analysis revealed that for two performance criteria the assigned
goal setting group showed more improvement than the participation goal
setting group. For one performance variable the participation group indicated better performance. However, for the unexcused absenteeism variable there was no significant difference between the groups. When the
satisfaction variables were analyzed there was no significant difference on
one (work), but the assigned goal setting subjects reported a greater increase in satisfaction with supervision than the participation goal setting
subjects. As a whole, it appears that the assigned goal setting subjects are
performing more effectively and are more satisfied with supervision than
the participation goal setting subjects. Thus, hypothesis II can not be
accepted.
In order to carefully trace changes in mean scores between each of the
four data collection points it was decided to utilize the Duncan multiple
range test. Hypothesis III proposed that although there would be performance and satisfaction improvements in the two goal setting groups,
these would diminish over the course of the study-pretreatment to 12
months. A careful inspection of Table 4 reveals that a number of improvements occur in both the performance and satisfaction variables when the
six month-pretreatmentmeans are analyzed. However, note the decreases
in performance mean scores for every variable when the 12-month means
are compared to the nine-month mean scores.
For both the participation and the assigned groups there is an increase
in unexcused absenteeism, service complaints, and cost of performance
between the ninth and twelfth month. There is also a decrease in both
416
September
TABLE 4
Performance and Satisfaction Means for Goal Setting Groups
and Duncan's Multiple Range Tests
Pretreati1nenit
Performance
Measures
UnzexclusedA bsentieeisl7n
Participation
Assigned
Se;-iviceComilplainlt
Participation
Assigned
Cost of Performance
Participation
Assigned
Safety
Participationl
Assigned
Satisfaction
Measures
Work
Participation
Assigned
Supervision
Participation
Assigned
6 MoInthis
.082--.0648.7
7.9
.002
--.o( I
73.6-78. 1
11.40
1. I0--
.074
.059
1.38
--.70-
-43.6
-44.9
--40.0-:
41.3---
1.43
-1.04
ns
72.0
79.1
ns
ns
-33.8
-37.0
ns
----37.()
--42.7
llS
42.9-::
45.0-
ns
ns
8.01
:---6.92
-61.7
-62. 4
-38.
1---33.9-::
39.4--34.6 --:` 36.7--36.2--
.041
.(01
-7.J4
1-
1.91
1.50
9 Monlthls
the
t Suggests that the difference is significant but in an opposite direction. For example,
assigned service complaint mean at nine months is 5.32, while at 12 months it is 6.92. Tfhe
service complaints have increased significantly. Howevc-, notice that they are still lower
than the pretreatmient mean of 7.91.
p < .01; Differences between data points are significant. For example, the .082 and
.002 means for the participation grotup on the tinexctused absenteeism variable are significantly
different.
.05.
p
work and supervision satisfaction in these two goal setting groups. For
example, the assigned group at nine months reported a work satisfaction
mean of 41.3, while at 12 months they indicate less satisfaction, with
a mean score of 37.0. In general, the data in Table 4 suggest that performance and satisfaction improvements in goal setting groups diminish over
a period of time.
The data and analysis in Table 4 generally support hypothesis III. Improvements in performance and satisfaction occur early after the training,
but they begin to diminish between the sixth and ninth months. In this
organization this information could point out the need to implement some
type of program to prolong the initial improvements in performance and
satisfaction.
DISCUSSION
The results indicate that formal goal setting, participation and assigned,
is superior to "do your best" on such performance variables as service com-
1977
Iiancevich
417
plaints, cost, and safety, and is also superior with regard to work and
supervision satisfaction. These results tend to support the hypothesis (I)
that the assigned and participation goal setting skilled technicians will perform more effectively and be more satisfied than the comparison group of
skilled technicians. These results are consistent with previous laboratory and,
field research findings (Locke & Bryan, 1966; Latham & Yukl, 1975a),
which showed that goal setting groups performedbetter than nongoal setting
groups.
These findings also agree with the medical personnel findings (Wexley &
Nemeroff, 1975), which found organizational improvements after formal
goal setting training. The medical study, however, only covered a period of
60 days after training. Additional support for goal setting training effecttiveness is found in a 12-week study of loggers (Latham & Kinne, 1974).
The present findings suggest that even when a longer period of time is used
to adequately test the full impact of goal setting training among organizational personnel the results are still favorable.
Interestingly, the results of the present study indicate slight superiority
of the assigned goal setting treatment over the participation goal setting
treatment. Hypothesis II suggested that the participation goal setting participants would perform more effectively and be more satisfied than their
assigned goal setting counterparts. The Latham and Yukl (1975a) study
found no superiority of participative over assigned goal setting treatments
for educated loggers. The skilled technicians in the present study are
educated, but are in a craft occupation, which may account for the differences in the Latham and Yukl (I 975a) and present study findings. Another
possible explanation for the superiority of the assigned goal setting treatment could involve the typical procedures used in the organization. The
participation condition in goal setting may be so different than what the
skilled technicians and supervisors are used to that it is not sustained over a
period of time such as nine or 12 months.
In this organization, prior to the formal goal setting training, the
predominant practice was for supervisorsto instruct the technicians to "do
your best." This was the procedure used in the comparison group. In the
participation group, the process of goal setting encouraged mutual
supervisor-subordinate agreement about the four performance criteria,
while in the assigned group the supervisorexamined past records of performance, informally discussed these criteria with the technicians, and then
assigned goals to subordinates. The assigned condition seems to be similar
to the typical procedures and could be considered a less drastic change.
Thus, the similarity between past and present could account for greater
improvements in the six dependent variables in the assigned group as
opposed to the particpation group.
Hypothesis III, based on previous goal setting research (Ivancevich,
1974), suggested that initial performance and satisfaction improvements
would diminish over the duration of the study. The findings indicate that
for at least six months both the participation and assigned goal setting
418
September
groups were superior to the comparison group. However, there is a pronounced dissipation of performance and satisfaction improvement approximately nine months after training, which is highlighted in Table 4. It seems
reasonable to suggest that reinforcement programs or refresher training are
needed to sustain task performance and satisfaction improvements in the
goal setting programs. The type, intensity, duration, and degree of reinforcement or retraining need to be studied in organizational settings.
Perhaps some combination of extrinsic feedback, intrinsic feedback,
and refresher training in addition to initial goal setting training would sustain the performance and satisfaction improvements. Kim and Hamner
(1976), in a quasi-experimental study of telephone company employees,
found that when evaluative and nonevaluative feedback is added to a goal
setting situation, performance is enhanced beyond the goal setting only up
to 90 days after the treatment.
The findings presented here obviously do not provide managers with
conclusive evidence regarding the superiority of goal setting treatments,
such as participation and assigned, over a "do your best" treatment. No
single field study using approximately 195 skilled technicians and supervisors in one organization can. Yet, it has been found that the assigned treatment needs to be considered as a viable alternative to the participation
treatment. A greater managerial awareness of the differences between the
typical procedures used in an organization and the goal setting treatment
which is being implemented seems to be appropriate. Whatever goal setting
treatment is used, it appears that the Locke (1968) goal setting theory,
which has been consistently supported by laboratory studies and a few field
studies, has applicability to the individuals who were involved in the present
study.
REFERENCES
1. Fayol, H. Genieral antd Indi stial Mantagemnent,trans. by C. Storrs (London: Pitman,
1949).
2. French, J. R., E. Kay, and H. H. Meyer. "Participation and the Appraisal System,"
Humani Relationas, Vol. 19 (1966), 3-19.
3. Hays, W. L. Statistics: For The Social Sciences (New York: Holt, Rinehart & Winston,
1973).
4. Ivancevich, J. M. "Changes in Performance in a Management By Objectives Program,"
Admfinistraftie Scientce Quarterly, Vol. 19 (1974), 563-574.
5. Kim, J. S., and W. C. Hamner. "Effect of Performance Feedback and Goal Setting on
Production and Satisfaction in an Organizational Setting," Journal of Applied Psychology, Vol. 61 (1976), 48-57.
8. ILatham,G. P., and G. A. Yukl. "Assigned Versus ParticipativeGoal Setting with Educated and Uneducated
Psychology,
Vol.
60
(1975a), 299-302.
9. Latham, G. P., and G. A. Yukl. "A Review of Research on the Application of Goal
Setting in Organizations,"Academy of Managemient Jour-nal, Vol. 18 (1975b), 824-845.
1977
Ivancevich
419
10. Latham, G. P., and G. A. Yukl. "Effects of Assigned and Participative Goal Setting
on Performance and Job Satisfaction," JouIrn?al of Applied Psychology, Vol. 61 (1976),
166-171.
11. Likert, R. New Patternis of Maniagemiienit (New York: McGraw-Hill, 1961).
12. Locke, E. A. "Toward a Theory of Task Performance and Incentives," Organlizationtal
Behavior anld HunmaniPerfornianice, Vol. 3 (1968), 157-189.
13. Locke, E. A., and J. F. Bryan. "The Effects of Goal Setting, Rule Learning and Knowledge of Score on Performance," AmiiericainJournslalof PsYclhology, Vol. 79 (1966), 451457.
14. Locke, E. A., J. F. Bryan, and L. M. Kendall. "Goals and Intentions as Mediators of
the Effects of Monetary Incentives on Behavior," Joournal of Applied Psychology, Vol.
52 (1968), 104-121.
15. Lowin, A. "Participative Decision-Making: Model, Literature Critique, and Prescription
for Research," Origaiiizationial Behavior atild Humiiiani Perfonianice,
Vol. 3 (1968), 68106.
16. McGregor, D. The HumiiiantSide of Enterprise (New York: McGraw-Hill, 1960).
17. Nunnally, J. C. Psychometric Thieory (New York: McGraw-Hill, 1967).
18. Smith, P. C., L. M. Kendall, and C. L. Hulin. The Measurement of Satisfaction in
Work antd Retirem?ienti (Chicago: Rand McNally, 1969).
19. Steers, R. M., and L. W. Porter. "The Role of Task-Goal Attr-ibuitesin Employee Performance," Psycliological Builletin, Vol. 81 (1974), 434-452.
20. Viteles, M. S. Motivatioti and(lMorale in Inidustrx'(New York: Nortonl, 1953).
21. Vroom, V. H. Work and Motihation (New York: Wiley, 1964).
22. Vroom, V. H., and P. Yetton. Leadersliip anid Decision Makinig (Pittsburgh: University
of Pittsburgh Press, 1973).
23. Wexley, K. N., and W. F. Nemneroff. "Effectiveness of Positive Reinforcement and
Goal Setting as Methods of Management Development," Jolurnlalof Applied PSYchology,
Vol. 60 (1975), 446-450.
24. Winer, B. J. Statistical Prinlciples in Experimilenital Design (New York: McGraw-Hill,
1973).
25. Yukl, G. A. "Toward a Behavioral Theory of Leadership," Organizational Behav,ior
anid Human Performance, Vol. 6 (1971), 414-440.