Introduction
Search engines have become one of the most important
Web services because of the rapid growth in the amount of
information available on the Internet. Increasingly advanced
features are being developed to improve the standard of service provided to search engine users. However, for search
engine designers, choosing from the abundance of features
on a design checklist presents a challenging task. Therefore,
a theoretical framework should be developed as the basis
Received April 21, 2007; revised April 16, 2008; accepted April 16, 2008
2008 ASIS&T Published online 9 July 2008 in Wiley InterScience
(www.interscience.wiley.com). DOI: 10.1002/asi.20889
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 59(11):18291840, 2008
Related Work
Herzbergs Two-Factor Theory
The two-factor theory was proposed by Herzberg et al.
(1959) to account for workers job motivation. Herzberg et al.
asked people what they liked and did not like about their
1830
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi
stop when the expected search cost is higher than the benefits that would be gained from searching further (Bearden &
Connolly, 2007; Deck & Wilson, 2006; Manning & Morgan,
1982; Zwick, Rapoport, Lo, & Muthukrishnan, 2003).
From the aforementioned analysis, it is clear that these two
strategiesquerying and browsingoccur alternately, as
noted by Bates (1989). Information seekers might start with a
query, and then browse the query results to learn new information, which might modify their information needs and mold
another query. This alternating process might continue until
the information seeker finds satisfactory results. Bates called
this process an evolving search. Research articles in a special
issue of the Communications of the ACM (Marchionini, 2006;
White, Kules, Drucker, & Schraefel, 2006) support Bates
concept, but called the phenomenon exploratory search. This
idea of evolving search sheds new light on the functions that
should be provided in search engines. Given that querying and
browsing are interdependent and therefore complementary
information-seeking strategies, features that support browsing (i.e., motivation factors) should be provided in a search
engine in addition to the features that support querying (i.e.,
hygiene factors). As the number of query results can be very
large, the features that support browsing allow users to extract
important information from a long list of query results and
help them accomplish the task of finding needed information.
Although previous studies have identified many search
engine features, they did not categorize them based on any
theoretical framework. Traditional features such as recall
and precision, coverage, overlap, search time, and validity
of links are usually deemed essential for search engines (Chu
& Rosenthal, 1996; Gordon & Pathak, 1999). Less popular features include response time, recency, expected search
length, relevance ranking, accuracy, cost, reliability, and stability (Lawrence & Giles, 1998a; Vaughan, 2004). Recently
added features such as a multilanguage search/query function, a multimedia search/query function, a summary of query
results, and advanced search instructions, which have yet to
be discussed thoroughly in the literature, also are considered
in this research. In total, 23 features of search engines are
identified and listed, along with their references, in Table 1.
We believe that these features can be related to the specific
dimensions of the hygiene and motivation factors defined by
Herzberg (2003), as shown in Table 2. Since the two-factor
theory distinguishes between hygiene factors and motivation
factors, we propose that the same dichotomy can be applied
to the features of search engines. Hygiene factors, which
support query tasks, include features such as the response
time, recall rate, precision rate, number of results, stability,
and live links. On the other hand, motivation factors, which
support the browse strategy, include features such as ranking, catalog browsing, and understandable result summaries.
Such features, which are similar to the motivation features
of a job, are challenging for users and engender a sense of
growth and advancement through learning. Zhang and colleagues (Zhang & von Dran, 2000; Zhang, von Dran, Small, &
Barcellos, 1999, 2000) suggested a similar classification for
Web services designed for information seeking.
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi
1831
TABLE 1.
Su (2003a, 2003b)
8. Diversity of result sources (Overlap): Diversity of Web sites that the results
are obtained from
9. Use instruction of system: Clarity of the instructions for using the search
engine system
Su (2003a, 2003b)
Su (2003a, 2003b)
Su (2003a, 2003b)
Motivation factors
15. Readability of search results: Ease of reading the search results
16. Understandability of the summary of search results: A summary that is
easy to understand and helps a user decide whether he/she needs the result
17. Ranking: The degree that the relevance ranking of search results
meets the users needs
Su (2003a, 2003b)
Su (2003a, 2003b)
20. Advanced search: Ease of using advanced search functions to process the
search results
21. Search tips: Provides tips for improving queries when the search results are not
satisfactory
Su (2003a, 2003b)
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi
TABLE 2.
Herzbergs hygiene
factors
Examples of Herzbergs
hygiene factors
Theorized applications
in search engines
Working conditions
Live links.
Stability of the system.
Retrieve a large amount of relevant information.
Diverse sources of information.
Company policy
Feedback or response
Response time.
Provides instructions about formulating
new queries.
n/a
Salary
Wages
n/a
Interpersonal relations
Coworkers attitudes
n/a
n/a
Supervision
Authority, availability of
a supervisor
Availability of designers
Challenging, interesting,
meaningful work
Achievement
Task completion
n/a
n/a
Responsibility
User control
Advanced search/query.
Search/query tips.
Recognition
n/a
n/a
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi
1833
included simultaneous measurements of many different variables (i.e., 14 hygiene factors and nine motivation factors), it
is necessary to use multivariate analysis, such as Bonferronis
method, to understand the relationships between the variables
(Johnson & Wichern, 2002). Bonferronis method allows
simultaneous comparison among correlated components
of vector measurements without increasing the probability of
Type I errors (i.e., falsely rejecting the null hypotheses).
Therefore, the method is more appropriate for our study
than are tests that require independent groups, such as the
chi-square and Tukey tests.
To test the hypotheses, the differences between attract
and retain responses were calculated for each of the 23
features selected by each respondent. Therefore, for each
respondent, there were 23 analysis units (pair differences
between attract and retain), the value of which could
be 1, 0, or 1. The means of the 23 matched pair differences
(range = 1 to 1) were compared to zero simultaneously
to test the hypotheses that the two factors (hygiene vs.
motivation) play different roles in attracting and retaining users. For hygiene factors (Factors 114 in Table 1),
the null hypothesis is D = 0,1 and the alternative hypothesis is D > 0 (asttract > retain). On the other hand,
for motivation factors (Factors 1523 in Table 1), the null
hypothesis is D = 0, and the alternative hypothesis is D < 0
(attract < retain).
Data-Collection Procedure
The survey was posted on the Web in October 2005 to
collect data. The incentive for participating in the survey was
a movie-ticket lottery. In total, 804 surveys were collected
in 2 weeks. After removing duplicate submissions, incomplete answers, and surveys that had the same answer for more
than five consecutive questions, 758 (94.3%) of the collected
surveys were deemed valid. Next, we discuss the empirical
results of the survey.
Empirical Results
Demographics and Experience of Using the
Internet and Search Engines
Sample demographics of this research are shown in the
left-hand part of Table 3. The results show that 95% of
the respondents were between 18 and 30 years old, and
70.45% were students. Compared with the Survey of Taiwan
Internet Usage by Yam.com in 2005 (the right-hand part of
Table 3), the sample demographics of this research were obviously biased in terms of age, education, and occupation. We
studied other large-scale Internet surveys to see if the Internet
use of our respondents deviated from that of the general population of Internet users. Compared with the demographics of
an Internet survey by Taiwans Ministry of Transportation and
Communications, the history and frequency of Internet use
of our sample were similar to those of the general population
1
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi
TABLE 3.
Variable
Yam.com survey
Frequency
(%)
(%)
Age
<17 years
1823 years
2429 years
3035 years
3640 years
4146 years
>47 years
3
483
237
25
7
1
2
(0.40)
(63.72)
(31.27)
(3.30)
(0.92)
(0.13)
(0.26)
<19 years
2024 years
2529 years
3034 years
3539 years
4044 years
>45 years
(14)
(19)
(24)
(17)
(12)
(7)
(6)
Gender
Male
Female
355
403
(46.83)
(53.17)
Male
Female
(41)
(59)
Education
Elementary school
Junior high school
Senior high school
College
Masters
Ph.D.
2
2
13
516
218
7
(0.26)
(0.26)
(1.72)
(68.07)
(28.76)
(0.92)
<Elementary school
Junior high school
Senior high school
College
Masters
(3)
(4)
(22)
(62)
(9)
Occupation
Not student
Student
224
534
(29.55)
(70.45)
Not student
Student
(75)
(25)
TABLE 4.
Sample of this
research
Frequency
(%)
Taiwan
government
survey
(%)
History
<1 year
13 years
35 years
>5 years
4
30
158
566
0.52
3.96
20.84
74.68
2.3
13.3
24.1
58.2
Frequency
1
4
10
743
0.13
0.53
1.32
98.03
1.4
1.2
28.7
64.2
8
6
16
136
126
393
73
(%)
0.52 Yes
3.96 Probably
20.84 Not certain
74.68 Probably not
16.62 Absolutely not
Continued use
Frequency
(%)
582
157
15
76.78
20.71
1.98
3
1
0.40
0.13
0.13
0.53
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi
1835
800
Frequency
Hygiene factors
Motivation factors
600
Attract
400
Retain
200
0
10
11
12
13
14
15
16
17
18
19
20
21
22
23
FIG. 1.
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi
TABLE 6.
Means of pair differences between attract and retain responses for hygiene and motivation factors.
99% Bonferroni simultaneous
confidence interval
No.
Description
Hygiene factors
1
2
3
4
5
6
7
8
9
10
11
12
13
14
Recall
Response time
Percentage of nonresult information
Precision
Validity of links
System stability
Recency
Diversity of result sources
Use instructions for the system
No. of results
Multilanguage search
Multimedia search
Accessibility of instructions for using the system
Search instructions
Motivation factors
15
16
17
18
19
20
21
22
23
Significantly
SD
Lower bound
Upper bound
Significance
0.067
0.139
0.153
0.053
0.198
0.108
0.036
0.113
0.110
0.066
0.034
0.158
0.024
0.042
0.213
0.193
0.302
0.135
0.299
0.284
0.275
0.365
0.351
0.286
0.208
0.289
0.187
0.159
0.066
0.138
0.152
0.052
0.197
0.107
0.035
0.112
0.108
0.065
0.033
0.159
0.023
0.043
0.068
0.139
0.154
0.053
0.199
0.109
0.037
0.115
0.111
0.067
0.035
0.157
0.025
0.042
0.0238
0.01715
0.0594
0.01451
0.06992
0.0594
0.0106
0.0343
0.0211
0.327
0.300
0.273
0.252
0.303
0.267
0.267
0.181
0.145
0.025
0.016
0.061
0.013
0.069
0.061
0.012
0.035
0.022
0.022
0.018
0.058
0.016
0.071
0.058
0.009
0.033
0.020
different from 0.
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi
1837
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi
If the effects of contextual variables and individual characteristics can be determined, we could provide customized
functionalities in search engines to serve users with different
goals, tasks, and expertise. Finally, besides the dual structure
proposed by Herzberg et al. (1959), other theories such as
prospect theory (Kahneman, & Tversky, 1979) and Kanos
model of attractive quality (Kano, Seraku, Takahashi, &
Tsuji, 1984) can provide different perspectives on the impact
of hygiene factors and motivation factors in relation to search
engines. As we assess the effects of hygiene factors in negative terms and motivation factors in positive terms, prospect
theory provides another interesting theoretical foundation
because it hypothesizes different effects in terms of loss and
gain. Moreover, Kanos model extends Herzbergs two-factor
theory to a model with five categories of quality features, and
emphasizes the dynamic impacts of these features. Hence, it
also would be interesting to consider if search engine features can be classified according to these five categories and
if they have different impacts on user behavior along with the
development of search engines.
As Zhang and von Dran (2000, p. 1256) noted, an effective information retrieval system should not only ensure
technical functionality . . . , but also seek to maximize user
capabilities to control, enjoy and manipulate the information seeking process. The suggested future-research avenues
outlined earlier are intended to improve the effectiveness of
search engines from the perspective of users. After all, a successful information-seeking process lies in fluent interaction
between a powerful system and satisfied users.
Acknowledgments
We thank the anonymous referees for their invaluable comments, which have helped us improve the article significantly.
In addition, we express our gratitude to Professor Shan-Yu
Chou, who provided us with a great deal of information and
many suggestions about the literature on consumer information search behavior. Finally, we thank Professor Yu-zer
Joung for his insightful comments on the revision of this
article.
References
Allport, G.W. (1961). Pattern and growth in personality. New York: Holt,
Rinehart and Winston.
Bates, M.J. (1989). The design of browsing and berrypicking techniques for
the online search interface. Online Review, 13(5), 407424.
Bearden, J.N., & Connolly, T. (2007). Multi-attribute sequential search.
Organizational Behavior and Human Decision Processes, 103, 147158.
Chade, H., & Smith, L. (2006). Simultaneous search. Econometrica, 74(5),
12931307.
Chignell, M.H., Gwizdka, J., & Bodner, R.C. (1999). Discriminating
meta-search: A framework for evaluation. Information Processing and
Management, 35, 337362.
Chowdhury, A., & Soboroff, I. (2002). Automatic evaluation of World Wide
Web search services. Proceedings of SIGIR02 (pp. 421422). New York:
ACM Press.
Chu, H., & Rosenthal, M. (1996). Search engines for the World Wide Web: A
comparative study and evaluation methodology. Proceedings of the 59th
American Society for Information Science, 33, 127135.
Clarke, S.J., & Willett, P. (1997). Estimating the recall performance of Web
search engines. Aslib proceedings, 49(77), 184189.
Deck, C.A., & Wilson, B.J. (2006). Tracking customer search to price
discriminate. Economic Inquiry, 44(2), 280295.
Dempsy, B.J., Vreeland, R.C., Summer, R.G. Jr., & Yang, K. (2000). Design
and empirical evaluation of search software for legal professionals on the
WWW. Information Processing and Management, 36, 253273.
Dogpile.com. (2007). Different engines, different results: Web searchers not
always finding what theyre looking for online. A Research Study by
Dogpile.com, in Collaboration with Researchers from Queensland
University of Technology and the Pennsylvania State University.
French, E.B., Metersky, M.L., Thaler, D.S., & Trexler, J.T. (1973).
Herzbergs two factor theory: Consistency versus method dependency.
Personnel Psychology, 26(3), 369375.
Gill, T.G. (1996). Expert systems usage: Task change and intrinsic motivation. MIS Quarterly, Summer, 310329.
Gordon, M., & Pathak, P. (1999). Finding information on the World Wide
Web: The retrieval effectiveness of search engines. Information Processing
and Management, 35(2), 141180.
Grigaliunas, G.S., & Herzberg, F. (1971). Relevancy in the testing
of motivation-hygiene theory. Journal of Applied Psychology, 55,
7379.
Gunn, H. (2006). Searching the Web with multisearch interfaces. Teacher
Librarian, 34(2), 6469.
Hackman, J.R., & Oldman, G.R. (1975). Development of the job diagnostic
survey. Journal of Applied Psychology, 59, 159170.
Hawking, D., Craswell, N., Thistlewaite, P., & Harman, D. (1999). Results
and challenges in Web search evaluation. Computer Networks, 31,
13211330.
Hendriks, P. (1999). Why share knowledge? The influence of ICT on the
motivation for knowledge sharing. Knowledge and Process Management,
6(2), 91100.
Herzberg, F. (1966). Work and the nature of man. Cleveland, OH: World
Publishing.
Herzberg, F. (2003). One more time: How do you motivate employees?
Harvard Business Review, January, 8796.
Herzberg, F., Bernard, M., & Snyderman, B. (1959). The motivation to work.
Snyderman, NY: Wiley.
House, R.J., & Wigdor, L.A. (1967). Herzbergs dual-factor theory of job
satisfaction and motivation: A review of the evidence and a criticism.
Personnel Psychology, 20(4), 369389.
Johnson, R.A., & Wichern, D.W. (2002). Applied multivariate statistical
analysis (5th ed.). London: Prentice Hall.
Jux2. (2006). Search engines are more different than people think. Retrieved
July 24, 2006, from www.jux2.com/stats.php
Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of
decision under risk. Econometrica, 47, 263291.
Kanfer, R. (1990). Motivation theory and industrial and organizational psychology. In M.D. Dunnette & L.M. Hough (Eds.), Handbook of industrial
and organizational psychology (2nd ed., Vol. 1, pp. 75170). Palo Alto,
CA: Consulting Psychologists Press.
Kano, N., Seraku, N., Takahashi, F., & Tsuji, S. (1984). Attractive quality
and must-be quality. Hinshitsu, 14(2), 147156.
Kopelman, R.E. (1986). Managing productivity in organizations. New York:
McGraw Hill.
Lawrence, S., & Giles, C.L. (1998a). Inquirus, the NECI meta search engine.
Computer Networks and ISDN Systems, 30, 95105.
Lawrence, S., & Giles, C.L. (1998b). Searching the World Wide Web.
Science, 280, 98100.
Leighton, H.V., & Srivastava, J. (1999). First 20 precision among World Wide
Web search services (search engines). Journal of the American Society for
Information Science, 50, 870881.
Liang, T.-P., & Lai, H.-J. (2002). Effect of store design on consumer
purchases: An empirical study of on-line bookstores. Information &
Management, 39, 431444.
Maddox, R.N. (1981). Two-factor theory and consumer satisfaction:
Replication and extension. Journal of Consumer Research, 8(1),
97102.
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi
1839
1840
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGYSeptember 2008
DOI: 10.1002/asi