and Questionnaires
RESEARCH PROCESS
Identify and Define Research Problem
Theory / Practice
Hypotheses / Conceptualization
Research Design
Data collection
In this workshop we
talk about all of the
steps in the research
process except Data
Analysis and Findings.
Data Analysis
Findings
What is a problem?
. . . any situation where a gap exists between the
actual and the desired state.
A problem does not necessarily mean that something
is seriously wrong. It could simply indicate an interest
in improving an existing situation. Thus, problem
definitions can include both existing problems in the
current situation as well as the quest for idealistic
states in the future.
Types of Variables:
Constructs
Brand Awareness
Brand Attitudes
Purchase Intentions
Importance of Factors
Psychographics
Satisfaction
Operational Description
Percentage of respondents that have heard of a
designated brand; awareness could be either
unaided or aided.
The number of respondents and their intensity of
feeling positive or negative toward a specific brand.
The number of people planning to buy the
specified object (e.g., product or service) within
a designated time period.
To what extent do specific factors influence
a person's purchase choice.
The attitudes, opinions, interests and
lifestyle characteristics of individuals
providing the information.
How people evaluate their post-purchase
consumption experience with a particular
product, service or company.
RESEARCH PROCESS
Identify and Define Research Problem
Theory / Practice
Hypotheses / Conceptualization
Research Design
Data collection
Data Analysis
Findings
What is theory ??
RESEARCH PROCESS
Identify and Define Research Problem
Theory / Practice
Hypotheses / Conceptualization
Research Design
Data collection
Data Analysis
Findings
Purchase
Likelihood
Price
Independent
Dependent
Variable
Variable
Moderator Variable
Discount Level
Restrictions
Price
Purchase
Likelihood
Independent
Dependent
Variable
Variable
Mediator Variable
(full mediation)
Price
Perceived
Value
Purchase
Likelihood
Mediator Variable
(partial mediation)
Perceived
Value
Price
Purchase
Likelihood
Independent
Dependent
Variable
Variable
Work Groups
Employee
Commitment
Compensation
Supervision
Work Groups
Intention to
Search
Compensation
Potential Hypotheses:
Commitment is positively related to supervision, work groups and compensation.
Intention to Search is negatively related to supervision, work groups & compensation.
Variable Type
Metric
Metric
Metric
Metric
Metric
Metric
Metric
Metric
Metric
Metric
Metric
Metric
Food Quality
Atmosphere
Prices
Employees
Nonmetric
Nonmetric
Nonmetric
Nonmetric
Relationship Variables
X17
X18
X19
X20
X21
Satisfaction
Likely to Return in Future
Recommend to Friend
Frequency of Patronage
Length of Time a Customer
Metric
Metric
Metric
Nonmetric
Nonmetric
Classification Variables
X22
X23
X24
X25
X26
X27
X28
Gender
Age
Income
Competitor
Which AD Viewed (#1, 2 or 3)
AD Rating
Respondents that Viewed Ads
Nonmetric
Nonmetric
Nonmetric
Nonmetric
Nonmetric
Metric
Nonmetric
RESEARCH PROCESS
Identify and Define Research Problem
Theory / Practice
Hypotheses / Conceptualization
Research Design
Data collection
Data Analysis
Findings
(2)
(3)
RESEARCH DESIGN
Role of Qualitative Research:
Search of academic, trade and professional
approach.
Draft questionnaire.
RESEARCH DESIGN
sample to population.
Facilitates examination of large number of
representative cases.
Structured approach to data collection.
Enables extensive statistical analysis.
RESEARCH PROCESS
Identify and Define Research Problem
Theory / Practice
Hypotheses / Conceptualization
Research Design
Data collection
Data Analysis
Findings
DATA COLLECTION
Approaches:
Observation
Human
Mechanical/Electronic Devices
Surveys
Self-Completion
Mail/Overnight Delivery/Fax
Electronic
Interviewer-Administered
Face-to-Face Home, Work, Mall, Focus Groups
Telephone
DATA COLLECTION
Budget
Knowledge of issues qualitative vs. quantitative
Respondent Participation
Taste Test; Ad Test
Card Sorts; Visual Scaling
Time Available
DATA COLLECTION
Types of Data:
Primary
Secondary
PRIMARY DATA
Primary Data
Features
Durability
Physical Design
Battery Function
Operation
27%
23%
19%
16%
15%
21%
16%
28%
16%
19%
These percentages
typically are determined
in quantitative surveys
(descriptive research).
Primary Data
Primary Data
39%
22%
19%
14%
5%
CONSIDERATIONS:
Methods human/mechanical/electronic.
Useful where respondent cannot or will not
articulate the answer.
Purpose of Questionnaires:
To obtain information that cannot be easily
concepts/constructs.
QUESTIONNAIRE DESIGN
Steps in Questionnaire Design:
1. Initial Considerations problem, objectives,
target population, sampling, etc.
2. Clarification of Concepts select variables,
constructs, measurement approach, etc.
3. Developing the Questionnaire
QUESTIONNAIRE DESIGN
QUESTIONNAIRE DESIGN
QUESTIONNAIRE DESIGN
Open-ended Questions
small samples.
Allows respondent freedom of response.
Respondent must be articulate and willing to spend time
giving a full answer.
Data is in narrative form which can be time consuming and
difficult to code and analyze.
Possible researcher bias in interpretation.
Narrative is analyzed using of content analysis. Software
is available (e.g., NUD*IST).
QUESTIONNAIRE DESIGN
Closed-end Questions:
Single Answer
Multiple Answer
Rank Order
Numeric
Likert-Type Scales
Semantic Differential
4.
Which countries in Europe have you traveled to in the last six months?
__ Belgium
__ Germany
__ France
__ Holland
__ Italy
__ Switzerland
__ Spain
__ Other (please specify) _____________
5.
QUESTIONNAIRE DESIGN
Closed-end Questions
response categories.
Data can be pre-coded and therefore in a form amenable
for use with statistical packages (e.g., SPSS, SAS)
data capture therefore easier.
More difficult to design but simplifies analysis.
Used in studies involving large samples.
Limited range of response options.
QUESTIONNAIRE DESIGN
Broad Considerations
Sequencing of questions.
Identification of concepts.
How many questions are required to capture
each concept.
Question wording.
Overall length of questionnaire.
Placing of sensitive questions.
Ability of respondents.
Level of measurement.
Open-ended versus closed-end questions.
QUESTIONNAIRE DESIGN
Questionnaire Sequence
Opening Questions
Research Topic Questions
Classification Questions
Rapport Questions:
. . . are used to establish rapport with the respondent
by gaining their attention and stimulating their interest
in the topic.
QUESTIONNAIRE DESIGN
Research Topic Questions
Concept/construct = an abstract idea formed in the mind. The idea
is a combination of a number of similar characteristics/variables that
collectively define the concept and are used to measure it. Constructs
are abstract/intangible and cannot be directly observed or measured
because they are the mental images a person attaches to an object,
such as attitudes, feelings, perceptions, expectations, or expressions
of future actions (e.g., purchase intentions).
Example Concept:
Reliable delivery
Technical sales Support
Inside sales representatives
Field sales representatives
Complaint resolution
Ordering/Invoicing
Website design
QUESTIONNAIRE DESIGN
Concepts
Concept Identification
Conceptual definition e.g., Service Quality.
As perceived by customers, it is the difference
between customers expectations or desires
of a vendor and their perceptions of the actual
situation (their experiences).
QUESTIONNAIRE DESIGN
QUESTIONNAIRE DESIGN
QUESTIONNAIRE DESIGN
QUESTIONNAIRE DESIGN
QUESTIONNAIRE DESIGN
Avoid Position Bias:
Position Bias:
How important are flexible hours in evaluating
job alternatives?
What factors are important in evaluating
job alternatives?
No Position Bias:
What factors are important in evaluating
job alternatives?
How important are flexible hours in evaluating
job alternatives?
QUESTIONNAIRE DESIGN
Double-Barreled Questions:
To what extent do you agree or disagree with the
following statements?
QUESTIONNAIRE DESIGN
Branching Questions:
. . . are used to direct respondents to answer the right
questions as well as questions in the proper sequence.
QUESTIONNAIRE DESIGN
Issues Self-Completion Instructions:
QUESTIONNAIRE DESIGN
QUESTIONNAIRE DESIGN
Identify response bias for below questions:
1.
2.
When you visited the museum, how many times did you read the
plaques that explain what the exhibit contained?
3.
4.
5.
Would you favor increasing taxes to cope with the current fiscal
crisis?
6.
7.
8.
When you buy fast food, what percentage of the time do you
order each of the following types of food?
9.
QUESTIONNAIRE DESIGN
Comments on Questions:
1.
2.
3.
4.
5.
6.
7.
8.
9.
QUESTIONNAIRE DESIGN
Pre-testing Questionnaires:
clarity of instructions
cover letter
clarity of questions
adequacy of codes and
categories for pre-coded
questions
quality of responses
likely response rate
Scale Development
Marketing
Bearden, William O. and Richard Netemeyer, Handbook of Marketing Scales, Sage
Publications, 2nd ed., 1998. Summarizes over 130 marketing related scales.
Bruner, Gordon Paul Hensel, Marketing Scales Handbook, Chicago, Ill., American
Marketing Association, 1992. Includes almost 600 scales.
General
Robinson, John P., Phillip R. Shaver and Lawrence S. Wrightsman, Measures of
Personal and Social Psychological Attitudes, San Diego, CA: Academic Press, 1991.
Contains over 150 published scales in 11 different areas.
Buros Institute of Mental Measurements website has reviews of published tests
and measurements. www.unl.edu/buros
Decision Analyst
www.decisionanalyst.com
Decisive Technology
www.decisive.com
Perseus Development
www.perseusdevelopment.com
Socratic Technologies
www.sotech.com
SPSS
www.spss.com
Survey Builder
www.surveybuilder.com
SurveyPro
www.surveypro.com
SurveySez
www.surveysez.com
WebSurveyor
www.websurveyor.com
MEASUREMENT SCALES
Types of Scales:
Neither Agree
or Disagree
3
Disagree
Somewhat
4
Strongly
Disagree
5
Strongly
Agree
1
Strongly
Disagree
5
Example:
My sales representative is . . . .
SD
D
Courteous
___ ___
Friendly
___ ___
Helpful
___ ___
Knowledgeable
___ ___
N
___
___
___
___
A
___
___
___
___
SA
___
___
___
___
Agree
Somewhat
2
Neither Agree
or Disagree
3
Disagree
Somewhat
4
Strongly
Disagree
5
I always eat at new restaurants when someone tells me they are good.
Strongly
Agree
1
Agree
Somewhat
2
Neither Agree
or Disagree
3
Disagree
Somewhat
4
Strongly
Disagree
5
This approach includes a separate labeled Likert scale with each item
(statement). The summated rating is a total of the responses for all the
items divided by the number of items.
Numerical Scales:
Example:
Using a 10-point scale, where 1 is not at all important
and 10 is very important, how important is ______ in
your decision to do business with a particular vendor.
Note: you fill in the blank with an attribute, such as reliable
delivery, product quality, complaint resolution, and so forth.
___
___
___
___
Discourteous
Unfriendly
Unhelpful
Dishonest
]
]
]
]
]
Very Satisfied
Somewhat Satisfied
Neither Satisfied nor Dissatisfied
Somewhat Dissatisfied
Very Dissatisfied
Courteous Service
Friendly Service
Helpful Service
Knowledgeable Service
Total
____
____
____
____
100
Courteous
Friendly
Helpful
versus
versus
versus
Knowledgeable
Helpful
Courteous
Sorting:
A scaling technique in which respondents are
asked to indicate their beliefs or opinions by
arranging objects (items) on the basis of
perceived importance, similarity, preference
or some other attribute.
___
___
___
___
Scale Development
Scale Development
Balanced vs. Unbalanced Scales?
Balanced:
To what extent do you consider TV shows with sex and
violence to be acceptable for teenagers to view?
__ Very Acceptable
__ Somewhat Acceptable
__ Neither Acceptable or Unacceptable
__ Somewhat Unacceptable
__ Very Unacceptable
Unbalanced:
__ Very Acceptable
__ Somewhat Acceptable
__ Unacceptable
Scale Development
Forced or Non-Forced?
How likely are you to purchase a laptop PC in the next six months?
Very
Very
Unlikely
Likely
1
2
3
4
5
6
__ No Opinion
Scale Development
Category Labels for Scales?
Verbal Label:
How important is the size of the hard drive in selecting a laptop PC to purchase?
Very
Somewhat
Neither Important
Somewhat
Very
Unimportant
Unimportant
or Unimportant
Important
Important
1
2
3
4
5
Numerical Label:
How likely are you to purchase a laptop PC in the next six months?
Very
Very
Unlikely
Likely
1
2
3
4
5
Unlabeled:
How important is the weight of the laptop PC in deciding which brand
to purchase?
Very
Very
Unimportant
___
Important
___
___
___
___
MEASUREMENT SCALES
Capabilities of Respondents.
Context of Scale Application.
Data Analysis Approach.
Validity and Reliability.
MEASUREMENT SCALES
Validity
Reliability
Measurement Error = occurs when the
values obtained in a survey (observed values)
are not the same as the true values
(population values).
RESEARCH DESIGN
Types of Errors:
SECONDARY DATA
SECONDARY DATA
Availability
Relevance
Accuracy
Sufficiency
RESEARCH PROCESS
Identify and Define Research Problem
Theory / Practice
Hypotheses / Conceptualization
Research Design
Data collection
Data Analysis
Findings
Data Analysis
Methods:
Dependence
Multiple Regression
Discriminant Analysis
ANOVA/MANOVA
Interdependence
Factor Analysis
Cluster Analysis
Learning Checkpoint: