Consumer Futures
Consumer Futures
Consumer Futures represents the interests of consumers across essential,
regulated markets. We use compelling evidence, expert analysis and
strong argument to put consumer interests at the heart of policy-making
and market behaviour.
Consumer Futures is the statutory representative for consumers of postal
services across the United Kingdom, for energy consumers across Great
Britain and for water consumers in Scotland. It maintains the powers,
responsibilities and duties of Consumer Focus.
In April 2014 Consumer Futures will become part of the Citizens Advice
service.
Consumer Futures
Foreword
Price comparison websites (PCWs) have mushroomed over recent years
and are now seen by many as a tool of consumer empowerment. They
are slowly beginning to shift traditional asymmetries in information
and power between a consumer and a supplier. The price comparison
intermediaries market continues to evolve and now alongside more
established PCWs, which focus primarily on information giving and advice,
a new generation of services that build on the price comparison model
is emerging. These include collective switching sites, group purchasing,
mobile apps or more sophisticated consumption data analysers.
The growth of the price comparison tool market is undoubtedly fueled by
consumer demand for third party services which can:
save them time and money when navigating through the maze of deals
and the complexity of products and services on the market
take the hassle of switching, for example switching energy suppliers
help them to understand their consumption needs, and potentially lead
to changes in consumption behavior.
The growing importance of the price comparison tool market was
recognised in the UK Governments consumer empowerment strategy
Better Choice, Better Deals: Consumers powering growth where,
for example, price comparison websites are seen as key tools to
help consumers make better and more informed choices. The UK
Governments midata initiative, which aims to give consumers access to
core consumption and transaction data, is set to power a new breed of
comparison tools that can offer bespoke comparisons to the consumer
based on their specific requirements and their actual use of a service.
However, despite the rapid development of the price comparison tool
market, little is known about:
consumer attitudes, knowledge and experiences of using PCWs
the reasons behind popularity of some services compared to others
consumer appetite for a new generation of intermediary services which
are emerging on the market.
For example anecdotal evidence suggests consumers tend to use PCWs for
car or home insurance, but fewer use them for other markets.
OFT research found that consumers trust price comparison websites for
energy, travel and insurance, but regard them as less reliable for other
financial products, mobile phones and media.
Ofgem research indicated that consumers were less aware of energy price
comparison websites which could help them to choose an energy supplier
or tariff, or help them to switch in comparison to generalist ones which
offer information on a range of consumer goods and services.
Consumer Futures
Marzena Lipman
Policy Manager
Consumer Futures
Table of Contents
1.
2.
3.
4.
5.
6.
6.7 Awareness and usage of accreditation schemes and accredited PCWs ........................... 58
7. The future for price comparison websites.................................................................................. 63
7.1 Anticipated future use of PCWs ........................................................................................ 63
7.2 Collective switching sites ................................................................................................... 63
7.3 Data analyser service ......................................................................................................... 68
7.4 Price comparison apps ...................................................................................................... 70
7.5 Interest in an alternative price comparison service .......................................................... 72
8. Conclusions ................................................................................................................................. 75
8.1 Awareness, perceptions and usage of price comparison sites ......................................... 75
8.2 Trust placed in price comparison sites .............................................................................. 75
8.3 Interest in alternative comparison models and services .................................................. 77
8.4 Ways in which PCWs enable consumers to make more effective choices ....................... 78
8.5 Ways in which PCWs inhibit effective choices .................................................................. 78
8.6 Ensuring that PCWs enable effective decision-making: user experience and usability ... 79
8.7 Ensuring that PCWs enable effective decision-making: accreditation ............................. 80
8.8 Recommendations for the ways PCWs operate................................................................ 80
8.9 Recommendations for further research............................................................................ 80
Appendix A: Methodology ................................................................................................................. 82
Research design .......................................................................................................................... 82
Target audience .......................................................................................................................... 82
Quantitative survey..................................................................................................................... 82
Semi-structured usability hall tests ............................................................................................ 85
Depth interviews ......................................................................................................................... 88
Appendix B: Websites covered in consumer usability testing ........................................................... 91
Appendix C: Quantitative questionnaire ........................................................................................... 92
Appendix D: Hall test screener questionnaire ................................................................................. 123
Appendix E: Hall test questionnaire................................................................................................. 134
Appendix F: Qualitative depth interview discussion guide ............................................................. 142
The Authors
Kate Downer, Associate Director, specialises in public policy, third sector and decisionmaking research, and has led high-profile assignments for Consumer Focus, the Department
for Work and Pensions (DWP) and many private sector clients. Kate has an MA in Modern
and Medieval Languages from Cambridge University, and an MSc in Management and
Business Research Methods from the Open University.
Aino Pietikinen, Project Manager, specialises in public policy and third sector research.
She has worked extensively for public and charity sector clients, including the Department for
Education (DfE), DWP, Nesta (National Endowment for Science, Technology and the Arts)
and the British Red Cross. Aino read Management at UMIST and Science, Technology and
Innovation Management at Manchester Business School, University of Manchester.
Charlotte Crichton, Senior Research Consultant specialises in technology, public and
third sector research. She has worked on a number of studies for Consumer Focus and other
client organisations including Macmillan Cancer Support, the British Library and DWP.
Charlotte read Psychology at the University of Kent.
Date Checked:26.4.13
Glossary of terms
Accreditation scheme
Advertising banner
See Banner
Ad-tracking
Affinity partnership
Airline insolvency
Banner
Billmonitor
Date Checked:26.4.13
Broadband
Signals sent over a wide range of frequencies in highcapacity telecommunications, used for access to the
internet and is sometimes known as high-speed internet
Click-throughs
Commission
Consumer watchdog
Contractual tie-ins
Deal
Date Checked:26.4.13
Depth interview
Direct purchasing
Download
Drop-down menu
Fibre-optic broadband
Filter
Hacking
Hall test
Homepage
Impartial results
Lapsed user
Date Checked:26.4.13
Link
Menu
Date Checked:26.4.13
Package
Pay as you go
Price-led ranking
Date Checked:26.4.13
Profile
Provider
Qualitative research
Quantitative research
Quotes
Rank
Regulated market
Regulator
Regulatory body
Search engine
Date Checked:26.4.13
Search results
See quotes
Search tools
Service provider
Smartphone
Stakeholder
Street intercepts
Supplier
Switching supplier
Tablet computer
Termination charges
Date Checked:26.4.13
Trader
See supplier
Trading Standards
Usage data
Which?
Date Checked:26.4.13
List of acronyms
CAB
CATI
ONS
OFT
PDA
PCW
RDD
RIM
RIU
SEG
Socio-Economic Grade
Date Checked:26.4.13
1.
Executive summary
1.1
Background
Price comparison websites (PCWs) are online tools that consumers can use to assess the
options available to them while shopping online, and to view different prices for specific
products and services. Along with increased penetration of fixed and mobile internet,
smartphones and other portable internet devices, use of PCWs has become increasingly
common among consumers. Previous research has highlighted various concerns about
PCWs, such as the failure of some to provide adequate information about delivery costs,
delivery times, taxes or availability; unclear information about the way search results are
ranked; and lack of information about payments that traders can make in exchange for
ranking placements and listings.1
However, to date there is little evidence of the user experience and usability of PCWs from
the consumer perspective.
Consumer Futures commissioned this research to explore consumer experiences of PCWs in
terms of awareness, trust and confidence, user behaviour, accessibility and usability, and
potential related concerns. The research will allow Consumer Futures to advise stakeholders
on consumer concerns regarding the use of PCWs and, ultimately, to set best practice for
such sites.
Consumer Futures represents the interests of consumers across essential, regulated
markets. It uses compelling evidence, expert analysis and strong argument to put consumer
interests at the heart of policy-making and market behaviour.
Consumer Futures is the statutory representative for consumers of postal services across the
United Kingdom, for energy consumers across Great Britain and for water consumers in
Scotland. It maintains the powers, responsibilities and duties of Consumer Focus.
In April 2014 Consumer Futures will, subject to Parliamentary consent, become part of the
Citizens Advice service.
1.2
Methodology
The research consisted of three elements:
a nationally representative telephone survey of 2,000 consumers aged 18 years and older
a consumer usability exercise with pre-selected PCWs, undertaken via 197 hall tests
qualitative 30-minute face-to-face interviews among 63 consumers (who also took part in
the usability study) to obtain a better understanding of attitudes to PCWs.
The usability hall tests and depth interviews were carried out in five locations across Great
Britain: Watford, Cardiff, Birmingham, Newcastle and Glasgow. They involved consumers
who use the internet to some extent, and who are responsible for researching or buying at
least one of the specified products. The products covered in the scope of the usability tests
and depth interviews are fixed broadband, electricity, home insurance, travel insurance and
mobile phones.
Civic Consulting (2011) Consumer market study on the functioning of e-commerce and Internet marketing and selling techniques in
the retail of goods [Online]. Available from:
http://ec.europa.eu/consumers/consumer_research/market_studies/docs/study_ecommerce_goods_en.pdf [Accessed:07.06.13] ;
Consumer Focus (2013), Comparing comparison sites, http://www.consumerfocus.org.uk/files/2013/01/Comparing-comparisonsites.pdf
i
Date Last Edited: 4 July, 2013
1.3
1.4
ii
Date Last Edited: 4 July, 2013
A few consumers also worry about adverts that are positioned next to results, because this
can make it difficult to identify whether the advertisement is actually part of the search
results. Some users also express concern about sites that encourage creating a personal
user account, or logging in via social media sites, and say that this would deter them from
using that PCW in the future.
Both the quantitative survey and qualitative research show that a key reason for negative
experiences with a PCW is the lack of opportunity to customise or tailor the search. Around a
quarter of the consumers in the hall tests place the ability to customise their search among
their personal top three factors influencing choice of PCW. Many become frustrated if the
search is inflexible and does not allow them to change the search criteria to reflect their
personal situation. They may also become irritated when answering questions requiring
specific information, which they dont have to hand, or when it is not clear why the
information is needed at such an early stage or how it will be used. Other elements that
frustrate consumers include sites not allowing the user to progress until they have provided
all information required (information they may not have to hand), not allowing the user to add
additional explanation (for example, if their situation does not correspond directly to one of
the options in a drop-down menu), and returning to previous pages several times because
incorrect or incomplete data has been provided.
Most people are willing to enter their postcode, because they do not perceive this information
to be overly personal in nature. However, consumers are more hesitant about providing their
telephone number and email address. Out of the two, they are least comfortable with
providing telephone numbers because they expect to receive sales calls as a consequence
of doing so. The majority of consumers are clear that they would not provide their bank
details or more sensitive financial information regarding their income when using a PCW.
In comparing the deals that PCWs offer, users prefer to be presented with a reasonably high
volume of information. It is important, though, that this information is clearly structured. This
allows users to feel confident about what they are buying, and to easily compare the different
options and their features.
Price is the most important factor in the comparison process, with nine out of 10 consumers
in the hall tests mentioning price as one of the three most important factors influencing their
personal decision. Generally, however, consumers do not necessarily choose the cheapest
deal: rather, they compare prices in the context of the overall deal and the information as a
whole. Consequently, the information provided about the deal (ie the product description and
features) is also very important, with two-thirds of consumers placing this among the top
three factors considered. Being a well-known brand is also a key consideration, with around
six in 10 consumers in hall tests mentioning familiarity with, or the reputation of, the product
provider as one of the top three factors they consider when making a decision.
The main perceived benefits of PCWs are getting better deals and saving money. The
majority of users think these sites make price comparisons easier and quicker to complete as
they no longer need to ring numerous providers and provide the same details multiple times.
It allows them to make an informed choice as they can easily compare deals in a structured
manner. Some believe that the sites also show a wider range of product providers while
others think they bring more freedom to do their research when it is convenient for them.
Many also believe they are now more questioning of their deals since they can look at
competitors offers. Indeed, most (83 per cent) PCW users visit more than one site in the
comparison process. Their main reasons for using multiple sites are to make sure they get
the best deal (61 per cent) or to compare or verify the comparison results (42 per cent). The
comparison process often also continues offline, for instance with phone calls to current or
alternative suppliers.
iii
Date Last Edited: 4 July, 2013
Consumers expect PCWs to be accurate and reliable, as well as easy to use, with half of
consumers (52 per cent) specifying getting accurate and reliable information as one of the
three factors that is most important to them when they use a PCW. Generally, consumers are
satisfied with the sites they have used. Over half (57 per cent) rate PCWs they have used in
the past as excellent or very good in terms of ease of use, and half (52 per cent) think they
have been useful in helping the user to find a good deal.
Consumers are happy to switch insurance providers using PCWs. They believe there is little
to gain from being loyal to their current provider, and also consider switching via PCWs to be
fairly easy. Consumers have started to switch utilities providers more in recent years and to
some extent, this is due to PCWs, since these sites are seen to have put more pressure on
the companies by providing consumers with more information about competitors prices.
Furthermore, some PCWs facilitate switching between providers, by making it easy to
purchase products or services directly through the comparison sites and generally reducing
the inconvenience and delays related to switching. Over half of consumers (52 per cent)
have used PCWs to switch providers or purchase products directly, predominantly with car
insurance (77 per cent of those who have used a PCW to switch). Over a third have switched
electricity or gas, or home insurance (37 per cent of those who have switched respectively)
via a PCW. The data suggests that PCWs facilitate supplier switching with utilities companies
in particular: almost half (46 per cent) of people using PCWs for gas or electricity think they
are excellent or very good and, on average, give them a score of 7.1 out of 10 on this
measure.
The main barrier to switching or purchasing directly via PCWs is that consumers want to
speak to their current provider before switching, often to see how the land lies with their
provider, or specifically to bargain. Almost two-thirds of consumers (63 per cent) give this
reason. Some (27 per cent), however, simply prefer to purchase off-line.
Half of all consumers (51 per cent) have not used a PCW in a regulated market (this includes
non-users of PCWs) in the course of the last two years.2 These consumers feel they still
make an active comparison. Nearly half of the non-users of PCWs (44 per cent) seek
information and recommendations from friends, family or neighbours, almost a third (29 per
cent) telephone a number of providers and around one quarter (26 per cent) rely on
advertising. While the proportion who telephone providers is relatively stable across the
different markets, likelihood of seeking others advice varies a little. While around half ask for
recommendations about a TV service or mobile phone deal (53 per cent and 49 per cent
respectively), slightly fewer consult friends, family or neighbours about deals on electricity or
gas (42 per cent) or insurance (37 per cent).
The main reason for not using PCWs is a preference to talk to someone in person (23 per
cent of non-users). A minority have had a negative experience, or have negative perceptions
of PCWs: 15 per cent are put off using sites because they think they are too complicated to
use. The majority of consumers (87 per cent) who dont use PCWs are confident they are
getting the best deal for their needs without one. When comparing themselves to PCW users,
nearly two fifths of non-users (38 per cent) say they get a better deal offline, while almost a
third (29 per cent) think they get the same deal as those using PCWs.
Of consumers who have used PCWs in the past two years, almost eight out of 10 (79 per cent) have used PCWs when investigating
deals for products in regulated markets only.
iv
Date Last Edited: 4 July, 2013
1.5
v
Date Last Edited: 4 July, 2013
1.6
vi
Date Last Edited: 4 July, 2013
Consumers, who are positive about apps, are often heavy mobile internet users, and they
value the convenience that apps offer. Those saying they are unlikely to use price
comparison apps feel that comparing is something they cannot do on the go either
because their mobile phone has a small screen that would make the process difficult, or
because they prefer to make price comparisons when there are no distractions. Other, more
minor, worries include privacy concerns around ad-tracking, not having the required
information to hand at the time, and fear of what might happen to the data the user has
entered if the handset is lost or stolen.
1.7
Conclusions
For a high proportion of consumers, PCWs form part of the usual decision-making
process and, in particular, for insurance products, gas and electricity. Most consumers
are aware of PCWs and the majority of these are able to name at least one of the Big Four
PCWs. More than half of all consumers have actually used PCWs in the last two years.
Advertising has a strong influence on the PCWs that consumers use, so it is unsurprising that
the Big Four sites dominate also in usage.
Consumers main concern about providing personal details is that doing so will result
in unwanted communications. PCWs occupy a position of trust in consumers minds. Most
feel that the information they access through price comparison websites is broadly reliable,
and they address any concerns about reliability by consulting multiple PCWs, or by verifying
information directly with providers.
Internet and PCW users show interest in other kinds of price comparison service that
would allow them to compare offers and get advice on the best deals available, and
have a strong preference for these alternatives to be offered online. Consumers are
interested in collective switching and data analyser services to some extent but there are
questions about mechanics of how these would work in practice. The main concerns relate to
how binding the commitment would be, and to issues of data privacy.
Consumers who participated in the quantitative survey were allocated a product or service
category that they had previously confirmed they had bought or renewed in the previous two
years, and asked, How likely are you to use a price comparison service which would allow you to compare
the offers and get advice on the best deal available for [category]? This does not need to be an online
service. They were asked to pick the most appropriate response from I would definitely use this, I would
consider it, I would possibly consider it if recommended to me by someone I trust and I wouldnt consider
it.
vii
Date Last Edited: 4 July, 2013
Consumers are less likely to be interested in price comparison apps than in the other
alternatives discussed. This disinterest is typically driven by a perceived lack of need to
compare prices on the go. Non-users of PCWs show less interest in accessing these kinds
of service.
Most consumers perceive PCWs to be convenient, useful tools that work in their
favour. They save consumers time and effort, helping them to take more effective action in
making purchasing decisions, and ultimately to secure good deals on products and services.
Many consumers feel that they are empowered by using PCWs and have more leverage over
the providers they use compared to before these sites became mainstream.
Some consumers struggle with sites particular physical features, such as confusing
layouts and small fonts. Consumers also react negatively to sites that dont allow them to
customise or tailor their search to the degree that they want to. On the other hand, PCW
users prefer sites to provide a lot of information about the product or service that is being
compared. While they want brief, straightforward questions to generate a fast comparison,
they want to feel the sites cater to their situation.
Many consumers have never thought about how PCWs make their money, but the
majority are very ready to believe that providers can (and do) pay PCWs in order to
influence comparison results. However, more than half of those who believe that this
happens say that it would not influence their choice of PCW. Many admit that they dont mind
how the sites make their money, as long as they see an improvement on their current
providers offer.
Following some guiding design principles would make PCWs more user-friendly:
Sites need to strike a balance between a fast fact-finding process and sufficiently detailed
search that ensures consumers are confident that the product fits adequately with their
needs. The results of the comparison need to show the consumer sufficient information about
the deals, while keeping the content concise and simple. Key to this is the ranking of results,
which must be clearly communicated. Some consumers voice a desire to manipulate the
results by applying different filters. As many consumers estimate their current spend or
usage, the sites could remind consumers that any comparisons, or anticipated savings, may
not be fully accurate.
Relatively few consumers who have used a PCW in recent years are aware of
voluntary accreditation schemes, although their general view is that these schemes
provide an additional form of reassurance and improve confidence on the information on
PCWs. Consumers see bodies such as regulators, Which? and the Citizens Advice Bureau
as being suitable organisations to represent their interests by accrediting sites. Consumers
using an accredited PCW rarely notice accreditation; the genuine importance they attach to it
may be more limited than they say it is.
1.8
Recommendations
This research highlights several ways in which PCWs could make changes to improve the
user experience, and to allow consumers to make more effective decisions when making
price comparisons. In summary, these are:
viii
Date Last Edited: 4 July, 2013
There is scope for further research to increase understanding of the way consumers view
and act on accreditation of PCWs. This research shows that awareness is currently low, and
that consumers rarely notice sites accreditation, despite many saying that they value it.
Moreover, PCW users tendency to interpret deals as good and appropriate for me, without
taking into account their own usage and consumption behaviour, could be seen to highlight
the need for best practice in the way sites select and display available deals.
More generally, further research would allow evaluation of the areas of best practice that this
research has identified, where they were implemented.
Additional research among non-users of PCWs would allow greater understanding of their
reservations in engaging with price comparisons, whether online or offline. In our view, older
consumers, in particular, are less willing than existing PCW users, to communicate or
negotiate actively with the providers they use, and may not even be aware that this is
possible. Consequently, some people miss out on the best deals systematically. Therefore,
raising awareness of the cost implications and support needs of these consumers is
important.
ix
Date Last Edited: 4 July, 2013
2.
2.1
2.2
Background
Global internet protocol (IP) traffic on public and private networks is expected to increase
fourfold between 2011 and 20164, with around 45 per cent of the worlds population online by
that time5. In the UK in 2012:
seventy six per cent of households had fixed or mobile broadband access, and households
had an average of three types of internet-enabled device
following a doubling in ownership between August 2010 and February 2011, smartphone
penetration was higher than in other European countries, and four in 10 adults (39 per
cent) owned a smartphone
one in 10 households (11 per cent) owned a tablet computer, and one in six (17 per cent)
intended to purchase a tablet in the next year.
Research by Civic Consulting (2011)6 and Ofcom (2011)7 has identified the UK as having
one of the highest proportions of online shoppers in Europe. The former reported that 71 per
cent of UK adults were frequent online shoppers, the latter that 82 per cent of UK consumers
used their internet connection for shopping. Although in February 2012 shopping carried out
online represented only 11 per cent of the UKs retail revenue8, the value of online retail
sales had increased by 0.6bn from February 2011, compared with an increase of only
0.1bn in high street stores.
Cisco (2012) Cisco Visual Networking Index: Forecast and Methodology, 2011-2016 [Online]. Available from:
http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white_paper_c11-481360.pdf. [Accessed:
07.06.13]
5
Cisco (2012) Cisco's VNI Forecast Projects the Internet Will Be Four Times as Large in Four Years [Online]. Available from:
http://newsroom.cisco.com/press-release-content?articleId=888280 [Accessed: 07.06.13]
6
Civic Consulting (2011) Consumer market study on the functioning of e-commerce and Internet marketing and selling techniques in
the retail of goods [Online]. Available from:
http://ec.europa.eu/consumers/consumer_research/market_studies/docs/study_ecommerce_goods_en.pdf [Accessed: 07.06.13]
7
Ofcom (2011) International Communications Market Report 2011 [Online]. Available from:
http://stakeholders.ofcom.org.uk/binaries/research/cmr/cmr11/icmr/ICMR2011.pdf [Accessed: 07.06.13]
8
Ofcom (2012) International Communications Market Report 2012 [Online]. Available from:
http://stakeholders.ofcom.org.uk/binaries/research/cmr/cmr12/CMR_UK_2012.pdf [Accessed: 07.06.13]
1
Date Last Edited: 4 July, 2013
This anticipated continued growth in internet use and online shopping highlights the role of
price comparison websites (PCWs); online tools that consumers can use to assess the
options available to them while shopping online, and to view different prices for specific
products and services. The sites can help to simplify purchase decision-making by compiling
and organising information from several sources, in a way that allows consumers to
understand easily the deals that are available to them.
Research conducted by the Office of Fair Trading (OFT) in 201017 showed that more than
eight in 10 consumers (81 per cent) had ever used a PCW, and that three-quarters (73 per
cent) had used one in the last year18. Civic Consulting (2011) found that 81 per cent of
consumers had used a PCW in the course of the previous year. This research, which
compared 27 European countries, found that of these, the UK had the highest number of
PCWs: 30 PCWs versus 22 sites in France and 19 in Germany.
While PCWs have the same general purpose, there are differences in the way they function.
Some are dedicated to a specific service area, such as energy, while others offer price
comparisons across a wider range of services. The ability to tailor searches according to
individual needs also differs, with some PCWs allowing greater customisation than others,
based on personal profiling or consumption data. Price comparison sites also differ in the
way they gather information and their approaches to revenue generation.
10
Ibid.
11
Ibid.
12
Ibid.
13
Ofcom (2011).
14
Ibid.
15
Ibid.
16
Ibid.
17
OFT (2010) The consumers view of the Advertising of Pricing: Final Report, Annexe H [Online]. Available from:
http://www.oft.gov.uk/shared_oft/market-studies/AoP/Annexe-H.pdf [Accessed: 07.06.13]
18
Note that this research was carried out using Ipsos MORIs online access panel. The survey sample therefore didnt include
members of the offline community. The under-representation of some demographic groups was controlled for by weighting the
final data to match the socio-demographic profile of Great Britain.
2
Date Last Edited: 4 July, 2013
Some source information directly from providers by arrangement; others gather information
independently from providers sites. Similarly, some rely on revenue from advertising, while
others earn this on a commission basis, when consumers switch providers as a direct result
of using the PCW.
The impartiality and reliability of PCWs and the accuracy of the information they present to
the user, have been highlighted in the recent research noted here, and are of particular
concern to consumer bodies. Civic Consulting (2011) found that some PCWs did not provide
adequate information about delivery costs, delivery times, taxes or availability, and that
information about default ranking was sometimes not presented to users clearly, or with
sufficient choice. The research also reports a lack of information about payments that traders
could make in exchange for ranking placements and listings.
Consumer Focus research published in 2013 reported the findings of a mystery shopping
exercise carried out on a total of 99 UK PCWs19. The research found that PCWs are a useful
platform for consumers to use in making basic searches, that they display a high proportion
of relevant search details, and that they usually provide accurate information about products
availability. However, a key finding of the study was that PCWs did not guarantee purchase
savings: in fact this was true in only 21 per cent of cases. Moreover, the Consumer Focus
research highlighted that not all PCWs allow users to make customised, personalised
searches, and that some sites lack clarity on costs: many dont disclose booking fees or
termination charges, for example, while others automatically add supplementary charges
such as product insurance.
A web sweep of 55 PCWs by the OFT in 2012 identified scope for improvements in the
presentation of search results, in the identification of the businesses operating individual
websites, and in privacy policies and complaints procedures20. To address concerns over
accuracy and reliability of information, the OFT has written to 100 leading PCWs asking them
to ensure they are providing clear information to consumers21. The energy regulator Ofgem
has also launched an investigation of PCWs and switching sites, to ensure the information
these sites provide to consumers is transparent and not misleading22.
Research evidence exists, therefore, about the accuracy and reliability of the information that
PCWs provide, and there is concern among consumer bodies about these sites. Evidence is
more limited, however, about the experiences and perspectives of consumers themselves.
Consequently, it is difficult to recommend strategies that consumers can apply, in order to
use comparison sites wisely. Ofgem (2012) has found that consumers level of trust in PCWs
differs by service sector, and is higher for energy, travel and insurance comparison sites than
it is for mobile phones or other financial products23. This research also reported lower
awareness among consumers of PCWs specialising in energy comparisons and switching.
19
Consumer Focus (2013) Comparing comparison sites: Price comparison website mystery shopping report [Online]. Available from:
http://www.consumerfocus.org.uk/files/2013/01/Comparing-comparison-sites.pdf [Accessed 20.03.13]
20
OFT (2012) OFT advises price comparison websites how clearer information can improve consumer trust [Online]. Available from:
http://www.oft.gov.uk/news-and-updates/press/2012/113-12 [Accessed: 20.03.13]
21
Ibid.
22
Utility Week (2012) Ofgem launches probe into price comparison websites [Online]. Available from:
http://www.utilityweek.co.uk/news/news_story.asp?id=197743&title=Ofgem+launches+probe+into+price
+comparison+websites [Accessed: 07.06.13]
23
Ofgem (2012). Consumer engagement with the energy market: information needs and perceptions of Ofgem [Online]. Available
from: http://www.ofgem.gov.uk/Markets/RetMkts/rmr/Documents1/Consumer%20
3
Date Last Edited: 4 July, 2013
Since 2009, Consumer Focus has managed a voluntary accreditation scheme for domestic
online energy price comparison services, known as the Confidence Code. The objective of
the Confidence Code is to implement and maintain standards that inspire consumer trust in
PCWs focused on the energy market. As a consumer watchdog, it needs to be able to advise
consumers on the accuracy and reliability of price comparison websites.
Understanding consumers perspectives on PCWs in more detail, and their experiences as
users, will allow Consumer Focus and other bodies to be able to better advise them on how
to use PCWs in the most beneficial way. A deeper understanding will also ensure that
recommendations regarding improvements or changes to PCWs are truly reflective of
consumers needs.
2.3
Objectives
The overall aim of this research is to explore consumer experiences of price comparison
websites in terms of awareness, trust and confidence, user behaviour, accessibility and
usability, and potential concerns. The research will allow Consumer Focus to advise
stakeholders on consumer concerns regarding the use of price comparison websites,
specifically websites covering the regulated markets and, ultimately, to set best practice for
such sites.
The research represents the views, experiences and understanding across the whole
population, including not only heavy internet users and those who are most comfortable
using the internet and online services, but those who dont use the internet at all, and those
who have some experience of the internet, but none of PCWs. It looks at the consumer
journey from the beginning to understand initial awareness, usage patterns and experiences
of usability. This will provide insight into how and why consumers use PWCs, evidence which
will prove useful in helping to assess and improve the websites functionality, ensuring that
they are easy for consumers to navigate.
The research also covers broader concepts such as trust in PCWs, their overall impact, and
attitudes to new developments among price comparison models. These will help to
contextualise findings and also identify further issues that may need to be addressed to
make consumers feel more at ease.
The specific research objectives are as follows:
engagement%20with%20the%20energy%20market,%20information%20needs%20and%20perceptions%20of%20Ofgem.pdf
[Accessed: 07.06.13]
4
Date Last Edited: 4 July, 2013
5
Date Last Edited: 4 July, 2013
3.
Methodology
This chapter provides a short summary of the research methodology, including the methods
used and achieved sample sizes. Full details about the research methodology can be found
in Appendix A.
3.1
3.2
Quantitative survey
The quantitative survey consisted of 2,000 structured interviews. The interviews were
conducted using computer assisted telephone interviewing (CATI) using Random Digit
Dialling (RDD). Of the telephone numbers called, 12.2 per cent were mobile telephone
numbers and 9.2 per cent of the total interviews completed were on mobile telephone
numbers. To ensure that the full range of age groups, gender, geographic locations and
socio-economic grades (SEG) were captured, in line with the nationally representative
population profile, a series of soft quotas were incorporated. The soft quotas were
monitored continuously and the sample was stratified by geographic area to assist in the
monitoring of interviews achieved.
Interviews were carried out between February 22 and March 17, 2013, including evenings
and weekends. On average, interviews lasted 20 minutes.
To make the data representative by age, gender, region and SEG, the data was weighted
using Random Iterative Method (RIM) weighting. Weights were calculated separately for age,
gender, region and SEG. These weights were then applied to the data with each weight
applied separately to each individual case.
After weighting, the sample for Scotland and Wales contains significantly more consumers in
socio-economic grade E, than for England. It is important to bear this in mind when
comparing differences across nation/region as differences in Scotland and Wales may be
heightened due to the increased number of consumers in socio-economic grade E. This is
reflected in some of the quantitative survey findings in this report; significant differences
observed in Scotland and Wales often correspond to significantly different data for socioeconomic grade E. We highlight where these significant differences occur together.
3.3
6
Date Last Edited: 4 July, 2013
The hall tests consisted of a qualitative observational and interactive task, in which
consumers were asked to search for a new deal using a PCW. Consumers were allocated to
one of the following product categories: fixed broadband, electricity, home insurance, travel
insurance or mobile phones. All consumers were responsible for researching and/ or paying
for the product category which they were allocated to. After being allocated a product
category, consumers were assigned one PCW, which they used to look for a new deal for
their allocated product category. The websites tested included the Big Four, industry-specific
and next generation comparison websites, along with other PCWs that cover multiple product
categories. Due to the number of product categories that the Big Four cover, and in order to
avoid biasing the results of the research towards these four sites, one product category was
excluded from each of the Big Four.
To ensure that the discussion could focus on PCWs usability (rather than the internet more
generally), all consumers had some degree of direct experience and familiarity with the
internet. All consumers taking part in the usability hall tests fell into one of the following three
categories:
heavy internet users (people who use the internet on a daily basis for at least two
activities, and at least monthly for at least two of: managing finances, managing utilities,
researching products and services, booking travel and online shopping)
light internet users (people who use the internet, but dont match the description of
heavy users, and have used a PCW before)
non-users of PCWs (people who use the internet, but have not used a PCW before).
The hall test entailed the consumer looking for a new deal for the allocated product category
on the assigned PCW, before continuing to consider PCWs more generally.
3.4
Depth interviews
After completing a usability hall test, 63 consumers took part in a 30 minute face-to-face
depth interview. Recruitment to the depth interviews was dictated by the following quota
criteria:
age
gender
SEG
internet user type (heavy user, light user or non-PCW user).
The depth interviews investigated in more detail consumer awareness, usage, experiences
and views on PCWs.
7
Date Last Edited: 4 July, 2013
4.
4.1
8
Date Last Edited: 4 July, 2013
Socio-economic grade E contains significantly more consumers who dont use the internet
than other grades, with less than half (45 per cent) of them using the internet. This is linked
to the high number of 60-74 year olds and those aged 75 or older who dont use the internet.
Of the 109 consumers who are aged 60+ and are in social grade E, almost eight in 10 (78
per cent) dont use the internet.
Figure 4.2: Internet access by socio-economic grade
Significantly more consumers in Scotland (23 per cent) are non-users of the internet than in
England (15 per cent), while the proportion of consumers in Wales who dont use the internet
lies between the two (19 per cent). These data are in line with findings from Ofcoms (2011)
communications survey24, which report that, in 2011, England had the greatest number of
broadband connections followed by Wales and then Scotland.
Consumers access the internet from a variety of settings. Eight in 10 (84 per cent) do so via
a computer, laptop or tablet. These devices are used principally at home (80 per cent),
though two-fifths (43 per cent) are accessing the internet via computers at work or at a place
of education. Around a quarter of consumers (27 per cent) use friends or neighbours
computers or tablets, while one-fifth (20 per cent) use public-access computers, such as
those in libraries.
Half of consumers (52 per cent) go online using a mobile device, such as a mobile phone,
PDA or BlackBerry, and a quarter (24 per cent) using a TV set or games console.
24
9
Date Last Edited: 4 July, 2013
The 84 per cent of consumers who use the internet is broadly reflective of 2011 data from the
Office for National Statistics (ONS), which reports that 77 per cent of households had an
internet connection at that time25. We should note that a small proportion of consumers (two
per cent) in our survey only access the internet outside the home (at work or at university, for
example), and that a handful (less than one per cent) only access the internet using a mobile
phone.
A large majority of the consumers, who participated in our hall tests, had regular internet
access, and almost all of those, who didnt have regular access, were aged 60 or above.
check email
visit websites for information about personal interests or hobbies
find information about products or services theyre thinking about buying
check the news or weather, or to make travel plans
check their bank account or financial holdings
visit social networking sites.
25
Office for National Statistics (2011) Statistical Bulletin: Internet Access - Households and Individuals, 2011 [Online]. Available
from: http://www.ons.gov.uk/ons/dcp171778_227158.pdf [Accessed: 07.06.2013]
10
Date Last Edited: 4 July, 2013
11
Date Last Edited: 4 July, 2013
12
Date Last Edited: 4 July, 2013
4.2
13
Date Last Edited: 4 July, 2013
Once again, we note that these differences in awareness may be because consumers in
socio-economic grade E make up a larger proportion of consumers in Scotland, than is the
case in England.
14
Date Last Edited: 4 July, 2013
I heard about this on the BBC news. I wouldnt bother with it.
Midlands, age 60-74, SEG E, non-user of PCWs
Ive been approached to do this [] There should be equality in deals; everybody should
be offered this scheme.
Midlands, age 45-59, SEG D, non-user of PCWs
4.3
15
Date Last Edited: 4 July, 2013
The majority of those who consult PCWs are generally accessing them using a computer or
laptop (91 per cent), with a small proportion (6 per cent) using a tablet computer. A very low
proportion (two per cent) generally access PCWs using a mobile phone or mobile phone app
(one per cent); most of these consumers are in the 18-29 age group.
Figure 4.5: How consumers access PCWs
16
Date Last Edited: 4 July, 2013
4.4
Consumers in socio-economic grade B are the most likely to use PCWs at least quarterly (62
per cent) whilst consumers in the lower grades are the least likely to visit PCWs on this basis,
with less than half in either grade doing so (42 per cent for socio-economic grade D and 47
per cent for grade E).
4.5
17
Date Last Edited: 4 July, 2013
Younger consumers are more likely to use the Big Four PCWs than older groups are: the
vast majority (91 per cent) of 18-29 year-olds and 30-44 year-olds (93 per cent) use them,
while the proportions among the 45-59 group (86 per cent) and 60-74 group (80 per cent) are
slightly lower.
Customers feel that the fact the Big Four sites are the first to spring to mind, results in their
using them most often. As Section 4.2 has described, these PCWs are typically front-of-mind
because consumers have seen or heard recent advertising.
Originally, it must have been TV adverts or radio adverts. I think Confused.com is always
on and so is that comparethemarket.com one. Probably, it must have been from there.
North East, SEG B, 30-44, heavy internet user
Its because I see the advertising. The first thing when I sit down, I think,
"Confused.com".
Midlands, SEG B, 60-74, heavy internet user
Google. If I can't remember the name then I will just put in "comparison insurance" and
then it will come up.
Wales, SEG C1, 30-44, heavy internet user
There is little evidence of loyalty no consumer said that they used a particular site out of
habit for example, and there was often hesitation as they named the ones they had used.
Consumers told us they simply used sites that come to mind when they start to shop around
or research a purchase.
18
Date Last Edited: 4 July, 2013
19
Date Last Edited: 4 July, 2013
26
20
Date Last Edited: 4 July, 2013
More than two-thirds of consumers (69 per cent) also agree that they use PCWs to identify
the providers that offer the particular products or services they are looking for, or to make a
switch between providers (67 per cent). Two-thirds agree that they use PCWs to save time
(65 per cent) and to inform them when considering switching providers (62 per cent). In total,
more than eight in 10 consumers (82 per cent) say they use PCWs either to switch, or to
consider switching providers.
Slightly fewer consumers use PCWs to carry out more general research. Just over half (53
per cent) visit PCWs to identify the different product or service bundles that are available on
the market. Just under half (47 per cent) visit them to carry out more general (ie, not pricespecific) factfinding about products and services they are interested in. Fewer consumers
one-third (35 per cent) say that they use PCWs to get general advice on products or
services. This is understandable: relatively few PCWs provide advice or even reviews within
the information that they offer.
Overall, eight in 10 consumers (83 per cent) use PCWs to compare prices for specific
products. Approximately nine out of 10 consumers in socio-economic grades A and B do this
(97 per cent and 88 per cent respectively) than among socio-economic grades C2 and D,
where around three-quarters do so (78 per cent and 77 per cent respectively). Similarly,
significantly more consumers in grades A and B use PCWs to actually switch providers.
In addition, significantly fewer young consumers aged 18-29 use PCWs to source general
advice on products or services (26 per cent) than consumers aged 30 or older where the
proportion is one-third or more.
These data indicate that consumers in socio-economic grades A and B either have a more
well-defined idea of the product or service that they want to purchase, or take less time to
make a decision, than those in other grades.
27
Andrew Smith Research and Research Now (2012). Customers in Britain 2012
21
Date Last Edited: 4 July, 2013
Figure 4.10: Products/ services that price comparison websites are used for
If we consider the product and service types that PCWs typically cover, the general pattern
here is that consumers are often using PCWs in purchasing:
products highlighted in PCWs advertising: all of the Big Four have promoted their use in
connection with car or home insurance
products that they buy most routinely: for example, insurance bought at the same time
every year; and
products that are relatively expensive: for example, insurance premiums and utilities.
The proportion of consumers using a PCW to shop for car, home or travel insurance is higher
among grades A and B, and lower among grades D and E. For example:
the majority in socio-economic grade A (88 per cent) and three-quarters in grade C1 (76
per cent) have shopped for car insurance via a PCW, compared with two-thirds of those in
socio-economic grade E (67 per cent)
two-thirds of those in socio-economic grade A (67 per cent) have shopped for home
insurance using a PCW, compared with half in grade C2 (50 per cent) and a quarter of
consumers in grade E (25 per cent)
more than one-third of consumers in socio-economic grades B (36 per cent) and C1 (35
per cent) have used a PCW to compare prices for travel insurance; less than one-fifth
have done so among grade E (17 per cent).
The youngest consumers those aged between 18 and 29 are also significantly less likely
to have used a PCW to compare prices for gas or electricity, than consumers in most of the
older age groups. Just over a quarter of the 18-29 group (28 per cent) have done so,
compared with half of the 45-59 group (50 per cent), and more than half of those aged
between 60 and 74 (53 per cent).
Significantly more consumers in Wales have used a PCW while shopping for car insurance
than in England: more than nine in 10 (92 per cent), compared with eight in 10 (80 per cent).
22
Date Last Edited: 4 July, 2013
4.6
23
Date Last Edited: 4 July, 2013
Figure 4.11: Use of price comparison website more than two years ago
Half of these lapsed users (50 per cent) have not used a PCW because they have not
needed to compare products, with significantly more men (59 per cent) than women (38 per
cent) giving this as a reason.
But some have been deterred by negative experiences. A minority of lapsed users (15 per
cent) feel they did not get the best deal when they used a PCW. A minority (seven per cent)
distrusted the results they got last time, or found the PCW hard to use (seven per cent), and
a small number experienced difficulties with the switching process (four per cent) or the
product that they had purchased (two per cent).
The qualitative research highlights that a main reason for finding the sites hard to use has to
do with struggling to interpret information that the sites present. Specifically:
some consumers, typically less experienced internet users, accidentally miss out
information that they are asked to enter. This slows down their progress, and they
interpret it to mean they have had difficulties using the site
a few people struggle to understand some of the terms they see on the sites, such as
baggage claims when searching for travel insurance, or have difficulty in understanding
what the amount of cover a policy would give them, and what it actually means in
practice.
Im not clear on some insurance jargon, such as what the 5 million referred to. The
language could have been made easier to understand.
South East, age 18-29, SEG E, heavy internet user
24
Date Last Edited: 4 July, 2013
Figure 4.12: Reason for not using price comparison website in the last two years
Male non-users of the internet are significantly more likely than women to be aware of PCWs.
More than half of men (53 per cent) say they are aware of PCWs, compared with two-fifths of
women (39 per cent).
25
Date Last Edited: 4 July, 2013
Significantly fewer consumers aged 75 or above are aware of PCWs than those in the age
groups below. One in three in the 75+ age group (29 per cent) are aware of PCWs,
compared with just over half in the 60-74 age group (54 per cent), and almost two-thirds in
the 45-59 age group (63 per cent).
A minority of consumers (21 per cent) who dont use the internet themselves, but are aware
of PCWs and what they do, have asked others to use PCWs on their behalf, with significantly
more women (25 per cent) having done this than men (16 per cent).
26
Date Last Edited: 4 July, 2013
5.
5.1
navigating from the homepage to the section that is specific to the product or service
they are looking for
entering any data that the site requests, in order to carry out a customised comparison
evaluating search results and making a decision to purchase, or to contact providers in
other ways.
The qualitative research demonstrates some of the challenges that consumers face in
practice when going through these steps, as well as the elements that they find
straightforward. These indicators of best practice and suggested improvements are
summarised in the sections below.
27
Date Last Edited: 4 July, 2013
In addition to unclear signposting, links that are unrecognisable, such as text that contains a
hyperlink but does not make this obvious, can mean that consumers dont know where to
click next, in order to proceed. Some users also get confused about whether a piece of text
or an image on the page is an actual link, and become frustrated by clicking on boxes and
text which they think are links when they are not. Towards the end of the process, others
dont realise that they need to click on the selected deal to get more information about it,
because they dont interpret the providers logo as a link for clicking on the deal. Clearlyformatted buttons and other links help consumers to understand the available next
steps on the page, and to judge which is likely to be most useful.
Consumers appreciate having explanations for technical terms that they might be unfamiliar
with, but some struggle to use definitions and explanations that are not provided in an
obvious way. Sites that provide such explanations using question marks or i symbols next to
the words are praised by those who are frequent internet users, but can be problematic for
less experienced users, who struggle to identify and use them. Including information to
explain terminology in side boxes means that inexperienced internet users are able to
find it easily.
A small number of consumers, who are generally in their fifties of older, also worry about
sites that position advertising next to results. This confuses some consumers, who think that
the advertisement is actually part of the search results. They also think adverts are irritating,
and get in the way. Setting advertising content clearly apart from comparison
information ensures that people can be confident of where these are on the page, and
focus on the results of their search.
I don't think they are particularly simple because you get all sorts of side issues. You get
adverts with them as well. I dont like that and I dont want that and it just interferes with it
and makes it more difficult to work your way through the site.
North East, SEG A, 75+, light internet user
28
Date Last Edited: 4 July, 2013
29
Date Last Edited: 4 July, 2013
30
Date Last Edited: 4 July, 2013
This is typically because they want to get a better initial understanding of the types of deals
available for them to select from, or of the parameters for different elements of the products:
for example, what is a reasonable amount of cover to purchase for airline insolvency?
Travel insurance is a bit of a complicated thing. You have to read first and then put in
what you want, not the other way round. There's different types of deals for travel
insurance, you have to read it first to know which one to pick.
England, SEG C1, 30-44, used PCWs in last two years
Willingness to enter personal data in using PCWs also depends to a great extent on what
this data is. Most people are willing to enter their postcode, but are more hesitant about
providing their telephone number and email address. People perceive postcodes not to be
too personal, recognising that postcodes relate to several addresses. Furthermore, this is
publicly available information. Their email address is also considered to be less personal
than their telephone number, and some consumers say that it is easy to discard unwanted
messages, even if receiving them can be annoying. They are least comfortable with providing
telephone numbers, expecting to receive sales calls if they do so, and feeling unable to
prevent this. Many consumers have already experienced these, and want to avoid this in the
future.
Entering personal data is often also a question of maintaining control. Some consumers
voice concern about the possibility that details submitted to PCWs will be sold on to other
companies without their knowledge, leading to unsolicited contact from a range of different
companies. Although this concern is voiced by a range of consumers, those aged 40 or
older, and those in socio-economic grades C1, C2, D and E are slightly more concerned
about the prospect of receiving junk mail and sales calls. By refusing to provide these details,
they feel they can maintain better control over who approaches them.
A minority of consumers are worried about PCWs being at risk of hacking, as they have
heard many stories about the hacking of sites for contacts and, particularly, financial details.
The majority of customers are clear that they would not provide their bank details or more
sensitive financial information regarding their income.
Comparing deals
Information required
In general, PCW users prefer sites to give them a lot of information about the product or
service they are comparing, so that they are confident about what they are buying. At the
same time, they expect sites to provide them with well-structured summary tables, giving
concise information on the deals and allowing them to cross-compare the different options.
Some consumers also mention that they like to have the option to use filters, which allow
them to reduce the number of options to a condensed, workable shortlist. Younger
consumers appetite for this kind of tool is often borne out of their generally higher levels of
comfort with the internet. Conversely, some older consumers mention that small icons or text
make it difficult for them to read everything properly; additional filtering tools would allow
them to condense the amount that they have to take in. This preference for filtering was
somewhat higher among the A, B and C socio-economic grades.
31
Date Last Edited: 4 July, 2013
Some specific provider details [on Tescocompare.com] were confusing. Id have liked to
see a filter showing information about the paying method, like whether you can do it by
Direct Debit or not.
South East, age 60-74, SEG C1, light internet user
Id like to see a ranking tool [on Moneysupermarket.com] where you could make
comparison based on price. For instance, cheapest option first.
South East, age 18-29, SEG C1, heavy internet user
I dont think the providers should be ranked as they are. The greatest saving was at the
end of the results [] They should be ranked alphabetically, by providers.
Wales, age 75+, SEG B, light internet user
Factors considered
While consumers look at a range of factors when they compare deals on PCWs, it is plain
that price is the most important one. Around nine out of 10 consumers in the hall tests
mention price as one of the three most important factors influencing their purchase decision
researched via a PCW, and around two-thirds of them say that price is the most important
factor. A majority of consumers also mention price in passing, as they talk spontaneously
about the steps they are taking as they use it.
Although price is the key influencing factor, many PCW users state in the hall test that they
dont immediately turn their attention to the cheapest possible deal, but instead compare
prices in the context of the rest of the information they are given about deals. The information
provided about the deal (ie the product description and features) is also very important; two
thirds of people in the hall tests say that this would be among the top three factors if they
were making a real-life decision using a PCW.
In the quantitative research (see Figure 5.3), one-fifth of consumers (21 per cent) say that the
product provider being a well-known brand is one of the three most important considerations
when using PCWs. A much higher proportion (around six in 10) in our hall tests mention the
reputation of the product provider as one of the top three prompted factors they would
consider when making a decision.
Examples of trusted brands include both traditional providers and newer affinity partners
such as Asda, Tesco or Debenhams, whose reputation in their core business areas creates a
positive impression over their products in other sectors, such as insurance.
Sometimes [reputation] is important, sometimes it's not, for example you can get the best
deals off little companies you've never heard of.
Scotland, 18-29, SEG E, heavy internet user
Next steps
For most consumers PCWs are one of several sources of information. The majority (83 per
cent) continue their search with other PCWs, using more than one site before making their
decision. Over half (57 per cent) use two or three comparison sites while over a quarter (26
per cent) use four or more PCWs before making a decision. Those who dont use the internet
very frequently are significantly more likely to use a single site, with a quarter (25 per cent) of
them saying this, compared with a minority of heavy internet users (16 per cent).
32
Date Last Edited: 4 July, 2013
Conversely, a significant minority (17 per cent) of consumers who use the internet, and use
PCWs, more often use four to five sites when they undertake the comparison process.
Figure 5.1: Number of PCWs used before making a decision
For the majority (61 per cent) of consumers, the main reason for using multiple sites is to
make sure they get the best deal. Around two fifths (42 per cent) do this in order to compare
or verify the comparison results. Only a few (five per cent) say they use more than one PCW
because they dont trust the sites. Visibly more consumers in socio-economic grade A (12
per cent) give this as a reason for using multiple sites than in other grades. Consumers in
London (9 per cent) are noticeably more likely to say they use multiple sites because they
dont trust the sites, than those in other regions.
33
Date Last Edited: 4 July, 2013
Consumers aged 60-74 are significantly less likely than younger consumers to use multiple
sites for cross-checking purposes.
Consumers other reasons for using multiple sites include ensuring that they see all possible
deals available, and comparing the results.
To see if there are any differences. If one site has deals that others don't have.
England, SEG B, 30-44, used PCWs in last two years
Because they do different companies - they don't all have the same ones another [site]
will have different companies.
England, SEG C1, 60-74, used PCWs in last two years
In addition to other PCWs, the comparison process often continues offline. Many consumers
mention that they follow up their use of a PCW with a call or a visit to a product providers
branch. The reasons for this are discussed in more detail in Section 6.3.
5.2
34
Date Last Edited: 4 July, 2013
35
Date Last Edited: 4 July, 2013
It's an efficient way at looking across many providers, saves the legwork, they store your
details for the next search and it is a fairly simple process.
England, SEG B, 30-44, used PCWs in last two years
I think it (PCW) is a bit of a time-saver, and it also narrows your search, so you dont have
to physically go to every store or office to check. If you have some good options, you can
go to those three places instead of doing a whole search around the city.
Midlands, SEG C1, 18-29, non-user of PCWs
Consumers also see PCWs as facilitating switching between providers, by making it easy to
purchase products or services directly through the comparison sites and generally reducing
the hassle and delays related to switching. This is discussed in more detail in section 5.4
further below.
36
Date Last Edited: 4 July, 2013
5.3
Usability expectations
Consumers expect PCWs to be accurate and reliable as well as easy to use. Half (52 per
cent) specify getting accurate and reliable information as one of the three factors that are
most important to them when they use a PCW, with almost as many (45 per cent) saying that
it must be easy to use. Nearly a third (31 per cent) also add impartiality of results, while the
same proportion (31 per cent) want to access a wide range of deals.
Ease of use is important to significantly more users of PCWs in Scotland (56 per cent) than
to those in England (45 per cent).
Figure 5.3: Most important features when using price comparison websites
User experience
Generally consumers are satisfied with their experiences of the PCWs they have used. Over
half (57 per cent) rate the PCWs they have used in the past as excellent or very good28 in
terms of ease of use. Almost the same proportion (52 per cent) think they have been useful
in helping the user to find a good deal. Over two-fifths (43 per cent) think they have been
excellent or very useful because they have been allowed to enter their own selection criteria.
28
Excellent or very good is defined as the proportion of consumers who have rated PCWs with a rating of eight, nine or 10.
Reasonable represents the proportion rating them with a score of five to seven.
37
Date Last Edited: 4 July, 2013
Interestingly, there is no difference between heavy and light users of price comparison
websites when it comes to perceptions of ease of use.
Customers who have used PCWs for comparing insurance products give, on average,
slightly higher ease of use scores (mean score of 7.7 out for 10) than those visiting PCWs for
broadband (mean score of 7.0) or mobile phones (mean score of 7.1).
Consumers in the depth interviews and hall tests also have positive perceptions of ease of
use. The majority of these consumers in the hall tests state that the PCWs they test are easy
to use, giving an overall mean score of 7.7 out of 10. The Big Four sites receive higher
ratings, with a mean score of 8.0. Sites that are accredited by the Consumer Focus
Confidence Code also receive a slightly higher mean score (8.0) for ease of use from the 58
consumers asked to test them in the research exercise.
In contrast, over half of consumers (54 per cent) rate PCWs they have used in the past as
poor29 in clarifying whether providers are able to influence their ranking.
Over a third (35 per cent) also think the sites are poor in terms of clarity regarding how
providers are selected to be included in the ranking. Again consumers in Scotland (51 per
cent) as well as the consumers in the higher socio-economic grades (54 per cent for A and
45 per cent for B) are more inclined to give poor ratings for PCWs on this aspect.
Just under half of consumers (46 per cent) say they have recommended PCWs to friends
and family, while a similar proportion (50 per cent) say they have not done so.
Understandably, those who think the information that PCWs provide is unreliable, are
significantly less likely to have recommended a PCW to someone else (21 per cent have
done so), than those who think the sites are fairly reliable (45 per cent) or very reliable (55
per cent).
29
Poor is defined as the proportion of consumers that have rated PCWs with a rating of one to four.
38
Date Last Edited: 4 July, 2013
Light internet users and infrequent users of PCWs are also less likely to have recommended
a PCW to someone else.
Figure 5.5: Whether recommended a price comparison website
5.4
Switching behaviour
39
Date Last Edited: 4 July, 2013
When asked to rate how useful the sites are for switching providers, those who have used
them for gas or electricity rate the sites much higher than those using PCWs for other
reasons. Forty six per cent of people using PCWs for gas or electricity think they are
excellent or very good and on average give them a score of 7.1 out of 10 on this measure.
For insurance, consumers are slightly more sceptical as only 39 per cent give them the
highest scores and the mean score is 6.8. The usefulness of these sites for switching mobile
or broadband is much less; the sites receive average scores of 4.8 and 3.7 respectively.
40
Date Last Edited: 4 July, 2013
Some also think that switching utility providers is now easier as it can be done directly on the
PCW, which then does the work on behalf of the consumer.
The opportunity to change has gone through the roof. My parents were with one provider
and I dont suppose they would even have contemplated changing. I am not even sure
you could [in the past]. Also, I don't think there was the competitive edge between the
electric cost, the pound a unit and that was the cost of electricity and it went up next year
and it is 1.05 a unit. There wasnt that ability to slice a tenth of a penny here and 5p
here.
South East, SEG E, 45-59, E, heavy internet user
I have actually used those and changed through them because it is very convenient. They
do all the work.
North East, SEG A, 75+, light internet user
41
Date Last Edited: 4 July, 2013
Figure 5.7: Reasons for not switching products/ services using price comparison
websites
Switching providers can occasionally be constrained by factors that are specific to the
individual consumer such as their location, or the nature of an existing contract which
mean they have no possibility to switch. Switching broadband and mobile phone contracts
can be complicated for those, who are bound into a contract with their current provider, and
penalties for switching prohibitive. Furthermore, the choice of provider can also be
constrained by where the consumer lives. For example, some areas have good mobile
coverage for only one provider; some live in areas where fibre optic broadband is not
available.
5.5
Non-user decision-making
42
Date Last Edited: 4 July, 2013
The consumers aged 30-44 (45 per cent) are much more likely to have bought or renewed
gas or electricity than consumers in the other age groups, especially compared to the young
non-users (32 per cent for 18-29 year olds). The young non-users are most likely to have
renewed their mobile contracts (60 per cent) whilst the over 60 year old non-users are most
likely to have renewed or purchased home insurance (58 per cent) compared to any other
age groups.
Non-users in socio-economic grades A, B, C1 and C2 are significantly more likely to have
purchased car insurance in the last two years, with between half and two-thirds having done
so than those in grades D and E, where fewer than three in 10 report this kind of purchase.
43
Date Last Edited: 4 July, 2013
Other information sources cited by consumers include Yellow Pages, other websites and
online sources, newspapers, visits to shops, brokers or door-to-door salesmen.
I guess I would probably ask for someones advice or I would probably go around and see
if I see any offers. If I see something interesting, I might go in there and ask. Maybe if it
was a bigger decision it would take me a few days more. I would just go to a few places
when I have the time and make a decision then.
Midlands, SEG C1, 18-29, non-user of PCWs
Often it is triggered by newspapers. We read two newspapers each day. We live near the
shops so we would see if there is a special offer I would consult the family about things
if it is an important step or something new I need to look for.
South East, SEG D, 75+, non-user of PCWs
The younger non-users of PCWs are more likely to rely on family and friend
recommendations than other age groups (55 per cent of 18-29 year olds and 53 per cent of
30 -44 year olds). Non-users in the South West of England are less likely (15 per cent) to
phone the providers than consumers in the rest of the country.
There are also some differences in the way different sources of information are used for
buying different services. Non-users rely on recommendation much more when buying
broadband services (57 per cent), TV (53 per cent) and mobile services (49 per cent)
compared to insurance purchases (37 per cent). More people also use adverts for
information when buying broadband (36 per cent) or TV services (35 per cent).
44
Date Last Edited: 4 July, 2013
Recommendations are also overall the most influential of all sources (29 per cent) for their
influence in final decision-making. Only one in six non-users of PCWs (16 per cent) say that
they are most influenced by calls to providers and even fewer (12 per cent) are swayed by
advertising.
Figure 5.10: Most influential information used in decision-making
45
Date Last Edited: 4 July, 2013
The majority of consumers (76 per cent) purchasing or switching electricity or gas are
confident that they have got the best deal, whereas nine out of 10 (90 per cent) of those
buying insurance are very, or fairly confident they are getting the best deal.
When asked to compare themselves to PCW users, nearly two fifths of non-users (38 per
cent) believe they actually get a better deal offline, while almost a third (29 per cent) think
they get the same deal that those using PCWs do. Only a minority (nine per cent) think they
might be losing out by not using PCWs, and actually getting a worse deal.
Figure 5.12: Whether PCWs are perceived to give a good deal
Some non-users are confident about their ability to negotiate the best deals by themselves
while others think there is very little difference between the deals that are available on- or
offline. A few also believe there is little point in switching providers because this will give only
short-term savings.
Simply because I'm capable of deciding what I like and what I don't like, and am also
capable of negotiating the best deal by myself.
England, SEG B, 60-74, never used PCWs
Because if you get it cheaper for one year, the next year it goes up to exactly the same
and you end up where you were at the start anyway.
England, SEG B, 75+, never used PCWs
46
Date Last Edited: 4 July, 2013
A minority have negative experience or perceptions of PCWs: 15 per cent are put off using
sites because they think they are too complicated to use. Only a small proportion (three per
cent) say they dont use these sites because of negative feedback from other people.
Some simply have no need for PCWs services: one-fifth (20 per cent) are not looking to
switch their provider while a minority (16 per cent) are simply not interested in the products
PCWs compare.
Other reasons for not using a PCW include not having a computer or not wanting to use one,
not having the need to use them or to compare prices, and a perception that the sites only
give price-related information and no other details about products or services.
I've never made a big enough purchase to care.
England, SEG C2, 18-29, never used PCWs
I like to stick with what I know and go on personal recommendation.
England, SEG C1, 45-59, never used PCWs
Figure 5.13: Reasons for not using price comparison websites
47
Date Last Edited: 4 July, 2013
6.
6.1
'I am not that cynical. I tend to believe what I am told but I can be a bit nave. If I saw it, I
would be like, "Okay, that is good" and believe it with confidence.'
South East, SEG D, 18-29, heavy internet user
'The big companies are not going to run away with your money because they are the ones
that have been in this country for that long.'
Scotland, SEG C1, 60-74, light internet user
There is a level of acceptance among consumers that the products they research on PCWs
are complex products, and that they may lack the will to bottom out every last detail. A
minority of consumers spontaneously link their feeling of trust to the influence of a regulatory
body, although they are not clear about which body this is.
'Quite happy really. I think they give you enough information. With things like this, I dont
tend to read all the small print. As long as the cover generally is right, I just look at the
numbers. The small print is going to be what it is going to be, really.'
North East, SEG B, 18-29, heavy internet user
48
Date Last Edited: 4 July, 2013
'I don't know if there is an ombudsman or whatever you call them that says that this has
got to be true. If you are writing it down on this site, it has got to be true. So I am going to
assume it would be true.'
South East, SEG C1, 30-44, light internet user
Only a minority of current PCW users say the information that PCWs provide is fairly (four
per cent) or very unreliable (one per cent), and as Section 5.5 has described, a very low
proportion (seven per cent) of lapsed PCW users cite a lack of trust in the results, as a
reason they have stopped using them.
'I don't know that I would be all that confident [in the information]. Its a generation thing.
Its not a thing Ive grown up with. With young people its been there all your life, but its
not been there all my life.'
Scotland, SEG B, 75+, light internet user
'I am not confident, because they are selling something, and can you rely on people who
are selling something to give you the right information all the time? No.'
Wales, SEG C2, 60-74, non-user of PCWs
Consumers who have never used a PCW report somewhat higher levels of mistrust. One in
10 (11 per cent) mention spontaneously that they would not trust the results, while a similar
proportion (nine per cent) think that providers can pay the PCWs to place them higher up the
search results, a topic addressed in more detail below in Section 6.2.
6.2
49
Date Last Edited: 4 July, 2013
When asked to give a score out of 1030 for their clarity about the criteria used to rank deals
on PCWs they have used, fewer than one-third (29 per cent) of consumers give a score of
eight or more, and the mean score awarded is 5.08 out of 10.
As Section 4.5 has described, the vast majority of PCW users (85 per cent) are visiting sites
to find the best deal. However, that best deal does not need to occupy the very top spot in
these predominantly price-led rankings. Only a small minority of consumers place the ranking
of deals among the three factors that they personally would consider important in a PCW if
they were actually making a decision, and none chose it as the most important factor overall.
Instead, it is more usual for consumers to scroll through ranked search results until they spot
a brand they 'know'. Consumers often explain that they distrust the cheapest results which
appear at the top of a list and are often from less well-known providers; perceived as 'too
good to be true'.
Some of these names that come up, I have never heard of them. Top Job, I have never
heard of that. Explorer, I don't know who does that. Travel Time, never heard of them
either.
North East, SEG C2, 75+, light internet user
I look to see if it is a company that I have known. I click into Sky and lets go onto their
website and see what they have done.
Wales, SEG E, 30-44, light internet user
Additionally, consumers are often seeking value for money, rather than the lowest ticket
price. They typically spend time weighing up product features and prices before settling on a
deal with the best product specification for a given price. This may end up being slightly more
expensive than the other options in their shortlist, but it feels to them like better all-round
value.
I won't necessarily always go for the top cheapest. I will go for what suits the totality of my
situation.'
South East, SEG C2, 60-74, heavy internet user
'Because I like to know that I am getting the best one that is tailored towards me, like what
I am going to get the most usage out of.'
South East, SEG D, 18-29, heavy internet user
Consumers can also avoid the cheapest, top-ranking deals because they dont know how
much they currently pay for the product or service they are researching. An offer from a
provider they know, which meets their personal criteria, has an attractive price and is
reasonably well-placed in the rankings, is typically seen as a 'best deal' in the consumer's
eyes.
30
Consumers who had used a PCW in the last two years were asked in the quantitative survey to give a score from one to 10 for
eight different aspects of the sites. The question explained that a score of 10 meant the site was outstanding and 1 was very
poor.
50
Date Last Edited: 4 July, 2013
'I don't want the cheapest result, as you get what you pay for. I am after something
reliable.'
South East, SEG C2, 60-74, heavy internet user
Some consumers are interested in alternatives to price being used for ranking comparison
results, as well as more filters, which would limit the number of options presented on-screen.
They mention rankings and filters that could help them sort results by download speeds for
broadband, the total cost of monthly instalments on a home insurance deal and a specific
price range for travel insurance corresponding to a person's budget. Some websites, such as
broadbandchoices.co.uk, already have a selection of filters in place, but other sites are more
limited in the way their results can be displayed.
They have got things on the right-hand side, where if you like that option that is being
provided by a certain provider, you can then go to their website and look into the offer in
more detail. You can look at terms and conditions and, sometimes, there might be hidden
things that have not been explained on the front pages because all it gives you sometimes
is what your excess is and how much you are paying. For example, car insurance, if you
have legal protection or a free car, that would be my next step.
Wales, SEG C1, 30-44, heavy internet user
What you are getting on a price comparison website is a very brief synopsis of the
highlights, the savings, the amount of money you can save. There is always going to be a
downside somewhere.
South East, SEG E, 45-59, heavy internet user
Consumers are aware that the need for customisation varies between product types: energy
or travel insurance quotes involve fewer variables than home insurance does, for example.
They realise that customisation has both benefits and drawbacks. On the one hand, it takes
people longer to input personal data to produce a more tailored result, while greater
customisation can require them to share more personal details than they feel comfortable
with. Maximum customisation with minimum input would be their ideal.
'The postcode gives the area, but there is no field given for type of property or heating.
More questions are needed, for example the number of rooms.'
Midlands, SEG A, 60-74, heavy internet user
It's a long process but it allows you to get a tailored search and better options.'
Wales, SEG E, 30-44, heavy internet user
6.3
51
Date Last Edited: 4 July, 2013
For most consumers, the verifying and cross-checking undertaken is not borne out of a
feeling that providers are wilfully trying to mislead them, but an instinctive belief that the
sheer volume of information online makes fact-checking necessary. For example, each site
may have a slightly different selection of providers and associated deals, and some sites may
have more recent information than others. By casting their search nets a little more widely,
they can feel confident that they haven't missed the best deals.
'I wouldn't doubt anything, but then again I probably would check other sites to see if they
have similar options. Usually I trust it.'
Midlands, SEG C1, 18-29, non-user of PCWs
'If I am looking for car insurance I will look at three or four different comparison sites. You
might get the same best one on a couple, but the other couple might give you a different
one.'
North East, SEG E, 60-74, light internet user
Once they have drawn up a shortlist of attractive offers from the PCWs consulted, many
consumers carry out further checks offline, often keeping paper notes of their inquiries. They
either telephone the providers, or visit these providers' websites to ensure that the deal they
saw on a PCW is still available, and that they have understood it correctly.
'I would probably go direct to that companys website and then double check again ... Just
to make sure that the information was still valid and that that particular offer was still
available, and that I hadn't missing anything in the small print.'
South East, SEG E, 45-59, heavy internet user
'I am pretty confident. If I had any further questions, then I would contact them myself just
to make sure before I committed to anything....I dont suppose they are going to give us
any different information but sometimes it is just to be clear.'
North East, SEG B, 18-29, heavy internet user
A minority of consumers also ask friends and family for their views on a potential provider.
'I am always a bit sceptical because I would then draw on information from someone else.
I would try and find someone else that is using the same provider or whatever and "How
has it worked out?'
South East, SEG D, 75+, non-user of PCWs
6.4
52
Date Last Edited: 4 July, 2013
More than one in 10 (13 per cent) participants in the quantitative survey, who have not used
a PCW in the last two years, say that reluctance to give their details to a third party has been
a reason. In the qualitative research, uncertainty about the way PCWs might use their
personal details is a significant concern; and fear that the act of accessing quotes will lead to
large volumes of unsolicited communications afterwards. Both in the qualitative and
quantitative research, this concern about unsolicited communication is higher among the
middle age groups those in their forties and fifties and is also slightly higher among the A
and C socio-economic grades than elsewhere.
'You just wonder sometimes, "Why do they need to know that information? What are you
going to do with that information? Are you going to get lots of other emails and offers that
pop up in your email account from other companies? Do they sell your information on? It
is general security.'
Wales, SEG C1, 45-59, heavy internet user
The only concern that I have is that details might sometimes be misappropriated. Its a bit
like the iron fist and velvet glove. You sometimes dont realise what you have let yourself
in for, until youre being inundated with stupid emails or telephone calls or junk mail
through the letterbox.
Wales, SEG E, age 30-44, light internet user
Some consumers are reluctant to enter their bank details in particular, in case they may
unwittingly make a financial agreement. Again, older consumers (those aged 40 or above)
are more likely to raise this as a concern than younger ones.
'They could be a fraud(ulent) company. You could sign up and pay Whenever they ask
for your card details then that is when I step back and I dont just send it.'
Midlands, SEG E, 18-29, heavy internet user
No, I wouldn't [give my bank account details] because something could go wrong and
they could get into your bank account. You see that on the TV. People do get into other
peoples accounts.
Wales, SEG C1, age 60-74, non-user of PCWs
Before you sign up to these, you want to make sure, because they ask you to put your
bank details in. They are getting all your details and (you need) to make sure they are
kosher. I would be wary about putting my bank details in.
Scotland, SEG C1, age 45-59, light internet user
On-screen notifications about issues with the website's security certificate also act as red
flags.
53
Date Last Edited: 4 July, 2013
'I may come out of the website if it is saying that the website is not secure. I really wouldn't
want my personal details hacked into. Also, I have had identity fraud done to me before
[] I would probably be a bit dubious.'
South East, SEG C1, 30-44, heavy internet user
6.5
6.6
54
Date Last Edited: 4 July, 2013
'Isn't that how people make money on computers? I don't know. Every time somebody
logs on, isn't that giving them money?'
Midlands, SEG C2, 60-74, non-user of PCWs
'That is a good question. I know they do make money. I don't know if they say, "You
advertise with us and we will give you a certain percentage," but how that is figured out, I
wouldn't really know.'
Midlands, SEG C2, 45-59, heavy internet user
Some providers, such as Direct Line, highlight their absence from any PCWs. This causes
speculation among a minority of consumers, in connection with the issue of how the PCWs
operate, and with their more general levels of trust.
'Somebody is not on any comparison sites at all and it tells you that on the television. It
says, "We are not on any comparison sites". If it was a good thing, why aren't they on it? If
it was that good, why are they bragging that they are not?'
Midlands, SEG B, 60-74, heavy internet user
55
Date Last Edited: 4 July, 2013
Significantly more men (59 per cent) at least suspect that this happens than women (41 per
cent). There is also a steady progression in suspicion along socio-economic lines, with just
over one in 10 in socio-economic grade E (13 per cent) saying they knew that PCW
companies could pay to influence rankings while two fifths in socio-economic grade A (43 per
cent) believe this is the case.
Just under half (43 per cent) of consumers, who know that providers can pay to get better
rankings on some PCWs, say this has a strong (20 per cent) or slight (23 per cent) influence
on their choice of PCW.
Figure 6.3: Influence of knowledge about paying for rank on use of PCWs paying for
ranking
However, more than half (56 per cent) of those who know for certain that providers can pay
to get better rankings on some PCWs add that this would not influence their choice of which
site to use at all. As we have seen, in Section 6.2, deal ranking in price order is not typically
the deciding factor when consumers weigh up options.
56
Date Last Edited: 4 July, 2013
As Section 5.3 explained, getting impartial results is noted by three in 10 (31 per cent)
consumers as one of the top three most important features in a PCW; the majority have other
priorities. Despite any perceived 'rigging' of the rankings, consumers are confident that
competitive deals, tailored to their own particular profile, are still being offered.
Moreover, the issue of rankings being influenced in some way is quite distinct in most
consumers' minds from the issue of 'accurate' or 'genuine' prices: that is, prices that really
exist when they go to follow up on a quoted offer. While a genuine offer is not the same
thing as impartial results, this is a nuance that most consumers do pick up on. They have a
general lack of clarity around this whole topic.
'I do think they are impartial. When you put the information in, say for car insurance, it
doesn't bring up the same sites so it is obviously tailored to the individual and not to a
particular company.'
Wales, SEG B, 45-59, heavy internet user
'No. I think there must be influence. There is influence in everything. But hopefully with a
big company they give you a price and that is the price you are going to pay.'
Midlands, SEG C2, 60-74, non-user of PCWs
As long as the price looks like an improvement on what they are currently paying, the
majority of consumers are pragmatic about how money changes hands behind the scenes,
with some even conceding that this is reasonable, because companies have to make their
money somehow.
'I don't think they have much control over it really. I suppose within these companies there
are probably people who know how these sites work and probably make sure their
company is at the top but then that is all in my interests so it might be a cheaper deal. If
they want the business then that is great. Let them fight amongst themselves. I am sure
there is stuff going on in companies to make sure that they can get the trade but that is
usually in my interests.'
North East, SEG B, 18-29, heavy internet user
'They have got to get a percentage, haven't they? Obviously they are going to take a little
bit of a cut off there which is only fair really.'
Wales, SEG E, 30-44, heavy internet user
Among the consumers, who say they either knew or suspected that providers can pay to
influence rankings, three-quarters think that at least half of providers do this (74 per cent),
with nearly a third (31 per cent) believing that all providers do so.
57
Date Last Edited: 4 July, 2013
Figure 6.4: Proportion of people who suspect that price comparison websites allow
payment for a better rank
6.7
58
Date Last Edited: 4 July, 2013
Consumers who are aware of these voluntary accreditation schemes typically say that the
existence of a scheme like this influences their choice of website: four in 10 (36 per cent) say
it does so a little, and one-third (34 per cent) that it has a strong influence on their choice.
Figure 6.6: How accreditation schemes influence choice of price comparison website
Three-quarters (76 per cent) of consumers who are not aware of voluntary accreditation
schemes say that they would be either 'slightly' (38 per cent) or 'strongly' influenced (38 per
cent) in their future choice of PCW.
Figure 6.7: Whether accreditation schemes would influence choice of PCW in future
59
Date Last Edited: 4 July, 2013
This echoes the findings of research conducted by Andrew Smith Research and Research
Now (April 2012)31, which reports that two-thirds (67 per cent) would be more likely to use a
PCW that is accredited by a relevant industry regulator.
Accreditation is seen largely as giving an extra level of reassurance to consumers, of
conferring legitimacy and instilling confidence and trust in the information generated by
PCWs. It also gives consumers protection and someone to whom they can turn to in the
event of a complaint. Some consumers feel this is especially helpful in view of the lack of
face-to-face contact entailed in a PCW. Even so, it must be noted that while actually using
PCWs, consumers rarely notice that a particular site is actually accredited.
'Very useful, and that puts your mind at rest, because you know that the are not going to
try and make lies up.'
Scotland, SEG D, 18-29, light internet user
'You have got somebody to go back to because you are not actually speaking to
anybody...The fact that they come under some sort of accreditation or somebody who is
going to answer if they dont do right, it makes you feel more safe.
South East, SEG B, 30-44, heavy internet user
Although consumers say that accreditation gives them an extra level of reassurance, they
dont actively seek this out, and dont miss it when it is not there. Nor are they likely to reject
a site they have been using up to now, just because they have learnt that it is not accredited.
As we have seen, consumers already place a high degree of trust in PCWs as they are
currently configured, notwithstanding their need to carry out a certain amount of factchecking of the results generated.
31
Andrew Smith Research and Research Now (April 2012). Customers in Britain 2012
60
Date Last Edited: 4 July, 2013
Which? and the Citizens Advice Bureau are well regarded and seen as representing the
interests of the wider public and as champions of consumer rights. The word 'trading' in the
Office for Fair Trading or Trading Standards is also reassuring: consumers see the remit of
these two organisations as clamping down on providers flouting the law or any kind of sharp
practice in their dealings with their customers. The Office of Fair Trading is seen as an
impartial 'watchdog'. Additionally, it matters a lot to consumers that the bodies which run
these schemes should be both 'well known' and 'the main ones' in their eyes.
'Anybody that is independent and has not got an agenda, independent and neutral then
you trust them. Along the lines of Which? and Citizens Advice Bureau, you trust them
because you know that they have got your best interests at heart.'
South East, SEG C2, 60-74, heavy internet user
'A lot of them are the ones which I have heard of and that I would think, "That is fine,"
because the more well-known it is, the better.'
South East, SEG D, 18-29, heavy internet user
Conversely, consumers are opposed to the idea of such a scheme being run by a
government ministry, an industry body, or the price comparison websites themselves. Fewer
than one in 10 (nine per cent) would prefer for one of these bodies to assume the role of
accreditor. A small number of consumers are also critical of the utilities regulators.
61
Date Last Edited: 4 July, 2013
'I mean, the Citizens Advice Bureau, there is a limit to what they can do. I dont imagine
the Citizens Advice Bureau would ever take anyone to court if you didnt get what you
wanted whereas I can imagine Trading Standards could take it further.'
North East, SEG B, 30-44, heavy internet user
'Because I think that (the CAB) is more associated with helping people with a benefits
problem or dealing with Government and local authorities rather than commercial
activities.'
North East, SEG A, 75+, light internet user
Ofgem and Ofcom dont seem to have much clout at all. They just seem to be agreeing
with whatever the companies say. I dont see any relevance to signing up to them so I
don't know. There are price rises and people getting ripped off from the gas and electricity
companies.'
Scotland, SEG C2, 60-74, non-user of PCWs
62
Date Last Edited: 4 July, 2013
7.
7.1
7.2
63
Date Last Edited: 4 July, 2013
aspect: consumers understand that this is thanks to the greater buying power afforded by the
group.
You are talking on a grander scale, because there are potentially 2,000 people that could
switch over. In my eyes you could potentially gain 2,000 more customers, so therefore
they are going to give us a really, really good deal. Its kind of like, me on my own is not
going to make any difference but if it is on a much grander scale then potentially you could
be getting a better deal. It seems to me like it would work a lot easier.'
North East, SEG C1, 30-44, heavy internet user
'If you got a good amount of people, you can bargain more with them, can't you? That
would work out better in somebodys favour because as one individual they are not going
to take too much notice of you.'
Midlands, SEG D, 30-44, non-user of PCWs
Letting someone else do the legwork to secure them a better deal also frees consumers up
to spend time doing other things. An initiative like this is particularly welcome against the
backdrop of ever-increasing fuel bills and the concerns that accompany them.
'Heating is necessary; not a luxury.'
North East, SEG C2, 45-59, heavy internet user
They [utilities company] have put the prices up, so I am paying a little bit more than I was
originally. It is about time I looked at that really.
Wales, SEG C1, 45-59, heavy internet user
Linked to this, is the opinion voiced by some consumers that the main energy providers are
overly dominant, and prone to regularly raising prices. They see the collective switching
concept as a way for them to make a joint stand against what they see as energy giants.
Others take a less combative view, seeing the deal as a 'win-win situation', where the energy
provider also benefits by gaining new customers.
[Collective switching] empowers local communities to fight corporate giants. Prices are
getting out of hand.'
North East, SEG C2, 45-59, heavy internet user
'Good idea, more power being put in the hands of the common public. Energy is not a free
market and there is too much collusion.'
Wales, SEG B, 45-59, light internet user
The notion of people acting together, and of strength in numbers, appeals on two levels: the
savings to be made through collective bargaining, plus the sense of community spirit.
64
Date Last Edited: 4 July, 2013
'This is a good idea. The community would come together and many people would
benefit.'
Wales, SEG C1, 18-29, heavy internet user
'Obviously that is giving the consumer power. It is giving the community power. It is giving
the town or the city a bit more power because obviously (the site) is going to do that on
their behalf.'
Midlands, SEG C2, 45-59, heavy internet user
The more they think about it, however, the more likely consumers are to come up with
reservations and questions about the exact way in which the switching scheme would work.
These reservations are more prevalent among those who gauge their level of interest as
'quite likely,' than among the most interested in collective switching.
One key area of concern relates to whether the process of initially registering an interest via
the website or of actually signing up to a deal it generates is binding. Some consumers
fear that an offer may be withdrawn if not enough people take it up; others specify that they
would need reassurance about not being under obligation to accept the offer once it is
known.
'Sounds great, but I can see many potential hurdles. For instance, if it is a collective, the
deal is being done on a set number of people, any one of whom can drop out at any time.
I am unsure how this would impact the rest.'
Scotland, SEG C1, 45-59, light internet user
'It's like a supermarket. Sounds great as long as it's easy to reject it. If I am presented with
an unimpressive offer, there needs to be the freedom to walk away.'
Midlands, SEG B, 45-59, light internet user
Another key worry is that the designated energy provider may raise prices further down the
line, whether owing to rises in its own wholesale costs, or to offset the loss of households
who may drop out of the scheme later on.
'My only concern about that would be whether what they give you with one hand, they
take it back with the other, so once you are all committed and they have lured you in with
these lucrative offers because of your collectiveness, they say, "OK, you are locked in
now. We are going to hike up our prices by 0.75 per cent, which on the whole might not
sound a lot to the individual consumer, but as a collective organisation, that is a lot of
money.'
Wales, SEG E, 30-44, light internet user
'Good idea, I wonder if it will be good in the long run though. Im worried that it perhaps
will start out as a great deal with subsequent increasing prices.'
Wales, SEG D, 18-29, heavy internet user
65
Date Last Edited: 4 July, 2013
A third concern relates to privacy issues generally and the collective switching sites', or
energy providers' possible misuse of personal data.
'I dont want to know that Joe up the road is on it or Fred up the street is on it. I would like
to be on it, but I dont want them to know I am on it. It should be totally confidential but
everybody collectively is getting a bargain.'
Midlands, SEG B, 60-74, heavy internet user
Meanwhile, a slightly lower proportion of consumers are more negative about the concept of
collective switching from the outset. However, just as some of those who are enthusiastic
about the idea also have concerns, some of this more negative group think collective
switching could be a good idea in principle, but that it is simply not right for them. Again, key
issues for this group also include the threat of their personal data being misused for
marketing purposes, and the implications of people quitting the scheme at any point in the
process, as outlined above.
'I don't like providing personal details. I receive a lot of calls and junk mail and dont know
how to make them stop.'
Midlands, SEG B, 45-59, heavy internet user
'Potentially a good idea, but it has problems. The fact that it depends on the number
signing up: what happens if people drop out?'
North East, SEG B, 45-59, heavy internet user
The other main concern expressed by consumers, who are more hesitant about collective
switching sites, relates to the overarching theme of individualism. For some, joining a
collective would lead to a perceived loss of control in the way they manage their household
affairs.
'I do not like this idea. I don't want to be dependent or reliant on other households.'
North East, SEG C1, 45-59, heavy internet user
Some also have a perception that they would actually be obliged to mix with people in their
community, or to share information with them, to a greater degree than they feel comfortable
with. A few even think they might be required to recruit other people to join the scheme,
which they find very off-putting.
'I would think that I wasnt just paying for my own usage. I just want my own little bill. I
dont want to pay for a holiday with a group of another 50 people. I want to pay for our
own holiday. I want to pay for what I am getting and what I am using.'
Midlands, SEG C2, 60-74, non-user of PCWs
66
Date Last Edited: 4 July, 2013
'I am a very private person. I just would not do it. I know my neighbours really well. I have
lived in my house for many years and I know them and they are lovely but I would not do
that. I don't know how it would work...We have all got different suppliers so we wouldn't
change and we would have to all change, so how would you get four people to decide
which supplier they are going with?'
South East, SEG E, 60-74, non-user of PCWs
'Would you blog and say, "Come on everybody, we need to get more than 100, can you
recommend any family or friends? and I dont like to be part of things like that. I feel a bit
tied. I haven't got time to see my friends, let alone go on the internet and be tied to
something. To get it to work I dont see how else they would do it. You would have to have
active participation in it and I am not good at doing things like that, not online and stuff.'
North East, SEG B, 30-44, heavy internet user
A few of those who dont wish to get unduly involved in their communities which they
perceive they would need to as members of this 'collective' suggest that a small, close-knit
rural village would be most suited to the ethos of the scheme.
'I feel that you would have to be living in a close community, perhaps working in a village.
In this case, it could be a good idea.'
Wales, SEG B, 75+, light internet user
'The scheme would be appropriate in a rural village. Great idea and people rallying
together is always good, especially as they can have others to talk to in the case of any
issues with the service.'
Midlands, SEG E, 75+, light internet user
Another facet of this individualism manifests itself in a concern about the deal not being
sufficiently tailored to consumers' needs its 'one size fits all' premise may mean it is not, in
fact, such a good deal as it purports to be.
'I have used this before but feel they are of limited use. You need this customised and
these are generally generic, without the option to customise.'
Wales, SEG B, 60-74, light internet user
'No, not all households use the same amenities, what is right for some is not for others.'
South East, SEG B, 45-59, heavy internet user
'There could be loopholes. People may have an agenda when things are done collectively
they are not always suitable for individuals.'
Wales, SEG C1, 60-74, non-user of PCWs
67
Date Last Edited: 4 July, 2013
Other, more minor concerns, include wariness about signing up with an energy provider
consumers have not heard of, or which they dont like, and concerns around how the deal
might be affected in the event of a household moving.
'What I dont like is that they are just finding one provider, and maybe I dont want to go
with that provider, or I might have had a bad experience with that provider. The option of
searching on a number of providers: that has been taken away from me.'
Wales, SEG C1, 30-44, heavy internet user
'I am unsure if a household would be tied to this, and what would happen if it moved.'
North East, SEG B, 30-44, heavy internet user
7.3
68
Date Last Edited: 4 July, 2013
'If they are going to then sell that data onto another party again and that other party is
going to continually try to cajole the consumer into signing up with them, then that is not
right.'
Wales, SEG E, 30-44, light internet user
'It is of some interest but I think there would be too much information sharing with that and
just the fact that somebody could go in and log in as me and that leaves me wide open for
whatever. I would like to look at it.'
Scotland, SEG C1, 45-59, heavy internet user
'Im not sure. I don't know if it just seems a bit invasive when I dont actually know who
they are. It would be different if it was my phone provider, but a random third party...'
South East, SEG D, 18-29, heavy internet user
Just under half of consumers say they are unlikely to use a data analyser service. The key
barrier for these consumers is their wish to protect the privacy of their personal and usage
data, including their own phone number or even the numbers they have called. This is a
much greater concern for those who dont see a use for the service, than for those who like
the concept. In particular, most would consider an online access version of the tool to be too
intrusive, though they have misgivings about the handling of their data generally, regardless
of its method of collection.
'I wouldn't mind giving the information that I had made 50 calls to Orange. I wouldn't mind
that but they dont need to know the numbers. That is a bit too personal and nothing to do
with them.'
Wales, SEG C1, 30-44, heavy internet user
'I am wary about them having your details, and do not want to be contacted.'
Wales, SEG C1, 45-59, light internet user
Some consumers are unlikely to use this kind of comparison tool because they prefer to stay
'in control' of the research process and, in particular, to visit phone shops and negotiate deals
in person. This attitude was especially marked in the case of mobile phone PCWs (of which
Billmonitor is essentially one example). In most other product categories consumers are quite
happy to relinquish 'control' in this way and let price comparison sites do the work for them.
'Im not too fond of these kind of things. I prefer to make my own judgement on what I
would like rather than someones computer telling me what I should be looking at, kind of
thing.'
Scotland, SEG C1, 18-29, light internet user
'I like to make my own decisions and be in control.'
Wales, SEG E, 45-59, heavy internet user
69
Date Last Edited: 4 July, 2013
Other consumers, meanwhile, feel that the act of inputting their usage data and letting the
tool sift through the options would take up too much time and involve too much work and
hassle on their part. This plays into the perception held by some consumers that the
comparison process would need to be undertaken regularly, to ensure that they got the best
deal on an ongoing basis.
'I wouldn't go on there and give the information that they wanted. I can't be bothered. It is
too much hassle. I know I wouldn't do it. I dont go online every month.'
Wales, SEG C2, 60-74, non-user of PCWs
'I would not make use of this, I don't have the time to enter the details every month.'
North East, SEG B, 45-59, heavy internet user
'I can see that it could be useful. However, I think it could become quite obsessive and
would have to be constantly checked. I dont have time.'
Wales, SEG C2, 30-44, light internet user
In contrast, some consumers are troubled by quite the opposite concern: that they cannot
see the point of using the tool unless they are at the end of their contract period. They
speculate as to whether the site might try to persuade them to switch providers.
Additionally, a minority of consumers have no interest in this concept because they are
happy with their current provider and feel no inclination to switch or even look into the
possibility of better deals. A few consumers are on 'Pay As You Go' contracts, so the concept
does not apply to them, while a small minority consider their usage too light to warrant an
investigative exercise on this scale.
'If I was using a bigger amount of mobile phone, I think I could justify it then. I only use a
small amount, so I just stay as I am.'
Midlands, SEG C2, 60-74, non-user of PCWs
7.4
70
Date Last Edited: 4 July, 2013
The idea appealed more to consumers in the South East and the Midlands than to those in
other regions. There was also a noticeable age bias, with only one consumer aged over 60
saying that they would be 'quite likely' to use these apps.
Consumers who say they would be likely to use PCW apps would appreciate the
convenience factor, enabling them to save time and money. The concept appeals particularly
to people who are heavy users of the internet via their smartphones, either because they
have no or limited access to other internet-enabled devices, or simply because surfing on
their phones fits it with their work patterns or general lifestyle. A few consumers also find
apps easier to use than full-sized websites, in the sense of requiring fewer steps to access.
'Because if you were on the go and you were looking for stuff and if you were working all
the time and you have got kids and you have got a house to run, so if you are travelling to
and from places then you could actually do that as you are sitting on a train or a bus. It is
a lot easier than getting a laptop out or a notebook.'
Scotland, SEG C1, 30-44, heavy internet user
'An app on your phone is there instantly without having to wait to get home. I am too tired
to browse at night, so it could be done during my lunch break.'
Midlands, SEG D, 30-44, heavy internet user
Smartphone users who say they are unlikely to use apps typically feel that comparing is not
something you can easily do on the go. This is mainly because they find entering data on the
small screens of their phones too fiddly and awkward, compared to the full-sized screen of a
computer, with a risk of making mistakes.
'That is just my preference. I dont like looking up things on my phone. I prefer to use the
big screen. I don't think you can get all the information on the one page.'
Scotland, SEG C1, 30-44, heavy internet user
'I am not interested, and would use my laptop. I could miss info on the small screen.'
North East, SEG B, 18-29, heavy internet user
Some also consider that to use PCWs effectively, you really need to sit down quietly and give
the process your full attention with no distractions, for which a home computer is ideal.
Carrying out inquiries on the go might lead you to make hasty decisions you might
subsequently regret. Sitting down at a home computer also enables you to take notes, have
multiple screens open simultaneously and all the requisite details about your current
product/provider to hand: e.g. usage data in the case of an energy site, or specific details
about your car or home in the case of an insurance quote.
'Wouldn't use this on my phone. If I was going to use a price comparison website then I
would make time for it and use it in a controlled way, not just on the run which could lead
to rash decisions.'
Scotland, SEG B, 30-44, light internet user
71
Date Last Edited: 4 July, 2013
'I would rather use my laptop at home. If I am trying to sort out my insurances, I will be at
home with everything I need close by.'
Wales, SEG B, 18-29, heavy internet user
Moreover, many consumers are happy with their current habit of setting aside time at home
to look at these websites; they are not actively seeking additional windows of opportunity to
make price comparisons and, consequently, see no real need to do this on the move. This
includes consumers who are mainly home-based anyway, or who are not heavy mobile
phone users. Linked to this notion of not needing extra opportunities to consult PCWs, is the
fact that this is an occasional activity, while apps are viewed by some as a facility to be used
on a more regular basis, if not necessarily daily.
I am happy to do it at home. You dont need to find a new energy supplier whilst
shopping.'
Wales, SEG B, 60-74, heavy internet user
'I just think for the amount of information you have to put in there for house insurance
specifically, I wouldn't want to be doing that on the phone or while I am having a coffee.
There is no benefit to me at all. If I am on the train from my house to work, I would rather
be reading my Kindle. I would rather be doing something like that at home.'
Wales, SEG C1, 30-44, heavy internet user
Consumers also have some privacy concerns around the issue of ad-tracking, as well as
fears of what might happen to the data they have entered into their mobile phone, in the
event of the handset being lost or stolen.
'Apps can track you, and likely know where you are and how you use your phone.'
North East, SEG B, 60-74, heavy internet user
'I suppose if I had an app, would my data be secure if I lost the phone? How secure would
it be?'
Wales, SEG B, 45-59, heavy internet user
The few consumers who touch on the issue of possible pricing for these apps are quite clear
in that they should be free.
7.5
72
Date Last Edited: 4 July, 2013
Figure 7.1: Likelihood to use price comparison service providing offers and advice
Levels of interest in an alternative price comparison service are relatively lower for TV
services (40 per cent say they would definitely use or consider using one), broadband (54
per cent) and mobile phones (46 per cent give one of these responses). Consumers show
more interest in a comparison service for utilities or insurance, with two-thirds (64 per cent)
indicating in each case that this kind of service would be of interest. There are more
providers to consider in these two sectors, and the option of checking out offers in-store is
less practical.
Looking across the socio-economic grades, significantly more consumers in socio-economic
grade E say that they would not consider using this sort of alternative comparison service
than in other grades: one-third (35 per cent) give this response, compared with less than
one-fifth of consumers in the other socio-economic grades. Consumers in Scotland are also
significantly more likely to respond that they would not consider using this kind of service (25
per cent), than those in England (17 per cent). As noted in Section 3.2, this may be because
consumers in socio-economic grade E make up a larger proportion of consumers in
Scotland, than in England.
Significantly more consumers in the two youngest age groups are interested in an alternative
switching service, with around three-quarters in each (73 per cent of those aged 18-29 and
72 per cent of those aged 30-44) saying that they would at least consider using one.
Interest in this kind of service is significantly higher among those who have used a PCW in
the course of the last two years (38 per cent say they would definitely use a service like this),
than it is among either lapsed users (eight per cent), or those who use the internet but have
never used a PCW (four per cent). Interest is also very low among non-users of the internet,
with only a small minority (four per cent) saying they would definitely want to use a service
like this, despite emphasis in the explanation that this could be an offline service.
In terms of what format this service should take, the two main preferences among those who
would consider using this are for a telephone or online service. While one-third (32 per cent)
prefer telephone, almost as many (30 per cent) would like to access this kind of service
online. Around a quarter (22 per cent) prefer a face-to-face service. Only a minority of
consumers (14 per cent) are interested in accessing this kind of service by post, with
significantly fewer in the 18-29 age groups and in socio-economic grade E giving this
response than in other age groups or socio-economic grades.
73
Date Last Edited: 4 July, 2013
Focusing on non-users of PCWs specifically, more than half of this group (55 per cent)
express a preference to access this kind of service either face-to-face (32 per cent) or by
telephone (23 per cent). This preference for offline channels is understandable, given that
clearly not all members of this sub-group are internet users.
74
Date Last Edited: 4 July, 2013
8.
Conclusions
8.1
car insurance (81 per cent of those using PCWs in the last two years)
home insurance (50 per cent)
electricity or gas (44 per cent)
travel insurance (32 per cent)
rail fares (31 per cent).
Some consumers also spontaneously mention their plans to use PCWs to a greater extent in
the future, when they next purchase, or switch providers for products they have not yet used
a PCW in researching or buying.
For a high proportion of consumers, PCWs form part of the usual decision-making
process for insurance products, gas and electricity. Their overall awareness and
choice of specific sites is heavily influenced by above-the-line advertising, and
consequently focuses on the Big Four PCWs.
8.2
75
Date Last Edited: 4 July, 2013
Broadly speaking, consumers use PCWs to get the best deals, to compare prices, and to
make savings on the products or services that they purchase: all positive outcomes that
indicate consumer trust in PCWs. Indeed, around half (52 per cent) of consumers who have
used a PCW in the course of the last two years, have switched providers or purchased
directly through a PCW, using the PCW not only as an information source, but as the
transactional channel when they purchase. Moreover, around half (46 per cent) have
recommended a PCW to a friend or family member.
More explicitly, on the topic of trust, most consumers feel that the information they access
through price comparison websites is broadly reliable, and are typically able to address any
concerns they might have either by consulting multiple PCWs, or by verifying information
directly with providers.
While consumers tend to respond to the questions that PCWs ask them rather automatically
clicking and answering methodically their willingness to share personal details and data
depends on:
By and large, people are able to assess whether the information they are being asked to
provide feels appropriate. Most understand, for example, why they might be asked for
medical details when applying for travel insurance, or that a utility or broadband provider
needs to know whether their home is in an area serviced by that company. For products like
mobile phones, they expect to be able to perform quick searches without providing in-depth
information.
Consumers main concern about providing personal details is that doing so will result in
unwanted communications. While they are slightly more tolerant of emails, many have
already experienced sales calls immediately after using a price comparison site. They see
these calls as a nuisance and as invasive, and prefer not to deal with them. This is a generic
concern about providing personal details, rather than one that they link to PCWs per se.
Only a minority of consumers are concerned that the details they provide to PCWs might be
sold on to other companies without their knowledge. Again, their fear is that this will lead to
unsolicited contact, and their aim is to maintain control over who is able to approach them.
The research shows that PCWs occupy a position of trust in consumers minds. It is
clear that PCWs are seen to deliver certain and specific benefits. For the most part,
consumers understand why they are asked to provide the details that sites request.
The concerns they do have often centre around providing contact details, and
receiving unwanted sales calls and emails as a consequence.
The way that sites rank comparison results is linked closely to the trust they place in PCWs.
Consumers typically make the assumption that price comparison results are ranked
according to their ticket or tariff price and, for some, their underlying trust means that they
continue to work on this assumption when they are uncertain whether it is the case. Some
consumers become confused when they encounter a site that ranks by another variable,
such as the potential saving versus their current provider, even when this ranking is flagged
by the web page. In fact, relatively few consumers feel clear about the criteria that are used
to rank deals on PCWs they have used: the mean of the scores they award is 5.08 out of 10.
76
Date Last Edited: 4 July, 2013
Many consumers are only able to estimate the amount they pay currently for the product or
service they are researching. They can be attracted to deals from providers that are known to
them (and that they therefore trust) and that rank well in the comparison results, sometimes
interpreting this combination of factors to mean a deal is the best one without assessing
how it compares to the real amount they pay at the moment.
Some consumers express interest in alternative methods of ranking and in being able to filter
comparison results by different variables. This would allow them to reduce the number of
options under consideration to a condensed shortlist.
Some consumers rely on assumptions about both the price they pay now and the
pricing details provided by PCWs. This means that despite having high levels of trust
in PCWs, their decisions are sometimes not based on accurate information.
Communicating clearly the way that results have been ranked and giving PCW users
the option to filter results in alternative ways, would help to reduce the information
that they are trying to process to a workable volume, and allow them to analyse that
information according to their preference.
Moreover, in spite of placing a lot of trust in PCWs, many consumers have never thought
about how the sites make their money and, consequently, are unsure about their operating
models. The majority guess initially that PCWs earn revenue from advertising or from
commission that is paid by providers, but are very ready to believe that providers can (and
do) pay PCWs in order to influence comparison results. Crucially, though, more than half of
those who believe that this happens, say that it would not influence their choice of PCW.
Neither do consumers typically distinguish between the impartiality and genuineness of
results. Most dont feel that providers paying for higher rankings interferes with prices being
correct or accurate, and many admit that they dont really mind how the sites make their
money. As long as the price that they see appears to constitute an improvement on their
current providers offer, most consumers are prepared to accept it and to maintain typically
high degrees of trust.
Many consumers lack clarity around the way results are ranked, and how this can be
affected by providers themselves. However, many dont see this as an issue
provided they can identify a price that is below the one they estimate they pay
currently.
8.3
77
Date Last Edited: 4 July, 2013
Consumers are less likely to be interested in price comparison apps than in the two concepts
described above. Disinterest is typically driven by a perceived lack of need to compare prices
on the go particularly on the small screen of a smartphone, where they think it would be
easy to make mistakes.
Those who use the internet or who already use PCWs say that they would be interested in
some other kind of service that would allow them to compare offers and get advice on the
best deals available although they have a strong preference for this to be an online service.
Those who have not used PCWs show less interest in accessing a service like this at all,
despite emphasis in the survey that this need not be an online service, and despite a feeling
among some that people who use PCWs get a better deal than they do as non-users.
Consumers show an interest in expansion of the range and type of PCW services that
are available, although the research highlights specific reservations about each of the
concepts discussed. Existing users show a clear preference for accessing
comparison services online; non-users of PCWs are less interested in accessing this
kind of service at all.
8.4
8.5
unclear signposting in menus and sub-menus, which can make users feel they lack
guidance and support in navigating
small text anywhere on sites causes users to worry that they might miss important
information, which the site may have intentionally made hard to find
78
Date Last Edited: 4 July, 2013
links and buttons that are not clearly discernible lead to uncertainty about where to click
next, which items or icons on the screen will take them forward and, consequently, create
frustration and confusion for some users
some consumers have difficulty locating explanations and definitions (such as definitions
of terminology) if they are not presented on the top layer of text. Explanations, however
clearly-worded, are problematic for some users to access if they need to hover or click to
uncover them
positioning advertising content next to search results confuses a few consumers, who
interpret the advertisement to be part of the search results. Others realise that this
content is advertising, but are annoyed by it being placed there.
Consumers also react negatively to sites that dont allow them to customise or tailor their
search to the degree that they want to. Many become frustrated when sites search functions
are heavily standardised, and not flexible enough to allow them to express information that
they believe is important to their situation, and the product that is the best deal for them.
On the other hand, PCW users prefer sites that provide a lot of information about the product
or service that is being compared. The more concise, comprehensible information that they
have, the more they can feel confident about the comparison they are making and about
what they are buying.
While a brief set of straightforward questions will yield a fast comparison, consumers
need to feel that the site is catering to their situation and that it reflects this in the way
it collects information about them. In order to engender confidence in the purchase
decision, this needs to be translated into search results that are detailed, but not
complex.
8.6
Ensuring that PCWs enable effective decision-making: user experience and usability
The research points to several approaches PCWs could employ to maximise consumer
understanding of the information that they are asked to enter when they use the site, and that
they are presented with when the site has made the comparison on their behalf.
Firstly, consumers believe that PCWs empower them as consumers, and most are happy to
put their trust in these sites. It should be clear to them why they are being asked for
information, and how that information will be used.
Following several guiding design principles would make PCWs more user-friendly:
Sites must strike a balance between a fact-finding process that is fast enough to keep the
user engaged, yet sufficiently detailed to make them feel confident that the product fits
adequately with their needs. Reflecting this, the results of the comparison need to show the
consumer sufficient information about the deals being offered, while keeping that information
concise and simple. Key to the way this information is managed and presented, is the
ranking of the results, which needs to be clearly communicated. Furthermore, ideally,
consumers would like to be able to manipulate the ranking results by applying different filters.
79
Date Last Edited: 4 July, 2013
Many consumers estimate their current spend or usage, and sites could highlight this in the
results, to remind consumers that any comparisons, or anticipated savings, may not be fully
accurate.
8.7
8.8
8.9
80
Date Last Edited: 4 July, 2013
Our view is that some consumers, particularly older consumers, who are least likely to use
PCWs, have not yet adapted to the increased choice and complexity that has grown up
within the product and service areas where PCWs operate. These consumers are less willing
than existing PCW users are to communicate or negotiate actively with the providers they
use, and many are not even aware that this is possible. Consequently, some people miss out
on the best deals systematically. Therefore, raising awareness of the cost implications and
support needs of these consumers is important.
On a related note, consumers may also have issues in getting around to learning to use
PCWs, or perhaps even to using the internet more generally. Some consumers may accept
that using a price comparison service of some kind might save them time and money in the
long term, but come up against the barrier of needing to invest time to learn how. There may
be scope to help consumers to overcome issues of this kind, if they are understood in greater
detail.
81
Date Last Edited: 4 July, 2013
Appendix A: Methodology
Research design
In light of the number and nature of the aims and objectives of this research, a mixed
methodology design was used. This consisted of three elements:
Quantitative survey
The quantitative survey consisted of 2,000 structured interviews. The interviews were
conducted using computer assisted telephone interviewing (CATI) using Random Digit
Dialling (RDD). Given that 15 per cent of UK households rely on mobile telephones alone32,
the sample included mobile telephone numbers. Of the telephone numbers called, 12.2 per
cent were mobile telephone numbers and 9.2 per cent of all quantitative interviews
completed were on mobile telephone numbers. To ensure that the full range of age groups,
gender, geographic spread and socio-economic grades (SEG) were captured, in line with the
nationally representative population profile, a series of soft quotas were incorporated. The
soft quotas were continuously monitored and the sample was stratified by geographic area to
assist in the monitoring of interviews achieved.
Interviews were carried out between February 22 and March 17, 2013. Some interviews were
conducted during evenings and at weekends to achieve a more representative sample. The
average interview length was 20 minutes.
After weighting, the sample for Scotland and Wales contains significantly more consumers in
socio-economic grade E, than the England sample does. It is important to bear this in mind
when comparing differences across nation/ region, as differences in Scotland and Wales may
be heightened due to the increased number of consumers in socio-economic grade E. This is
reflected in some of the quantitative survey findings in this report: significant differences
observed in Scotland and Wales often correspond to significantly different data for socioeconomic grade E. We highlight where these significant differences occur together.
The unweighted distribution of interviews by gender, age, region/ nation and SEG is shown in
Tables A.1-A.4.
32
Ofcom (2011) International Communications Market Report 2011 [Online]. Available from:
http://stakeholders.ofcom.org.uk/binaries/research/cmr/cmr11/icmr/ICMR2011.pdf [Accessed: 07.06.2013]
82
Date Last Edited: 4 July, 2013
83
Date Last Edited: 4 July, 2013
To make the data representative by age, gender, region and SEG the data was weighted
using Random Iterative Method (RIM) weighting. Weights were calculated separately for age,
gender, region and SEG. These weights were then applied to the data with each weight
applied separately to each individual case.
The weighted distribution of interviews by gender, age, region/ nation and SEG is shown in
Tables A.5-A.8.
84
Date Last Edited: 4 July, 2013
85
Date Last Edited: 4 July, 2013
fixed broadband
electricity
home insurance
travel insurance
mobile phones.
All consumers were responsible for researching and/ or paying for the product category
which they were allocated to. Table A.10 shows the total number of hall tests for each
category.
86
Date Last Edited: 4 July, 2013
To ensure that the discussion could focus on PCWs usability (rather than the internet more
generally), all consumers had some degree of direct experience and familiarity with the
internet. All consumers taking part in the usability hall tests fell into one of the following three
categories:
heavy internet users (people who use the internet on a daily basis for at least two of the
following tasks, and at least monthly for two of the tasks marked with *):
sending/ receiving emails
checking news, weather or travel plans (e.g. maps, train times)
visiting sites for information on personal interests or hobbies
visiting sites for information on products/ services I am thinking of buying*
checking your bank account and other financial holdings*
checking, paying or managing my utilities, phone, broadband or other bills*
booking holidays, hotels or making travel arrangements*
grocery shopping online*
other online shopping*
playing games online
downloading music or movies
visiting social networking sites (such as Facebook) or contributing to blogs, forums or
other open source sites
light internet users (people who use the internet, but dont match the description of
heavy users, and have used a PCW before)
Non-users of PCWs (people who use the internet, but have not used a PCW before).
Table A.11 shows summary details of the number of usability hall tests carried out for each
product category.
Table A.11 Distribution of usability hall tests by user type and Big 4 vs. others
Market
Total
Non-users
Big 4
Light
Heavy
users
users
34
3
10
21
10
Fixed
broadband
Electricity
55
13
17
25
9
Home insurance
37
9
10
18
14
Mobile phones
28
8
7
13
4
Travel insurance
43
9
14
20
13
Total
197
42
58
97
50
Others
24
46
23
24
30
147
The hall test entailed the consumer looking for a new deal for the allocated product category
on the assigned PCW, before continuing to consider PCWs more generally. The topics
covered in the hall test interview included:
steps taken when looking for a new deal on the PCW, and why those steps
factors that are important when making a decision
87
Date Last Edited: 4 July, 2013
Depth interviews
After completing a usability hall test, 63 consumers took part in a 30 minute face-to-face
depth interview. Just over half of these (35 consumers) had been pre-recruited to take part in
the depth interview at an arranged time, following their participation in the hall test. A further
28 consumers who had been recruited to take part in the hall test using in-street intercepts
also took part in a depth interview. Recruitment to the depth interviews was dictated by the
following quota criteria:
age
gender
SEG
internet user type (heavy user, light user or non-user of PCWs).
88
Date Last Edited: 4 July, 2013
Newcastle
Watford
6
5
11
Watford
Total
30
33
63
Total
11
30-44
19
45-59
12
60-74
12
75+
Total
11
13
14
14
11
63
Newcastle
2
5
2
2
1
2
14
Watford
0
3
3
1
2
2
11
Total
2
17
18
11
7
8
63
As with the hall tests, the interviews were split by location. Table A.15 shows summary
details of the number of interviews in each location by user type.
89
Date Last Edited: 4 July, 2013
Total
11
13
14
14
11
63
The depth interviews investigated consumers experiences and views on PCWs in more
detail. Topics covered in the interviews included:
shopping around and switching behaviour changed as a result of the emergence of PCWs
how consumers became aware of PCWs and the service they offer, in particular the role
of (above the line) advertising recommendations, etc
previous usage of PCWs for products and reasons for this
extent to which a number of price comparison websites are used for the same query
willingness to use PCWs in connection with products not used for to date, and reasons
after using a PCW how the product is purchased: for example, whether via the link
provided or directly via the provider, and reasons for this
ease of use of PCWs, including what is considered good and bad practice
confidence in using PCWs, and the benefits and drawbacks of using them
opinions on the objectivity and accuracy of the results
awareness of accreditation schemes
opinion on what accreditation means in this context, and who should accredit PCWs
reactions and likelihood to use next generation comparison tools: collective switching
sites and data analyser services
reactions and likelihood to use PCW smartphone apps.
Each consumer was given a 10 cash incentive as a thank you for taking part. The depth
interviews were carried out following the hall tests between February 26 and March 9, 2013.
90
Date Last Edited: 4 July, 2013
91
Date Last Edited: 4 July, 2013
92
Date Last Edited: 4 July, 2013
Before we start, I would like to ask a few questions about you and your household.
S1
Ask all
Record Sex
DO NOT ASK, SINGLE CODE
S1
Codes
Routing
Male
S2
Female
S2
Codes
Routing
Under 18
CLOSE
18-29
S3
30-44
S3
45-59
S3
60-74
S3
75+
S3
Refused
99
CLOSE
Ask all
S2
Could you please tell me into which of the following age ranges
you fall?
READ OUT, SINGLE CODE
93
Date Last Edited: 4 July, 2013
S3
Ask all
Which part of Great Britain do you live in?
Codes
Routing
Scotland
S4
Wales
S4
S4
East Midlands
S4
East of England
S4
Greater London
S4
S4
S4
S4
10
S4
West Midlands
11
S4
12
S4
Dont know/Refused
99
CLOSE
94
Date Last Edited: 4 July, 2013
Ask all
S4
Codes
Routing
S5
GCSE/O-Level/CSE
S5
S5
S5
S5
Masters/PhD or equivalent
S5
No formal qualifications
S5
S5
Dont know/Refused
99
S5
Codes
Routing
Ask all
Wed like to ask you about the member of your household
who you would say is the CHIEF INCOME EARNER, that is the
person with the largest income, whether from employment,
pensions, state benefits, investments or any other sources.
S1
TYPE OF FIRM
WRITE IN
Q1
WRITE IN
Q1
WRITE IN
Q1
QUALIFICATIONS HELD
WRITE IN IF
NOT CIE,
Q1
OTHERWISE
USE
ANSWER
FROM S4
SELF-EMPLOYED?
Yes 1
No 2
95
Date Last Edited: 4 July, 2013
Q1
WRITE IN
Q1
WRITE IN
Q1
Dont know/Refused
99
INTERVIEW INSTRUCTIONS:
CODE SOCIAL GRADE OF CHIEF INCOME EARNER
1A
2B
3 C1
4 C2
5D
6E
96
Date Last Edited: 4 July, 2013
Close
Ask all
Q1
How do you access the internet? Please include all the ways
you ever access the internet.
Codes
Routing
Q2
Q2
Q2
Q2
Q2
Q2
Q2
Q34
Q2
Dont know/Refused
99
CLOSE
97
Date Last Edited: 4 July, 2013
Q2
Ask if Q18
For which of the following do you use the internet and how
often?
Codes
Routing
Q3
Q3
Q3
Q3
Q3
Q3
Q3
Q3
Q3
10
Q3
11
Q3
12
Q3
98
Q3
98
Date Last Edited: 4 July, 2013
Q3
Ask all
Have you ever heard of price comparison websites?
Codes
Routing
Q4
Yes
Q4
No
Q36
Codes
Routing
all4comparing.co.uk
Q5
beatthatquote.com
Q5
best-mobile-contracts.co.uk
Q5
biba.org.uk
Q5
billmonitor.com
Q5
broadbandchoices.co.uk
Q5
broadbandgenie.co.uk
Q5
buymobilephones.net
Q5
cable.co.uk
Q5
cheapflights.co.uk
10
Q5
11
Q5
comparemobiledeals.com
12
Q5
comparethemarket.com
13
Q5
confused.com
14
Q5
Ask if Q3=1
Please name as many price comparison sites as you can
remember.
DO NOT READ OUT, MULTICODE.
INTERVIEWER PROBE ANY MORE THAT COME TO MIND?
UNTIL RESPONDENT SAYS No
99
Date Last Edited: 4 July, 2013
dealchecker.co.uk
15
Q5
ebookers.com
16
Q5
energyhelpline.com
17
Q5
energylinx.co.uk
18
Q5
expedia.com
19
Q5
fairinvestment.co.uk
20
Q5
fuelswitch.com
21
Q5
gocompare.com
22
Q5
homeadvisoryservice.co.uk
23
Q5
homephonechoices.co.uk
24
Q5
icelolly.com
25
Q5
kelkoo.co.uk
26
Q5
knowyourmoney.co.uk
27
Q5
lastminute.com
28
Q5
lovemoney.com
29
Q5
mobilechecker.co.uk
30
Q5
mobilechoices.co.uk
31
Q5
mobilife.com
32
Q5
money.co.uk
33
Q5
moneyfacts.co.uk
34
Q5
moneynet.co.uk
35
Q5
moneysavingexpert.com
36
Q5
moneysupermarket.com
37
Q5
myutilitygenius.co.uk
38
Q5
omio.com
39
Q5
100
Date Last Edited: 4 July, 2013
onecompare.com
40
Q5
onestopphoneshop.co.uk
41
Q5
onthebeach.co.uk
42
Q5
opodo.co.uk
43
Q5
quidco.com
44
Q5
quotezone.co.uk
45
Q5
raileasy.co.uk
46
Q5
railsaver.co.uk
47
Q5
redspottedhanky.com
48
Q5
saveonyourbills.co.uk
49
Q5
simplifydigital.co.uk
50
Q5
simplyswitch.com
51
Q5
skyscanner.net
52
Q5
switchgasandelectric.com
53
Q5
tescocompare.com
54
Q5
theenergyshop.com
55
Q5
trainline.com
56
Q5
travelrepublic.co.uk
57
Q5
travelsupermaket.com
58
Q5
ukpower.co.uk
59
Q5
unravelit.com
60
Q5
urmob.co.uk
61
Q5
uswitch.com
62
Q5
which.co.uk/switch/
63
Q5
whoscheapest.co.uk/
64
Q5
101
Date Last Edited: 4 July, 2013
Q6
None
65
Q5
98
Q5
Dont know
99
Q5
Codes
Routing
Yes
Q7
No
Q32
Dont know/Refused
99
Q32
Codes
Routing
Q8
Q8
Car Insurance
Q8
Home Insurance
Q8
Travel Insurance
Q8
Q8
Q8
Package holidays
IF CODE 8, 9,
10 ONLYGO
TO Q36
Rail fares
IF CODE 8, 9,
10 ONLYGO
TO Q36
Ask if Q3=1
Have you used a price comparison website in the last two
years?
DO NOT READ OUT, SINGLE CODE
Q7
Ask if Q6=1
Which of the following products/services do you use price
comparison websites for?
Please say yes to all categories that you have used price
comparison websites for.
READ OUT, MULTI CODE
102
Date Last Edited: 4 July, 2013
Q8
10
IF CODE 8, 9,
10 ONLYGO
TO Q36
11
Q36
Dont know/Refused
99
Q36
Ask if Q7=1-7
Which of the following price comparison websites have you
ever used?
Codes
Routing
Q9
beatthatquote.com
Q9
biba.org.uk
Q9
billmonitor.com
Q9
broadbandchoices.co.uk
Q9
broadbandgenie.co.uk
Q9
comparethemarket.com
Q9
dealchecker.co.uk
Q9
energyhelpline.com
Q9
icelolly.com
10
Q9
moneysavingexpert.com
11
Q9
moneysupermarket.com
12
Q9
myutilitygenius.co.uk
13
Q9
energylinx.co.uk
14
Q9
fuelswitch.com
15
Q9
gocompare.com
16
Q9
quidco.com
17
Q9
103
Date Last Edited: 4 July, 2013
simplifydigital.co.uk
20
Q9
simplyswitch.com
21
Q9
switchgasandelectric.com
22
Q9
theenergyshop.com
24
Q9
ukpower.co.uk
25
Q9
unravelit.com
26
Q9
uSwitch.com
27
Q9
which.co.uk/switch/
28
Q9
98
Q9
Dont know/Refused
99
Q36
104
Date Last Edited: 4 July, 2013
Q9
Ask if Q899
Thinking specifically about the sites that you just mentioned,
how often do you use a price comparison site?
Codes
Routing
READ OUT.
At least monthly
Q10
Q10
Q10
Twice a year
Q10
Once a year
Q10
Q10
Q10
Dont know/Refused
99
Q10
105
Date Last Edited: 4 July, 2013
Codes
Routing
Q11
Q11
Q11
Q11
Q11
Dont know/Refused
99
Q11
Codes
Routing
Q12
Q12
Q12
Q12
Dont know/Refused
99
Q12
106
Date Last Edited: 4 July, 2013
Codes
Routing
Q13
Q13
Q13
Q13
To switch suppliers
Q13
Q13
Q13
Q13
Q13
10
Q13
98
Q13
Dont know/Refused
99
Q13
Routing
Q14
No
Q15
107
Date Last Edited: 4 July, 2013
Codes
Routing
Broadband
Q16
Q16
Car Insurance
Q16
Home Insurance
Q16
Travel Insurance
Q16
Q16
TV service
Q16
Q16
Package holidays
Q16
Rail fares
10
Q16
11
Q16
12
Q16
Dont know/Refused
99
Q16
108
Date Last Edited: 4 July, 2013
Routing
Q16
Q16
Q16
Q16
Q16
Q16
Q16
Q16
Q16
10
Q16
Dont know/Refused
99
Q16
109
Date Last Edited: 4 July, 2013
Q16
Ask if Q899
When using price comparison sites for a particular purpose,
how many sites do you tend to look at before making your
decision?
Codes
Routing
One
Q17
Two to three
Q17
Four to five
Q17
Q17
Dont know/Refused
99
Q17
Codes
Routing
WRITE IN
Q18
Q18
Q18
Q18
Other
Q18
Dont know/Refused
99
Q18
110
Date Last Edited: 4 July, 2013
Codes
Routing
Very reliable
Q19
Fairly reliable
Q19
Fairly unreliable
Q19
Very unreliable
Q19
Dont know/refused
99
Q19
Codes
Routing
WRITE IN
Q20
Codes
Routing
Q21
Q21
Q21
Dont know/Refused
99
Q21
111
Date Last Edited: 4 July, 2013
Codes
Routing
Q22
Q22
Q22
Dont know/Refused
99
Q22
Codes
Routing
All
Q23
Q23
Q23
Dont know/refused
99
Q23
Codes
Routing
Q24
Q25
Dont know/Refused
99
Q25
112
Date Last Edited: 4 July, 2013
Codes
Routing
Q28
Q28
Q28
Dont know/Refused
99
Q28
Codes
Routing
Q26
Q26
Q26
Dont know/Refused
99
Q26
Codes
Routing
Q27
Q27
Q27
Q27
Q27
Q27
Q25
Ask if Q23=2 OR 99
Would the existence of an accreditation scheme help you to
decide which price comparison websites to use in the future?
READ OUT, SINGLE CODE
113
Date Last Edited: 4 July, 2013
Q27
Dont know/Refused
99
Q27
Codes
Yes=1
Routing
Yes=1
Q28
Yes=1
Q28
Yes=1
Q28
Yes=1
Q28
Yes=1
Q28
Well-known brand/name
Yes=1
Q28
Telephone helpline
Yes=1
Q28
Yes=1
Q28
Yes=1
Q28
10
Yes=1
Q28
12
Yes=1
Q28
13
Yes=1
Q28
Electricity or gas
Insurance
Broadband service
TV service
Mobile phone
114
Date Last Edited: 4 July, 2013
Codes
Routing
1-10 or DK/
REFUSED 99
Q29
Easy to use
1-10 or DK/
REFUSED 99
Q29
1-10 or DK/
REFUSED 99
Q29
1-10 or DK/
REFUSED 99
Q29
1-10 or DK/
REFUSED 99
Q29
1-10 or DK/
REFUSED 99
Q29
1-10 or DK/
REFUSED 99
Q29
Codes
Routing
Q30
115
Date Last Edited: 4 July, 2013
Codes
Routing
Yes
Q31
No
Q31
Cant remember
Q31
Dont know/Refused
99
Q31
Codes
Routing
Q43
Codes
Routing
Yes
Q33
No
Q35
Dont know/Refused
99
Q35
Codes
Routing
Q36
Q36
SINGLE CODE
116
Date Last Edited: 4 July, 2013
Q36
Q36
Q36
Q36
Q36
Dont know/Refused
99
Q36
Codes
Routing
Yes
Q35
No
Q36
Dont know/Refused
99
Q36
Codes
Routing
Q36
Yes, I have asked other people but they have not used them
for me
Q36
No,
Q36
Dont know/Refused
99
Q36
117
Date Last Edited: 4 July, 2013
ROUTING
Yes
No
N/A
Q37
Car insurance
Q37
Home insurance
Q37
Travel insurance
Q37
Mobile phone
Q37
TV service
Q37
Landline telephone
Q37 SEE
INSTRUCTION
BELOW
Package holidays
Q37 SEE
INSTRUCTION
BELOW
Rail fares
Q37 SEE
INSTRUCTION
BELOW
Q37 SEE
INSTRUCTION
BELOW
Q37
118
Date Last Edited: 4 July, 2013
Codes
Routing
Q38
Q38
Q38
Q38
Q38
Q38
Dont know/Refused
99
Q38
Codes
Routing
Q39
Q39
Q39
Q39
Q39
Q39
Dont know/Refused
99
Q39
Q38 Ask if Q31 not answered and coding more than one option at
previous Q37
Which of these is most influential in your decision-making?
READ OUT FILTER ON PREVIOUS Q, SINGLE CODE
119
Date Last Edited: 4 July, 2013
Codes
Routing
Very confident
Q40
Fairly confident
Q40
Q40
Q40
Codes
Routing
Better
Q41
Same
Q41
Worse
Q41
Dont know/Refused
99
Q41
Codes
Routing
Q42
120
Date Last Edited: 4 July, 2013
Codes
Routing
Q43
Q43
Q43
Q43
Q43
Q43
Q43
Q43
Q43
10
Q43
Other specify
10
Q43
Codes
Routing
Q44
I would consider it
Q44
Q44
121
Date Last Edited: 4 July, 2013
I wouldnt consider it
Thank and
close
Dont know/Refused
99
Thank and
close
Codes
Routing
Q44
Q44
Q44
Q44
Dont know/Refused
99
Q44
122
Date Last Edited: 4 July, 2013
Thank you for sparing me a minute. I am working on behalf of Consumer Focus, the independent
organisation representing the interests of consumers across Great Britain.
We are interested in learning more about peoples experiences of using online comparison
websites and are looking for people who are willing to take part in a short exercise. It will take
approximately 20 minutes of your time today and you will receive a cash incentive of 5 as a thank
you for your time. We would simply like to sit with you while you go through online comparison
sites and complete a few specified tasks.
You dont need to be a regular user of the internet or these sites to take part. We just want to get
your thoughts on them and the tasks we ask you to complete.
Our team is located a short walk from here [add location].
123
Date Last Edited: 4 July, 2013
Ask all:
Record Sex
DO NOT ASK, SINGLE CODE
S1
Codes
Routing
Male
S2
Female
S2
Codes
Routing
__________
S2b
Refused
99
CLOSE
Codes
Routing
Under 18
CLOSE
18-24
S3
25-39
S3
40-54
S3
55-64
S3
65-74
S3
75+
S3
Refused
99
CLOSE
Ask all:
S2a
Ask all:
S2b Could you please tell me into which of the following age ranges
you fall?
READ OUT, SINGLE CODE
124
Date Last Edited: 4 July, 2013
Ask all:
S3
Codes
Routing
Student
S4
Full-time employed
S4
Part-time employed
S4
Unemployed
S4
Housewife
S4
Home-maker
S4
S4
99
CLOSE
Ask all:
Note: Please ask them to answer
with the details for the chief income
earner in the household, even if it is
not them
Job title
Business qualification
Number of staff responsible for
Routing
S5
S5
C1
S5
C2
S5
S5
125
Date Last Edited: 4 July, 2013
S5
S5
Ask all:
Can you tell me into which of the following bands your total
annual household income falls?
S1
Codes
Routing
S6
15,000 - 19,999
S6
20,000 - 29,999
S6
30,000 - 39,999
S6
40,000 - 49,999
S6
50,000 - 59,999
S6
60,000 - 69,999
S6
70,000 - 99,999
S6
100,000 or more
S6
Dont know/Refused
99
S6
Codes
Routing
Electricity
S7
Travel insurance
S7
Home insurance
S7
Mobiles
S7
Fixed broadband
S7
WRITE IN
S6
Ask all:
Are you responsible for researching and/or paying for any
of the following:
S1
126
Date Last Edited: 4 July, 2013
S7
None of these
Close
99
Close
Codes
Routing
Yes
S8
No
S8
Ask all:
S1
S8
S1
Ask all:
How often do you use the internet?
By this we mean you use the internet for more than 30 minutes
each day.
Codes
Routing
S9
S9
Do not use the internet myself but ask family and/or friends to
help me if I need to research something (No permanent internet
access)
Close
Do not use the internet at all or have anyone else access it for me
Close
127
Date Last Edited: 4 July, 2013
S9
For which of the following do you use the internet and how
often?
Daily
Several
times a
week
Weekly
At least
monthly
Once
every
couple
of
months
Once
or
twice a
year
Less
than
once a
year
Never
128
Date Last Edited: 4 July, 2013
S10
S1
Ask all:
Have you used price comparison websites?
Codes
Routing
S11
S11
S11
Never
S11
Dont know/Refused
99
Close
online shopping,
managing finances,
managing utilities etc.
visiting sites for information on products and services
booking holidays
Non-user
Not heavy user and has not used price comparison sites
129
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
S11
Codes
moneysupermarket.com
comparethemarket.com
confused.com
beatthatquote.com
billmonitor.com
broadbandchoices.co.uk
broadbandgenie.co.uk
thepeoplespower.co.uk
energyhelpline.com
10
moneysavingexpert.com
11
myutilitygenius.co.uk
12
Energylinx.co.uk
13
Fuelswitch.com
14
Quidco.com
15
Simplifydigital.co.uk
16
SimplySwitch.com
17
switchgasandelectric.com
18
google.co.uk/compare
19
biba.org.uk
20
UKPower.co.uk
21
130
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Unravelit.com
22
uSwitch.com
23
Which?Switch.co.uk
24
mobilife.com
25
tescocompare.com
26
None
27
98
Dont know
99
131
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
INTERVIEWER DECLARATION
This declaration covers the recruitment interviewing on this project. You should sign it after successfully recruiting a
respondent.
You must complete this section neatly for this interview to be valid.
I declare that I have conducted this interview within the MRS Codes of Conduct, the respondent answered all parts of
the questionnaire & he/she was previously unknown to me.
I also declare to hold in confidence any information about the products, packaging or concepts that may be disclosed to
you directly or indirectly by participating in this research.
I will not discuss any of the information disclosed to me with anyone other than the respondents participating in the
test. this includes verbal discussions, texts, blogs, twitters or any other medium. about the products, packaging or
concepts
NAME (PRINT)
SIGNATURE
INTERVIEWER NO
DATE OF RECRUITMENT
THANK YOU FOR WORKING ON THIS PROJECT
132
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
UNDER THE DATA PROTECTION ACT, IT IS ILLEGAL FOR MARKET RESEARCH COMPANIES TO STORE RESPONDENTS ADDRESS DETAILS
WITH THE QUESTIONNAIRE BEYOND THE LIFE OF A PROJECT RECONTACTING RESPONDENTS CAN ONLY BE CARRIED OUT IF THE
RESPONDENTS PERMISSION HAS BEEN OBTAINED. THE ONLY EXCEPTION TO THIS IS RE-CONTACT FOR QUALITY CONTROL PURPOSES
ADDRESS DETAILS APPEAR ON THE BACK PAGE OF THE RECRUITMENT QUESTIONNAIRE, SO IT CAN BE REMOVED & CONFIDENTIALY
DISCARDED AFTER THE PROJECT HAS FINISHED.
PROJECT MEERKAT
3753
PERSONAL INFORMATION
First name
Last name
133
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Q1a.
Q1b.
Date Checked:26.4.2013
Q2.
Steps taken
Q3.
Explanation of behaviour/ reasons for
doing this
135
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Q2.
Q3.
Interviewer instruction: do not probe, but tick off any of the following
factors if the respondent mentions them during the course of the task.
Factor
Mentioned
Price
Reputation of product provider
Information provided about the deal
What other people have said about deals,
e.g. in reviews
Number of comparison options provided
Ability to customise your search (using
personal data e.g. postcode or price of bill)
The ranking of deals in the results the site
produces
Whether a deal is flagged as recommended
for you or something similar
Interviewer read out:
Still thinking about what you have seen on the screen in the last few
minutes, Id like us to think about the things that would be important for
you, if you were actually making a decision
Im going to read out a list of factors that Im interested in. Id like you to
tell me which would be the 3 most important ones. Well mark the most
important with a 1, the second most important with a 2 and the third
most important with a 3.
Interviewer, rotate order of codes 1 to 8: start with code 1 for first
interview; code 2 for second, and so on.
136
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Factor
1. Price
2. Reputation of product
provider
3. Information provided
about the deal
4. What other people
have said about deals,
e.g. in reviews
5. Number of
comparison options
provided
6. Ability to customise
your search (using
personal data e.g.
postcode or price of
bill)
7. The ranking of deals
in the results the site
produces
8. Whether a deal is
flagged as
recommended for
you or something
similar
9. Other (write in)
Overall, how easy or difficult did you find it to use this website?
Please use a scale of 0-10, where 0 means the website is impossible or
very difficult to use, and 10 means it is extremely easy to use.
Q5.
Tell me a bit about why you gave the site that score.
137
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Q6.
What were the specific things about this site that made it feel userfriendly, would you say? Can you give me an example? Why did that make
it feel user-friendly?
Q7.
Q8.
And what were the things about this site that werent user-friendly? Why
did that make you feel that way? Can you give me an example? Which are
the least user-friendly aspects of the site? Why?
Q9
How comfortable would you feel about providing your email address,
postcode, consumption data (annual energy bill, mobile phone bill etc.)
[Interviewer: for travel insurance interview], and medical conditions
when using a site like this?
Interviewer: probe here to make sure you understand any differences
about comfort levels with different types of information
138
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Q11.
How likely do you think you would be to use a service like this?
Very likely
Quite likely
Not very likely
Not at all likely
Q12.
Date Checked:26.4.2013
CONSENT
Q13.
Q14.
How likely do you think you would be to use a site like this?
Very likely
Quite likely
Not very likely
Not at all likely
Q15.
Mobile apps:
Q16.
Q17.
Q18.
We would like to know how likely you think you would be to use a
dedicated price comparison mobile app?
Very likely
Quite likely
Not very likely
Not at all likely
I dont really use apps/ I
dont understand what
apps are
Why do you say that?
140
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Q19.
Additional
comments
Conclusion
Thank you for your time. Is there anything else you would like to say about
your experience of using price comparison websites today?
141
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Previous
switching
behaviour
Introduction
Thank you for taking part in this interview. Id now like to understand in a
bit more detail your experiences and views on price comparison websites
No right/ wrong answers
Section 2 Awareness and usage (15 minutes)
Can you start by telling me a bit more about your normal habits when
youre considering buying or switching products like broadband, mobile
phone, energy and insurance. What, broadly, are the steps for you?
Interviewer: Allow spontaneous response here, then ask:
How often, if at all, would you say you switch provider? Why?
- Interviewer: Probe to understand reasons for differences between
product categories.
- Do they tend to switch in the end, or ultimately decide to stick with
their existing provider?
I wonder whether things have changed for you since price comparison
websites started to be available. Did you switch provider regularly, or
research providers of services, before price comparison websites existed?
Awareness and
usage
Now that price comparison sites are available, has this affected the way you
consider these products and the way you go about purchasing them?
- What has changed? Why?
- Interviewer: Probe to understand how they previously accessed
information and whether they now shop around more/ less than
previously
Id now like to focus on your experience of price comparison websites:
So first of all, tell me about the price comparison websites that you are
aware of.
142
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Thinking generally here, how do you find out about price comparison
websites?
- Probe on advertising vs. experience vs. recommendations etc.
And why do you use these sites?
- Interviewer: Probe to understand perceived benefits, issues of trust,
ease of use etc. Ask respondent,
In what way are things better when you use a price comparison site, than
when you dont? Can you give me some examples?
And how do you actually go about using price comparison sites? Please talk
me through what you typically do after you have produced the table of
results.
- Interviewer: Probe to understand whether they compare findings
across different sites, whether they check with suppliers directly
(online or offline), whether they look at other sources (such as best
buy tables in the paper). Probe to understand whether they prefer
sector specific sites or generic sites etc.
Do you ever make the purchase/ switch directly through the price
comparison website? Why (not)?
- Interviewer: Probe to understand perceived advantages/ concerns.
You said that you have used price comparison sites for [insert categories].
Are there reasons why you havent used them for [other categories]?
Is this something youd think about doing in the future? Why (not)?
143
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Experience
Trust, confidence
& accreditation
144
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
145
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
We also spoke earlier about a new kind of price comparison tool where you
give detailed data on your usage (e.g. of energy, your mobile phone) to a
third party, who then helps you find the best deal.
Interviewer: please read out if they would like a recap of the definition
Some price comparison tools can help you to analyse detailed data on your
consumption pattern, which you usually find in your monthly or annual bills,
to find the most suitable deal. For example, theres a comparison tool called
Billmonitor, which allows you to input detailed data on your mobile phone
usage. Billmonitor then analyses the information, in order to find the
mobile phone contract that is most suited to your lifestyle.
How would you feel about providing detailed data on your consumption
(e.g. of energy, mobile phone usage) to a third party, to help them find the
best deal for you?
Interviewer, probe to understand willingness
What do you think would be the benefits to you of using a service like this?
What concerns do you have? Why do you say that?
Interviewer: ladder if possible here to understand the implications of any
concerns
Lastly, some price comparison providers are now beginning to develop
dedicated smartphones apps to allow people to access their services in this
way. Apps can make it easier for people to access the services on the go and
often also have more customisable features than websites.
What is your reaction to this idea?
Would you consider using a price comparison app on your tablet or mobile?
Why do you say that?
What concerns do you have? Why do you say that?
Interviewer: ladder if possible here to understand the implications of any
concerns
What would encourage you to use a price comparison app?
146
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Additional
comments
Final check
Conclusion
Is there anything else that you would like to say on this subject to our
client?
Pay incentive and ensure respondent signs for it.
147
Date Last Edited: 4 July, 2013
Date Checked:26.4.2013
Consumer Futures
If you have any questions or would like further information about our research,
please contact Marzena Lipman, by telephone on 020 7799 7981 or
via email marzena.lipman@consumerfutures.org.uk
For regular updates from Consumer Futures, sign up to our
monthly e-newsletter by emailing enews@consumerfutures.org.uk or
follow us on Twitter http://twitter.com/Futures_tweet
If you require this publication in Braille,
large print or on audio CD please contact us.
Deaf, hard of hearing or speech-impaired consumers
can contact Consumer Futures via Text Relay:
From a textphone, call 18001 020 7799 7900
From a telephone, call 18002 020 7799 7900
ISBN: 978-1-907125-79-9