Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?

U Liebe, K Glenk, M Oehlmann, J Meyerhoff

Research output: Contribution to journalArticlepeer-review

15 Citations (Scopus)
6 Downloads (Pure)

Abstract

Web surveys are becoming increasingly popular in survey research including stated preference surveys. Compared with face-to-face, telephone and mail surveys, web surveys may contain a different and new source of measurement error and bias: the type of device that respondents use to answer the survey questions. This is the first study that tests whether the use of mobile devices, tablets or smartphones, affects survey characteristics and stated preferences in a web-based choice experiment. The web survey on expanding renewable energy production in Germany was carried out with 3,182 respondents, of which 12 per cent used a mobile device. Propensity score matching is used to account for selection bias in the use of mobile devices for survey completion. We find that mobile device users spent more time than desktop/laptop users to answer the survey. Yet, desktop/laptop users and mobile device users do not differ in acquiescence tendency as an indicator of extreme response patterns. For mobile device users only, we find a negative correlation between screen size and interview length and a positive correlation between screen size and acquiescence tendency. In the choice experiment data, we do not find significant differences in the tendency to choose the status quo option and scale between both subsamples. However, some of the estimates of implicit prices differ, albeit not in a unidirectional fashion. Model results for mobile device users indicate a U-shaped relationship between error variance and screen size. Together, the results suggest that using mobile devices is not detrimental to survey quality.
Original languageEnglish
Pages (from-to)17 - 31
Number of pages15
JournalJournal of Choice Modelling
Volume14
DOIs
Publication statusFirst published - 2015

Bibliographical note

1023311

Keywords

  • Acquiescence bias
  • Choice experiment
  • Mobile device
  • Propensity score matching
  • Renewable energy
  • Sample selection bias
  • Smartphone
  • Survey format
  • Survey quality

Fingerprint Dive into the research topics of 'Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?'. Together they form a unique fingerprint.

Cite this