Scottish Household Survey 2020: methodology and impact of change in mode

The methodology report for the Scottish Household Survey 2020 telephone survey which discusses the impact of the change in mode.


Appendix 1: Bibliography

Ansolabehere, S., and B. F. Schaffner (2014). "Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison," Political Analysis, 22, 285–303

Berger, Y. G., Muñoz, J. F. and Rancourt, E (2009) 'Variance estimation of survey estimates calibrated on estimated control totals - An application to the extended regression estimator and the regression composite estimator'. Computational Statistics and Data Analysis 53(7):2596-2604

Biemer, P.B., and others, eds. (1991). Measurement Errors in Surveys. New York: John Wiley and Sons

Biemer, P.B. (2001) "Non-response Bias and Measurement Bias in a Comparison of Face to Face and Telephone Interviewing" Journal of Official Statistics, Vol. 17, No. 2, 2001, 295-320.

Biemer, P.B., de Leeuw, E., Eckman, S., Edwards, B., Kreuter, F., Lyberg, L.E., Tucker, N.C., & West, B.T. (2017) Total Survey Error in Practice. Wiley Series in Survey Methodology.

Campanelli, P., Nicolaas, G., Jäckle, A., Lynn, P., Hope, S., Blake, M. and Gray, M. (2013) 'A Classification of Question Characteristics Relevant to Measurement Error and Consequently Important for Mixed Mode Questionnaire Design'. First presented at the Royal Statistical Society. London, 11 October 2011.

Chang, L., and J. A. Krosnick (2009). "National Surveys via RDD Telephone Interviewing versus the Internet Comparing Sample Representativeness and Response Quality," Public Opinion Quarterly, 73, 641–678.

Clifford, S., and J. Jerit (2016). "Cheating on Political Knowledge Questions in Online Surveys: An Assessment of the Problem and Solutions," Public Opinion Quarterly, 80, 858–887.

de Leeuw, E. D. (2005) To mix or not to mix data collection modes in surveys. Journal of Official Statistics, 21, 2, pp.233-255.

Dillman, D. A., G. Phelps, R. Tortora, K. Swift, J. Kohrell, J. Berck, and B. J. Messer (2009). "Response Rate and Measurement Differences in Mixed-Mode Surveys Using Mail, Telephone, Interactive Voice Response, and the Internet," Social Science Research, 38, 1–18

Estevao, V. M. and Särndal, C.-E. (2009) 'A new face on two-phase sampling with calibration estimators'. Statistics Canada, Survey Methodology 35(1):3-14

Freeth, S. and Sparks, J. (2004) Scottish Household Survey – Report of the 2001 Census-linked study of survey non-response. Office of National Statistics.

Foster, K. (1998) Evaluating Non-response on Household Surveys: Report of a Study Linked to the 1991 Census. London: Office for National Statistics, 1998. Print

Gooch, A., and L. Vavreck (2019). "How Face-to-Face Interviews and Cognitive Skill Affect Item NonResponse: A Randomized Experiment Assigning Mode of Interview," Political Science Research and Methods, 7, 143–162.

Hall, J., Brown, V., Nicolaas, G., and Lynn, P. (2013) Extended Field Efforts to Reduce the Risk of Non-response Bias: Have the Effects Changed over Time? Can Weighting Achieve the Same Effects?" Bulletin of Sociological Methodology/Bulletin De Méthodologie Sociologique 117.1: 5-25.

Heerwegh, D. (2009) Mode differences between face-to-face and web surveys: An experimental investigation of data quality and social desirability effects. International Journal of Public Opinion Research, 21, 1, pp. 111-121.

Hope, S. (2005); SCVS: Calibration Exercise Report, Edinburgh, Scottish Government. Available from the Scottish Government website

Hutcheson, L. Martin, C., and Millar C. (2020), Response rates, Reissuing and Survey Quality: Does reissuing reduce non-response bias in the Scottish Household Survey? Ipsos MORI Scotland

Kronsick J. (1991), "Response Strategies for Coping with the Cognitive Demands of

Attitude Measures in Surveys," Applied Cognitive Psychology, 5: 213-236.

Kreuter, F., Presser, S., & Tourangeau, R. (2008) Social desirability bias in CATI, IVR and web surveys. Public Opinion Quarterly, 72, 5, pp. 847-865.

Loud, C. (2014) The Coverage of the Postcode Address File and AddressBase for

Sampling and Using AddressBase classification to identify ineligible addresses in advance of fieldwork. Office of National Statistics.

Luiten, A. (2013) Improving Survey Fieldwork with Paradata. The Hague: Statistics Netherlands.

Lugtig, P., G.J.L.M. Lensvelt-Mulders, R. Frerichs, and A. Greven. (2011) "Estimating Nonresponse Bias and Mode Effects in a Mixed-Mode Survey." International Journal of Market Research, 53(5): 1 – 16

Lynn, P, and Clarke, P. (2002) Separating Refusal Bias and Non-contact Bias: Evidence from UK National Surveys. Journal of the Royal Statistical Society: Series D (The Statistician). J R Statist Soc D 51.3: 319-33.

Martin, C. (2020) Response rates, reissuing and survey quality: does reissuing

reduce non-response bias in the Scottish Crime and Justice Survey. Scottish Government web-based report.

McCaig, E and Leven, T (2003) Fundamental review of the Scottish Crime Survey, Edinburgh, Scottish Executive

Scottish Government (2014) Scottish Household Survey – Methodology and Fieldwork Outcomes 2012. Edinburgh, Scottish Government. Available from www.webarchive.org.uk/wayback/archive/20190502131410/https://www2.gov.scot/Topics/Statistics/16002/PublicationMethodology

Olson, Kristen M.; Smyth, Jolene; Horwitz, Rachel; Keeter, Scott; Lesser, Virginia; Marken, Stephanie; Mathiowetz, Nancy A.; McCarthy, Jaki S.; O'Brien, Eileen; Opsomer, Jean D.; Steiger, Darby; Sterrett, David; Su, Jennifer; Suzer-Gurtekin, Z. Tuba; Turakhia, Chintan; and Wagner, James, "Transitions from Telephone Surveys to Self-Administered and Mixed-Mode Surveys: AAPOR Task Force Report" (2020). Sociology Department, Faculty Publications. 751.

Williams, J & Holcekova. (2015) Assessment of the impact of a lower CSEW response rate. ONS.

Ye, C., Fulton, J. and Tourangeau, R. (2011) 'More Positive or More Extreme? A Meta-Analysis of Mode Differences in Response Choice', Public Opinion Quarterly, 75(2), pp. 349–365.

Contact

Email: shs@gov.scot

Back to top