Scottish Social Attitudes Survey 2023 - Technical Report

Technical report supporting the Scottish Social Attitudes Survey core module 2023.

In 2023, SSAS was run as a push-to-web survey for the first time in its history. This report presents detailed analysis of this change in methodology from face-to-face to push-to-web.


Relationship between Disability/Long-term health condition and National Identity variables with Core Module Questions

Given the differences outlined previously in report with respect to the proportion who (a) report having a disability or long-term health condition and (b) say, when forced to choose, whether they are Scottish or British, it is worth examining the relationship between them and the attitudinal questions in the Core Module. There are two possibilities to consider. First, how strong is the relationship between these variables and people’s responses to the questions in the Core Module? If the relationship is weak or non-existent then the different distribution of responses to these background variables will not have had a material impact on the figures obtained by the Core Module questions. Second, is there any notable difference by mode in the strength of any relationship between these variables and questions in the Core Module? If not, it would suggest that despite the differences in the distribution of responses to these background questions, the relationship between them and items in the module is comparable over time.

Disability/Long-term health condition

Tables 19, 20, and 21 show the relationships between disability and long-term health condition with three Core Module questions, where the wording was not amended for the push-to-web survey.

Table 19 : Relationship between Disability/Long-term Health Condition and how good respondents rate the Scottish Government to be at listening to people’s views before taking decisions
2017 2017 2019 2019 2023 2023
Long-term Health Condition No Long-tern Health Condition Long-term Health Condition No Long-term Health Condition Long-term Health Condition No Long-term Health Condition
Very good 4 4 7 6 4 4
Quite good 38 48 37 49 37 30
Not very good 37 32 35 28 33 43
Or, not at all good 17 11 16 10 21 22
Total Very/Quite Good 42 51 44 55 42 33
Total Not very/Not at all Good 54 43 50 38 55 64
Don’t Know/Refusal 4 6 5 7 4 3
Chi-Squared 17.199 (<.001) 17.199 (<.001) 18.186 (p<.001) 18.186 (p<.001) 12.973 (p<0.01) 12.973 (p<0.01)
Cramer’s V 0.121 0.121 0.138 0.138 0.093 0.093
Table 20: Relationship between Disability/Long-term Health Condition and how much respondents trust the UK Government to work in Scotland’s best interests
2017 2017 2019 2019 2023 2023
Long-term Health Condition No Long-tern Health Condition Long-term Health Condition No Long-tern Health Condition Long-term Health Condition No Long-tern Health Condition
Just about always 2 2 1 3 3 4
Most of the time 17 20 11 14 13 18
Only some of the time 39 46 40 39 32 32
Almost never 41 29 46 41 50 44
Don’t Know/Refusal 1 3 3 1 2 2
Total Just about always/most of the time 19 22 12 18 16 23
Total Only some of the time/Almost never 81 76 86 81 82 76
Chi-Squared 18.31 (p<.001) 18.31 (p<.001) 10.80 (p<0.02) 10.80 (p<0.02) 8.74 (p<0.05) 8.74 (p<0.05)
Cramer’s V 0.123 0.123 0.104 0.104 .075 .075
Table 21: Relationship between Disability/Long-term Health Condition and who respondents think has the most influence over the way Scotland is run
2017 2017 2019 2019 2023 2023
Long-term Health Condition No Long-tern Health Condition Long-term Health Condition No Long-tern Health Condition Long-term Health Condition No Long-tern Health Condition
Scottish Government 46 41 39 41 40 45
UK Government 38 43 41 43 51 44
Local Councils 5 5 7 8 6 8
European Union 7 8 7 6 1 1
Don’t Know/Refusal 4 4 6 3 3 2
Chi-Squared 3.98 (p>0.05) 3.98 (p>0.05) 2.11 (p>0.05) 2.11 (p>0.05) 6.18 (p>0.05) 6.18 (p>0.05)
Cramer’s V 0.058 0.058 0.046 0.046 0.064 0.064

Although Tables 19 and 20 reveal that in each year there is a statistically significant relationship with people’s long-term health status, in both cases the Cramer’s V score is below 0.2, which indicates a weak relationship.[xvii] Table 19 does show a change in the direction of this weak relationship, with those with a long-term health condition/disability now somewhat more rather than less likely to say the Scottish Government is very/quite good at listening to people’s views before taking decisions, but this is not true of Table 20. Meanwhile, Table 21 shows that there is no significant relationship between the two variables in any of the years tested.

Given the weakness of the relationships and their consistency in general over time, it would appear that the lower reported prevalence of those with a long-term health condition or disability will not have impacted significantly on the pattern of response to the core module questions.

National Identity

Tables 22 to 24 show the equivalent analysis for people’s national identity when they are forced to choose just one. Given the low base sizes for the other responses, the analysis is confined to those who choose either ‘British’ or ‘Scottish’:

Table 22 : Relationship between National Identity and how good respondents say the Scottish Government is at listening to people’s views before taking decisions
2017 2017 2019 2019 2023 2023
British Scottish British Scottish British Scottish
Very good 3 4 1 9 2 4
Quite good 34 44 34 45 16 38
Not very good 41 34 37 31 41 39
Or, not at all good 20 14 22 10 38 16
Total Very/Quite Good 37 48 35 54 18 42
Total Not very/Not at all Good 61 48 59 41 80 55
Don’t Know/Refusal 2 4 5 5 3 2
Chi-Square 14.992 14.992 39.595 39.595 106.622 106.622
Cramer’s V 0.118 0.118 0.211 0.211 0.280 0.280
Approximate Significance 0.05 0.05 <.001 <.001 <.001 <.001

Table 23 : Relationship between National Identity and how much respondents trust the UK Government to work in Scotland’s best interests

2017 2017 2019 2019 2023 2023
British Scottish British Scottish British Scottish
Just about always 7 1 7 1 11 2
Most of the time 32 13 25 8 30 13
Only some of the time 41 43 43 40 37 28
Almost never 18 42 25 50 19 57
Don’t Know/Refusal 1 1 1 1 3 *
Total Just about always/most of the time 39 14 32 9 41 14
Total Only some of the time/Almost never 59 85 68 90 56 85
Chi Squared 112.388 112.388 88.536 88.536 209.714 209.714
Cramer’s V 0.322 0.322 0.315 0.315 0.393 0.393
Approx significance <.001 <.001 <.001 <.001 <.001 <.001
Table 24: Relationship between National Identity and who respondents think has the most influence over the way Scotland is run
2017 2017 2019 2019 2023 2023
British Scottish British Scottish British Scottish
Scottish Government 52 40 44 38 56 39
UK Government 34 44 34 45 32 52
Local Councils 6 4 8 7 7 7
European Union 5 7 9 7 1 1
Don’t know/Refusal 3 4 4 4 4 2
Chi Squared 15.486 15.486 8.722 8.722 47.905 47.905
Cramer’s V 0.119 0.119 0.099 0.099 0.188 0.188
Approx significance 0.04 0.04 0.121 0.121 <.001 <.001

Here, the relationship between national identity and our three core module questions is not only significant (with the exception of the 2019 figures in Table 24) but is also relatively strong. However, the strength of the relationship (measured by Cramer’s V) is slightly higher in 2023 than in the two previous years. This though is the opposite of what we would expect if the rise in British identity was solely a result of the order of response options. Such a process should mean that those who are classified as British in 2023 are less distinctive than those who are classified that way in previous years - and thus less likely to express different views from those who call themselves Scottish. Thus while consideration should be given the randomisation of response options to the national identity question if SSAS is fielded online in future, these results suggest that it is reasonable to compare the relationship between items in the core module and national identity with that in previous years.

Contact

Email: CIMA@gov.scot

Back to top