Scottish Social Attitudes Survey 2023 - Technical Report
Technical report supporting the Scottish Social Attitudes Survey core module 2023.
In 2023, SSAS was run as a push-to-web survey for the first time in its history. This report presents detailed analysis of this change in methodology from face-to-face to push-to-web.
Relationship between Disability/Long-term health condition and National Identity variables with Core Module Questions
Given the differences outlined previously in report with respect to the proportion who (a) report having a disability or long-term health condition and (b) say, when forced to choose, whether they are Scottish or British, it is worth examining the relationship between them and the attitudinal questions in the Core Module. There are two possibilities to consider. First, how strong is the relationship between these variables and people’s responses to the questions in the Core Module? If the relationship is weak or non-existent then the different distribution of responses to these background variables will not have had a material impact on the figures obtained by the Core Module questions. Second, is there any notable difference by mode in the strength of any relationship between these variables and questions in the Core Module? If not, it would suggest that despite the differences in the distribution of responses to these background questions, the relationship between them and items in the module is comparable over time.
Disability/Long-term health condition
Tables 19, 20, and 21 show the relationships between disability and long-term health condition with three Core Module questions, where the wording was not amended for the push-to-web survey.
2017 | 2017 | 2019 | 2019 | 2023 | 2023 | |
---|---|---|---|---|---|---|
Long-term Health Condition | No Long-tern Health Condition | Long-term Health Condition | No Long-term Health Condition | Long-term Health Condition | No Long-term Health Condition | |
Very good | 4 | 4 | 7 | 6 | 4 | 4 |
Quite good | 38 | 48 | 37 | 49 | 37 | 30 |
Not very good | 37 | 32 | 35 | 28 | 33 | 43 |
Or, not at all good | 17 | 11 | 16 | 10 | 21 | 22 |
Total Very/Quite Good | 42 | 51 | 44 | 55 | 42 | 33 |
Total Not very/Not at all Good | 54 | 43 | 50 | 38 | 55 | 64 |
Don’t Know/Refusal | 4 | 6 | 5 | 7 | 4 | 3 |
Chi-Squared | 17.199 (<.001) | 17.199 (<.001) | 18.186 (p<.001) | 18.186 (p<.001) | 12.973 (p<0.01) | 12.973 (p<0.01) |
Cramer’s V | 0.121 | 0.121 | 0.138 | 0.138 | 0.093 | 0.093 |
2017 | 2017 | 2019 | 2019 | 2023 | 2023 | |
---|---|---|---|---|---|---|
Long-term Health Condition | No Long-tern Health Condition | Long-term Health Condition | No Long-tern Health Condition | Long-term Health Condition | No Long-tern Health Condition | |
Just about always | 2 | 2 | 1 | 3 | 3 | 4 |
Most of the time | 17 | 20 | 11 | 14 | 13 | 18 |
Only some of the time | 39 | 46 | 40 | 39 | 32 | 32 |
Almost never | 41 | 29 | 46 | 41 | 50 | 44 |
Don’t Know/Refusal | 1 | 3 | 3 | 1 | 2 | 2 |
Total Just about always/most of the time | 19 | 22 | 12 | 18 | 16 | 23 |
Total Only some of the time/Almost never | 81 | 76 | 86 | 81 | 82 | 76 |
Chi-Squared | 18.31 (p<.001) | 18.31 (p<.001) | 10.80 (p<0.02) | 10.80 (p<0.02) | 8.74 (p<0.05) | 8.74 (p<0.05) |
Cramer’s V | 0.123 | 0.123 | 0.104 | 0.104 | .075 | .075 |
2017 | 2017 | 2019 | 2019 | 2023 | 2023 | |
---|---|---|---|---|---|---|
Long-term Health Condition | No Long-tern Health Condition | Long-term Health Condition | No Long-tern Health Condition | Long-term Health Condition | No Long-tern Health Condition | |
Scottish Government | 46 | 41 | 39 | 41 | 40 | 45 |
UK Government | 38 | 43 | 41 | 43 | 51 | 44 |
Local Councils | 5 | 5 | 7 | 8 | 6 | 8 |
European Union | 7 | 8 | 7 | 6 | 1 | 1 |
Don’t Know/Refusal | 4 | 4 | 6 | 3 | 3 | 2 |
Chi-Squared | 3.98 (p>0.05) | 3.98 (p>0.05) | 2.11 (p>0.05) | 2.11 (p>0.05) | 6.18 (p>0.05) | 6.18 (p>0.05) |
Cramer’s V | 0.058 | 0.058 | 0.046 | 0.046 | 0.064 | 0.064 |
Although Tables 19 and 20 reveal that in each year there is a statistically significant relationship with people’s long-term health status, in both cases the Cramer’s V score is below 0.2, which indicates a weak relationship.[xvii] Table 19 does show a change in the direction of this weak relationship, with those with a long-term health condition/disability now somewhat more rather than less likely to say the Scottish Government is very/quite good at listening to people’s views before taking decisions, but this is not true of Table 20. Meanwhile, Table 21 shows that there is no significant relationship between the two variables in any of the years tested.
Given the weakness of the relationships and their consistency in general over time, it would appear that the lower reported prevalence of those with a long-term health condition or disability will not have impacted significantly on the pattern of response to the core module questions.
National Identity
Tables 22 to 24 show the equivalent analysis for people’s national identity when they are forced to choose just one. Given the low base sizes for the other responses, the analysis is confined to those who choose either ‘British’ or ‘Scottish’:
2017 | 2017 | 2019 | 2019 | 2023 | 2023 | |
---|---|---|---|---|---|---|
British | Scottish | British | Scottish | British | Scottish | |
Very good | 3 | 4 | 1 | 9 | 2 | 4 |
Quite good | 34 | 44 | 34 | 45 | 16 | 38 |
Not very good | 41 | 34 | 37 | 31 | 41 | 39 |
Or, not at all good | 20 | 14 | 22 | 10 | 38 | 16 |
Total Very/Quite Good | 37 | 48 | 35 | 54 | 18 | 42 |
Total Not very/Not at all Good | 61 | 48 | 59 | 41 | 80 | 55 |
Don’t Know/Refusal | 2 | 4 | 5 | 5 | 3 | 2 |
Chi-Square | 14.992 | 14.992 | 39.595 | 39.595 | 106.622 | 106.622 |
Cramer’s V | 0.118 | 0.118 | 0.211 | 0.211 | 0.280 | 0.280 |
Approximate Significance | 0.05 | 0.05 | <.001 | <.001 | <.001 | <.001 |
Table 23 : Relationship between National Identity and how much respondents trust the UK Government to work in Scotland’s best interests
2017 | 2017 | 2019 | 2019 | 2023 | 2023 | |
---|---|---|---|---|---|---|
British | Scottish | British | Scottish | British | Scottish | |
Just about always | 7 | 1 | 7 | 1 | 11 | 2 |
Most of the time | 32 | 13 | 25 | 8 | 30 | 13 |
Only some of the time | 41 | 43 | 43 | 40 | 37 | 28 |
Almost never | 18 | 42 | 25 | 50 | 19 | 57 |
Don’t Know/Refusal | 1 | 1 | 1 | 1 | 3 | * |
Total Just about always/most of the time | 39 | 14 | 32 | 9 | 41 | 14 |
Total Only some of the time/Almost never | 59 | 85 | 68 | 90 | 56 | 85 |
Chi Squared | 112.388 | 112.388 | 88.536 | 88.536 | 209.714 | 209.714 |
Cramer’s V | 0.322 | 0.322 | 0.315 | 0.315 | 0.393 | 0.393 |
Approx significance | <.001 | <.001 | <.001 | <.001 | <.001 | <.001 |
2017 | 2017 | 2019 | 2019 | 2023 | 2023 | |
---|---|---|---|---|---|---|
British | Scottish | British | Scottish | British | Scottish | |
Scottish Government | 52 | 40 | 44 | 38 | 56 | 39 |
UK Government | 34 | 44 | 34 | 45 | 32 | 52 |
Local Councils | 6 | 4 | 8 | 7 | 7 | 7 |
European Union | 5 | 7 | 9 | 7 | 1 | 1 |
Don’t know/Refusal | 3 | 4 | 4 | 4 | 4 | 2 |
Chi Squared | 15.486 | 15.486 | 8.722 | 8.722 | 47.905 | 47.905 |
Cramer’s V | 0.119 | 0.119 | 0.099 | 0.099 | 0.188 | 0.188 |
Approx significance | 0.04 | 0.04 | 0.121 | 0.121 | <.001 | <.001 |
Here, the relationship between national identity and our three core module questions is not only significant (with the exception of the 2019 figures in Table 24) but is also relatively strong. However, the strength of the relationship (measured by Cramer’s V) is slightly higher in 2023 than in the two previous years. This though is the opposite of what we would expect if the rise in British identity was solely a result of the order of response options. Such a process should mean that those who are classified as British in 2023 are less distinctive than those who are classified that way in previous years - and thus less likely to express different views from those who call themselves Scottish. Thus while consideration should be given the randomisation of response options to the national identity question if SSAS is fielded online in future, these results suggest that it is reasonable to compare the relationship between items in the core module and national identity with that in previous years.
Contact
Email: CIMA@gov.scot
There is a problem
Thanks for your feedback