Publication - Independent report
Health and social care staff experience survey 2022
Independent report by Webropol providing detailed information and analysis of staff experience in health and social care across Scotland during 2022
Appendix 6: Statistical Notes
Significance Testing
Significance testing has been carried out on the iMatter data, to assess whether year to year movements in results are likely to be ‘true’, rather than ‘chance’. Specifically, a series of t-tests have been used to examine the size of change needed to give us a very high level of confidence that a ‘true’ change has happened. The key element here is the number of responses – the larger the number of responses, the smaller the minimum change that can be deemed statistically significant (meaning that the change is highly likely to be ‘true’).
Overall Health and Social Care Level Data
- A change of 0.3, or even 0.2 at times, is significant across Health and Social Care as a whole. This generally means any change reported from 2021 to 2022 is likely to be a ‘true’ change
Board Level Data
As noted previously, the number of respondents (the achieved sample size) is key to the level of movement year on year that is significant. Therefore, for individual Boards, significant movements are:
- Boards with less than 800 responses per year: movements of 3 points are significant
- Boards with between 800 and 2,800 responses per year: movements of 2 points are significant
- Boards with over 2,800 responses per year: movements of 1 point are significant
| Movements of 3pp are significant | Movements of 2pp are significant | Movements of 1pp are significant |
|---|---|---|
| Healthcare Improvement Scotland | NHS Shetland | NHS National Services Scotland |
| NHS Western Isles | NHS 24 | NHS Tayside |
| The State Hospital | NHS Golden Jubilee | NHS Grampian |
| NHS Borders | NHS Lothian | |
| Public Health Scotland | NHS Greater Glasgow & Clyde | |
| NHS Orkney | Scottish Ambulance Service | |
| NHS Education for Scotland | NHS Forth Valley | |
| NHS Dumfries & Galloway | NHS Highland | |
| NHS Fife | ||
| NHS Ayrshire & Arran | ||
| NHS Lanarkshire |
As seen with the National data there are incidences where significant movements are not evident in data reported at whole integer level only. Occasionally where there appears to be a movement in scores, but this is simply a result of rounding to whole integers and the difference is in fact, not significant. The following tables illustrate where this is the case.
| Component Scores | 2021 | 2022 | Reported difference | Significant Difference |
|---|---|---|---|---|
| I am clear about my duties and responsibilities | 86 | 87 | 1 | Very significant |
| I get the information I need to do my job well | 79 | 81 | 2 | Very significant |
| I am given the time and resources to support my learning growth | 70 | 72 | 2 | Very significant |
| I have sufficient support to do my job well | 76 | 78 | 2 | Very significant |
| I am confident my ideas and suggestions are listened to | 74 | 76 | 2 | Very significant |
| I am confident my ideas and suggestion are acted upon | 70 | 72 | 2 | Very significant |
| I feel involved in decisions relating to my job | 70 | 71 | 1 | Very significant |
| I am treated with dignity and respect as an individual | 83 | 84 | 1 | Very significant |
| I am treated fairly and consistently | 81 | 82 | 1 | Very significant |
| I get enough helpful feedback on how well I do my work | 73 | 74 | 1 | Very significant |
| I feel appreciated for the work I do | 73 | 75 | 2 | Very significant |
| My work gives me a sense of achievement | 79 | 81 | 2 | Very significant |
| I feel my direct line manager cares about my health and well-being | 84 | 86 | 2 | Very significant |
| My direct line manager is sufficiently approachable | 87 | 88 | 1 | Very significant |
| I have confidence and trust in my direct line manager | 84 | 85 | 1 | Very significant |
| I feel involved in decisions relating to my team | 75 | 76 | 1 | Very significant |
| I am confident performance is managed well within my team | 77 | 78 | 1 | Very significant |
| My team works well together | 82 | 83 | 1 | Very significant |
| I would recommend my team as a good one to be a part of | 83 | 84 | 1 | Very significant |
| I understand how my role contributes to the goals of my organisation | 82 | 83 | 1 | Very significant |
| I feel my organisation cares about my health and wellbeing | 70 | 71 | 1 | Very significant |
| I feel board members who are responsible for my organisation are sufficiently visible | 55 | 55 | 0 | Not significant |
| I have confidence & trust in Board members who are responsible for my organisation | 61 | 61 | 0 | Not significant |
| I feel sufficiently involved in decisions relating to my organisation | 55 | 55 | 0 | Very significant* |
| I am confident performance is managed well within my organisation | 62 | 63 | 1 | Very significant |
| I get the help & support I need from other teams and services to do my job | 70 | 70 | 0 | Very significant* |
| I would recommend my organisation as a good place to work | 73 | 74 | 1 | Very significant |
| I would be happy for a friend or relative to access services within my organisation | 77 | 77 | 0 | Not Significant |
* Although rounding to the same score in 2022 as 2021, both are significantly higher this year.
| EEI Score | 2021 | 2022 | Significant Difference |
|---|---|---|---|
| Health and Social Care | 75 | 76 | Very Significant |
| NHS Golden Jubilee | 72 | 74 | Significant |
| Healthcare Improvement Scotland | 81 | 82 | Not Significant |
| NHS 24 | 75 | 76 | Fairly Significant |
| NHS Ayrshire & Arran | 75 | 77 | Very Significant |
| NHS Borders | 74 | 75 | Fairly Significant |
| NHS Dumfries & Galloway | 72 | 75 | Very Significant |
| NHS Education for Scotland | 84 | 85 | Not Significant |
| NHS Fife | 75 | 75 | Not Significant |
| NHS Forth Valley | 73 | 76 | Very Significant |
| NHS Grampian | 76 | 76 | Very Significant* |
| NHS Greater Glasgow & Clyde | 74 | 75 | Very Significant |
| NHS Highland | 73 | 75 | Very Significant |
| NHS Lanarkshire | 77 | 78 | Very Significant |
| NHS Lothian | 76 | 76 | Fairly Significant* |
| NHS National Services Scotland | 78 | 78 | Not Significant |
| NHS Orkney | 70 | 72 | Fairly Significant |
| NHS Shetland | 78 | 79 | Not Significant |
| NHS Tayside | 74 | 76 | Very Significant |
| NHS Western Isles | 76 | 74 | Not Significant |
| Public Health Scotland | 77 | 75 | Significant |
| Scottish Ambulance Service | 65 | 67 | Very Significant |
| The State Hospital | 74 | 75 | Not Significant |
* Although rounding to the same score in 2022 as 2021, both Boards scored higher this year than last year
sig ≤ 0.05 but sig≤0.01 Fairly significant
sig<0.01 but sig≥0.001 Significant
sig < 0.001 Very significant
| Individual Significance of Movement 2022 – 2021 | Clear about my duties and responsibilities | Get the information I need to do my job well | Given the time and resources to support my learning growth | I have sufficient support to do my job well | Confident my ideas and suggestions are listened to | Confident my ideas and suggestions are acted upon | Involved in decisions relating to my job | Treated with dignity and respect | I am treated fairly and consistently | I get enough helpful feedback on how well I do | I feel appreciated for the work I do | My work gives me a sense of achievement |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Health & Social Care | 1 | 2 | 2 | 2 | 2 | 2 | 1 | 1 | 1 | 1 | 2 | 2 |
| Geographic Boards | ||||||||||||
| NHS Ayrshire & Arran | 1 | 2 | 2 | 2 | 1 | 2 | 2 | 2 | 2 | 3 | 3 | 1 |
| NHS Borders | 2 | 2 | 4 | 3 | 2 | 2 | 2 | 2 | 2 | 1 | 2 | 1 |
| NHS Dumfries & Galloway | 2 | 2 | 3 | 4 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 |
| NHS Fife | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 0 |
| NHS Forth Valley | 1 | 3 | 4 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 4 | 2 |
| NHS Grampian | 1 | 1 | 2 | 2 | 1 | 1 | 2 | 1 | 2 | 1 | 1 | 1 |
| NHS Greater Glasgow & Clyde | 0 | 2 | 2 | 2 | 1 | 1 | 1 | 2 | 2 | 2 | 1 | 1 |
| NHS Highland | 1 | 1 | 2 | 3 | 3 | 2 | 2 | 3 | 3 | 3 | 2 | 2 |
| NHS Lanarkshire | 1 | 1 | 2 | 2 | 1 | 2 | 2 | 1 | 1 | 1 | 2 | 2 |
| NHS Lothian | 0 | 1 | 1 | 2 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 |
| NHS Orkney | 3 | 3 | 3 | 3 | 3 | 2 | 2 | 1 | 1 | 2 | 1 | 4 |
| NHS Shetland | 0 | 0 | 2 | 1 | 2 | 2 | 2 | 1 | 1 | 1 | 2 | 1 |
| NHS Tayside | 1 | 2 | 3 | 3 | 2 | 2 | 2 | 2 | 2 | 3 | 3 | 2 |
| NHS Western Isles | 0 | -2 | -2 | -1 | 0 | 0 | -1 | 0 | 0 | 0 | -2 | -1 |
| National Boards (Support) | ||||||||||||
| Healthcare Improvement Scotland | 1 | 2 | 1 | 0 | 2 | 2 | 2 | 1 | 1 | 2 | 2 | 2 |
| NHS Education for Scotland | 1 | 1 | 2 | 2 | 0 | 1 | 1 | 1 | 0 | 1 | 1 | 2 |
| Public Health Scotland | 0 | -2 | -2 | -1 | -2 | -1 | -4 | -1 | -1 | -1 | -2 | -2 |
| National Services Scotland | 1 | 1 | 2 | 1 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 1 |
| National Boards (Patient Facing) | ||||||||||||
| NHS Golden Jubilee | 2 | 3 | 1 | 2 | 2 | 2 | 2 | 3 | 3 | 2 | 2 | 2 |
| Scottish Ambulance Service | 0 | 2 | 2 | 4 | 2 | 2 | 3 | 2 | 3 | 2 | 3 | 1 |
| NHS 24 | 1 | 1 | 4 | 2 | 1 | 1 | 1 | 1 | 2 | 3 | 1 | 1 |
| The State Hospital | 1 | 2 | 0 | 0 | 0 | 0 | 1 | 1 | 2 | 1 | 0 | 1 |
| My Line Manager/Team Significance of Movement 2022 – 2021 | My direct line manager cares about my health and well-being | My direct line manager is sufficiently approachable | I have confidence and trust in my direct line manager | I feel involved in decisions relating to my team | I am confident performance is managed well within my team | My team works well together | I would recommend my team as a good one to be a part of |
|---|---|---|---|---|---|---|---|
| Health & Social Care | 2 | 1 | 1 | 1 | 1 | 1 | 1 |
| Geographic Boards | |||||||
| NHS Ayrshire & Arran | 2 | 2 | 2 | 2 | 2 | 2 | 2 |
| NHS Borders | 1 | 1 | 1 | 2 | 1 | 1 | 1 |
| NHS Dumfries & Galloway | 3 | 2 | 2 | 3 | 3 | 4 | 3 |
| NHS Fife | 0 | 1 | 0 | 0 | 0 | 0 | 1 |
| NHS Forth Valley | 3 | 2 | 3 | 3 | 3 | 2 | 2 |
| NHS Grampian | 0 | 0 | 1 | 2 | 1 | 1 | 1 |
| NHS Greater Glasgow & Clyde | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| NHS Highland | 2 | 1 | 3 | 2 | 3 | 1 | 2 |
| NHS Lanarkshire | 1 | 0 | 1 | 1 | 1 | 1 | 1 |
| NHS Lothian | 1 | 1 | 0 | 1 | 1 | 1 | 1 |
| NHS Orkney | 0 | 1 | 2 | 3 | 3 | 2 | 2 |
| NHS Shetland | 1 | 2 | 1 | 1 | 1 | 1 | 1 |
| NHS Tayside | 2 | 1 | 2 | 2 | 3 | 2 | 2 |
| NHS Western Isles | -1 | -1 | -1 | -1 | -2 | -1 | -1 |
| National Boards (Support) | |||||||
| Healthcare Improvement Scotland | 1 | 1 | 1 | 2 | 0 | 0 | 0 |
| NHS Education for Scotland | 0 | 1 | 1 | 1 | 1 | 1 | 0 |
| Public Health Scotland | -2 | -3 | -3 | -3 | -2 | -1 | -2 |
| National Services Scotland | 1 | 1 | 1 | 1 | 0 | 0 | 1 |
| National Boards (Patient Facing) | |||||||
| NHS Golden Jubilee | 3 | 2 | 3 | 2 | 2 | 1 | 2 |
| Scottish Ambulance Service | 3 | 2 | 3 | 3 | 3 | 3 | 3 |
| NHS 24 | 1 | 1 | 1 | 1 | 0 | 1 | 2 |
| The State Hospital | 1 | 1 | 3 | 1 | 0 | 0 | 0 |
| My Organisation Significance of Movement 2022 – 2021 | I understand how my role contributes to the goals of my organisation | I feel my organisation cares about my health and wellbeing | I feel that board members who are responsible for my organisation are sufficiently visible | I have confidence and trust in Board members who are responsible for my organisation | I feel sufficiently involved in decisions relating to my organisation | I am confident performance is managed well within my organisation | Get the help and support I need from other teams and services within the organisation to do my job | I would recommend my organisation as a good place to work | I would be happy for a friend or relative to access services within my organisation |
|---|---|---|---|---|---|---|---|---|---|
| Health & Social Care | 1 | 1 | 0 | 0 | 0 | 1 | 0 | 1 | 0 |
| Geographic Boards | |||||||||
| NHS Ayrshire & Arran | 0 | 2 | 0 | 0 | 1 | 0 | 1 | 0 | 0 |
| NHS Borders | 0 | 1 | -2 | -1 | 0 | 1 | 1 | 1 | 1 |
| NHS Dumfries & Galloway | 1 | 2 | 1 | 1 | 2 | 2 | 3 | 2 | 1 |
| NHS Fife | -1 | -1 | -1 | -1 | 0 | 0 | -1 | 0 | -1 |
| NHS Forth Valley | 1 | 2 | 1 | 2 | 2 | 3 | 2 | 2 | 1 |
| NHS Grampian | 0 | 0 | 1 | -1 | 0 | 0 | 0 | 0 | -1 |
| NHS Greater Glasgow & Clyde | 0 | 1 | 0 | 0 | 0 | 1 | 1 | 1 | 0 |
| NHS Highland | 1 | 1 | 3 | 2 | 2 | 2 | 1 | 2 | 0 |
| NHS Lanarkshire | 0 | 1 | -1 | 0 | 1 | 1 | 0 | 1 | 0 |
| NHS Lothian | 0 | 0 | -1 | -1 | 0 | -1 | 0 | -1 | -1 |
| NHS Orkney | 3 | 1 | 0 | 0 | 3 | 4 | 0 | 2 | 1 |
| NHS Shetland | 1 | 1 | -1 | 0 | 0 | -1 | 1 | 0 | 0 |
| NHS Tayside | 0 | 2 | 1 | 1 | 1 | 1 | 2 | 2 | 1 |
| NHS Western Isles | -1 | -3 | -5 | -4 | -3 | -4 | 0 | -2 | -2 |
| National Boards (Support) | |||||||||
| Healthcare Improvement Scotland | 2 | 1 | 0 | 0 | 3 | 2 | 1 | 0 | 0 |
| NHS Education for Scotland | 1 | 1 | -1 | -1 | -1 | 2 | 1 | 1 | 1 |
| Public Health Scotland | -3 | -2 | 0 | -3 | -4 | -2 | -1 | -2 | -3 |
| National Services Scotland | 0 | 0 | 0 | 0 | -2 | 0 | 0 | -1 | -1 |
| National Boards (Patient Facing) | |||||||||
| NHS Golden Jubilee | 1 | 2 | 0 | 0 | 0 | 1 | 1 | 1 | 1 |
| Scottish Ambulance Service | 0 | 2 | 2 | 1 | 1 | 1 | 1 | 1 | 1 |
| NHS 24 | 1 | 2 | 0 | 2 | 1 | 3 | 2 | 3 | 2 |
| The State Hospital | 0 | 1 | -1 | 0 | -1 | 2 | 0 | 1 | 1 |
Contact
Email: Suzanne.thomas@gov.scot
There is a problem
Thanks for your feedback