Devolved disability benefits evaluation: research
In October 2023, the Scottish Government commissioned The Lines Between (TLB) to carry out research to inform an evaluation of transitions from Child Disability Payment (CDP) to Adult Disability Payment (ADP) in the context of the devolved disability benefits
Appendix 6: Review of logic model outcomes and risk factors
This Appendix summarises progress towards the outcomes and discusses the risk factors listed in the CDP-ADP logic model.
Outcomes |
Achieved? |
|---|---|
Short-term |
|
Guidance and communication about applying for ADP is clear and easily understood |
Partially. 45% (39) described Social Security Scotland letters as very helpful, and 32% (28) as quite helpful, but 23% (20) as not at all helpful. The letters are crucial in reminding and prompting CDP clients and formal representatives to apply for ADP and in informing them about how and when to do so. Feedback was generally positive, but there is also room for improvement to make communications even clearer (Chapter 2). |
Case managers, client advisors and local delivery colleagues know how to support disabled people and their representatives effectively |
Yes. Positive feedback from Social Security Scotland about the support, training and guidance they receive. Favourable comments from clients and formal representatives about the support they have received and how they are treated (Chapter 4). |
ADP payments happen at the time people expect them and on the same day they would ordinarily receive/expect to be paid CDP |
Partially. Most clients and formal representatives reported a smooth transition, with ADP payments happening on time and as expected for 80% (51). There were very few negative comments about this, but 14% (9) disagreed that ADP payments started on time and as expected (Chapter 5). |
Application determinations happen promptly |
Partially. Most clients and formal representatives (60%, 40) agreed or strongly agreed their application was handled within a reasonable timeframe, but 28% (19) disagreed or strongly disagreed. |
A rights-based and person-centred approach are embedded in the CDP-ADP process |
More data is required. Most clients and formal representatives (71%, 55) felt treated with dignity, fairness and respect (Chapter 4), but more data related to rights-based and person-centred approaches is needed to comment further on this outcome. |
Clients and their representatives understand the information about the process and the options available to them and what is involved in the application process |
Partially. Over two-thirds (68%, 54) of clients and formal representatives who responded to our survey reported that they understood what was involved in applying for ADP while receiving CDP. Three-fifths (60%, 46) of clients and formal representatives strongly agreed or agreed they understood the options available about when to apply to ADP. Interviewees, in general, reported they understood the process, including their options about when they could apply and what would happen to their payments while their application was being processed. However, some interviewees and survey respondents misunderstood aspects of the process. These clients had not been sure when they had to apply or what would happen to their payments while their application was being processed (Chapter 2). |
Clients and their representatives are reassured that they will continue to receive CDP until they reach the upper age limit, regardless of the outcome of their ADP application |
Partially. It was comforting for clients and formal representatives to know that CDP payments would continue for a specified time if the ADP application was unsuccessful. 58% (45) reported feeling reassured by this. This offers clients and formal representatives greater certainty and financial stability (Chapter 5). |
Clients and their representatives who meet the criteria experience a straightforward journey from CDP to ADP that minimises anxiety and uncertainty about the process |
Partially. Although a large proportion (69%, 55) found the process good or very good overall, many (24%, 19) found the application difficult or very difficult. However, large proportions of survey respondents agreed or strongly agreed they felt anxious (65%, 51) and/or uncertain (57%, 43) while applying for ADP (Chapter 4). |
Clients and their representatives feel empowered and in control of their benefits |
Partially. 32% (25) felt in control of their benefits (Chapter 4). |
Clients and their representatives feel treated with dignity, fairness and respect. |
Partially. Most clients and formal representatives (71%, 55) felt treated with dignity, fairness and respect (Chapter 4). |
Clients and their representatives whose applications are unsuccessful understand the process, the reasons why their application was unsuccessful and their rights to a redetermination and appeal after their determination. |
Partially. Many clients and formal representatives (69%, 54) were aware of their right to a redetermination and appeal. Only five survey respondents had received an unsuccessful determination. Three of those who participated in interviews reported they received clear information with their determination but disagreed with the decision and appealed (Chapter 5). |
Medium-term |
|
Barriers to applying for disability benefits are reduced |
Yes. Overall, the changes and policy commitments outlined in Chapter 1 have reduced barriers to applying – people have the option of when to apply at a time that suits them (Chapter 3), Social Security Scotland's letters inform them of the need to apply and when (Chapter 2), they have the reassurance of receiving CDP payments while waiting for a determination (enhancing financial stability and certainty), even after turning 18. Payments are backdated so late appliers are not penalised financially (Chapter 5). |
Clients feel that they have a positive relationship with SSS |
Partially. There are many contributory factors to clients' trust in Social Security Scotland but, in general, clients and formal representatives commented favourably about their relationship with and trust in Social Security Scotland. Many survey respondents (71%, 55) agreed they were treated with dignity, fairness, and respect, but there were also some difficulties contacting the agency (Chapter 4). |
Trust in Social Security Scotland increased |
|
Clients have financial stability |
More data is needed. Clients and formal representatives are reassured of receiving CDP payments while waiting for a determination (enhancing financial stability and certainty), even after turning 18, and payments are backdated, so late appliers are not penalised financially (Chapter 5). However, there are many contributory factors to financial stability, and more data about clients' and formal representatives' broader feelings of financial stability is required to comment further on this outcome. |
Long-term |
|
Human rights are respected and protected |
More data is needed. The changes and policy commitments outlined in Chapter 1 may contribute to respecting and promoting human rights by supporting people to apply for benefits they may be entitled to, but more data is needed to measure this outcome. |
The take-up of benefits is maximised |
More data is needed. The changes and policy commitments outlined in Chapter 1 may contribute to greater take-up of benefits by helping to remove barriers to applying for ADP, but more data is needed to measure this outcome. |
Poverty is reduced |
Partially. The changes and policy commitments outlined in Chapter 1 may contribute to reducing poverty by supporting more disabled people to access financial assistance through ADP, but more data is needed to measure this outcome. |
Risk factor |
Comments |
|---|---|
Policy changes are not implemented as intended |
No issues identified. |
Unclear communications, errors in communications |
Area for consideration. Our findings identified scope to further increase the clarity of Social Security Scotland communications. |
Disabled people and their representatives do not receive sufficient support |
Area for consideration. Interviewees gave positive feedback about support services, but also called for these to be publicised more widely. Over half of clients and formal representatives who responded to our survey (51%, 40) advocated for more practical support for applicants. |
Confusion and difficulties experienced by disabled people and their representatives as individuals approach 18 years of age and make the transition from child to adult services more widely |
No issues identified. There were a few examples of clients and formal representatives timing their ADP application with wider transition activities, but we are unaware of this causing any problems. |
Impact of processing times in Social Security Scotland |
Area for consideration. Long processing times affect clients' and formal representatives' experience of the process. Uncertainty around processing times can cause anxiety. Suggestions from interviewees included providing applicants with an estimate of when they can expect to receive a determination (Chapter 4). |
Contact
Email: socialresearch@gov.scot
There is a problem
Thanks for your feedback