Fair Start Scotland evaluation report 2: participant phone survey - November 2019
Part of a series on the evaluation of Fair Start Scotland employability services. It presents more detailed findings from a representative telephone survey of FSS participants and explores their experiences in the first year of service delivery (Apr 18 to Mar 19).
Appendix 1
Appendix A: Methodology
The Fair Start Scotland (FSS) Wave 1 telephone survey was carried out in June 2019, on a sample drawn from all beneficiaries who took part in FSS from its commencement in March 2018 until the end of December 2018.
IFF were provided with sample consisting of all starts on the FSS service during this period. Following data cleaning, a total of 6,780 records were available, of which 6,044 had a valid telephone number and address. From those with full contact details, 3,175 pieces of sample were drawn. Sample was drawn in proportion with the distribution of participants by lot, with Lot 8 (Highlands & Islands) slightly oversampled to ensure a minimum base for subgroup analysis of this region. Table 1.1 below shows the number of records drawn and the number of surveys achieved from each lot.
Table 1.1: Sample drawn and surveys completed per Lot
Lot | All sample | Sample drawn | Unweighted responses | Weighted responses | ||||
---|---|---|---|---|---|---|---|---|
N | % | N | % | N | % | N | % | |
Lot 1 Glasgow | 1289 | 19.0% | 597 | 18.8% | 176 | 17.5% | 191 | 19.0% |
Lot 2 Lanarkshire | 1262 | 18.6% | 584 | 18.4% | 174 | 17.3% | 187 | 18.6% |
Lot 3 Tayside | 740 | 10.9% | 346 | 10.9% | 99 | 9.9% | 110 | 10.9% |
Lot 4 Forth Valley | 551 | 8.1% | 257 | 8.1% | 83 | 8.3% | 81 | 8.1% |
Lot 5 East | 1102 | 16.3% | 514 | 16.2% | 184 | 18.3% | 164 | 16.3% |
Lot 6 South West | 636 | 9.4% | 295 | 9.3% | 93 | 9.3% | 94 | 9.4% |
Lot 7 North East | 393 | 5.8% | 181 | 5.7% | 55 | 5.5% | 58 | 5.8% |
Lot 8 Highlands and Islands | 291 | 4.3% | 159 | 5.0% | 60 | 6.0% | 43 | 4.3% |
Lot 9 West | 516 | 7.6% | 241 | 7.6% | 81 | 8.1% | 76 | 7.6% |
Total | 6780 | 100% | 3175 | 100% | 1,005 | 100% | 1,005 | 100% |
Participants were sent an advance letter two weeks prior to fieldwork to notify them of the research and offer them the opportunity to decline to take part. Telephone fieldwork was conducted between 3rd June and 28th June, and 1,005 completed interviews were achieved. A full breakdown of sample outcomes is shown in Table 1.2.
Table 1.2: Sample outcomes
Number | Proportion of starting sample (%) | |
---|---|---|
Total sample | 3,175 | 100% |
Opt outs | 47 | 1.5% |
Unusable (for example, wrong number) | 159 | 5.0% |
Contact attempted, no final outcome after minimum number of attempts | 1696 | 53.4% |
Refusal | 266 | 8.4% |
Respondent stopped or screened out during survey | 2 | 0.1% |
Total surveys completed | 1,005 | 31.7% |
The survey was 20 minutes in length. The data was checked, tabulated and verbatim responses were fully coded for analysis purposes. A rim weight (based on age, gender and lot) was applied to bring the oversampled Lot 8 back in line with population proportions and to correct for any non-response bias. Tables 1.3 and 1.4 show a breakdown of the profile of respondents by Lot, after weighting had been applied.
Table 1.3: Profile of survey respondents in each Lot, by gender and age (weighted data)
Total | Gender | Age | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Unweighted | Weighted | Male | Female | 16-34 | 35-49 | 50+ | ||||||
Total | 1005 | 1005 | 654 | 65% | 351 | 35% | 385 | 38% | 313 | 31% | 308 | 31% |
Lot 1 Glasgow | 176 | 191 | 118 | 62% | 73 | 38% | 77 | 41% | 53 | 28% | 61 | 32% |
Lot 2 Lanarkshire | 174 | 187 | 126 | 67% | 61 | 33% | 74 | 39% | 58 | 31% | 55 | 29% |
Lot 3 Tayside | 99 | 110 | 74 | 67% | 36 | 33% | 47 | 43% | 25 | 23% | 37 | 34% |
Lot 4 Forth Valley | 83 | 81 | 44 | 54% | 37 | 46% | 31 | 38% | 24 | 30% | 27 | 33% |
Lot 5 East | 184 | 164 | 114 | 69% | 50 | 31% | 49 | 30% | 60 | 36% | 56 | 34% |
Lot 6 South West | 93 | 94 | 58 | 62% | 36 | 38% | 34 | 36% | 37 | 39% | 24 | 26% |
Lot 7 North East | 55 | 58 | 43 | 73% | 16 | 27% | 23 | 40% | 21 | 37% | 14 | 24% |
Lot 8 Highlands and Islands | 60 | 43 | 30 | 69% | 13 | 31% | 15 | 34% | 13 | 31% | 15 | 35% |
Lot 9 West | 81 | 76 | 49 | 64% | 27 | 36% | 36 | 47% | 22 | 28% | 19 | 24% |
Table 1.4: Profile of survey respondents in each Lot, by qualifications, employment history and health (weighted data)
Total | Qualifications | Employment history | Health limits day-to-day activities | |||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Unweighted | Weighted | None | National 1-5 or equivalent | (Advanced) Highers or equivalent | Degree or above | Worked in the last 5 years | Not worked in the last 5 years | Has condition, impacts activities | Has condition, no limitations | No condition | ||||||||||
Total | 1005 | 1005 | 143 | 14% | 384 | 38% | 190 | 19% | 131 | 13% | 616 | 61% | 381 | 38% | 603 | 60% | 129 | 13% | 254 | 25% |
Lot 1 Glasgow | 176 | 191 | 27 | 14% | 79 | 42% | 27 | 14% | 35 | 19% | 114 | 60% | 77 | 40% | 82 | 43% | 14 | 7% | 92 | 48% |
Lot 2 Lanarkshire | 174 | 187 | 23 | 12% | 69 | 37% | 39 | 21% | 20 | 11% | 103 | 55% | 80 | 43% | 122 | 65% | 22 | 12% | 40 | 21% |
Lot 3 Tayside | 99 | 110 | 12 | 11% | 49 | 44% | 27 | 24% | 8 | 7% | 77 | 70% | 33 | 30% | 90 | 82% | 9 | 8% | 8 | 7% |
Lot 4 Forth Valley | 83 | 81 | 14 | 18% | 32 | 39% | 16 | 19% | 10 | 12% | 43 | 53% | 38 | 47% | 57 | 70% | 10 | 12% | 14 | 17% |
Lot 5 East | 184 | 164 | 28 | 17% | 57 | 35% | 28 | 17% | 22 | 13% | 106 | 65% | 56 | 34% | 100 | 61% | 19 | 12% | 42 | 26% |
Lot 6 South West | 93 | 94 | 15 | 16% | 34 | 36% | 19 | 21% | 10 | 11% | 52 | 55% | 42 | 44% | 55 | 58% | 15 | 16% | 23 | 25% |
Lot 7 North East | 55 | 58 | 9 | 15% | 22 | 38% | 9 | 16% | 8 | 14% | 42 | 72% | 15 | 26% | 32 | 55% | 14 | 25% | 12 | 21% |
Lot 8 Highlands and Islands | 60 | 43 | 8 | 18% | 13 | 30% | 7 | 17% | 5 | 12% | 29 | 67% | 14 | 32% | 25 | 57% | 4 | 10% | 14 | 32% |
Lot 9 West | 81 | 76 | 7 | 9% | 29 | 38% | 16 | 21% | 13 | 17% | 50 | 65% | 27 | 35% | 42 | 55% | 22 | 28% | 8 | 11% |
Contact
Email: kirstie.corbett@gov.scot
There is a problem
Thanks for your feedback