Scottish National Standardised Assessments: national report for academic year 2017-2018
The report by ACER UK provides a summary of outcomes at a national level on the Scottish National Standardised Assessments.
Appendix 5: Statistical reliability of the SNSA for academic year 2017 to 2018
To evaluate whether a set of items is psychometrically sound, it is necessary that each item discriminates effectively between learners who have the knowledge or skill that underpins the item and those who have not, and that the set of items as a whole measures a unified latent trait (for example, numeracy). One key summary statistic that is usually used to indicate whether items in an assessment are working well as a set is a reliability statistic, such as Cronbach’s Alpha. According to this metric, reliabilities above 0.75 are typically considered as satisfactory and above 0.80 as excellent.
Table 8 shows Cronbach’s Alpha reliability statistics for the 11 SNSA administered in the academic year 2017 to 2018.
Table 8: Assessments’ reliability results
| Assessment | Reliability |
|---|---|
| P1 numeracy | 0.865 |
| P1 literacy | 0.861 |
| P4 numeracy | 0.868 |
| P4 reading | 0.899 |
| P4 writing | 0.864 |
| P7 numeracy | 0.879 |
| P7 reading | 0.872 |
| P7 writing | 0.802 |
| S3 numeracy | 0.905 |
| S3 reading | 0.888 |
| S3 writing | 0.823 |
The summary of the results presented in Table 8 shows that the reliabilities of all assessment forms were excellent (more than 0.80).
Contact
There is a problem
Thanks for your feedback