Family Nurse Partnership evaluation: methods and process
This paper presents the methods of using routinely collected health, education and social care data to evaluate the Family Nurse Partnership (FNP) in Scotland using a natural experiment methodology.
3. Outcome measures
3.1. Outcomes
The evaluation specification required there to be no pre-specified primary outcome(s). The outcomes of this study closely follow the key activities and outcomes in the FNP programme’s logic model (Appendix 1). A brief list of outcomes to be included in the evaluation is provided in Table 6 below and a full listing of all 54 outcomes is provided as an online supplement.
Outcomes are listed according to the logic model and the following information provided:
- the data source
- the variables to be used
- whether the outcome is specifically mentioned in the logic model
- the hypothesised direction of FNP programme effect
- the outcome to be analysed with the main method
- any pre-defined sensitivity analyses such as adjustment for FNP
dosage or sub-group analyses to be performed.
Also included in this supplement are all data sources and outcomes considered but subsequently not used, and any identified gaps where it is indicated in the logic model but no data source is available.
3.1.1. Categorisation of outcomes
The ability to report on outcomes will depend on several factors: geographical and study cohort coverage, data quality (e.g. completeness), and possible bias in outcomes (such as FNP nurses carrying out child health assessments). As a result, the outcomes have been categorised into either short-term, medium-term, or descriptive.
Short term outcomes (n=20): These map well to the logic model, are known to have good data quality, and coverage across Scotland and our study cohort (thus maximising the number that can be formally analysed using statistical methods). These outcomes are likely to be associated with the pregnancy and birth period, and up to the child’s 2nd birthday (e.g. child health outcomes). These outcomes will be formally analysed using statistical methods
Medium-term outcomes (n=14): These outcomes rely on data only measured in the period after the 2nd birthday (e.g. school based outcomes at age 4 years of age onwards) and the population included in the analysis would be restricted as a result. These outcomes will also be formally analysed using statistical methods. Medium term outcomes also include those where the analysis would incorporate a time to event approach that would use our study cohort.
Descriptive outcomes (n=20): We will describe outcomes where the direction of the FNP effect is either uncertain, where outcomes are rare, or where the data are classed as experimental statistics (i.e. a type of official statistic that is undergoing development e.g. child attainment).
Table 6: Maternal and child outcomes and follow-up time points
Follow-up Time Points |
|||||||||
---|---|---|---|---|---|---|---|---|---|
Outcome Type1 |
During pregnancy |
At birth |
Post-partum assessments |
||||||
10 days |
6-8 weeks |
2 years |
27-30 months |
4-5 years |
5-6 years |
||||
Maternal Outcomes |
|||||||||
Positive health behaviour |
|||||||||
Alcohol/substance misuse during pregnancy |
ST |
√ |
|||||||
Improved parental life-course |
|||||||||
Childcare use |
D |
√ |
|||||||
Return to education |
ST |
√ |
|||||||
Highest educational attainment for all school leavers |
D |
√ |
|||||||
Subsequent birth (live/still) |
ST |
√ |
|||||||
Inter-pregnancy/birth interval (2 outcomes) |
MT |
up to √ |
|||||||
Child Outcomes |
|||||||||
Competent parenting in terms of child-health |
|||||||||
Breastfeeding (3 outcomes: initiation, at 6-8 weeks, duration) |
ST |
√ |
√ |
√ |
|||||
Birthweight2 |
D |
√ |
|||||||
Passive smoking |
ST |
√ |
√ |
√ |
|||||
Competent parenting: child protection |
|||||||||
Safe home environment |
ST |
√ |
|||||||
Safe home environment |
MT |
√ |
|||||||
Improved birth outcomes |
|||||||||
Pre-term delivery (<37 vs 37+ weeks) |
ST |
√ |
|||||||
Pre-term delivery (<28, 28 to <32, 32 to <37,37+ weeks) |
D |
√ |
|||||||
Improved child health |
|||||||||
Physical development: Healthy Body Mass Index (BMI) |
ST |
√ |
|||||||
Physical development: Healthy BMI |
MT |
√ |
|||||||
Gross motor skills concern |
ST |
√ |
√ |
||||||
Fine motor skills concern |
ST |
√ |
|||||||
Registered with dentist at 24 months |
ST |
√ |
|||||||
Attended a dentist by 27-30 month visit |
ST |
√ |
|||||||
Hospital admissions for dental procedure |
MT |
√ |
up to √ |
||||||
Hospital admissions for serious injuries |
MT |
√ |
up to √ |
||||||
Any attendance to Accident and Emergency (A&E) |
D |
√ |
√ |
||||||
Accidental injuries |
MT |
√ |
up to √ |
||||||
Improved child development |
|||||||||
Any child development concern3 |
ST |
√ |
√ |
||||||
Any new child development concern at 27-30 months |
ST |
√ |
|||||||
Any student need concern |
MT |
√ |
|||||||
(a) Personal/social & (b) Emotional/ behavioural concern |
ST |
√ |
√ |
||||||
Social, emotional, and behavioural difficulty |
MT |
√ |
|||||||
Speech, language, and communication concern |
ST |
√ |
√ |
||||||
Language or speech disorder/Communication Support Needs |
MT |
√ |
|||||||
Physical or motor impairment |
MT |
√ |
|||||||
Vision concern |
ST |
√ |
√ |
||||||
Vision impairment |
MT |
√ |
|||||||
Hearing concern |
ST |
√ |
√ |
||||||
Hearing impairment |
MT |
√ |
|||||||
Other student need4 |
MT |
√ |
|||||||
More able pupil |
D |
√ |
|||||||
Child attainment |
D |
√ |
|||||||
Improved child protection |
|||||||||
Child protection (CP) investigation |
D |
√ |
√ |
||||||
Age at first CP investigation |
D |
√ |
|||||||
Number of CP investigations |
D |
√ |
|||||||
Investigation requiring a CP Case Conference (CPCC) |
D |
√ |
√ |
||||||
Type of concern identified at CPCC |
D |
√ |
√ |
||||||
Length of time on CP register |
D |
√ |
√ |
||||||
Child registered as a result of conference |
D |
√ |
√ |
||||||
Child de-registered |
D |
||||||||
Looked after status |
D |
√ |
√ |
√ |
|||||
Children with a looked after status |
D |
√ |
√ |
||||||
Time spent in first placement |
D |
√ |
|||||||
Placement type |
D |
√ |
|||||||
Placed for adoption |
D |
√ |
1. ST - Short term outcome; MT - Medium term outcome; D - Descriptive outcome;
2. Birthweight appropriate for gestational age and adjusted for gestational age, maternal height, maternal weight at booking, parity and ethnic group - Gestation Related Optimal Weight GROW [24]
3. Concern in any of the following areas: Gross and Fine Motor, Speech, Language and Communication, Social, emotional, behavioural, and attention, hearing and vision
4. Learning disability, Dyslexia, Other specific learning difficulty, Other moderate learning difficulty, Deafblind, Autistic spectrum disorder, Physical health problem, and Mental health problem.
Contact
Email: socialresearch@gov.scot
There is a problem
Thanks for your feedback