Pesticide Usage in Scotland: Rodenticides on Arable Farms

Appendix 4 - Survey methodology

Sampling and data collection

Using the May 2022 Single Application Form (SAF) data ^[12], a sample was drawn representing arable cultivation in Scotland. The country was divided into 11 land-use regions (Figure 11). Each sample was stratified by these land-use regions and according to holding size. The holding size groups were based on the total area of arable crops grown. The sampling fractions used within both regions and size groups were based on the areas of relevant crops grown rather than number of holdings, so that smaller holdings would not dominate the sample.

The survey covered rodenticide use during the 12 month period January to December 2022. Following an introductory letter and telephone call, data were collected by telephone interview, email or post. When rodenticides were applied by a pest control professional (PCP) the data were obtained from either the farm rodent control record book or by post/telephone interview from the contractor. If it was recorded that rodenticides were used but product data were not obtainable this was recorded as unspecified rodenticide use.

In total, information was collected from 298 holdings (Table 6). These 298 holdings represent four per cent of the total arable holdings in Scotland, and eight per cent of the arable area (Table 7). The data collected were; who conducted the baiting, product(s) used, bait type, weight applied, target and season of use. Information about use of non-chemical rodent control methods was also recorded.

All farmers and PCPs encountered in the survey were also asked to respond to a simple questionnaire containing questions relating to whether they had received training in use of rodenticides, their self-reported compliance with best use practice for rodenticides and their knowledge of rodenticide stewardship. Farmers were also asked to provide operation details about their farm, such as whether they kept livestock or had a grain store, to allow comparison in farm operation in relation to whether they used rodenticides.

It should be noted that, in relation to all data collected, responses are as reported by the rodenticide users and no attempt has been made to check their accuracy.

Estimation of national rodenticide use

The figures presented in this report are produced by surveying a sample of holdings rather than conducting a census of all the holdings in Scotland. Therefore, the figures are estimates of total rodenticide use for Scotland and should not be interpreted as exact.

National rodenticide use (holdings using rodenticides, rodenticide occurrence and weight) was estimated from the sample data by ratio raising. This is a standard statistical technique for producing estimates from a sample. This method involves multiplying the sample data by a factor dependent on the number of farms within each region and size group to match the data recorded in the relevant SAF data for arable crops. Due to small sample sizes the data from some regions were merged and a secondary adjustment factor was applied to the raising factors to account for region and size groups for which no holdings were sampled. Details of regions, size groups, raising and adjustment factors are presented in Table 8.

The remainder of the data (use of non-chemical control methods, details of farm operation, compliance with best practice and knowledge of rodenticide stewardship) are unraised and represent the information collected from the sample.

Changes from previous years

All data in 2020 had to be collected using non-visit methods such as by phone interview or by email due to restrictions imposed by the COVID-19 pandemic. In 2022, data were also primarily collected by non-visit methods in order to reduce burden on farmers. Every effort was made to achieve a robust sample.

For previous reports, the June Agricultural Census was used to draw a sample of farmers growing the relevant crops to participate in the survey. National rodenticide use was then estimated by ratio raising, by comparing the sampled numbers of holdings in each region and size group to the holding numbers recorded in the June Agricultural Census data.

To allow for the Agricultural Statistics Transformation Programme^[12], the June 2022 Agricultural Census was paused. This pause was agreed with the Office for Statistical Regulation and data users.

For this report, the May 2022 Single Application Form (SAF) data was used to draw the sample and estimate national pesticide use using the same methodology as previous surveys. The SAF is the form completed by farmers annually to claim a range of government payments, SAF data accounts for the majority of land area for arable crops. The sample drawn is based on area of crop grown, rather than number of holdings. As such, no attempt is made to account for holdings that are not captured by SAF returns. (Note: The difference in total Scottish arable area recorded between SAF 2022 and Agricultural Census 2021 was less than one per cent. The largest difference was biased towards the smaller size groups, less than five per cent of a difference).

Statistical analyses

As estimates are based on a random stratified sample of farms in each survey year and individual farms may be sampled more than once in the time series, there is no simple method of statistical comparison for estimated rodenticide use on arable farms over time. However, the percentage of farms using rodenticides, the percentage of farms on which baiting was conducted by PCPs and the percentage occurrence of first and second generation compounds have been analysed using Pearson's chi-squared test. The percentage occurrence of first and second generation compounds was analysed using the number of holdings as a base. These conservative analyses do not take into account the stratification, finite population sampling or common farms between years and are therefore less likely to find significant differences. All significant differences are highlighted in the text and tables of this report.

Data quality assurance

The dataset undergoes several validation processes as follows; (i) checking for any obvious errors upon data receipt (ii) checking and identifying inconsistencies with use and pesticide approval conditions once entered into the database (iii) 100 per cent checking of data held in the database against the raw data. Where inconsistencies are found these are checked against the records and with the farmer if necessary. Additional quality assurance is provided by sending reports for independent review. In addition, the Scottish pesticide survey unit is accredited to ISO 9001:2015. All survey related processes are documented in Standard Operating Procedures (SOPs) and output is audited against these SOPs by internal auditors annually and by external auditors every three years.

Main sources of bias

These surveys may be subject to measurement biasas they are reliant on respondents recording data accurately. As surveys are not compulsory they may also be subject to non-response bias, as some farmers and PCPs may be more likely to respond than others. However, the use of a random stratified sample is an appropriate survey methodology and reserve lists of farms are held for each stratum to allow non-responding farms to be replaced with similar holdings.

Experience indicates that stratified random sampling, including reserves, coupled with personal interview technique, delivers the highest quality data and minimises non-response bias.