| Tracking link | 2021 | 2022 | 2023 | 2024 |
|---|---|---|---|---|
| RAP Champions | 49.7% | 40.8% | 50.9% | 59.3% |
| Profession newsletters/mailing lists | 21.5% | 31.2% | 29.9% | 31.3% |
| Other | 9.6% | 11% | 11.9% | 6.1% |
| Slack | 3.7% | 11.8% | 7.3% | 3.3% |
| Other Champions | 15.5% | 5.2% | 0% | 0% |
Data collection
How we collect data
The Coding in Analysis and Research Survey (CARS) data collection takes place for approximately one month, every autumn. The survey is self-selecting and participation is voluntary. Launch dates vary slightly by year to maximise response rate, for example by avoiding clashes with other internal surveys. In 2024, data collection took place from 22 October to 31 December.
We invite analysts to participate in the survey using a variety of online channels, mailing lists, networks and newsletters. For the past four years, the most common source of data has been through departmental Reproducible Analytical Pipeline (RAP) champions, who promote the survey in their organisations. We rely on various champion networks, Heads of Profession (HoPs) for analysis and Departmental Directors of Analysis (DDans) to promote the survey and encourage their analytical communities to participate. This means the response rate and any selection bias will vary across organisations.
Our promotional materials make it clear that we are interested in responses from all analysts, whether or not they use coding in their work. The survey may however attract a disproportionate number of respondents who have an interest in coding and RAP. We advise against making strong inferences about differences between professions and departments or attempting to estimate real frequencies from the data because of these potential limitations.
Lastly, while the survey is open to all public sector analysts, the vast majority of responses come from the UK and devolved Civil Service (90.5% in 2024). As such, follow-up questions on grade and profession applied only to civil servants.
Where our data comes from
Link tracking allows us to see where responses are coming from. Links promoted by RAP champions were the most commonly used for the past three waves, and accounted for over half of responses in 2024.
Sample size by year
| Year | Sample |
|---|---|
| 2021 | 912 |
| 2022 | 1322 |
| 2023 | 1297 |
| 2024 | 1300 |
Respondent characteristics
Coding frequency
Every year, we ask respondents how often they code to achieve work objectives. In 2024, this question was only asked of respondents with current or prior coding experience. Although we seek responses from all analysts the data probably over-represents people with coding experience. In 2024, 15.8% of respondents never used code at work or had no coding experience.
Show chart
Show table
| In your current role, how often do you write code to complete your work objectives? | 2021 | 2023 | 2023 | 2024 |
|---|---|---|---|---|
| Never | 12% | 12.3% | 13.3% | 15.8% |
| Rarely | 13% | 10.6% | 11.7% | 11.8% |
| Sometimes | 18.4% | 18.2% | 19.7% | 16.5% |
| Regularly | 30.9% | 29% | 27.4% | 33.5% |
| Always | 25.7% | 29.9% | 27.9% | 22.4% |
Grade
Across all years, over 80% of Civil Service respondents reported that they are at H, S or Grade 7 grades (or equivalent). Note, this excludes respondents where an equivalent grade could not be determined. While this will be representative of the grade distribution of analysts in some government organisations, it may not be the case for all organisations.
Show chart
Show table
| Grade | 2020 | 2021 | 2022 | 2023 |
|---|---|---|---|---|
| Administrative Officer or Executive Officer | 8.7% | 8.3% | 6.7% | 5.6% |
| Higher Executive Officer | 26% | 26.3% | 28.6% | 24.9% |
| Senior Executive Officer | 33.6% | 34.5% | 33.8% | 38.8% |
| Grade 7 | 25% | 22.2% | 26.2% | 24.9% |
| Grade 6 or above | 6.6% | 8.6% | 4.7% | 5.8% |
Profession
Below is a breakdown of the proportion of respondents in different Civil Service professions. These cover the Analysis Function professions and do not apply outside of the Civil Service. The exception to these are data scientists and data engineers who do not have an official government profession. Note that respondents can be members of more than one analytical profession. Profession data is difficult to compare across years as these questions have changed in line with changes to the Analysis Function.
The CARS sample has high representation from statisticians compared with other professions. This again may be representative of some organisations but not all, and is not representative of the Civil Service as a whole.
| Civil Service Profession | Percentage |
|---|---|
| Government Statistician Group | 37% |
| Civil Service, no profession membership | 13.2% |
| Data Scientists | 12.1% |
| Government Social Research | 11.2% |
| Government Operational Research Service | 10.3% |
| Government Economic Service | 8.9% |
| Government Digital and Data | 4.5% |
| Government Science & Engineering | 3% |
| Other Civil Service profession | 2.7% |
| Government Geography Profession | 1.6% |
| Data Engineers | 1.5% |
| Government Actuary's Department | 0% |