| Project name | Project description | Division |
|---|---|---|
| Put the project name here |
A short summary of what the project does |
Name of division |
| Name of Senior Responsible Owner (SRO) | Name of Commissioner | Name of Analyst(s) | Name of Analytical Assurer(s) |
|---|---|---|---|
| Enter name here... |
Enter name here... |
Enter name here... |
Enter name here... |
| Date of sign off | Name of responsible person | Role of responsible person | Comments |
|---|---|---|---|
| Enter date here... |
Enter name here... |
Enter role here... |
Enter notes here... |
| Quality Question | Answer | Answer added by | Date of answer | Answer signed off by SRO? | Next review due on | Any change since last review? | |
|---|---|---|---|---|---|---|---|
| Q1 | What question does the analysis try to answer? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q2 | Why do you need to answer this analysis question? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q3 | Which organisational priorities does this analysis address? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q4 | If you use a model, is it business critical? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q5 | Who needs the answer to the analysis question? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q6 | Who do you need to consult to make sure you meet the right user needs? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q7 | How will you know you have answered the analysis question correctly? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q8 | What is the estimated time and resource required to answer the analysis question (in months and FTE)? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q9 | What is the impact if the analysis is not done now? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q10 | What is the impact if the analysis is not done correctly? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q11 | Name the commissioner, senior responsible owner and analytical assurer of this analysis? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q12 | What tools and resources will you use in production? Are they the best for the job? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q13 | Do you have the right internal and external resources and capability to deliver the analysis? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q14 | What are the anticipated risks of the analysis? Have you discussed these risks with customers and stakeholders? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q15 | Is there a contingency plan prepared if your mitigation plans fail? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q16 | Do the data and analysis comply with ethical requirements? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q17 | What relevant questions are outside the scope of the analysis? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q18 | How will you peer review and assure the analysis? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q19 | Will external experts be involved in development and scrutiny of analysis? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Question | Answer | Answer added by | Date of answer | Answer signed off by SRO? | Next review due on | Any change since last review? | |
|---|---|---|---|---|---|---|---|
| Q20 | Is there a simple, plain English description of what the analysis is for and what it does? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q21 | Does the analysis have a logic flowchart which explains the end-to-end steps in the workflow? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q22 | When do you expect to start and finish each stage of analysis: data collection, processing, quality assurance, analysis and dissemination? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q23 | Does any part of the analysis rely on manual processing? Have you considered the cost and benefits of fully automating the process? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q24 | What happens if team members, reviewers or users find a mistake in the analysis? Do you have a clear and efficient process for addressing issues and preventing them from happening again? |
Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q25 | Have you assessed uncertainty? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Question | Answer | Answer added by | Date answer added | Answer signed off by SRO? | Next review due on | Any change since last review? | |
|---|---|---|---|---|---|---|---|
| Q26 | How will the data in the analysis be processed before and during use? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q27 | Is the data appropriate given the methods selected? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q28 | What are the strengths and limitations of the data you use? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q29 | Is there a robust relationship between your team and data providers? Do data providers understand how and why you use their data? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q30 | Do you understand how data providers collect, process and quality assure the data you use? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q31 | Is there a formal agreement to set out data content, when and how you will get the data? If not, why not? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q32 | Do you know what quality checks are carried out on the data before you receive them? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q33 | How will you work with your data provider when your data requirements change? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q34 | How do you know if your data provider makes a change to their systems or processes which could impact the data you receive or the analysis you produce? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q35 | How did you choose the methods for the analysis? How do you know the methods you use are appropriate? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q36 | Have reasonable alternative methods been explored and rejected for good reasons? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q37 | How do you know that your analysis is working correctly? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q38 | Can you describe the assumptions of your analysis, when they were made and who made them and signed them off? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q39 | How are assumptions validated and assured before you apply them? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q40 | How do you measure and report uncertainty in your analysis? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q41 | Have you considered the implications of relevant, unquantified uncertainties? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q42 | Can you explain the impact of your analysis on downstream processes? Are there risks around these dependencies? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q43 | Is all or part of the analysis reliant on a single person? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q44 | Is it clear why important decisions about the analysis were made, who made them and when? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q45 | If changes need to be made to code or datasets, is it easy to track who made the changes and when and why they were made? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q46 | Would another analyst be able to reproduce your analysis output or continue the work (without talking to you first)? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q47 | Do you use internal peer review to check scripts and code, documentation, implementation of methods, processes and outputs? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q48 | Is your code and analysis ever peer reviewed by someone outside your team or organisation? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q49 | What is your assessment of the quality of your analytical outputs? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q50 | How do you assure yourself that the analysis you do is correct? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q51 | Do the outputs of your analysis align with similar findings from elsewhere? If not can you explain why? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q52 | If you find outliers or unusual trends in the data, what steps do you take to investigate them? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Question | Answer | Answer added by | Date answer added | Answer signed off by SRO? | Next review due on | Any change since last review? | |
|---|---|---|---|---|---|---|---|
| Q53 | Can you give a clear account of what can and cannot be inferred from the analysis? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q54 | Have you assessed the limitations of the data and analysis and set out how they affect the quality and use of the outputs? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q55 | Have you sense checked outputs with user groups and stakeholders? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q56 | Is uncertainty about data quality, assumptions and methodology clearly communicated to users? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q57 | Are the implications of unquantified uncertainties communicated to users? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q58 | Is workflow documentation including technical guides and code repositories publicly available? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q59 | Does the technical guide and documentation explain how to run the analysis to obtain valid outputs? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q60 | Have you fully documented the analysis code to comply with good practice? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |
| Q61 | Is there a clear feedback mechanism so users can report back on the suitability of outputs? | Enter your answer here... |
Enter full name |
Enter date |
Yes/No |
Enter next review date |
Enter text |