Annex A – Process evaluation interview questions
The following interview question sets were developed to support a process evaluation of the Safe System Capacity Building Programme. Each set was tailored to a specific stakeholder group: Contractor (Agilysis), client (Transport Scotland), and road safety delivery body (from a Scottish local authority), in order to gather a well-rounded understanding of the programme’s delivery, outputs, and perceived impacts.
The questions aimed to explore a range of topics including training design and delivery, development of the Safe System Manual, project coordination, organisational engagement with Safe System principles, and recommendations for future improvement. Insights from these interviews were used to inform the overall interpretation of the programme’s effectiveness.
A.1 Contractor questions (Agilysis)
Training programme delivery
- How were the Foundation and Principles training sessions delivered in practice (logistics, engagement, delegate feedback)?
- What went well - and what challenges did you face (including reaching the target number of participants?)
- What is your perspectives on how the training was received?
Safe System Manual development
- How was the editorial process managed, and what role did you play?
- What kind of feedback came in from contributors or reviewers?
- Is there anything that you would have done differently?
- What impact do you expect this aspect of the project to have going forwards?
Project coordination and communication
- How did collaboration with Transport Scotland and other partners work day to day?
- Were there any particular barriers or friction points that impacted delivery?
Reflections on programme outcomes
- In your view, has the programme supported meaningful capacity building or culture change?
- What would you recommend doing differently in future programmes?
A.2 Client questions (Transport Scotland)
Programme delivery
- To what extent were the original aims of the programme achieved?
- Were milestones and deliverables delivered on time and to expected quality?
Training programme
- What were your impressions of the training programme’s strengths and weaknesses?
- How well did the Safe System Foundation and Principles training meet internal needs?
- What feedback have you received from internal or external participants?
- Can you describe a moment when the training/manual/partnership really clicked, or didn’t?
Safe System Manual
- How effective has the development process been?
- Do you feel the manual will meet the intended audience’s needs and support ongoing learning?
Partnership and engagement
- How has collaboration with delivery partners (e.g., Agilysis) and other stakeholders worked in practice?
- Any lessons learned regarding stakeholder engagement?
Overall reflections and recommendations
- What has worked well in this phase of the programme?
- What would you recommend for improvement in future phases or similar programmes?
- Is there anything we haven’t covered that you think is important for the evaluation?
A.3 Road safety delivery body questions (a Scottish local authority)
Training experience
- Did you or colleagues attend the Safe System Foundation or Principles training?
- What aspects of the training were most or least useful?
Safe System awareness and culture
- Has the programme influenced your organisation’s understanding or commitment to Safe System principles?
- Have you seen any practical changes as a result?
Safe System Manual
- Have you accessed or used the Safe System Manual or related resources?
- How relevant and usable do you find them?
Future needs and support
- What further support or training would help your organisation embed Safe System thinking?
- Do you have any suggestions or recommendations for the programme team going forward?