Appendix A: Methodology And Data Sources

Appendix A: Methodology And Data Sources

A.1 Overview

The project presented in this report has been evaluated against their objectives and the following criteria, where applicable, to support the evaluation:

  • Environment;
  • Safety;
  • Economy;
  • Integration;
  • Accessibility & Social Inclusion;
  • Costs to Government; and
  • Value for Money.

As the evaluation focuses on impacts relating to the project’s objectives, evaluations against all of the above criteria may not be undertaken for all projects. The evaluation is supported by the consideration of network traffic indicators, including traffic volumes, overtaking opportunities and travel times, as presented in the following section.

A.2 Network Traffic Indicators

Traffic Volumes

Comparison Between Pre and Post Opening Traffic Flows

A comparison of traffic flows pre and post opening has been undertaken to provide an indication of the impact that the project has had on traffic volumes. The amount of traffic data presented is dependent upon the complexity of the project. The comparison can also serve as a proxy for the effect that the project has had on noise and air quality at the One Year After Evaluation stage.

Comparison Between Predicted and Actual Traffic Flows

A comparison of predicted and actual opening year traffic flows has been undertaken to confirm the accuracy of predictions during the project’s preparation. The comparison can also serve as a proxy for whether the predicted benefits of the project are likely to be realised.

Depending on the nature of the traffic modelling undertaken to assess the project, the predicted traffic flow is either derived by:

  • factoring the base year or the predicted opening year, design network flows to the actual opening year using National Road Traffic Forecast (NRTF) growth factors; or
  • extrapolating from, or interpolating between, the modelled assessment year, design network flows.

The difference between the actual traffic flow and the predictions has been calculated and expressed as a percentage of the actual flow. A threshold of +/‑20% is generally accepted by Transport Scotland as being a reasonable range for future year forecast traffic flow comparisons.

The amount of traffic data presented is dependent upon the complexity of the project. The comparison can also serve as a proxy for the likely impact of the project on noise and air quality.

Data Sources

Predicted Traffic Flows Obtained/derived from the traffic/economic modelling undertaken to support the pre-tender economic assessment.
Actual Traffic Flows Obtained from automatic traffic counters in the vicinity of the project/study area.

Overtaking Opportunities

Post Opening Overtaking Opportunities

Where no overtaking information is available, the impact of providing increased overtaking opportunities has been based on the evaluation of other projects with a comparable standard of carriageway in the same geographic region for which overtaking surveys have been carried out.

Anecdotal, qualitative evidence from stakeholders has also been gathered, where available.

Data Sources

Post Opening Overtaking Conditions Judged from post opening survey information for other projects, and from the nature of the A75 Cairntop to Barlae scheme (additional lane in each direction).
Stakeholder Feedback Obtained from Stena Line and Road Haulage Association.

Travel Times

Change in Travel Times

Based on the evaluation of other projects with a comparable standard of carriageway for which pre and post opening journey time data is available, supported by anecdotal evidence where available.

Comparison Between Pre and Post Opening Travel Times

A comparison between pre and post opening travel times has been carried out based on actual survey evidence.

Comparison Between Predicted and Actual Travel Times

A comparison between predicted and actual opening travel times has been carried out using actual post-opening travel times, and predicted times from the relevant modelling and assessment reports.

Data Sources

Pre Opening Travel Times Confirmed through pre opening survey information collected to support the project’s economic assessment.
Post Opening Travel Times Confirmed through post opening survey information.
Predicted Travel Times Obtained from the pre-tender economic assessment undertaken during the project’s preparation.
Stakeholder Feedback Obtained from Stena Line and Road Haulage Association.

A.3 Environmental

Mitigation Measures

A review of the environmental mitigation measures implemented during construction has been undertaken to establish whether or not the measures proposed during the project’s preparation have been introduced and to provide comment on their success. The mitigation measures implemented were confirmed through site visits.

Data Sources

Proposed Mitigation Measures Presented in the Environmental Statement produced during the project’s preparation.
Implemented Mitigation Measures Confirmed through site visit.

Noise and Air Quality

A review of noise and air quality has not been undertaken for this scheme as no significant impacts on noise and air quality were expected due to the rural nature of the scheme.

A.4 Safety

Accidents

Comparison Between Pre and Post Opening Personal Injury Accident Numbers

A comparison of the personal injury accident numbers pre and post opening has been undertaken to provide an early indication of whether the project is operating safely.

The number of personal injury accidents for the 3 years within the vicinity of the project prior to opening has been compared with the observed number of personal injury accidents for the project in its first year of operation. The comparison shall be updated to include the observed number of accidents in the three year period after opening when the accident data is available.

It is important to realise that road infrastructure projects normally take a minimum of 5 to 7 years to plan prior to the commencement of construction. Many proposed road projects are derived from safety concerns such as fatal and serious accidents and often, these are treated in terms of Accident Investigation and Prevention work prior to planning the permanent solution. The comparison between 3 year pre and post opening accidents, therefore, only demonstrate the minimum road safety improvement derived from the project.

Where the influence of a trunk road improvement project has a significant impact on the local road network, it may be appropriate to extend the scope of the accident analysis.

Road Safety Audits

Road Safety Audit (RSA) reports have been reviewed, where available, to confirm whether there is any evidence that the project is not operating safely and where recommendations have been made for ameliorative measures, if appropriate.

Data Sources

Personal Injury Accident Numbers Obtained from the STATS19 data collection system.
Safety Issues Detailed within RSA reports produced following audits carried out 1 year after project opening.

A.5 Economy

Transport Economic Efficiency

A comparison between predicted and actual traffic flows and/or travel times has been undertaken as a proxy for whether the predicted benefits of the project are likely to be realised.

A comparison which returns a positive traffic flow difference in an uncongested situation indicates that the economic benefits of the project may have been over predicted as fewer vehicles will actually accrue journey time savings than predicted. Similarly, the economic benefits of a project may also be over predicted where actual travel times are greater (i.e. speeds lower) than predicted.

Conversely, where the comparison returns a negative traffic flow difference or actual travel times are less (i.e. speeds higher) than predicted, the economic benefits of the project may have been under predicted.

A.6 Integration

Commentary on Transport Integration and Policy Integration has been provided for projects that have specific objectives relating to the Integration criterion. In addition, anecdotal evidence from stakeholders has also been gathered, where available.

Data Sources

Local Government Policies Outlined within Structure and Local Plans.

A.7 Accessibility & Social Inclusion

Commentary on Community Accessibility has been provided for projects that have specific objectives relating to the Accessibility & Social Inclusion criterion, supported by anecdotal evidence where available.

Data Sources

Provision for Non-motorised Users Confirmed through site visit.
Cycling Provisions Detailed within the Cycle Audit report produced during the project’s preparation.

A.8 Costs To Government

Investment Costs

Comparison Between Predicted and Out-turn Costs

A comparison between predicted and out-turn costs has been undertaken for to confirm the accuracy of predictions during the pre-tender stage and support the evaluation of value for money.

The project cost predicted during the pre-tender stage has been used in the evaluation as it is at this stage that the decision is taken on whether or not to proceed with the project.

One of the features of the progressive analysis of projects is that the economic assessment is undertaken at each stage based on the return on future investment. This means that project costs incurred prior to the pre-tender economic assessment, which are already spent and cannot be recovered (whether or not the project goes ahead) are excluded from the overall project costs input to the economic assessment. As such, only out-turn costs incurred after the pre-tender economic assessment have been included in the comparison.

Adjustments for Retail Price Indices and discount rates to both the predicted and out-turn costs have been made, taking expenditure by year into account, to convert the figures to a common ‘present value year’ for prices and values – either 1998 or 2002 depending on the ‘present value year’ used in the pre‑tender economic assessment.

Data Sources

Predicted Project Costs Obtained from the pre-tender economic assessment undertaken during the project’s preparation.
Out-turn Costs Obtained from out-turn cost records.

A.9 Value For Money

Initial Indications

Based on the evaluation of economic benefits and project costs, a judgement in terms of the potential impact on the projects’ value for money has been made.

The value for money of a project is considered to be greater than predicted where the economic benefits have been under predicted and the project costs over predicted. Conversely, the value for money of a project is considered to be lower than predicted where the economic benefits have been over predicted and the project costs under predicted.

Where both the economic benefits and project cost have been under predicted or over predicted, a judgement has been made with regards to the likely overall impact on value for money.

Data Sources

Predicted NPV and BCR Obtained from the pre-tender economic assessment undertaken during the project’s preparation.

A.10 Achievement Of Objectives

Initial Indications

The evaluation includes an indication of how the A75(T) Cairntop to Barlae scheme is progressing towards achieving its objectives. Where specific indicators to measure the project’s performance against its objectives have not been developed, an indication of how the project is progressing towards achieving its objectives is based on the pre opening data available, supplemented by post opening data collected as part of the evaluation.

Data Sources

Objectives Confirmed from reported Environmental Statements or Route Action Plan, where applicable.