skip to primary navigation skip to content

SSA Toolkit

Analyse risk

 

Analyse risk

Analyse risk

Determining the severity of each risk in terms of impact and likelihood

This section looks at how to rate the severity of each risk in terms of its impact and likelihood. Impact refers to how serious the consequences of it going wrong are, and likelihood refers to how likely it is to go wrong. Rating risk is important because it helps to prioritise the risks, identifying those that most need to be addressed.

On this page:

Analyse risk is the second activity in the Assess phase of SSA

Analyse risk is an activity in the Assess phase of SSA


What problems might it cause?

It is important to identify not only what might go wrong in the system, but what the outcomes of that might be: what resultant problems it might cause. There are many types of outcome that may need to be considered in the SSA, including, in particular, injury to patients, staff or the public. Other types, which are sometimes referred to as risk ‘domains’, may include outcomes relating to:

  • Quality of service;
  • User experience;
  • Complaints or litigation;
  • Project performance, for example, excessive delays;
  • Financial performance, for example, a failure to meet a CQUIN target;
  • Inspection or audit targets, for example, a loss of accreditation or an increase in inspections;
  • Publicity for the Trust, for example, damage to reputation;
  • The environment.

It is seldom practical to consider all of these in one SSA. The scope of the investigations (as specified in the Outline goals activity) should identify the most relevant type or types of outcomes to be investigated. Some SSAs may focus on just one type of risk. However, there is then the danger of ignoring or even increasing risks of other types, some of which may be very high. It may be necessary to adjust the scope of the SSA if it is felt that important issues are being omitted. Introducing more risk types increases the complexity of the assessment and the time required to complete it, but also its rigour.

 

Portion of a risk table, showing problems that might be caused by things going wrong in the system. For example, if there is insufficient staff available to accept the patient, this may result in the unit being unable to accept the patient. Alternatively, they may accept the patient by pulling staff from other areas of the unit. This would create a knock-on effect of reduced staffing in these other areas at times of high activity.

Examples of problems that might be caused by things in the system going wrong

Putting ‘What problems might it cause’ into practice

Space to record this information is provided in the SSA Assessment Form. To do this:

  1. Select the ‘Identify/Analyse/Evaluate risks’ page in the Assessment Form.
  2. For each item in column E (What could go wrong?), enter the problems it might cause in column F (headed What problems might it cause?). Don't state the size of these problems, as this will come later in the table.
  3. If something could cause more than one problem, then use multiple rows to describe the different problems. New rows can be added by highlighting the row below, right clicking and selecting Insert.
  4. Add an ID number or letter for each row in the ID column on the left, to make it easier to refer back to later. List these in numerical/alphabetical order, so that the spreadsheet will work properly later on.
Screenshot of the Risks page of the assessment form

 


Case Study

Part of the completed ‘Identify/Analyse/Evaluate risks’ page from the Section 136 case study is shown opposite. Further explanation of this stage in the case study can be found on the Section 136 page on ‘What problems might it cause?’


What are we doing to prevent it?

It is also important to record any measures already in place to prevent the problems from arising, or to reduce their impact or likelihood. These need to be taken into account in the SSA when rating impact, likelihood and risk. However, note that such measures are never perfect in reducing risk, either because they are not always adopted in daily practice (often for ‘good’ reasons), or because they are fundamentally imperfect in some way.

The existing measures will also affect the Propose actions activity later in the SSA. The proposed actions will benefit from information about the effectiveness of and flaws in the measures that are already in place.

Existing measures can take many forms, including administrative actions such as policies and procedures, activities performed by staff such as doing frequent patient observations, the use of medical devices to monitor patients, or staff training.

Portion of a risk table, showing some of the measures already being taken to prevent problems from arising and to reduce their impact and likelihood. For example, something that might go wrong is that there is insufficient staff available to accept a patient, leading to being unable to accept the patient or to knock on effect of reduced staffing in other areas of the unit. Measures to address this include increasing staff capacity and providing early notice of a patient's arrival. Another problem is that there may be no space in the unit due to another patient already being present, leading to being unable to accept a patient and resultant distress. Measures to address this include increasing unit capacity and providing early notice of arrival. Another possible problem is no or incorrect paperwork leading to time being wasted, distress and possible legal problems. A measure to address this is clear procedures for police and mental health.

Examples of risk prevention measures

Putting ‘What are we already doing to prevent it’ into practice

Space to record this information is provided in the SSA Assessment Form. To do this:

  1. Select the ‘Identify/Analyse/Evaluate risks’ page in the Assessment Form.
  2. For each row, enter any measures already in place to prevent the problems in column G (headed What are we already doing to prevent it?). More than one measure can be listed in each cell, if preferred. If there are no measures, then leave the cell blank.
Screenshot of the Risks page of the assessment form

Case Study

Part of the completed ‘Identify/Analyse/Evaluate risks’ page from the Section 136 case study is shown opposite. Further explanation of this stage in the case study can be found on the Section 136 page on ‘What are we already doing to prevent it?’


Retrieving risk criteria

At this point, it is important to retrieve the risk criteria that were established for the SSA during the Set risk criteria activity. These criteria include the definitions of impact and likelihood levels that will be used in estimating impact and likelihood for each of the potential problems in the system.

Putting ‘Retrieving risk criteria’ into practice

The risk criteria were previously recorded in the SSA Assessment Form. To retrive them:

  1. Select the ‘Set risk criteria’ page in the Assessment Form.
  2. Retrieve copies of any risk criteria related documents or guidelines listed in the Documents box.
  3. Examine the information previously entered in the box headed Risk bands.
Screenshot of the Set risk criteria page of the assessment form

Case Study

The completed ‘Set risk criteria’ page from the Section 136 case study is shown opposite. Further explanation of this stage in the case study can be found on the Section 136 page about Retrieving risk criteria.


Estimating impact

It is now necessary to estimate the impact of the outcomes. Impact refers to the severity or ‘consequence’ of the outcomes. The greater the impact, the more important it is to do something about it. For example, the severity of a mix up between two medicines depends upon the types of medicines involved: the intravascular injection of sterile saline solution may result in no harm, whereas the injection of Vincristine into the spine will result in the death of the patient. Here the latter clearly has greater impact.

Impact is rated by referring to the definitions of impact levels included in the risk criteria retrieved above. An example of a set of definitions is shown below. The definitions match impact ratings to detailed descriptions of harm. In the example below, an impact rating of 2 (low/minor) would be assigned to an issue that results in someone needing first aid.

 

A table of impact score definitions. A score of 1 (Negligible) is defined as: Minimal injury requiring no/minimal intervention or treatment, No time off work required. A score of 2 (Minor) is defined as: Minor injury or illness requiring minor intervention, Requiring time off work for less than 3 days, Increase in length of hospital stay by 1 to 3 days. A score of 3 (Moderate) is defined as: Moderate injury requiring professional intervention, Requiring time off work for 4 to 14 days, Increase in length of hospital stay by 4 to 15 days, RIDDOR/agency reportable incident. A score of 4 (Major) is defined as: Major injury leading to long-term incapacity/disability, Requiring time off work for more than 14 days, Increase in length of hospital stay by more than 15 days, Mismanagement of patient care with long-term effects. A score of 5 (Catastrophic) is defined as: Incident leading to death, Multiple permanent injuries or irreversible health effects, An event which impacts on a large number of patients.
Excerpt from a set of impact definitions in the domain of
‘Impact on the safety of patients, staff or public (physical/psychological harm)’
(from A risk matrix for risk managers)

 It may be helpful when determining the quantitative impact or rating of an event to:

  • Examine the problems that might arise from the event, and consider their severity by comparison with available definitions of impact;
  • Examine the impact that this event or similar events have had in the past, either in the current facility under examination or in other facilities;
  • Consider whether any existing measures (identified above) affect the impact rating;
  • Separate the ratings for different types of impact, for example, across more than one row in the assessment form, as shown below.

 

Portion of a risk table, showing the impact ratings for some events. For example, one of the things that could go wrong is insufficient staff being available to accept a patient. This may result in being unable to accept the patient altogether with an impact rating of 3. An alternative is that staff are pulled from other areas of the unit, resulting in reduced staffing in those areas. This was given an impact rating of 4. Another possibility is that there is a delay in getting staff in place, leading to the unwell patient having to wait and the police becoming unhappy. This was also given a rating of 3.

 

Examples of impact ratings

 

Putting ‘Estimating Impact’ into practice

Space to record this information is provided in the SSA Assessment Form. To do this:

  1. Select the ‘Identify/Analyse/Evaluate risks’ page in the Assessment Form.
  2. For each row, enter an impact rating in column H (headed How bad is it if it does go wrong?). This rating indicates how bad the problem in that row would be if it did occur.
Screenshot of the Set risk criteria page of the assessment form

Case Study

Part of the completed ‘Identify/Assess/Evaluate risks’ page from the Section 136 case study is shown opposite. Further explanation of this stage in the case study can be found on the Section 136 page about Estimating impact.


Estimating likelihood

It is also necessary to estimate the likelihood of the outcomes. Likelihood refers to how likely or probable it is that a potential problem will occur. This can vary from ‘rare’ to ‘almost certain’, through various levels of likelihood. The more likely a problem, the more important it may be to do something about it. For example, a mix up between two medicines needs to be taken more seriously if it is deemed likely to occur monthly, rather than once a decade.

Likelihood is rated by referring to the definitions of likelihood levels included in the risk criteria retrieved above. An example of a set of definitions is shown below. In this example, a rating of 3 would be given to an issue that ‘might happen occasionally’, where this requires some individual judgement, for example, to interpret what is meant by ‘occasionally’.

 

A table of likelihood score definitions. A score of 1 (Rare) is defined as: This will probably never happen or recur. A score of 2 (Unlikely) is defined as: Do not expect it to happen or recur but it is possible it may do so. A score of 3 (Possible) is defined as: Might happen or recur occasionally. A score of 4 (Likely) is defined as: Will probably happen or recur but is not a persistent issue. A score of 5 (Almost certain) is defined as: Will undoubtedly happen or recur, possibly frequently.

 

Excerpt from a set of likelihood definitions using broad descriptors of frequency
(from A risk matrix for risk managers)

 

It may be helpful when determining the likelihood of an event to look at data for how often this event has happened in the past, either in the current facility under examination or in other facilities. If the system or the event is novel, then an idea of likelihood can still be attained by examining data for similar events, for example, mistakes in prescriptions for other medicines.

It is also important to consider any existing measures to control risk (identified above), and how they might moderate the likelihood of the event in practice. For example, a haematology unit may have a policy of using safety syringes, in theory reducing the chance of a needlestick injury to zero. However, if the policy is generally ignored, the chance of the injury will be higher.

The scenario in which the event takes place can also influence the likelihood rating. For example, the chance of a staff member receiving a needlestick injury from a patient with a communicable disease may depend greatly upon whether the SSA is considering treatment in a general ward, or a specialist haematology clinic. The likelihood may be still greater if assessing an emergency resuscitation scenario, where speed of treatment is essential and where the patient may be confused and agitated. This shows the importance of stating the assumptions and describing the scenario clearly in the Outline goals and Describe system activities in the Examine phase.

 

Portion of a risk table, showing the likelihood ratings for some events. For example, one of the things that could go wrong is insufficient staff being available to accept a patient. This might result in being unable to accept the patient at all. However, the likelihood of this was rated 1, given the measures already in place to prevent this, such as staff capacity and early notice of arrival. Another possibility is that staff are made available by moving them from other areas of the unit, leading to reduced staffing in those other areas. This is much more likely to happen, and was rated 4.
Examples of likelihood ratings

Rating the likelihood of an event may provoke some discussion and disagreement over the exact score. Generally this is a healthy sign that the participants are engaging with the process, but it can be a sign that the scope of the assessment is too broad and may require some restriction. For example, when staff from different units with different exposures to risk are taking part in the same SSA, it can be helpful to split into different groups and run more than one assessment, noting where the variation occurs and by how much. An alternative and simpler strategy may be to just use the highest, worst case, score.

Putting ‘Estimating likelihood’ into practice

Space to record this information is provided in the SSA Assessment Form. To do this:

  1. Select the ‘Identify/Analyse/Evaluate risks’ page in the Assessment Form.
  2. For each row, enter a likelihood rating in column J (headed How likely is it to go wrong?). This rating indicates how likely it is that the problem in that row will occur.
Screenshot of the Risks page of the assessment form

Case Study

Part of the completed ‘Identify/Assess/Evaluate risks’ page from the Section 136 case study is shown opposite. Further explanation of this stage in the case study can be found on the Section 136 page about Estimating likelihood.


Calculating risk

Once impact and likelihood have been estimated, it is useful to calculate a risk score for each event by multiplying these two values together. For example, an incident may have an impact of 3 and a likelihood of 4. Its risk is then 3 multiplied by 4, i.e. 12.

 

Portion of a risk table, showing some of the risk scores. For example, the issue: Insufficient staff available to accept patient, leading to being unable to accept the patient, has an impact of 3 and a likelihood of 1, and thus a risk score of 3. The issue of insufficient staff leading to reduced staff in other areas of the unit has an impact of 4 and a likelihood of 4, resulting in a risk of 16. Other risks are rated 12, 4 and 4.

Examples of risk calculations

Putting ‘Calculating risk’ into practice

Space to record this information is provided in the SSA Assessment Form. To do this:

  1. Select the ‘Identify/Analyse/Evaluate risks’ page in the Assessment Form.
  2. Examine the risk scores in column K (headed What is the risk?. In the spreadsheet version of the form, these scores should be calculated automatically. If using the printed form, or if the calculation is not working properly, then enter the risk scores manually into this column. These can be calculated by multiplying the impact (column H) and likelihood (column J).
Screenshot of the Risks page of the assessment form

Case Study

Part of the completed ‘Identify/Analyse/Evaluate risks’ page from the Section 136 case study is shown opposite. Further explanation of this stage in the case study can be found on the Section 136 page about Calculating risk.