“It’s not just counting, it’s caring”

Content

Our aim was to support the NHS to provide a healthcare environment free of harm for our patients.

Origins of the Safety Thermometer

Studies have shown that the NHS is inundated with a myriad of local and national datasets to try to understand harm. Many of these measures are slow to provide feedback and only relate to the most severe of harms, for example incident reports and mortality data respectively. Our ambition was to build a measurement system which would provide a ‘temperature check’ on the prevalence of harm and empower front-line staff to lead improvement efforts.

Haelo led the development and design of NHS Safety Thermometers since their inception in 2010, working within and alongside NHS bodies (such as NHS Digital and NHS Improvement) and data hosting experts (South West Quality Observatory). Haelo’s experience and knowledge of developing measurement strategies was complemented with input from clinical experts and front-line users, who provided feedback and ideas throughout the development of the NHS Safety Thermometers.

Safety Thermometer Data
Measure-with-the-NHS-ST

Journey

In 2010 the Harm free care programme was launched to support teams in reducing common harms across the health economy. We faced a common challenge – in order to improve safety we needed to be able to access regular data that could be used over time to measure improvement. At the time there was no data source which could be used at a local and national level to provide a snapshot of harm and so we set about developing the NHS Safety Thermometer with clinical expert groups to measure:

  • Pressure ulcers
  • Falls
  • Urinary tract infections (in patients with a catheter)
  • Venous thromboembolism

These harms were not chosen at random. They each had a high prevalence and huge impact on patients lives and were relevant across the health economy but importantly they are interlinked. Most improvement efforts on these harms were happening in silos but actually the same patients are at risk of each of these harms, many key interventions (for example intentional rounding) are similar and working to reduce one of these harms has the potential to increase another (for example you might cause a pressure ulcer using ted stockings to prevent a VTE). At the time we also had no data on how many people were experiencing more than one of these harms. The NHS Safety Thermometer ‘classic’ enables us to understand the burden of each individual harm, tracking improvement over time and the ‘harm free’ care measure provides a totally unique composite that is focused on the patient’s experience of harm wherever they are being cared for.

 


Implementation

Developing a new measurement system requires a precarious balancing act between the cost of collection vs the value added of the data, however the Safety Thermometer is not only about data; the act of data collection at the point of care raises awareness and brings the opportunity for immediate improvements to patient care, empowering frontline teams with data and calling them to action. This guiding principle led the creation of a point-of-care survey methodology that is carried out on 100% of patients on one day each month. Data are collected by frontline teams at the point of care as part of the daily work flow, ensuring quick and easy collection. Definitions are clinically valid and data are sourced through conversation with the patient, patient assessment and paper or electronic notes.

Early phases of collection relied upon the completion of a simple template which was then submitted by email for data processing and analysis, undertaken on a monthly basis, but by 2013 this was available via an online platform to enable data entry via portable devices, although paper forms are also available. In 2015 all Safety Thermometers were supported by dedicated Apps downloadable from the website. Instant charts are available for all Safety Thermometers once data have been entered. Run charts, funnel plots and Pareto charts can be viewed at a ward / team, organisational, regional or national level.

Haelo developed a series of bespoke tools to interpret data for improvement and provide recommendations, using core principles of statistical process control charts to identify.


Incentivised Improvement

We were commissioned by NHS England to lead the national roll out the CQUIN, acting as the primary point of contact and providing all supporting information and data analysis and running a series of regional and national events. CQUIN stands for commissioning for quality and innovation. The system was introduced in 2009 to make a proportion of healthcare providers’ income conditional on demonstrating improvements in quality and innovation in specified areas of patient care.

Following it’s launch in 2012, an incredible 180,000 patients being surveyed across acute and community based care each month. The launch of the CQUIN was supported by the “Harm-Free Care” campaign, which was designed and led by Haelo and demonstrated our expertise in delivering impactful and effective communications. The campaign was supported by a website with learning resources and case studies, social media presence (#harmfreecareselfie) and presentations to national audiences.

By the end of 2013, over a thousand organisations (including NHS trusts, care homes and private hospitals) were regularly collecting and submitting data via the NHS ‘Classic’ Safety Thermometer portal, therefore the next phase of the national CQUIN was to incentivise improvement in the data collected.  You can find out more about the CQUIN monitoring tool on the website.


Next Generation

The widespread use of the NHS ‘Classic’ Safety Thermometer was a huge success story, however feedback suggested that the definition of harm-free care was not appropriate in all clinical settings. In response to this demand, Haelo led the development of a number of bespoke ‘Next Generation’ Safety Thermometers, using the harm-free care principle and survey methodology in the following settings:

In addition, the Medicines Safety Thermometer was developed to shed light on an area where harm is prevalent but poorly reflected in existing datasets.

 


Results

Since 2012, data on over 11 million patients have been submitted to the NHS Safety Thermometers from across the healthcare economy, making it one of the largest patient safety data collections of its kind in the world. This is an incredibly valuable data resource and presents an opportunity to capture knowledge and learning about the impact of safety improvement initiatives.

Haelo is undertaking analysis of the available data to better inform our understanding of healthcare-associated harm occurring throughout the NHS. The national picture the NHS Safety Thermometer data provides can challenge current practice, identify problem areas in the system and influence national programmes of work.

One completed analysis looked at the rate of urinary catheter use over time1. Catheters increase the risk of urinary tract infections. There is evidence that catheters are inserted inappropriately in up to 50% of cases2,3, unnecessarily exposing patients to infection risk. We found no clinically significant reduction in urinary catheter prevalence over the 46 months of study, likely due to guidelines focussing on care of catheter in situ as opposed to indication for insertion. We therefore called for further guidance on indication for catheter insertion.

Further analysis underway is examining trends in pressure ulcers over time and is investigating the scale of this problem across the NHS. Early results suggest reductions over time in most healthcare settings but with significant variation in this. Results suggest that over the four and half years of the study, nearly 150,000 patients had a grade 3 or 4 pressure ulcer, highlighting the challenges which remain in tackling this problem. These initial results will be shared with representatives from NHS Improvement.

 

Publications

National papers have been published:


Building Capacity

Throughout the harm-free care campaign and development of NHS Safety Thermometers, Haelo sought to use innovative techniques to build system capability to understand and interpret data for improvement. Initially this took the shape of online teaching sessions, creation of interactive guidance documents and films (included above). As our understanding of the needs of users grew, we provided more responsive products to meet specific demands.


medication safety thermometer paper published

Future

For seven years, working with a range of partners and sub-contractors, Haelo led the innovation and development of the NHS Safety Thermometer portfolio providing measurement and capability building expertise for the NHS. With the NHS Safety Thermometers largely well-established, the day-to-day administration of the programme is now managed by South Central West Commissioning Support Unit, on behalf of NHS Improvement.

The success of the NHS Safety Thermometers is reliant upon the hundreds / thousands of NHS staff who collect and review data on a monthly basis as part of their commitment to providing safe care to every patient, every day.

Contact us

Get in touch if you want to learn more about how we can support your organisation use or develop your own NHS Safety Thermometer:

  • Developing complex measurement systems
  • Using innovative technologies to support data capture and analysis
  • Understanding how data can be used to support improvement in your organisation
  • Delivering an impactful behaviour change campaign
  • Conducting bespoke analysis of complex data sources

Links & References

Acknowledgement

The success of the NHS Safety Thermometers is reliant upon the hundreds / thousands of NHS staff who collect and review data on a monthly basis as part of their commitment to providing safe care to every patient, every day.

Links and References

1.) Shackley D, Whytock C, Parry G et al. Variation in prevalence of urinary catheters: a profile of NHS patients in England. BMJ Open (In Press, May 2017).

2.) Gokula RRM, Hickner JA, & Smith MA. Inappropriate use of urinary catheters in elderly patients at a midwestern community teaching hospital. American journal of infection control 2004; 32(4), 196-199.

3.) Tiwari MM, Charlton ME, Anderson JR, et al. Inappropriate use of urinary catheters: a prospective observational study. Am J Infect Control 2012; 40(1):51-4.

The opinions expressed in this study are those of the authors, Salford Royal NHS Foundation Trust. The inclusion in this study of the NHS Safety Thermometer logo is with the permission of NHS Improvement, but this study does not purport to reflect the opinions or views of NHS Improvement and not imply the expression of any opinion whatsoever on the part of NHS Improvement or the NHS Safety Thermometer Programme. Neither NHS Improvement nor any person acting on their behalf may be held responsible for the use which may be made of the information contained therein.