QSMs April – June 2019

You can download the full April–June 2019 QSM results (2.4MB, PDF) or view the commentary and interactive charts below.

• Upper group: ≥ 90 percent
• Middle group: 75–89 percent
• Lower group: < 75 percent

* Patients aged 75+ (55+ for Māori and Pacific peoples)

Process marker 2: Percentage of older people assessed as at risk of falling who received an individualised care plan that addresses these risks

About 93 percent of patients assessed as being at risk of falling had an individualised care plan completed (Figure 2). This measure has increased 16 percentage points compared with the baseline in quarter 1, 2013. Achievements vary across DHBs. In quarter 2, 2019, there were 16 DHBs in the upper group compared to 14 in quarter 1, 2019. Nelson Marlborough, South Canterbury and Southern DHBs have been consistently lower than the national average in the development of an individualised care plan. Northland has remained in the upper group since quarter 4, 2018. Canterbury, Counties Manukau, Hutt Valley, Waitematā and Whanganui DHBs have been consistently present in the upper group for more than six consecutive quarters.

• Upper group: ≥ 90 percent
• Middle group: 75–89 percent
• Lower group: < 75 percent

When assessments and care plans are plotted against each other, a trend of movement over time is shown from the bottom left corner (low assessment and individualised care plan) to the top right corner (high assessment and individualised care plan) in Figure 3. Five DHBs sat at the top right corner in quarter 1, 2013; in quarter 2, 2019, nine DHBs are in this ‘ideal’ box (see Figure 3), down from ten DHBs the last quarter. Ten DHBs met the care plan rate target but did not meet the assessment rate baseline.

Outcome marker: In-hospital falls resulting in a fractured neck of femur per 100,000 admissions

There were 92 falls resulting in a fractured neck of femur (broken hip) in the 12 months ending June 2019.

To control the impact of changes in the number of admissions and to capture special causes of variation with a more robust time-series, the results will be reported quarterly instead of monthly. Figure 4 shows the quarterly rate of in-hospital falls causing a fractured neck of femur per 100,000 admissions.

The median of this measure was 12.8 in the baseline period of July 2010 to June 2012. It had moved down since September 2014, to 9.4 per 100,000 admissions, and shown a significant improvement. This reduction is supported by the observed improvement in the assessment and plan process markers results. There are some variations, especially in quarter 2, and quarter 3, 2018. Further analysis needs to understand the causes of these variations.

The number of 92 in-hospital falls resulting in a fractured neck of femur is significantly lower than the 115 we would have expected this year, given the falls rate observed in the period between July 2010 and June 2012. The in-hospital falls reduction is estimated to have saved $1.06 million from July 2018 up until June 2019. This is based on an estimate of $47,000[1] for a fall with a fractured neck of femur (Figure 5).

We know some of these patients are likely to be admitted to aged residential care on discharge from hospital, which is estimated to cost $135,000 per occurrence.[2]

If we conservatively estimate that 20 percent of the patients who avoided a fall-related fractured neck of femur would have been admitted to an aged residential care facility, the reduction in falls represents $1.46 million in total avoidable costs since July 2018.

• Upper group: ≥ 70 percent before quarter 3, 2014, 75 percent in quarters 3 and 4, 2014, and 80 percent since quarter 1, 2015.
• Middle group: 60 percent to target.
• Lower group: < 60 percent.
• Hand hygiene national compliance data is reported three times every year, not quarterly.

Outcome marker: Healthcare associated Staphylococcus aureus bacteraemia (SAB) per 1,000 bed-days

Healthcare associated SAB can be associated with medical devices or surgical procedures which means the onset of symptoms may occur outside of the hospital (community onset).
Figure 7 displays the monthly healthcare associated SAB per 1,000 bed-days. Data for the last month, June, is omitted, due to denominator completeness issues. From May 2017, the median has significantly increased from 0.11 to 0.13 per 1,000 bed-days. We are working with DHBs to better understand this shift and will monitor closely in the coming quarters.

• Upper group: 100 percent
• Middle group: 95–99 percent
• Lower group: < 95 percent

Process marker 2: Right antibiotic in the right dose – cefazolin 2 g or more or cefuroxime 1.5 g or more

In the current quarter, 97 percent of hip and knee arthroplasty procedures received the recommended antibiotic and dose. Seventeen of the 20 DHBs reached the threshold level of 95 percent compared with only three in the baseline quarter.[3] In quarter 1, 2019, West Coast DHB has moved to the lower group. 

• Upper group: ≥ 95 percent
• Middle group: 90–94 percent
• Lower group: < 90 percent

Outcome marker: SSIs per 100 hip and knee operations

In quarter 1, 2019 (January up until March) there were 38 SSIs out of 2,442 hip and knee arthroplasty procedures, a quarterly SSI rate of 1.56 percent, which is higher than the current median of 0.9 percent since August 2015. There were four consecutive points above the median since December 2018 and a peak rate of 2.32 percent in January 2019. It could be an early indication of a significant upwards shift, but we will monitor closely in the coming quarters. Information on the month of April is not reported.

• Upper group: 100 percent
• Middle group: 95–99 percent
• Lower group: < 95 percent

Process marker 2: Dosing – correct antimicrobial prophylaxis used in at least 95 percent of procedures

The antibiotic prophylaxis of choice is ≥ 2 g or more of cefazolin for adults and ≥ 30 mg/kg of cefazolin for paediatric patients, not to exceed the adult dose. The target is that either dose is used in at least 95 percent of procedures. All DHBs performing cardiac surgery except Canterbury achieved the target this quarter. 

• Upper group: > 95 percent
• Middle group: 90-95 percent
• Lower group: < 90 percent

Process marker 3: Skin preparation – appropriate skin antisepsis is always used

Appropriate skin antisepsis in surgery involves alcohol/chlorhexidine or alcohol/povidone iodine. The target is 100 percent of procedures achieving this marker. All DHBs except Southern achieved the target this quarter.

• Upper group: 100 percent
• Middle group: 95–99 percent
• Lower group: < 95 percent

Outcome marker: SSIs per 100 procedures rate

In March 2018 we see the median shift downwards from 4.8 SSI cases per 100 cardiac procedures to 4.0. This is a significant improvement since the beginning of the SSII Programme. Cardiac surgical services in DHBs are dedicated to ensuring high compliance with the process measures in addition to implementing other quality improvement activities such as an anti-staphylococcal bundle. 

Rates for uptake (all components of the checklist were reviewed by the surgical team) are only presented where at least 50 audits were undertaken for a checklist part. Uptake rates were calculated by measuring the number of audits of a part where all components of the checklist were reviewed against the total number of audits undertaken. 

The components for each part of the checklist are shown in the poster on the right. Of the 15 DHBs that achieved 50 audits in each checklist, 11 achieved the 100 percent uptake target in at least one part of the checklist, during the current quarter (see Figure 16). Data is not presented where there were fewer than 50 audits.

The levels of team engagement with each part of the checklist were scored using a seven-point Likert scale developed by the World Health Organization. A score of 1 represents poor engagement from the team and 7 means team engagement was excellent. The target is that 95 percent of surgical procedures score engagement levels of 5 or above. As Figure 17 shows, for the latest quarter Bay of Plenty, Hawke’s Bay, MidCentral, Northland, Southern, Wairarapa and Whanganui DHBs achieved the target in all three parts. Eight other DHBs achieved the target in one or two parts – a decrease from twelve DHBs last quarter. Data are not presented where there were fewer than 50 audits.

The safe surgery quality and safety domain now includes a start-of-list briefing measure to reinforce the importance of the briefing as a safe surgery intervention. The measure is described as ‘Was a briefing including all three clinical teams done at the start of the list?’

Figure 18 shows, in quarter 2, 2019, 12 DHBs reported that a start-of-list briefing was happening. There is no specific target for this part of the measure; the aim is to have all 20 DHBs increasingly undertaking and reporting briefings over time. The programme team continues to work with the auditing teams to increase data submission rates so the report better matches practice in DHBs.

The rates of postoperative sepsis and deep vein thrombosis/pulmonary embolism (DVT/PE) are the two outcome markers for safe surgery. The rates have fluctuated over time. To understand the factors driving the changes and to provide risk-adjusted outcomes in the monitoring and improvement of surgical QSMs, we have developed a risk-adjustment model for these two outcome markers.

The model identifies how likely patients being operated on were to develop sepsis or DVT/PE based on factors such as their condition, health history and the operation being undertaken. From this, we calculated how many patients would be predicted to develop sepsis or DVT/PE based on historic trends. We then compare how many patients actually developed sepsis or DVT/PE to create an observed/expected (O/E) ratio. If the O/E ratio is more than 1 then there are more sepsis or DVT/PE cases than expected, even when patient risk is taken into account. A ratio of less than 1 indicates fewer sepsis or DVT/PE cases than expected.

Figure 19 shows the DVT/PE risk-adjustment model results in two charts. The O/E ratio control chart shows there were 11 consecutive quarters in which the observed numbers were below the expected numbers since quarter 2, 2013. This indicates a statistically significant downwards shift, taking into account the increasing number of high-risk patients treated by hospitals and more complex procedures undertaken by hospitals. Over the past three years, a higher number of cases of DVT/PE have been observed in the second quarter. In the most recent six quarters, the O/E ratio is higher than the median value of 0.93. We will closely monitor this in future quarters to see if there is enough evidence of a shift up.

Process measure 1: Correct calculation of early warning score

The first process measure (Figure 24) shows the percentage of audited patients with an early warning score calculated correctly for the most recent set of vital signs. This measure demonstrates how the recognition part of the system is working through the correct use of the NZEWS. We’ve introduced a threshold to indicate relative groupings for this quarter. Results for this measure show a national figure of 94 percent for this quarter.

Eighteen DHBs (90 percent) submitted data for this measure. Those using an electronic vital signs system in all their eligible wards will be able to achieve 100 percent consistently for this measure. While Southern DHB is yet to implement the NZEWS, they have reported data using their existing EWS.

Process measure 2: Appropriate response to escalations

The second process measure (Figure 25) shows the percentage of audited patients that triggered an escalation of care and received the appropriate response to that escalation as per the DHB’s agreed escalation pathway. This measure demonstrates how the response part of the system is working through the appropriate response to care that has been escalated.

The national figure for this measure was 75 percent, an increase from the previous quarter of 64 percent. There was considerably more variation between DHBs than for the first process measure, highlighting an opportunity for improvement. The Commission is currently working with DHBs to understand this variation in particular regarding the consistency of data collected, the sample size and timeframes regarding the escalation pathway. A total of 17 DHBs (85 percent) submitted data for this measure.

Outcome measure 1: Rate of in-hospital cardiopulmonary arrests (preliminary results)

The following outcome measures will be used over time to determine whether the improvements to hospitals’ recognition and response systems have improved patient outcomes. Both measures are shown in a rate per 1,000 admissions. It is important to note that the preliminary admissions data used to calculate the rate is taken from the National Minimum Dataset (NMDS) at a DHB level and may differ from rates generated from administrative systems locally.

The results (Figure 26) show a national rate of 1.5 cardiopulmonary arrests per 1,000 admissions for this quarter. Fifteen DHBs provided data for this measure. Canterbury DHB is not displayed this quarter because it is currently developing systems to capture cardiac arrest data.

Outcome measure 2: Rate of rapid response escalations (preliminary results)

The second outcome measure (Figure 27) shows the rate of rapid response escalations per 1,000 admissions (excluding those mentioned previously). Consistent with the previous quarter, the results showed a national rate of 32 events per 1,000 admissions. Fifteen DHBs (75 percent) provided data for this measure.

International research has shown that an effective recognition and response system will result in an inverse relationship between outcome measures 1 and 2 (ie, a higher rate of rapid response escalations with a lower rate of in-hospital cardiopulmonary arrests). Another outcome measure used internationally is unplanned admissions to intensive care units. See the patient deterioration domain of the Atlas of Healthcare Variation for these data.

To further investigate the relationship between process measures 1 and 2 we have developed a scatterplot. The aim over time, is to have all DHBs locate in the top right corner which reveals a high rate of NZEWS scoring accuracy and appropriate response. It shows all DHBs that supplied data had a high rate of early warning score calculated correctly but there is more variation across all DHBs in the reported rates of appropriate response.  

Process measure 2: Percentage of at-risk patients with a documented and current individualised care plan

The second process measure (Figure 30) shows the percentage of at-risk patients with a documented and current individualised care plan designed to address any risk (prevention) or manage any existing pressure injuries. This measure is used to monitor how well DHBs are putting in actions to prevent or manage pressure injuries for at-risk patients.

The national figure for this measure was a rate of 84 percent, an increase from 80 percent during last quarter.

A total of 18 DHBs (90 percent) submitted data for this measure.

Outcome measure 1: Percentage of patients with hospital-acquired pressure injury

The following outcome measures will be used over time to determine whether the improvements to prevention and management of pressure injuries have improved patient outcomes.

The first outcome measure (Figure 31) shows the percentage of patients with hospital acquired pressure injuries (ie, pressure injuries that formed while the patient was in hospital).

The national figure for this measure was a rate of 4.1 percent, an increase from 3.5 percent during last quarter. There is also considerable variation between DHBs highlighting an opportunity for improvement. We are working with DHBs to improve consistency of data collection.

A total of 18 DHBs (90 percent) submitted data for this measure.

Outcome measure 2: Percentage of patients with a non-hospital-acquired pressure injury

The second outcome measure (Figure 32) shows the percentage of patients with non-hospital-acquired pressure injuries (ie, patients that arrived at hospital with a pressure injury that was formed in aged residential care, at home or in community care.)

The national figure for this measure was a rate of 1.5 percent, a small increase from 1.4 percent during last quarter. There is also considerable variation for this outcome measure highlighting an opportunity for improvement.

A total of 18 DHBs (90 percent) submitted data for this measure.

References

1. de Raad J–P. 2012. Towards a value proposition: scoping the cost of falls. Wellington: NZIER.
2. Ibid.
3. In quarter 1, 2015, 1.5 g or more of cefuroxime was accepted as an alternative agent to 2 g or more of cefazolin for routine antibiotic prophylaxis for hip and knee replacements. This improved the results of this process measure for MidCentral DHB significantly, from 10 percent before the change to 96 percent immediately after the change. It also increased the national result from 90 percent to 95 percent in quarter 1, 2015.