QSMs October – December 2018

You can download the full October–December 2018 QSM results (2.08 MB, PDF) or view the commentary and interactive charts below.

Falls

Process marker 1: Percentage of older people assessed for the risk of falling

Nationally, 91 percent of older patients* were assessed on their falls risk in quarter 4, 2018. The rate has remained around the expected achievement level of 90 percent since quarter 4, 2013, despite some variations in a few quarters. At the district health board (DHB) level, 12 out of 20 DHBs achieved the expected marker level. Auckland, Nelson Marlborough and Waikato DHBs have seen declines, while Hauora Tairāwhiti and Northland DHB have seen improvements.

• Upper group: ≥ 90 percent
• Middle group: 75–89 percent
• Lower group: < 75 percent

* Patients aged 75+ (55+ for Māori and Pacific peoples)

Process marker 2: Percentage of older people assessed as at risk of falling who received an individualised care plan that addresses these risks

About 93 percent of patients assessed as being at risk of falling had an individualised care plan completed. This measure has increased 16 percentage points compared with the baseline in quarter 1, 2013. Achievements at DHB level vary but, overall, where patients have been assessed to be at risk of falling, completion of individualised care plans for that population group need to be at a consistently high level. In quarter 4, 2018, there were 12 DHBs in the upper group. Auckland, Nelson Marlborough, South Canterbury and Southern DHBs have seen a decline, while Hauora Tairāwhiti and Northland DHB have seen an improvement.

• Upper group: ≥ 90 percent
• Middle group: 75–89 percent
• Lower group: < 75 percent

When assessments and care plans are plotted against each other, a trend of movement over time is shown from the bottom left corner (low assessment and individualised care plan) to the top right corner (high assessment and individualised care plan). Five DHBs sat at the top right corner in quarter 1, 2013; in quarter 4, 2018, 11 DHBs are in this ‘ideal’ box (see Figure 3), up from 10 DHBs the last quarter. Auckland DHB and Nelson Marlborough DHB are in the lower left corner, which is under the target for assessment and care plan.

Outcome marker: In-hospital falls resulting in a fractured neck of femur per 100,000 admissions

There were 97 falls resulting in a fractured neck of femur (broken hip) in the 12 months ending December 2018.

To control the impact of changes in the number of admissions per month, Figure 4 shows in-hospital falls causing a fractured neck of femur per 100,000 admissions. The median of this measure was 12.6 in the baseline period of July 2010 to June 2012. It has moved down since September 2014, to 9.7 per 100,000 admissions, and shown a significant improvement. There was a high number of falls in February to October 2018, which may be an indication of a significant increase in the rate. This will be closely monitored over the coming quarters.

The number of 97 in-hospital falls resulting in a fractured neck of femur is significantly lower than the 112 we would have expected this year, given the falls rate observed in the period between July 2010 and June 2012. The reduction is estimated to have saved $0.7 million in the year ending December 2018, based on an estimate of $47,000[1] for a fall with a fractured neck of femur.

We know some of these patients are likely to be admitted to aged residential care on discharge from hospital, which is estimated to cost $135,000 per occurrence.[2]

If we conservatively estimate that 20 percent of the patients who avoided a fall-related fractured neck of femur would have been admitted to an aged residential care facility, the reduction in falls represents $0.97 million in total avoidable costs since December 2017.

Hand hygiene 

National compliance with the five moments for hand hygiene remains high.

Process marker 1: Percentage of opportunities for hand hygiene taken

The process marker has not been updated this quarter, as we don’t collect process data in quarter 4.

• Upper group: ≥ 70 percent before quarter 3, 2014, 75 percent in quarters 3 and 4, 2014, and 80 percent since quarter 1, 2015.
• Middle group: 60 percent to target.
• Lower group: < 60 percent.
• Hand hygiene national compliance data is reported three times every year, not quarterly.

Outcome marker: Healthcare associated Staphylococcus aureus bacteraemia (SAB) per 1,000 bed-days

Healthcare associated SAB can be associated with medical devices or surgical procedures which means the onset of symptoms may occur outside of the hospital (community onset).

Figure 7 displays the monthly healthcare associated SAB per 1,000 bed-days. The final month is omitted, due to denominator completeness issues. From May 2017, the median has significantly increased from 0.11 to 0.13 per 1,000 bed-days. This is concerning and will be closely monitored over the next couple of quarters.

Surgical site infection improvement (SSII) – orthopaedic surgery

As the Commission uses a 90-day outcome measure for surgical site infection (SSI), the data runs one quarter behind other measures. Information in this section relates to hip and knee arthroplasty procedures from quarter 3, 2013, to quarter 3, 2018.

Process marker 1: Antibiotic administered in the right time

For primary procedures, an antibiotic should be administered in the hour before the first incision (‘knife to skin’). As this should happen in all primary cases, the threshold is set at 100 percent. In quarter 3, 2018, 98 percent of hip and knee arthroplasty procedures involved the giving of an antibiotic within 60 minutes before knife to skin. Ten DHBs achieved the national goal. Counties Manukau Health and Northland DHB have been in the lower group consistently over the last year

• Upper group: 100 percent
• Middle group: 95–99 percent
• Lower group: < 95 percent

Process marker 2: Right antibiotic in the right dose – cefazolin 2 g or more or cefuroxime 1.5 g or more

In the current quarter, 98 percent of hip and knee arthroplasty procedures received the recommended antibiotic and dose. Eighteen DHBs reached the threshold level of 95 percent compared with only three in the baseline quarter.[3]

• Upper group: ≥ 95 percent
• Middle group: 90–94 percent
• Lower group: < 90 percent

Outcome marker: SSIs per 100 hip and knee operations

In quarter 3, 2018, there were 24 SSIs out of 2,572 hip and knee arthroplasty procedures, an SSI rate of 0.93 percent. A shift in the median is detected from August 2015, with the reduction being from 1.18 percent SSIs during the baseline period to 0.85 percent after it.

SSI improvement – cardiac surgery

This is the eighth quality and safety marker (QSM) report for cardiac surgery. Since quarter 3, 2016, all five DHBs performing cardiac surgery have submitted process and outcome marker data from all cardiac surgery procedures, including coronary artery bypass graft with both chest and donor site, and with chest site only. There are three process markers and one outcome marker, which are similar to the markers for orthopaedic surgery.

Process marker 1: Timing – an antibiotic to be given 0–60 minutes before knife to skin

The target is 100 percent of procedures achieving this marker. Capital & Coast and Southern DHBs achieved the target this quarter.

• Upper group: 100 percent
• Middle group: 95–99 percent
• Lower group: < 95 percent

Process marker 2: Dosing – correct antimicrobial prophylaxis used in at least 95 percent of procedures

The antibiotic prophylaxis of choice is to be ≥ 2 g or more of cefazolin for adults and ≥ 30 mg/kg of cefazolin for paediatric patients, not to exceed the adult dose. The target is that either dose is used in at least 95 percent of procedures. All DHBs, except Canterbury and Southern achieved the target this quarter.

• Upper group: > 95 percent
• Middle group: 90-95 percent
• Lower group: < 90 percent

Process marker 3: Skin preparation – appropriate skin antisepsis is always used

Appropriate skin antisepsis in surgery involves alcohol/chlorhexidine or alcohol/povidone iodine. The target is 100 percent of procedures achieving this marker. All DHBs, except Auckland adult, achieved the target this quarter.

Note: New Zealand is 100 percent, but not green as colouring is applied to raw data, but displayed data is rounded up.

• Upper group: 100 percent
• Middle group: 95–99 percent
• Lower group: < 95 percent

Outcome marker: SSIs per 100 procedures rate

In quarter 3, 2018, there were 28 SSI cases in 656 procedures, an infection rate of 4.3 percent. The latest 7 points are on or below the median. The median will not be adjusted until 12 months after the initial rate drop because of data completeness.

Safe surgery

This is the 10th report for the safe surgery QSM, which measures levels of teamwork and communication around the paperless surgical safety checklist.

Direct observational audit was used to assess the use of the three surgical checklist parts: sign in, time out and sign out. A minimum of 50 observational audits per quarter per part is required before the observation is included in uptake and engagement assessments. Rates are greyed out in the tables below where there were fewer than 50 audits.

Figure 15 shows, for each part of the checklist, how many audits were undertaken. Thirteen out of the 20 DHBs achieved 50 audits for all three parts in quarter 4, 2018. Counties Manukau Health has a large auditor cohort, which explains its high numbers.

Rates for uptake (all components of the checklist were reviewed by the surgical team) are only presented where at least 50 audits were undertaken for a checklist part. Uptake rates were calculated by measuring the number of audits of a part where all components of the checklist were reviewed against the total number of audits undertaken. 

The components for each part of the checklist are shown in the poster on the right. Of the 13 DHBs that achieved 50 audits in each checklist, nine achieved the 100 percent uptake target in at least one part of the checklist, during the current quarter (see Figure 16). Data is not presented where there were fewer than 50 audits.

Rates for uptake (all components of the checklist were reviewed by the surgical team) are only presented where at least 50 audits were undertaken for a checklist part. Uptake rates were calculated by measuring the number of audits of a part where all components of the checklist were reviewed against the total number of audits undertaken. 

The components for each part of the checklist are shown in the poster on the right. Of the 13 DHBs that achieved 50 audits in each checklist, nine achieved the 100 percent uptake target in at least one part of the checklist, during the current quarter (see Figure 16). Data is not presented where there were fewer than 50 audits.

The levels of team engagement with each part of the checklist were scored using a seven-point Likert scale developed by the World Health Organization. A score of 1 represents poor engagement from the team and 7 means team engagement was excellent. The target is that 95 percent of surgical procedures score engagement levels of 5 or above. As Figure 17 shows, for the latest quarter, Bay of Plenty, MidCentral and West Coast DHBs achieved the target in all three parts. Nine other DHBs achieved the target in one or two parts – an increase from five DHBs last quarter. Data are not presented where there were fewer than 50 audits.

Note: the numbers in Figures 16 and 17 have been rounded but the colours are assigned based on whether the target was achieved.

The safe surgery quality and safety domain now includes a start-of-list briefing measure, to reinforce the importance of the briefing as a safe surgery intervention. The measure is described as ‘Was a briefing including all three clinical teams done at the start of the list?’

Figure 18 shows, in quarter 4, 2018, 11 DHBs reported a start-of-list briefing was happening. There is no specific target for this part of the measure; the aim is to have all 20 DHBs increasingly undertaking and reporting briefings over time. The programme team continues to work with the auditing teams to increase data submission rates so the report better matches practice in DHBs.

The rates for postoperative sepsis and deep vein thrombosis/pulmonary embolism (DVT/PE) are the two outcome markers for safe surgery. The rates have fluctuated over time. To understand the factors driving the changes and to provide risk-adjusted outcomes in the monitoring and improvement of surgical QSMs, we have developed a risk-adjustment model for these two outcome markers.

The model is used to identify how likely patients being operated on were to develop sepsis or DVT/PE based on factors such as their condition, health history and the operation being undertaken. From this, we can calculate how many patients we would have predicted to develop sepsis or DVT/PE based on historic trends. We can then compare how many patients actually did develop sepsis or DVT/PE, to create an observed/expected (O/E) ratio. If the O/E ratio is more than 1 then there are more sepsis or DVT/PE cases than expected, even when patient risk is taken into account. A ratio of less than 1 indicates fewer sepsis or DVT/PE cases than expected.

Figure 19 shows the DVT/PE risk-adjustment model results in two charts. Using the same methodology as above, the O/E ratio control chart shows there were 11 consecutive quarters in which the observed numbers were below the expected numbers since quarter 2, 2013. This indicates a statistically significant downwards shift, taking into account the increasing number of high-risk patients treated by hospitals and more complex procedures undertaken by hospitals. Over the past three years, a higher number of cases of DVT/PE have been observed in the second quarter.

Medication safety

The quality and safety domain for medication safety focuses on medicine reconciliation. This is a process by which health professionals accurately document all medicines a patient is taking and their adverse reactions history (including allergy). The information is then used during the patient’s transitions in care. An accurate medicines list can be reviewed to check the medicines are appropriate and safe. Medicines that should be continued, stopped or temporarily stopped can be documented on the list. Reconciliation reduces the risk of medicines being:

• omitted
• prescribed at the wrong dose
• prescribed to a patient who is allergic
• prescribed when they have the potential to interact with other prescribed medicines.

The introduction of electronic medicine reconciliation (eMedRec) allows reconciliation to be done more routinely, including at discharge. There is a national programme to roll out eMedRec throughout the country; Figure 20 shows there are six DHBs that have implemented the system to date. Further uptake of eMedRec is limited until the IT infrastructure is improved in each DHB hospital.

Within the six DHBs that have implemented eMedRec, only Northland and Taranaki DHB hospitals are reporting their process markers. Figure 22 shows the process marker change over time for these two DHBs. Further work is being undertaken on refining and agreeing the eMedRec marker definitions. Once this has been achieved the other DHB hospitals using eMedRec will report their process markers.

Patient deterioration

This is the third quarter that structural, process and outcome measures for the patient deterioration QSMs have been reported.

DHBs were asked to provide both process and outcome measure data by ethnicity where possible. Despite an increase in ethnicity data submitted from the previous quarter, we have not included this in the national report because the majority of DHBs were still unable to submit. We acknowledge that, for some DHBs, it will take more time to start collecting and submitting ethnicity-level data.

Note: The results for the markers for Nelson Marlborough DHB may be subject to change due to data collection issues.

Structural measure: Eligible wards using the New Zealand early warning score

The structural measure demonstrates the progress DHBs have made towards implementing improvements to their recognition and response systems and aligning with the New Zealand early warning score (NZEWS).

The majority of DHBs (90 percent, n=18) have now implemented (or are in the process of implementing) the NZEWS in their hospitals. We have also seen a decrease in the use of the tool across all eligible wards from the last quarter (now at 96 percent). Note: the New Zealand percentage is calculated based on only those DHBs that have implemented the NZEWS.

Process measure 1: Correct calculation of early warning score

The first process measure shows the percentage of audited patients with an early warning score calculated correctly for the most recent set of vital signs. This measure demonstrates how the recognition part of the system is working through the correct use of the NZEWS. Results for this measure revealed a national figure of 91 percent.

A total of 16 DHBs (80 percent) submitted data for this measure. Those using an electronic vital signs system will be able to achieve 100 percent consistently for this measure. Southern DHB is yet to implement the NZEWS, but is using its existing EWS.

Process measure 2: Appropriate response to escalations

The second process measure shows the percentage of audited patients that triggered an escalation of care and received the appropriate response to that escalation as per the DHB’s agreed escalation pathway. This measure demonstrates how the response part of the system is working through the appropriate response to care that has been escalated.

The national figure for this measure was 75 percent, an increase from the previous quarter. There was also considerably more variance between DHBs than for the first process measure, highlighting an opportunity for improvement. A total of 14 DHBs (70 percent) submitted data for this measure.

Outcome measure 1: Rate of in-hospital cardiopulmonary arrests (preliminary results)

The following outcome measures will be used over time to determine whether the improvements to hospitals’ recognition and response systems have improved patient outcomes. Both measures are shown in a rate per 1,000 admissions. It is important to note that the preliminary admissions data used to calculate the rate is taken from the National Minimum Dataset (NMDS) at a DHB level and may differ from rates generated from administrative systems locally.

The results show a national rate of 1.4 cardiopulmonary arrests per 1,000 admissions for this quarter. A total of 14 DHBs provided data for this measure. Canterbury DHB is not displayed this quarter because it is currently developing systems to capture cardiac arrest data.

Outcome measure 2: Rate of rapid response escalations (preliminary results)

The second outcome measure shows the rate of rapid response escalations per 1,000 admissions (excluding those mentioned previously). Consistent with the previous quarter, the results showed a national rate of 26 events per 1,000 admissions. A total of 14 DHBs (70 percent) provided data for this measure.

International research has shown that an effective recognition and response system will result in an inverse relationship between outcome measures 1 and 2 (ie, a higher rate of rapid response escalations with a lower rate of in-hospital cardiopulmonary arrests). Another outcome measure used internationally is unplanned admissions to intensive care units. See the patient deterioration domain of the Atlas of Healthcare Variation for this data.

To further investigate the relationship between process measures 1 and 2, we have developed a scatterplot. The aim over time, is to have all DHBs locate in the top right corner which reveals a high rate of NZEWS scoring accuracy and appropriate response. It shows all DHBs that supplied data had a high rate of early warning score calculated correctly. There is more spread for the second process marker, which shows two distinct groups: those that achieve higher than 70 percent and those that do not. This will be investigated in the next QSM report.

References

1. de Raad J–P. 2012. Towards a value proposition: scoping the cost of falls. Wellington: NZIER.
2. Ibid.
3. In quarter 1, 2015, 1.5 g or more of cefuroxime was accepted as an alternative agent to 2 g or more of cefazolin for routine antibiotic prophylaxis for hip and knee replacements. This improved the results of this process measure for MidCentral DHB significantly, from 10 percent before the change to 96 percent immediately after the change. It also increased the national result from 90 percent to 95 percent in quarter 1, 2015.