Assessing the performance of mental health service facilities for meeting patient priorities and health service responsiveness

Abstract

The World Health Organisation has defined health service responsiveness as one of the key-objectives of health systems. Health service responsiveness relates to the ability to respond to service users’ legitimate expectations on non-medical issues when coming into contact with the services of a healthcare system. It is defined by the areas showing respect for persons and patient orientation. Health service responsiveness is particularly relevant to mental health services, due to the specific vulnerability of mental health patients but also because it matches what mental health patients consider as good quality of care as well as their priorities when seeking healthcare. As (mental) health service responsiveness applies equally to all concerned services it would be suitable as a universal indicator for the quality of services’ performance. However, performance monitoring programs in mental healthcare rarely assess health service performance with respect to meeting patient priorities. This is in part due of patient priorities as an outcome being underrepresented in studies that evaluate service provision. The lack of studies using patient priorities as outcomes transmits into evidence based guidelines and subsequently, into underrepresentation of patient priorities in performance monitoring. Possible ways out of this situation include more intervention studies using patient priorities as outcome, considering evidence from qualitative studies in guideline development and developing performance monitoring programs along the patient pathway and on key-points of relevance for service quality from a patient perspective.

What is good healthcare? More than 15 years ago the World Health Organization (WHO) tackled this question within the World Health Report 2000, ‘Health Systems: Improving Performance’ (WHO, 2000). In this report, health systems were evaluated and benchmarked for characteristics that WHO defined as contributing to the three key-objectives of healthcare systems:

• • ‘improving health’, as clearly the main objective of health systems;

• • fairness, as the ability of health systems to treat patients equally and not discriminate against them as well as protected them from the financial risks of illness; and

• • the quality of health services within a system in terms of health service responsiveness.

This editorial focuses on one of these key-objectives of health systems: health service responsiveness. It was defined as a parameter relating to a healthcare system's ability (as the sum of its services) to respond to service users’ legitimate expectations on non-medical issues when coming into contact with the health system (Valentine et al. 2003). The concept of health service responsiveness is built by two major areas: showing respect for persons and patient orientation. These areas are sub-divided into eight domains (Valentine et al. 2003).

The domains related to showing respect for persons include:

• • Confidentiality of personal information: talking privately to healthcare providers, personal information are kept confidential.

• • Autonomy and participation in decisions: involvement of patients in decisions about their healthcare or treatment, getting information about other treatments and tests.

• • Clarity of communication: how clearly healthcare providers explain things to patients, being granted enough time for asking questions about health problems or treatment.

• • Dignity: respectful treatment and communication, e.g., being greeted and talked to respectfully, privacy during physical examinations and treatments is respected.

The domains belonging to patient orientation imply:

• • Prompt attention: travelling time to hospital and other services, amount of time waiting for being attended.

• • Choice of healthcare provider: freedom to choose the healthcare providers that the patient is confident with.

• • Access to family and community support when in hospital: contact with outside world and maintaining of regular activities, e.g., ease of having family and friends visiting, staying in contact with the outside world.

• • Quality of basic amenities: cleanliness of the rooms inside the facility, including toilets, amount of space patients have.

In addition to these eight domains identified by WHO, research on the applicability of the health service responsiveness concept to different health system contexts revealed, that for chronic and mental healthcare the concept would need to be enhanced by a domain related to coordination of services (Bramesfeld et al. 2007; Röttger et al. 2014; Forouzan et al. 2016). This domain would also belong to the area of patient orientation. Not only that the health service responsiveness concept was proven to be applicable to mental healthcare, moreover its domains, including that of coordination, match priorities in healthcare of patients using mental health services (Stegbauer et al. 2015).

Health service responsiveness measures distinct patient experiences with non-medical health issues in the domains listed above. It thus seeks to put patients’ experience in relation to a common set of standards, of what patients’ legitimately expect when coming in contact with the system and its services (Zastowny et al. 1995). This distinguishes health service responsiveness from patient satisfaction: while patient satisfaction asks for patients’ subjective judgment of the services they are receiving, health service responsiveness assesses patients’ objective experience with these services, regardless of whether they are satisfied with what they receive or not (Valentine et al. 2003).

Mental health services being responsive to service users’ expectations are highly relevant as mentally ill patients are specifically vulnerable for not being treated as they wish to and for human rights violations due to the characteristics of their illness and the stigma attached to it (Loh et al. 2007). In addition, what is considered good quality of care in long-term mental healthcare matches the health service responsiveness domains (Taylor et al. 2009). Only health services, that act according to patients’ priorities, meet their expectations and respect their rights, will be used optimally. Research has shown that low health service responsiveness is being related to patients avoiding medical care despite being in need of it (Röttger et al. 2016).

The approach of WHO to introduce health service responsiveness as a quality parameter for the performance of health services and systems seems to be more relevant today than ever before: Evidence is growing in all medical specialties including mental healthcare, that there is a gap between what is considered optimal care and what is in fact provided (‘chasm’) (Institute of Medicine, 2001; Gaebel et al. 2009). In response to the awareness of this ‘chasm’, more and more programmes to measure performance of healthcare services are developed and implemented across healthcare systems. Scrutinising health service performance by quality monitoring programmes can be as well voluntarily done, as it can be mandatorily requested by health systems. Whether voluntary or mandatory, quality monitoring programmes aim to measure quality of care by using quantifiable indicators that are assessed at the level of the single health service providing facility. Quantifiable indicators offer an important possibility to compare performance of health service facilities longitudinally over time as well as between service facilities.

In the last 10 years increasingly quality monitoring programmes have been implemented that measure the performance of mental health service facilities using indicators. On a national level this is usually done in the context of a broader national quality monitoring programme, designed to monitor performance for different health problems (CIHI, 2013; NICE, 2013; Willms et al. 2013; ACHS, 2014; BMA and NHS Employers, 2014). Although most quality monitoring programmes in mental healthcare take some aspects of health service responsiveness such as showing respect for persons and patient orientation into consideration, most of them focus on indicators related to clinical treatment in terms of adherence to clinical guidelines. These indicators, such as for example treatment rates or complications, usually relate only to specific patient populations. They may require adjustment for morbidity and other risks, to allow for a fair comparison between service facilities. In contrast to this, assessing and comparing the performance of (mental) health service facilities by their health service responsiveness means assessing and comparing them by a universal indicator, that does not need any adjustment for specific risks. Most of the health service responsiveness domains relate to all mental health patients and facilities regardless of their specific characteristics and risks; e.g., being respectful treated and talked to (domain dignity) or the cleanliness of the rooms inside the facility, including the toilets (domain basic amenities), applies equally to all (mental) health facilities and to all patient populations.

It is no coincidence that quality monitoring programmes in (mental) healthcare focuses on clinical outcomes, such as symptom reduction, functionality or use of special healthcare services rather than on patient expectations or priorities. Quality monitoring programmes are usually developed with reference to clinical guidelines. Clinical guidelines in turn, are developed on the basis of the best available scientific evidence. The strongest evidence for interventions to be included in guidelines usually stems from controlled or – even better – randomised controlled trials. Common outcomes of these trials include symptom reduction, improvement of daily functioning and use of healthcare services, mainly hospital services (Catts et al. 2010; Stegbauer et al. 2015). Outcome measures related to patient experiences or priorities are underrepresented in studies that evaluate the effectiveness of (mental) healthcare interventions. This shows a concept of healthcare effectiveness that orients along the priorities of healthcare providers and cost carriers rather than patients’ priorities. The underrepresentation of patient priorities and expectations in outcome studies is being explained by patient priorities being ‘soft’ parameters, by a lack of evidence, in particular in respect to quantitative studies, a lack of reliable instruments to assess together with a high effort for assessing patient priorities, mainly if this has to be done by patients’ surveys (Pohontsch et al. 2015). Further, referring in a scientific way to patients priorities in mental healthcare is a rather new field with the first studies being published only 20 years ago (Stegbauer et al. 2015).

Despite these all being good reasons, it needs to be acknowledged that the lack of recognition of patient priorities and experiences as outcomes in studies that evaluate (mental) healthcare interventions, transmits into guidelines and from guidelines into quality monitoring programmes. Without studies that consider patient experiences or priorities as outcomes, patient priorities and expectations will continue to be underrepresented in guidelines and subsequently in quality monitoring.

There are possibilities how to deal with this situation:

Firstly, effectiveness studies that use patient experiences or priorities, as important outcomes need to be promoted. There are examples that controlled studies can be done with the key outcomes relating to patient experiences, such as empowerment (Stierlin et al. 2014). However, this requires a change in the perspective of what matters in healthcare from a providers’ and funding agencies’ perspective towards the perspective of patients.

Secondly, evidence from qualitative studies should be used more as a source in the development of clinical guidelines. A transparent method to evaluate the strength of evidence provided by qualitative studies has been proposed with the CERQual (Confidence in the Evidence from Reviews of Qualitative Research) approach (Lewin et al. 2015). Experience with the application of the CERQual methodology for processing qualitative evidence in guideline development on women's health issues in developing countries showed, that considering systematically qualitative evidence in guideline development leads to them being better implementable and more patient centred (Bohren et al. 2015; Tunçalp, 2015).

Thirdly, performance measurement of (mental) healthcare services should not only orient at clinical guidelines, but should consider the patient pathway. The patient pathway visualises the typical way of a patient with a specific medical problem through medical and attached services. Along the patient pathway key-points of relevance for quality of care from a patient perspective can be identified (AQUA, 2015). Using the patients’ pathway as the basis for the systematic development of requirements and indicators ensures that quality of services is not only viewed for those issues with a traditional evidence base, but also for those ‘softer’ ones, which do matter from a patient perspective.

Finally, considering the patient perspective as represented by the health service responsiveness domains, requires assessing patients' experiences through a patient survey. At present, only a minority of quality monitoring programmes in (mental) healthcare also assess quality of care by asking patients for their experience with a specific service or facility. By not asking patients for their experience, an important information source for assessing quality of care is left out. Patients are known to be clear definers of good quality, good evaluators of the healthcare they receive and good rapporteurs of their experiences with healthcare (Donabedian, 1992). Patients’ views are crucial for judging patient-relevant outcomes and they are often the only tie between different healthcare sectors and services (Blum et al. 2001; Ludt et al. 2014).

On the other side, it needs to be acknowledged how difficult it is to implement patient surveys that produce reliable and valid outputs within quality monitoring programmes (Willms et al. 2013). Therefore, despite a patient survey always being a golden standard in performance assessment, also more indirect measures of respecting patients’ priorities need to be considered. This could include peer reviews (checking basic amenities) and service provider reported indicators. Indicators do not only function by measuring and benchmarking, but also by drawing attention to specific processes.

Taking into consideration the quality chasm which is present in (mental) healthcare and remembering the United Nations’ claim that individuals with physical and mental disabilities have the right to the highest quality health services and the right of mentally ill persons for perceiving care of highest quality (Gostin et al. 2003), it is the prime time to start measuring quality of care of mental health service facilities systematically. A core feature for assessing and benchmarking the quality of mental health service facilities is their performance on showing respect for persons and patient orientation. Incentives for patient orientations within mental healthcare are usually low (Zechmeister et al. 2002); however, evidence suggests that including aspects of patient orientation and showing respect for persons in systematic performance measurements can be an effective means to improve performance (Killaspy et al. 2013).