Olive Tree community treatment centre for individuals with personality disorder: naturalistic service evaluation

Abstract

Aims and method

Community treatment for individuals with personality disorder is a fast developing field. We report here on the effectiveness of one such approach. We examine the referral pathway of all clients between January 2005 and April 2008, including the mean days spent in our unit, the days spent in a psychiatric hospital before and after admission to our unit, and the results of changes in the rating scales we routinely use.

Results

Drop-out rates and the mean duration of therapy were acceptable. There has been a clear reduction of in-patient bed use and a small but significant improvement of most psychometric test results.

Clinical implications

This study provides further evidence for the effectiveness of community treatment for individuals with personality disorder.

The Department of Health 2003 policy implementation guideline Personality Disorder: No Longer a Diagnosis of Exclusion ¹ set out to the UK's National Health Service (NHS) trusts the government's intentions for the delivery of personality disorder services within general mental health and forensic settings. In this document, the government built on standards four and five in the National Service Framework for Mental Health ² and set out specific guidance on the development of services for people with personality disorder. It made explicit that all trusts delivering general adult mental health services need to consider how to meet the needs of individuals with a personality disorder who experience significant distress or difficulty as a result of their disorder. Later in 2003, a further National Institute for Mental Health in England publication ³ indicated that new funds would be made available to help stimulate the development of improved and new services to support users with personality disorders. The Olive Tree community treatment centre for individuals with personality disorder, created by the Coventry Primary Care Trust, became one of the pilots of this government initiative. ^4,5 At a timeofchangeinthe field of personality disorders, possible changes in classification and funding and the closing of a high-profile in-patient therapeutic community such as the Henderson, ⁵ it may be of interest to readers to see how a community-based approach that would be easy to replicate in other venues has fared.

The Coventry Community Specialist Personality Disorder Service is a tertiary specialist team ⁷ with the aim of using the structure of a clinical psychiatric service, designed around the assertive outreach recovery model, to deliver therapy in a variety of settings to individuals with a primary diagnosis of personality disorder. The service came into being towards the start of 2005, but owing to staff recruitment problems became fully operational only towards the end of the year. It provides a service to the local secondary mental health services: assessments, second opinions to psychiatrists, treatment of patients with a primary diagnosis of personality disorder, as well as training, supervision and mentoring of professionals involved in the care of such individuals. We also take an active role in the development of protocols and systems of communication about individuals with personality disorder, and training programmes on the diagnosis and treatment of such individuals.

There is mounting evidence that personality disorder can be successfully treated in the community with interventions such as therapeutic communities, ⁸ partial hospitalisation ⁹ and psychotherapy (metalisation-based therapy, ¹⁰ dialectical behaviour therapy ¹¹ and cognitive analytic therapy ¹² ). The Coventry service takes the stance that the quality of the therapeutic alliance is one of the most important factors for successful outcome of psychotherapy ^13,14 and that a consistent, structured, focused, non-collusive approach based on the principles of attachment and the recovery model can be containing and therapeutic (see, for example, Bateman ¹⁵ ).

Our service follows a team approach that has evolved with time ¹⁶ and allows the provision of crisis support, mutual cover between therapists and good communication between different therapy modalities. The setting is a specialist unit situated away from the main psychiatric hospital in Coventry and therapists are expected to see their clients for individual work in the community, mostly at the user's general practice surgeries. Service users are expected to enter into both individual and group therapy, although individual therapy is offered to those who either do not need or cannot tolerate group therapy. We also offer a ‘parallel service’ of short-term group therapy without individual support or follow-up and with a much shorter period of assessment.

Group therapy ideally consists of long-term dynamic group therapy facilitated by two therapists. Therapy is structured around care plans that are frequently updated, meaningful and coherent to both client and therapists, and describe not only important, concrete goals and plans of action, including environmental manipulation, ¹⁷ but also provide a reformulation of current psychotherapeutic core issues that take priority. This approach is based upon an integrationist approach as articulated by Albeniz & Holmes. ¹⁸ Core issues are identified early (some at assessment) in cooperation with the service user and addressed in therapy in a way designed as far as possible to suit the individual. The details of how these issues are addressed and how their evolution (and newly discovered issues) is further described are left to negotiation between the therapists and service user, provided the approach used is coherent to the therapists involved, the service user and supervisors. Therapy provision may also be adapted in terms of frequency, geographical location, style and content. Occasionally, elements of care such as crisis management or environmental manipulation may be handed over to other teams when it becomes apparent that these issues endanger the therapeutic alliance. Medication is prescribed by the doctors in the unit, or by the service user's current treating psychiatrist. ^19,20 Considerable time and effort is spent liaising with and influencing other parts of the mental health service involved in the care of our users.

Referrals (with a copy of patients' psychiatric files) are screened by a panel consisting of the potential assessors. The assessment process is led and supervised by the senior psychiatrists in the unit and is performed by the associate specialist (around 80% of all assessments) and senior therapists (predominantly one senior group therapist) who were trained after expressing an interest. The assessment consists of one to eight 1-hour long sessions, currently a mean of around 3 h, guided by a semi-structured set of questionnaires, and results in a case summary that is prepared according to agreed guidelines. Admission into the unit depends on discussions between the assessors and the senior doctors, based upon the prepared case summaries and the questioning of the assessor, and decisions may occasionally be postponed pending further assessment sessions.

We aimed to create a flexible responsive service, thus:

1. 1 The service would have a low drop-out rate and high retention rate; in those that did leave therapy, a mean of at least 6 months (150 days) of therapy would be achieved and 50% of discharged individuals would have completed therapy successfully.

2. 2 Over the course of treatment there would be a reduction in wider mental health service use and an improvement in symptoms of personality disorder; over time after referral to the service, change would be shown in reduced hospital admissions and their duration, as well as an improvement in the psychometric measures we use in our unit.

Method

This paper presents the findings of a longitudinal cohort study as the result of a naturalistic service evaluation we completed after our unit has been operational for around 3 years. All referred clients between January 2005 and April 2008 were included in this study. All assessed clients were asked to sign a consent form to use their data for audit and research purposes, and so far all users who provided us with psychometric data have signed the consent forms.

Data collection

Inclusion criteria for the unit are:

1. • age between 18 and 65 years

2. • personality disorder as a primary diagnosis (meaning that although there might be evidence of other

mental illness, personality disorder is seen as being the most important condition to address for the individual at the time of assessment; the presence of serious mental illness is therefore a relative rather than an absolute exclusion criterion).

Exclusion criteria are:

1. • being homeless

2. • significant forensic issues that cannot be safely contained in our unit

3. • very poor psychological mindedness

4. • insucient ego strength

5. • significant substance misuse that will disrupt therapy.

‘Poor psychological mindedness’ in our unit is located on the extreme end of the traditional psychological view of the concept, and is defined as an inability to accept and think about one's own role in the genesis and maintenance of problematic patterns of thinking, feeling and doing. The exclusion criterion of ‘insufficient ego strength’ is met when the post-assessment panel, after discussion with the assessor, judges the service user to be at risk of extreme impulsivity that would make it too dangerous to work with them, for example where hospitalisation is required, or judges them not to have the necessary inner resources to cope with even gentle explorative therapeutic approaches, therefore therapy would likely result in catastrophic decompensation. This criterion is very rarely used because assessment and treatment function as automatic screening processes, as individuals with very poor ego strength may find it difficult to apply themselves, although a patient, gentle, flexible approach may help to overcome hurdles in engagement.

Study design

All service users assessed for the full service are invited to complete a set of psychometric tests including the Personality Disorder Questionnaire version 4 (PDQ–4), ^21,22 Clinical Outcome Routine Evaluation (CORE), ²³ Social Anxiety and Distress Scale (SADS), ²⁴ Social Functioning Questionnaire (SFQ) ²⁵ and a modified version of the Standardised Assessment of Personality – Abbreviated Scale (SAPAS). ²⁶ This last scale was originally designed to have eight items rated as ‘yes’ and ‘no’, but this was converted to a 10-point Likert scale to make it better suited to measure change. The psychometric tests reported here are routinely used to aid diagnosis and monitor progress, and the individual results are discussed with service users in each review clinic. These measures were also used by the Department of Health who monitored our performance as a pilot. Ethical committee approval was obtained and service users signed consent forms to use their anonymised data.

We planned to repeat the CORE six-monthly and the PDQ–4 yearly to improve the rate of completed scales but due to a low rate of repeating ratings we decided to repeat all the ratings yearly. All rating scales are self-report and were filled by service users on computer. A reduction of the score would show an improvement, except for the SFQ which should show an increase in the score. Additionally, our trust's information department provided us with 5 years' service use data on all users accepted into our unit at least a year ago, allowing us to compare mental health service use for at least 1 year after being accepted into our unit with data from before their admission.

Data analysis

Service use data from before and after admission were compared with the χ²-test. Analysis was done using SPSS for Windows, version 15.

In the analyses of the psychometric test results, the Shapiro–Francia test and histograms were used to judge whether the scores for each subscale were normally distributed. When examining the difference in scores at assessment for those who responded and did not respond at follow-up, for those subscales that were normally distributed the two groups were examined using the unpaired t-test, and for those subscales that were not normally distributed the two groups were examined using the Mann–Whitney test.

In the set of analyses examining whether there was a change in scores over time for those users with scores on both occasions, for subscales where the change in scores was normally distributed the paired t-test was used to compare values between the two occasions, and for subscales where the change in scores was not normally distributed the Wilcoxon matched-pairs test was used to compare values between the two occasions. The significance of all results was judged on the P-value resulting from each test (P<0.05 is usually regarded as evidence of a statistically significant result). Only those psychometric tests were included in the analysis where the first measure was provided more than a year prior to April 2008.

Results

Service user characteristics

As can be seen from the referral pathway flowchart (Fig. 1), between January 2005 and April 2008 we had 501 referrals, 393 of which were for the full service and 108 for the ‘parallel service’. There were 379 women referred (76%), mean age 36 years (s.d. = 11.2) and 122 men, average age 37 years (s.d. = 10.8). Of the 337 individuals for whom we had ethnicity data, 327 (97%) were White British, five Asian British, one Black British and four of mixed race. We accepted six (60%) of those of Black and ethnic minority background into the service compared with 156 (48%) of the White British individuals referred.

Fig 1 Referral pathway flowchart.

Outcome of assessment

At the time of analysis, 62 of all referred individuals were either still being assessed or have been invited for assessment appointments. We screened out 54 (11%) of those referred for reasons such as the personality disorder not being the primary diagnosis, moving out of area, declining therapy, being referred to another service, or forensic issues. Of those individuals who did not complete the assessment procedure (n = 102, 20%), 67 never showed up after three appointment letters, 30 dropped out of assessment, and assessment was terminated early in cases where users moved out of the area or where it was discovered they had significant involvement with another service. Some individuals (n = 79, 16%) were assessed yet not offered a service, mainly for reasons of poor psychological mindedness (n = 22) and because there were other psychiatric diagnoses that required more urgent treatment (n = 39). Other reasons for not offering a service included the finding of insufficient ego strength in six individuals, and reasons such as declining the offer of therapy and being referred to another service.

Of 501 patients referred to our unit, 62 (12%) are still in the assessment pathway, whereas 283 (64% of the remainder) completed assessment. Of those assessed, 203 (72%) have been accepted into our service and 94 have so far been discharged from therapy (41 classed as ‘successful therapy’ and 38 disengaged from therapy). The main reason for not accepting a referred client into our service seems to be that a high proportion (102 clients in total, or 23% of those who had an opportunity to undergo assessment) either never showed up or dropped out of the assessment process. There is no significant difference in age between those who dropped out and those who successfully completed therapy or those who are currently in therapy (all around 36 years old), but a significantly higher proportion of those who never showed up for the assessment were male (22 out of 67) compared with 18 out of 79 currently in therapy (χ² = 0.01) or 15 out of 79 screened out after assessment (χ² = 0.02). When comparing the gender mix and age of those screened out after having completed assessment (n = 79) with those accepted into the outreach service and for individual therapy (n = 79), no significant differences were found with the χ²-test (0.39 and 0.17 respectively), although the mean age of those screened out is slightly higher (40 v. 35.6 years).

A total of 204 service users were accepted into treatment (including 21 accepted yet waiting for therapy to start), 139 into the full service and 65 into the ‘parallel service’. Of all those who were accepted and started treatment, 94 (52%) users have so far been discharged from our service: 41 (43% of all discharged) completed treatment successfully, 38 (40% of all discharged) disengaged from therapy, 4 discharged when we agreed (in supervision and the in the review clinic) that the benefit of treatment had reached a plateau, 4 moved out of area, 2 were found to have insufficient psychological mindedness, 3 declined therapy, and 2 were referred to another area.

The average number of treatment days in our unit (Table 1) for those who disengaged was 246 (s.d. = 191); for successfully treated, 213 (s.d. = 255); for those whose therapy plateaued, 485 (s.d. = 212); those found to have insufficient psychological mindedness, 118 (s.d. = 5); those who moved out of area, 432 (s.d. = 93); and those referred to another service, 266 (s.d. = 170).

Table 1 Days spent in the Olive Tree centre (excluding 21 clients awaiting parallel therapy)

		Duration in service, days
		Mean			s.d.
Discharge reason	n	No parallel activity	Parallel activity client	Total	No parallel activity	Parallel activity client	Total
Not discharged
Individual therapy	5	298.00		298.00	449.61		449.61
Outreach	74	492.99		492.99	332.52		332.52
Parallel therapy clients in treatment	(9)a		302	302		229	229
Did not engage	38 (13)a	287.88	161.42	246.86	205.83	124.61	191.29
Moved/lives out of area	4 (1)a	414.33	483.00	431.50	105.52		92.75
Not psychologically minded	2	117.50		117.50	4.95		4.95
Patient declined therapy	3 (3)a		0.00	0.00
Referred to another service	2	266.00		266.00	169.71		169.71
Successful therapy	41 (19)a	336.77	70.84	213.54	296.95	44.24	255.34
Therapy benefit plateaued	4	485.00		485.00	211.89		211.89
Patient discharged from therapy total	94 (36)a	319.93	114.12	245.30	240.97	114.23	226.53

In-patient days

Table 2 gives the number of days spent as an in-patient on a psychiatric ward for 95 clients who were accepted into our service at least a year before the survey. The χ²-test of the average days spent in hospital for the 3 years before compared with 3 years after being accepted into our service is highly significant (P = 0.00). Comparing the year before being accepted into our service with the year following, there has been an 82% reduction of days spent in hospital and a 52% reduction in the number of admissions.

Table 2 Hospital admissions for patients accepted into the Olive Tree centre more than a year before the survey

	Years before the survey	In-patient days, n		Total number of admissions	Patients in cohort n	Total number of patients applied to	Mean days per patient	Mean admissions per patient
		Total	s.d.
Years before admission	3-4	171	28.18	5		95	1.80	0.05
	2-3	260	12.78	8		95	2.74	0.08
	1-2	632	28.54	7		95	6.65	0.07
	0-1	853	26.72	23		95	8.98	0.24
Years since admission	0-1	157	7.81	11	37	95	1.65	0.12
	1-2	140	14.02	4	44	58	2.41	0.07
	2-3	1		0	14	14	0.07	0.00
	Total	2214	22.59	58	95		3.47	0.09

Psychometric test results

Initial rating scale results for service users assessed and accepted into the full service were compared for those who went on to provide a follow-up rating and those who did not (Table 3). An average of 86 users completed at least one scale before April 2007. Around 60% of those who completed the ratings on assessment went on to provide at least one follow-up rating. No significant differences on psychometric measures were found for most measures. Significant differences were found for the PDQ–4 subscales negativistic, histrionic and paranoid. A significant difference was also found for the SFQ. A high proportion (53%) of ratings scored high on the PDQ–4 subscale of ‘too good’, indicating that the scores may underestimate the severity of pathology. In the PDQ–4, the lowest scores were found in the categories of histrionic (4%), narcissistic (6%) and antisocial traits (19%), and the highest in avoidant (70%), borderline (61%), and impulsivity (58%) subscales, whereas the rest ranged between 30 and 47%. The fraction scoring within the clinical range of any scales on the CORE was 0.87 (s.d. = 0.33) and 0.37 (s.d. = 0.48) for the PDQ–4.

Table 3 Comparison of initial ratings of users who provided follow-up measures (Time 2) with those who did not

Scale	Subscale	n	Not responded at Time 2, mean (s.d.)	Responded at Time 2, mean (s.d.)	P
PDQ—4	Paranoid	87	11.7 (1.5)	10.8 (1.5)	*
	Schizotypal	86	13.8 (2.2)	13.4 (2.5)
	Histrionic	86	10.9 (1.5)	10.1 (1.4)	*
	Borderline	87	13.0 (2.0)	12.8 (1.6)
	Impulsivity	88	8.7 (1.6)	9.1 (1.6)
	Avoidant	87	13 (11, 13.5)	12 (11, 13)
	Antisocial	87	9.0 (1.6)	8.8 (1.6)
	Dependent	87	11.9 (2.1)	11.3 (2.0)
	Obsessive—compulsive	88	12.3 (1.6)	11.8 (1.7)
	Negativistic	85	10.7 (1.8)	9.8 (1.9)	*
	Depressive	86	12.2 (1.5)	12.6 (1.3)
	Suspect	88	2 (2, 2)	2 (2, 2)
	Narcissistic	88	11 (11, 13)	10 (10, 12)	**
	Schizoid	86	10 (9, 12)	11 (9.5, 12)
	Conduct disorder	87	17 (15, 19)	16 (15, 18)
	Suspect	88	2 (2, 2)	2 (2, 2)
	Too good	88	6.5 (0.9)	6.3 (0.9)
CORE	Functions	91	35.2 (5.4)	36.6 (5.8)
	Well-being	91	12 (11, 13)	12 (12, 13)
	Problems	90	51 (43, 54)	47 (40, 54)
	Risk	92	15 (6, 20)	14 (8, 20)
	All items	88	110 (18)	108 (18)
SADS		87	193 (55)	199 (48)
SFQ		89	16.1 (5.1)	18.0 (4.5)	**
Modified SAPAS		95	52 (46, 62)	54 (46, 60)
Satisfaction		41	73 (63, 77)	73 (66, 77)

Psychometric ratings for those service users for whom we have at least one measure in addition to the rating done at assessment are presented in Table 4. The mean number of days between measures is 300. Although all scales and subscales show an improvement in scores, changes at 5% significance are only for the CORE (all items, problems and risk subscales) and the PDQ–4 (borderline, depressive, schizoid, obsessive–compulsive subscales). Trait significance at 10% was observed in the SFQ, the functions subscale of the CORE and four subscales of the PDQ–4: paranoid, dependent, impulsivity and avoidant. Although there was an improvement in scores in the modified SAPAS, the SADS, the well-being subscale of the CORE (functions, well-being) and other subscales of the PDQ–4, this did not achieve statistical significance. There was little change in the PDQ–4 conduct disorder.

Table 4 Comparison of initial measures (Time 1) with follow-up measures (Time 2)

Scale	Subscale	n	Change from Time 1 to Time 2 Mean (95% CI)	P
PDQ—4	Paranoid	40	−0.5 (−1.0 to 0.0)
	Schizotypal	39	−0.6 (−1.4 to 0.3)
	Histrionic	37	−0.2 (−0.6 to 0.3)
	Narcissistic	39	−0.1 (−0.4 to 0.3)
	Borderline	40	−0.8 (−1.3 to −0.2)	**
	Antisocial	39	−0.3 (−0.7 to 0.1)
	Avoidant	39	−0.7 (−1.3 to 0.0)
	Dependent	40	−0.6 (−1.3 to 0.0)
	Obsessive—compulsive	38	−0.6 (−1.2 to −0.1)	*
	Negativistic	38	−0.4 (−0.9 to 0.2)
	Schizoid	40	−1 (−2 to 0)	**
	Impulsivity	38	0 (0 to 0.7)
	Conduct disorder	40	0 (0, 0)
	Depressive	39	0 (−1 to 0)	*
	Suspect	40	−0.1 (−0.2 to 0.1)
	Too good	40	0.1 (−0.19 to 0.42)
CORE	Well-being	53	0 (−1 to 1)
	Problems	53	−5.7 (−9.1 to −2.3)	**
	Functions	53	−0.6 (−2.5 to 1.2)
	Risk	53	−3.4 (−5.4 to −1.4)	**
	All items	50	−11.6 (−17.4 to −5.9)	***
SADS		35	−4.7 (−20.7 to 10.3)
SFQ		38	1.8 (−0.1 to 3.6)
Modified SAPAS		54	−2 (−3.7 to 2)

Discussion

We feel the evidence presented here suggests that our approach results in good engagement with an acceptable rate of discharge after successful therapy, even though we missed by 5% our target of 50% for discharge after successful therapy and mean duration of therapy in days markedly exceeded our target of 6 months. Bearing in mind the caveats described below, we feel that the evidence presented here suggests that our service had a broadly positive impact for our service users as shown in the outcomes from the psychometric tests used and has resulted in fewer days of hospital admission.

Assessment non-attendance

The relatively high number of referred clients who fail to attend for their first assessment appointment is an ongoing matter of concern and frustration, and perhaps more could be done to improve this. We continue to engage with referrers and we include information about our unit with all letters of invitation to the assessments. It is interesting that a disproportionate number of referred men never show up for their first appointment, but of those who do show up the drop-out rate appears to be low to normal. Although it can be speculated that the reason for this might be cultural and relates to stigma and male stereotyping, more needs to be understood about this finding.

In-patient days

The average duration of stay in our unit, even for those who eventually disengaged, is quite long in this difficult to engage population (246 days on average for those who dropped out of therapy). ²⁷ Furthermore, there has been a substantial reduction in the absolute and average number and duration of psychiatric hospital admissions. There is no control group against which to compare the size of this reduction and the trend seems to be an escalation of hospital admissions leading up to patients being accepted into our unit, with a sudden reduction of hospital use. One possible explanation is that patients are referred to us in the midst or towards the end of an episode of serious mental illness (which is only a relative exclusion criterion in our unit), which starts to resolve immediately before or shortly after their acceptance into our unit. Another possibility, not mutually exclusive, is that users tend to be referred to us at a time that their support networks are in various stages of collapse, perhaps for a variety of reasons related to the consequences of their personality disorder and how this interacts with the particular circumstances of their lives, and stage of life. In the absence of a control group, our unit cannot take credit for the immediate reduction of hospital use, as this might be the consequence of work done shortly before the referral to our unit. We would propose that our direct involvement, both through our lengthy assessments before being accepted into our unit, as well as the containing, supportive and therapeutic effect we believe our involvement has, helps to hasten recovery from episodes of mental illness and facilitate communication and healthy therapeutic relationships between our users and other parts of the mental health service.

Follow-up ratings

We only have 33–59 follow-up ratings per user for around 100 users who are or have been in our unit for a year or more. This reduces the statistical power of the measurements to find a significant change, yet the vast majority of ratings showed an improvement, with statistically significant improvements in numerous measures. Perhaps paradoxically, those who completed a follow-up rating scored higher on the subscales paranoia, histrionic, negativism, narcissism and worse on the SFQ, implying that the sample who provided follow-up measures were slightly more disturbed. The personality traits that showed markedly below significant improvement were narcissistic and histrionic traits. Anecdotally, narcissistic traits do improve with time but require a longer period of attachment, so change may only manifest with longer follow-up. The approach to narcissism in our unit has changed over time and it will be of interest to see how this measure changes in the future. It is interesting that although impulsive traits did not show a significant improvement on the PDQ–4, this seems at odds with an improvement of the CORE subscales of problems and risk, and the SFQ, all of which would seem to require improved impulsivity. Although this finding is not understood, one possibility is that the subjective view of impulsivity in general terms, as measured by the PDQ–4, lags behind reality, which may be better captured by the CORE and SFQ. Also, our unit does not formally provide teaching or training in emotion regulation, leaving this aspect to the individual therapist to attend to when appropriate and potential improvement in this area may be sacrificed for work in other areas.

Of interest are the clearly positive changes seen in ‘difficult to treat’ traits such as schizoid or anankastic traits. It is also interesting that the CORE well-being subscale, as well as the SADS, do not show a significant change, in contrast with the SFQ and the aggregate CORE, both of which show positive change. It appears from this that although improvement occurs in most measured areas, the subjective level of stress remains more or less constant. One interpretation of this may be that users are able to ‘push’ themselves in therapy, building new skills and experiences in preference to distress reduction. It should also be borne in mind that the psychometric tools we use can only be imperfect proxy measures of hypothesised underlying pathology and the dramatic change in the schizoid subscale, for example, may be measuring something other than true schizoid personality disorder pathology.

The modified SAPAS shows only a trend towards significance. This short rating scale may not be as sensitive as the more detailed rating scales for measuring actual or subjective change in personality pathology, and changes in this scale, as with compulsivity on the PDQ–4, may lag behind more sensitive measures.

Future directions

It is humbling to realise that the mean reduction in ratings of subscales was 5% both on the PDQ–4 (from 34 to 29%) and the CORE (from 98 to 93%). The wide standard deviation of scores on these measures indicate that there may only be a small proportion of service users who are sufficiently close to the cut-off mark on these tests to cross the boundary between being in the normal and clinical range, even with moderate improvement. There are service users who did substantially better than others and some individuals need longer to change their lives than others, therefore a future description of these subgroups might be of interest. Ideally, other indicators of successful therapy such as rates of self-harm, employment status, average annual income and other measures would be included in this paper. We have direct feedback from service users, provided individually and in forums, but this is not included in this article.

It may be important to compare our approach with other treatment models. We are also continuing to monitor progress with all the measures we presented in this paper in order to evaluate longer-term outcomes, including a more accurate idea of change and correlations between variables as hypothesised. The numbers of referred clients are also not an accurate reflection of our workload, as we only started to accept routine referrals from the end of 2005 onwards, and we have had an increased rate of referrals and completed assessments year on year so far.