Hostname: page-component-586b7cd67f-t7czq Total loading time: 0 Render date: 2024-11-30T19:11:55.180Z Has data issue: false hasContentIssue false

Substance use, risk behaviours and well-being after admission to a quasi-residential abstinence-based rehabilitation programme: 4-year follow-up

Published online by Cambridge University Press:  13 March 2023

Nina MacKenzie*
Affiliation:
Division of Psychiatry, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK; and NHS Lothian, Edinburgh, UK
Daniel J. Smith
Affiliation:
Division of Psychiatry, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK
Stephen M. Lawrie
Affiliation:
Division of Psychiatry, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK; and NHS Lothian, Edinburgh, UK
Andrew M. Rome
Affiliation:
Figure 8 Consultancy Services Ltd, Dundee, UK
David McCartney
Affiliation:
Lothian and Edinburgh Abstinence Programme, NHS Lothian, Edinburgh, UK
*
Correspondence: Nina MacKenzie. Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

Tackling Scotland's drug-related deaths and improving outcomes from substance misuse treatments, including residential rehabilitation, is a national priority.

Aims

To analyse and report outcomes up to 4 years after attendance at a substance misuse residential rehabilitation programme (Lothians and Edinburgh Abstinence Programme).

Method

In total, 145 participants were recruited to this longitudinal quantitative cohort study of an abstinence-based residential rehabilitation programme based on the therapeutic community model; 87 of these participants were followed up at 4 years. Outcomes are reported for seven subsections of the Addiction Severity Index-X (ASI-X), together with frequency of alcohol use, heroin use, injecting drug use and rates of abstinence from substances of misuse.

Results

Significant improvement in most outcomes at 4 years compared with admission scores were found. Completing the programme was associated with greater rates of abstinence, reduced alcohol use and improvements in alcohol status score (Mann–Whitney U = 626, P = 0.013), work satisfaction score (U = 596, P = 0.016) and psychiatric status score (U = 562, P = 0.007) on the ASI-X, in comparison with non-completion. Abstinence rates improved from 12% at baseline to 48% at 4 years, with the rate for those completing the programme increasing from 14.5% to 60.7% (χ2(2, 87) = 9.738, P = 0.002). Remaining abstinent from substances at follow-up was associated with better outcomes in the medical (U = 540, P < 0.001), psychiatric (U = 273.5, P < 0.001) and alcohol (U = 322.5, P < 0.001) subsections of the ASI-X.

Conclusions

Attending this abstinence-based rehabilitation programme was associated with positive changes in psychological and social well-being and harm reduction from substance use at 4-year follow-up, with stability of change from years 1 to 4.

Type
Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press on behalf of the Royal College of Psychiatrists

Higher-risk alcohol use and problematic drug use are significant issues in Scotland, causing damage to people's lives, families and communities. Tackling the high level of drug-related deaths in Scotland is a priority of the Scottish Government, which recently set out a National Mission to reduce drug deaths through improvements to treatment, recovery and other support services.1 This includes increasing capacity and improving access to residential rehabilitation. A review of existing literature conducted on behalf of the Scottish Government found a ‘relatively robust body of evidence suggesting that residential rehabilitation is associated with improvements across a variety of outcomes relating to substance use, health and quality of life’.2

Rome et al (2017) reported 6-month and 1-year outcomes following attendance at a quasi-residential rehabilitation programme, and found significant positive changes in participants’ physical health and social well-being and significant harm reduction in relation to alcohol and heroin use.Reference Rome, McCartney, Best and Rush3 The long-term impact of attendance at residential rehabilitation programmes is less frequently reported in the research literature but is an important aspect of examining the various stages of addiction and recovery. This paper specifically considers whether improvements in outcomes of the same cohort are maintained or otherwise at 4-year follow-up. Outcomes are reported for seven subsections of the Addiction Severity Index-X (ASI-X) interview tool, together with frequency of alcohol and heroin use, frequency of injecting drug use and rates of abstinence from substances of misuse.

Aims

To analyse and report outcomes up to 4 years after attendance at a residential substance misuse rehabilitation programme (the Lothians and Edinburgh Abstinence Programme).

Method

Setting

The Lothians and Edinburgh Abstinence Programme (LEAP) is a mixed-gender 12-week quasi-residential (treatment and accommodation are on different sites) drug and alcohol rehabilitation programme based on a therapeutic community model. Patients are housed in nearby hostel accommodation provided by the City of Edinburgh Council solely for LEAP patients and they attend the treatment facility for morning and afternoon sessions. The aim of LEAP is to make a positive difference to illicit drug use and harmful alcohol use and to positively influence various social indicators, including crime, training and employment, and social functioning. It is a 3-month-long day programme consisting of psychosocial interventions delivered by a team of NHS Lothian staff. The team includes medical staff (a general practitioner (GP) with special interest and a consultant psychiatrist), a pharmacist, clinical psychologist, therapists, registered mental health nurses, an occupational therapist, a peer support coordinator, peer support workers and administration support staff. Referrals are accepted from community mental health teams (CMHTs), GPs, third-sector community addiction support hubs (which work in collaboration with CMHTs), specialist in-patient detoxification services and criminal justice workers. Similar to other residential rehabilitation facilities, the programme consists of groups, meetings, duties, teaching and a focus on relationships and social roles within the community. There are one-to-one sessions with a therapist and group therapy, using a blend of therapeutic techniques, including cognitive–behavioural therapy. The community of patients and peer support workers act as an agent of change.4 Further additions to the LEAP model include physical and mental health assessment and care, housing and benefits support, family support, education, training and employability provision, aftercare for up to 2 years and assertive linkage to mutual aid before and during treatment. All patients are local to the Lothian area, which means that new social networks developed during treatment can continue to be accessed after treatment is concluded.Reference Rome, McCartney, Best and Rush3

Design

The study design was a longitudinal quantitative cohort study. This was chosen to allow the collection of data from a known cohort that had received the same intervention at set intervals over an extended period. The LEAP cohort included every patient admitted to the facility between April 2008 and March 2009. Participants had to be over 18 years of age, commencing a new treatment episode, prepared to give written consent to the tracking/follow-up procedures and willing to provide locator information. Severity of Dependence ScaleReference Gossop, Darke, Griffiths, Hando, Powis and Hall5 measures were used to ascertain the extent to which the baseline measures of the cohort were comparable in severity to other treatment-seeking populations in Scotland.

Sample

The study recruited 145 participants, of whom 87 were followed up at 4 years (Fig. 1). At treatment intake 71.7% of the participants were male, with a median age of 35 years; 68 (46.9%) participants reported having problem alcohol and drug use, 46 (31.7%) had problem alcohol use only and 31 (21.4%) had problem drug use only. Of the 99 participants who had problem drug use, 30 were using a single substance (with or without alcohol) and 69 were using two or more substances (with or without alcohol). Polydrug use was more common than single drug use. The most common substance of use was heroin, used by 39% of participants. Cannabis was used by 35% of participants, 29% used sedatives and 23% used methadone (illicit or prescribed) (Supplementary Table 7, available at https://dx.doi.org/10.1192/bjo.2023.23).

Fig. 1 Flowchart of follow-up rates at each time point.

Study participants who did not complete the full programme but who were followed up at 1 year and 4 years (‘non-graduates’) were used as a comparison group.

Ethical approval

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. All procedures involving human subjects/patients were approved by NHS Lothian Research Ethics Committee (REC ref. 08/S1101/25).

Outcome measures

The follow-up protocol used a semi-structured interview designed to provide information about key aspects of participants’ lives. Participants were interviewed on admission and at 6-month, 1-year and 4-year follow-up stages using the ASI-X, an updated and slightly expanded version of the EuropASI.Reference Kokkevi and Hartgers6Reference Scheurich, Müller, Wetze, Anghelescu, Klawe and Ruppe8 Sixty-six questions were used from the ASI-X. The current study analyses 7 subsets of the ASI-X (medical status, satisfaction with work, drug status, alcohol status, legal status, other social relationships and psychiatric status) recorded 4 years after leaving the programme. Further questions on interview included frequency of any alcohol use, frequency of heavy alcohol use (using the cut-off of more than 9 units per day on more than 10 days in the past 30 days, i.e. equating to more than 21 units of alcohol per week on average), frequency of heroin use, frequency of injecting drug use and abstinence status over the previous 30 days. The ASI-X subscales had acceptable to high levels of internal consistency as determined by Cronbach's alpha, as detailed by Rome et al (2017).Reference Rome, McCartney, Best and Rush3

Procedure

Clinical staff completed an ASI-X with each participant on intake according to the training and guidance manual. A follow-up ASI-X interview, completed by telephone, was conducted at 6 months, 1 year and 4 years post-treatment by independent researchers. The independent researchers had no relationship with the treatment provider and this was made clear to participants at each contact point. Participants were contacted by telephone or mail to arrange follow-up interviews. For those participants not contactable, additional methods were used to update details and increase the frequency of contact attempts. Every out-of-contact participant was phoned morning, afternoon and evening on each day of the working week (Monday to Friday).

Analysis

The responses were scored according to the ASI-X scoring guidance.Reference McLellan, Cacciola, Alterman, Rikoon and Carise9 These scores were then used to calculate composite scores for each section. The possible range of the ASI-X composite scores was between 0 and 1, where lower scores indicated more positive results.

Substance use and injecting drug use was measured as the total number of days that participants spent using each substance in the 30 days prior to the interview. Because of the use of 30-day measurement windows, the data do not provide a fully continuous coverage of the follow-up period. Abstinence rates were defined at baseline as free of substance use on admission to the programme, and at follow-up points as continuing abstinence.

Wilcoxon signed-rank tests were conducted to assess paired differences present between the various outcome measures from baseline to 4-year follow-up for the cohort as a whole, as well as for completers (‘graduate’) and non-graduate subgroups, and abstinent and non-abstinent subgroups. A correlation analysis (Spearman's rank-order correlation) was conducted to investigate stability of outcomes for individuals from the 1-year to 4-year follow-up points. Mann–Whitney U-tests were conducted to assess differences present between graduate and non-graduate participant groups on outcome measures at baseline and at 4-year follow-up interview. Where categorical data were analysed, χ2-tests were used. Further interpretation of results was conducted using descriptive statistics to illustrate the direction of any change for various outcome measures.

Results

The cohort was found to be slightly older in median age (35 v. 30 years) and similar in gender (72% v. 71% male) to the treatment-seeking population in Scotland at the time.10 Approximately 55% of the participants completed the rehabilitation programme (‘graduated’). Of the 125 participants available for follow-up at 4 years, 42% identified themselves as having problematic use of both alcohol and drugs, 35% reported an alcohol only problem and 22% reported problem drug use only. Retention in treatment to the completion of the programme was highest for those in the ‘alcohol only’ group, where 65.9% graduated (compared with 50% of those reporting ‘drug only’ problem use and 49% of those who reported having problematic alcohol and drug use). At 4-year follow-up there was proportionally a greater degree of attrition from the ‘drug only’ group (Table 1). This is consistent with other research studies.Reference Baker, Edmonds, Calvert, Sanders, Bridges and Rhea11,Reference Deane, Wootton, Hsu and Kelly12

Table 1 Characteristics at baseline and follow-up for those who completed treatment (‘graduates’) and those who did not (‘non-graduates’)

SDS, severity of dependence scale; IQR, interquartile range.

There was no significant difference in age (U = 1761, P = 0.395), Severity of Dependence Scale (SDS) scores (U = 2188.5, P = 0.199) or gender distribution (X 2 = 0.453, P = 0.501) between the graduate group and non-graduate group. There were no significant differences between the graduate and non-graduate groups at baseline in all outcomes except the medical status score; graduates’ medical status score at baseline was significantly worse (U = 1487, P = 0.023).

Baseline measures were compared between participants followed up at 4 years and those lost to follow-up. Those followed up spent significantly longer in treatment than those not followed up (mean 63.89 v. 49.45 days, U = 1216, P = 0.019). There were also more graduates followed up than non-graduates (X 2(1, 125) = 9.727, P = 0.002) (Supplementary Table 4). Those followed up were using alcohol more frequently at baseline than those not followed up (U = 1304.5, P = 0.044). There was no significant difference between the two groups on all other measures (Supplementary Table 5).

Baseline measures were compared with 4-year follow-up for all participants and then for two groups: graduates and non-graduates (Tables 2 and 3).

Table 2 Comparison of outcome measures from baseline to 1 year and 4 years post-treatment

IQR,  interquartile range; frequency, number of days on which the stated substance was used over the previous 30 days. Means are shown where we felt they are informative. Abstinence is shown as a proportion and was analysed using a χ 2-test.

a. Subscales of the Addiction Severity Index-X, composite scores range from 0–1, lower scores indicate more positive results.

Table 3 Comparison of outcomes for those who completed treatment (‘graduates’) with those who did not (‘non-graduates’)

Frequency, number of days on which the stated substance was used over the previous 30 days.

a. Subscales of the Addiction Severity Index-X.

Changes associated with attendance at the rehabilitation programme

For the group as a whole, there was a significant improvement from baseline to 4 years across all but three of the outcome measures, regardless of treatment completion. There was no significant difference from baseline to 4-year follow-up in the psychiatric and medical status subscores, regardless of the substance use group participants identified with (drugs, alcohol or both). There was a non-significant trend (P = 0.065) towards fewer days of alcohol use at 4-year follow-up. Abstinence rates rose from 12% to 30% at 1 year and to 48% at 4 years across the group as a whole (Table 2), with a statistically significant increase in the proportion of participants reporting abstinence at 4-year follow-up compared with baseline (baseline 15/125, 4-year 42/87, n = 87 P < 0.001).

Stability of change

Improvements seen at 1-year follow-up were maintained at 4-year follow-up, except for frequency of alcohol use, which increased at 4-year follow-up (Table 2). This comparison of 1-year data with 4-year data potentially demonstrates the maintenance of treatment effect. However, it is possible that the outcome measures at 1 year and 4 years could be identical, but that these could reflect scores for completely different subsets of individuals. For this reason, a correlation analysis (Spearman's rank-order correlation) was conducted to look at stability of outcomes for individuals. There was statistically significant moderate positive correlation between medical status scores (rs(65) = 0.400, P = 0.001), alcohol status (rs(65) = 0.253, P = 0.038), drugs status (rs(65) = 0.395, P = 0.001), legal status (rs(79) = 0.357, P = 0.001), psychiatric status (rs(65) = 0.529, P > 0.001), alcohol use (rs(65) = 0.380, P = 0.002) and heroin use (rs(65) = 0.396, P = 0.001). There was a positive correlation of moderate strength between these 1-year and 4-year subscores, which could be consistent with the view that there is stability of change over time.

There was no significant correlation between satisfaction with work scores (rs(65) = 0.219, P = 0.075), other relationships status scores (rs(65) = −0.060, P = 0.631) or frequency of injecting drug use (rs(65) = 0.161, P = 0.193) at 1 year and at 4 years. Closer inspection of the data revealed that although half of the participants improved their work satisfaction score from 1 year to 4 years, half worsened. There was further improvement in the other relationships subscores from 1 year to 4 years, although the change did not reach a level of significance. The sample size for injecting drug users was small and may lack statistical power.

Changes associated with programme completion

Graduates showed greater positive change in scores than non-graduates at 4 years for five outcome measures; work satisfaction, alcohol status, psychiatric status, heavy alcohol use and abstinence rates (Table 3). Graduates’ scores improved more than non-graduates’ scores for work satisfaction, alcohol status subscores and frequency of heavy alcohol use. The graduate group's psychiatric status score improved at 4-year follow-up, whereas the non-graduate group's score worsened. Both groups showed improved drug status, other relationship status, legal status, heroin use and injecting drug use outcome measure scores, with no significant difference in change scores. There was no significant change in medical status scores for either group. Both groups showed improved abstinence rates (Fig. 2), but the improvement was greater in the graduate group (χ2(2, 87) = 9.738, P = 0.002). The graduate group's abstinence rates rose from 14.5% (10/69) at baseline to 60.7% (34/56), compared with a change from 8.9% (5/56) to 25.8% (8/31) in the non-graduate group. When analysing results by substance use group, the results were significant for each of the three groups (the alcohol group's abstinence rate increased from 5/44 to 15/34, n = 34, P = 0.002; drugs only group increased from 3/28 to 10/15, n = 15, P = 0.012; alcohol and drugs group increased from 7/53 to 17/38, n = 38, P = 0.002).

Fig. 2 Abstinence rates at follow-up points for those who completed treatment (‘graduates’) and those who did not (‘non-graduates’).

Changes associated with abstinence

Baseline to 4-year outcomes were compared separately for those who reported being abstinent from all substances at 4 years and those who did not, and the change scores for the two groups were then compared (Supplementary Table 6).

For the group who were abstinent at 4 years, all ASI-X status outcome measures improved from baseline to follow-up. For the group who were not abstinent at 4 years, medical and psychiatric status scores worsened significantly, and there was no significant difference in the alcohol status composite score from baseline to follow-up. The change scores between the two groups differed significantly for medical status, alcohol status and psychiatric status. Remaining abstinent from substances at follow-up was associated with better outcomes in the medical, psychiatric and alcohol subsections.

Mortality

There were 12 deaths within the cohort over the 4-year follow-up period. Two of these deaths occurred 6–12 months after leaving the rehabilitation programme, two deaths occurred 1–2 years after, 5 occurred 2–3 years after and the remainder occurred over 3 years after leaving the programme. This mortality rate of 20.7 per 1000 people is approximately 5 times higher than that of the general population of Scotland under 75 years old in 2014.13 However, this rate is commensurate with mortality rates found in other cohort studies of drug users.Reference McKeganey, Bloor, McIntosh and Neale14,Reference Degenhardt, Hall and Warner-Smith15 Five of these deaths were classed as ‘drug-related’ in line with the definition of the Advisory Council on the Misuse of Drugs. The rate of drug-related deaths of 8.6 per 1000 is commensurate with national rates of drug-related deaths and local rates of drug-related deaths of 8.8 per 1000 problem drug users within Lothian Health Board.16 Alcohol-related health complications accounted for one-third of the deaths, and 25% of the deaths were secondary to respiratory conditions. Of the 12 participants who died, 8 had reported using both alcohol and drugs, 2 had reported only problem alcohol use and 2 had reported problem drug use only. Four of the participants who died had not completed LEAP, whereas the other eight had. Baseline outcome scores were not significantly different for these 12 participants in severity of dependence score, frequency of use of alcohol or heroin or ASI-X subsection scores. A high burden of physical illness in those admitted to in-patient substance misuse services has been described in the literature.Reference McKeganey, Bloor, McIntosh and Neale14,Reference Mogford and Lawrence17,Reference Bradley and Martin18

Discussion

Statement of principle finding

Attending the LEAP abstinence-based rehabilitation programme was associated with positive changes in psychological and social well-being and harm reduction from substance use at 4-year follow-up, demonstrating stability of change from 1-year to 4-year follow-up, regardless of whether the programme was completed or not. However, completing the full 12-week programme (55% of participants completed) was associated with drinking less alcohol and drinking less frequently, and with improvements in alcohol status score, work satisfaction score and psychiatric status score on the ASI-X, in comparison with non-completion. Abstinence rates improved from 12% at baseline to 30% at 1 year and 48% at 4 years. Similar abstinence rates at 1-year follow-up after residential rehabilitation were recorded by Gossop et al, who reported 33% at 1 year and 2 years, and 38% at 5 years.Reference Gossop, Marsden, Stewart and Rolfe19 This improvement in abstinence was most marked in those who graduated the programme, where rates rose from 14.5% to 60.7%. Further analysis of those who reported being abstinent from all substances at 4 years found significant improvement in medical, psychiatric and alcohol subsections, compared with those who were not abstinent. These results add to the growing evidence that positive changes in behaviour after residential rehabilitation for substance misuse can be maintained over time.

Relevance to other studies

Treatment retention, completion and continuing care post-discharge have been found to be significant predictors of recovery.Reference Rome, McCartney, Best and Rush3,Reference Eastwood, Peacock, Millar, Jones, Knight and Horgan20Reference Turner and Deane28

The association between programme completion and better outcomes demonstrated by our study has been found in previous larger-scale longitudinal cohort studies. Gossop et al, during a large multi-site cohort study of a variety of modes of treatment in England, reported that completion of both residential rehabilitation and in-patient detoxification programmes was predictive of positive outcomes and associated with a reduced risk of relapse.Reference Gossop, Marsden, Stewart and Treacy29 Teesson et al reported on a longitudinal Australian study that found more time spent in residential rehabilitation and successful completion of treatment were associated with reduced drug use and criminal behaviour and increased abstinence.Reference Teesson, Mills, Ross, Darke, Williamson and Havard25 Graduation from the treatment programme was of greater importance for sustained abstinence than programme type or length. This finding was supported by another Australian study, which found that significant predictors of treatment success were completion of primary index treatment and attendance at mutual aid. Further, for individuals with primarily problem alcohol use, abstinence was predicted by residential rehabilitation and mutual aid attendance.Reference Manning, Garfield, Best, Berends, Room and Mugavin26 Hubbard et al in the USA reported that participants who spent 90 days or more in long-term residential treatment had the most significant reductions in drug use and criminal activity and significant increases in rates of employment.Reference Hubbard, Craddock, Flynn, Anderson and Etheridge27 Further research has been conducted on factors affecting retention in treatment. Meier & Best found that retention rates for 90 days of residential treatment in the UK varied from 25 to 48%.Reference Meier and Best30 Programme-level factors associated with retention were primarily related to patient privacy, higher staff/patient ratio and domestic services support and individual counselling, with higher levels linked with greater patient retention. Greater programme intensity and higher numbers of beds per facility were both associated with lower retention rates for 90 days.

Our finding that the graduate group achieved and maintained abstinence to a greater degree than the non-graduates, and that abstinence was associated with improved outcomes, is also consistent with previous work. Gossop et al reported abstinence rates of 35.9% for participants in contact with residential rehabilitation services and 24.3% for those receiving methadone maintenance treatment at 2-year follow-up.Reference Gossop, Stewart, Browne and Marsden24,Reference Gossop, Marsden, Stewart and Treacy29 They found better rates of abstinence with treatments that have a clear abstinence focus, rather than a focus on harm reduction. A longitudinal cohort study of treatment outcomes associated with a range of treatment agencies in Scotland reported abstinence rates of 8% at 33-month follow-up, but when assessed according to mode of treatment this rate was 24.7% for those treated in residential rehabilitation services.Reference McKeganey, Bloor, Roberston, Neale and MacDougall31 In a comparison between abstinent and non-abstinent participants, abstinence was associated with reduced criminal behaviour, suicide/self-harm and alcohol misuse, and with improvements in employment and physical health. Teesson et al reported that heroin abstinence was more likely in a group who had engaged in residential rehabilitation, who also demonstrated lower criminality and lower likelihood of needle-sharing.Reference Teesson, Mills, Ross, Darke, Williamson and Havard25 Manning et al compared the effectiveness of linkage to 12-step mutual aid groups for 153 participants from a short-term in-patient detoxification. Assertive linkage to 12-step mutual aid groups led to more frequent attendance post-discharge, which was associated with improved abstinence.Reference Manning, Best, Faulkner, Titherington, Morinan and Keaney32 The importance of peer support and assertive linkage was underlined, and this adds to the literature on continuity of care.

The current findings that the frequency of alcohol use and quantity of alcohol consumed were reduced is important in the context of physical and psychological harm that result from problem alcohol use. Chronic alcohol misuse is an important cause of medical complications among drug misusers and has been found to be associated with increased risk of overdose and mortality.Reference Gossop, Marsden, Stewart and Kidd33 In the present study, 77% of participants identified themselves as having problem alcohol use, either alone or in combination with problem drug use. However, although frequency of alcohol use improved from baseline to 1-year follow-up, this was not maintained at 4 years, when there was an increase in use of alcohol (albeit still lower than at baseline). This has implications for clinicians and policymakers; excessive alcohol use and public health policies regarding alcohol may warrant a renewed focus.

Psychological and psychiatric problems are more prevalent among problem drug and alcohol users in treatment than in the general population. Improvement in psychological health and functioning is an important treatment goal in substance misuse. The current finding that positive improvements were observed in the psychiatric subscore of LEAP graduates, compared with a worsening score in non-graduates, suggests that gains in mental health can be achieved after completing residential treatment. It may be that the LEAP service is better placed and equipped to assess and address the psychiatric needs of their patients, in comparison with other treatment models (such as short-term detoxification treatments or methadone maintenance treatment).Reference Cleary, Hunt, Matheson and Walter34,Reference Bergman, Greene, Slaymaker, Hoeppner and Kelly35 Additionally, participants who reported that they were abstinent at 4-year follow-up had significantly improved psychiatric and medical status scores, indicating gains are more likely in physical and mental health if abstinence is maintained. This has important service development implications, highlighting the importance of thorough psychiatric assessment in routine clinical practice and the positive impact of retaining individuals in treatment. A failure to adequately address psychiatric problems leads to poorer outcomes from substance misuse treatment.Reference McKeganey, Bloor, McIntosh and Neale14,Reference Gossop, Marsden, Stewart and Treacy29 This implies the importance of enhanced training for staff in both psychiatric settings and substance misuse services, and the importance of strong links between mental health services and substance misuse services.

Strengths and weaknesses of the study

The findings outlined above should be interpreted cautiously. This kind of naturalistic longitudinal cohort study design does not permit changes observed to be attributed directly to the impact of residential treatment. We have identified an association between outcome measures and the intervention, rather than a causal explanation. Residential rehabilitation typically forms one of multiple interactions with substance use treatment services, and delineating which of these treatments has produced specific outcomes in the longer-term is therefore challenging. However, studies of this design allow investigation of treatment outcomes under normal clinical practice conditions and are valuable in helping to identify what works in practice, even though control over aspects of evaluation design are more limited than in other experimental studies. Regardless of whether the results are directly attributable to the treatment programme, the outcomes reflect the participants’ recovery progress over 4 years. The discovery that outcomes were better for those who completed the residential programme compared with those who did not would support the conclusion that at least some of the positive outcomes at 4 years is attributable to the intervention.

The assessment of change over time post-treatment can be affected by many factors. Participants may experience change, either positive or negative, in aspects of their lives that leads them to decide not to participate further, and people with drug and alcohol problems are often socially and geographically transient and lose touch with researchers. Several studies provide good evidence that tracking patient outcomes over time post-discharge through use of validated assessment measures can provide important insights into recovery trajectories.Reference King, Dow and Stevenson21,Reference Bergman, Greene, Slaymaker, Hoeppner and Kelly35,Reference Schoenthaler, Blum, Fried, Oscar-Berman, Giordano and Modestino36 However, attrition from research follow-ups was a major methodological limitation for many studies. A notable strength of this study was the high baseline recruitment of 100% of eligible patients and good retention rates over an extended period of time (60% of the original cohort and 70% of those available for follow-up at 4 years). Analysis showed that there were no pre-treatment differences between those who were followed up and those who were not. Those successfully interviewed at 4 years had spent more time in rehab and a greater proportion had completed treatment. The improvements we have obtained may be from a group of individuals who were better placed to maintain their lifestyle changes compared with those not followed up. Higher rates of assessment data at all collection time points would have increased the generalisability of study results and limited any potential systematic bias (the potential that those who were followed up differed systematically from those who were not).

The use of 30-day measurement windows and relying on self-reported levels of substance use mean that the data do not provide a fully continuous coverage of the follow-up period and are reliant on accurate self-reporting. Neale & Robertson found a high level of consistency between self-reported drug use and oral fluid testing, in fact discovering that respondents commonly reported consumption that screening failed to identify.Reference Neale and Robertson37 The use of the extensive, validated and reliable ASI-X outcome measure allows the accurate study of a range of domains. A growing number of studies have used the ASI to measure change in substance use, which improves comparability of outcomes across studies and enables the examination of treatment effects on a range of life domains.Reference De Andrade, Elphinston, Quinn, Allan and Hides38Reference Bultler, Budman, Goldman, Newman, Beckley and Trottier41

Future directions

Ongoing research is required to further delineate the mechanisms by which residential rehabilitation generates outcomes and the ways in which these differ from other treatment modalities. Given the greater change associated with retention in treatment, it would be important to understand what factors are associated with treatment completion and to design residential services to maximise retention in treatment. Understanding the factors that promote abstinence will allow more focused interventions and support and lead to improved long-term outcomes for problem substance users. Residential rehabilitation services can be uniquely placed to offer increased support for physical and mental health issues, to help develop a supportive network of peers and to encourage integration into a wider treatment network. Future research could explore the effect of strong links between community services and rehabilitation programmes, supporting patients before, during and after rehabilitation, on the stability of recovery over time.

Our findings provide an encouraging view of residential rehabilitation programmes. Wherever an individual lives in Scotland they should be able to access an array of substance use services, both harm reduction and abstinence focused, at the point of need.

Supplementary material

Supplementary material is available online at https://doi.org/10.1192/bjo.2023.23.

Data availability

The data that support the findings of this study are available from the corresponding author on reasonable request. The data are not publicly available because they contain information that could compromise the privacy of research participants.

Acknowledgements

We thank Robert Rush, statistician at Queen Margaret University Edinburgh, for his assistance with accessing the data-set.

Author contributions

N.M. accessed, analysed and interpreted the data for the study and drafted the paper. A.M.R. collected the data, and A.M.R. and D.M. designed the study and contributed to the analysis and interpretation of the data. D.J.S. and S.M.L. contributed to the interpretation of the data and drafting of the paper. All authors contributed to the final edits of the approved version.

Funding

This research received no specific grant from any funding agency, commercial or not-for-profit sectors.

Declaration of interest

S.M.L. is a member of the BJPsych Open editorial board and did not take part in the review or decision-making process of this paper.

References

Minister for Drugs Policy. National Mission on Drug Deaths: Plan 2022–2026. Scottish Government, 2022.Google Scholar
Director-General Health and Social Care. Residential Rehabilitation: A Review of the Existing Literature and Identification of Research Gaps within the Scottish Context. Scottish Government, 2022.Google Scholar
Rome, AM, McCartney, D, Best, D, Rush, R. Changes in substance use and risk behaviours one year after treatment: outcomes associated with a quasi-residential rehabilitation service for alcohol and drug users in Edinburgh. J Groups Addict Recov 2017; 12: 8698.CrossRefGoogle Scholar
Clinical Guidelines on Drug Misuse and Dependence Update 2017 Independent Expert Working Group. Drug Misuse and Dependence: UK Guidelines on Clinical Management. Department of Health, 2017.Google Scholar
Gossop, M, Darke, S, Griffiths, P, Hando, J, Powis, B, Hall, W, et al. The Severity of Dependence Scale (SDS): psychometric properties of the SDS in English and Australian samples of heroin, cocaine and amphetamine users. Addiction 1995; 90: 607–14.10.1046/j.1360-0443.1995.9056072.xCrossRefGoogle ScholarPubMed
Kokkevi, A, Hartgers, C. EuropASI: European adaptation of a multidimensional assessment instrument for drug and alcohol dependence. Eur Addict Res 1995; 1: 208–10.CrossRefGoogle Scholar
Tengvald, K, Andren, A, Bergman, H, Engstrom, C, Nystrom, S, Sallmen, B, et al. Implementing the Addiction Severity Index (ASI) in Swedish human services sectors: Experiences, problems and prospects. J Subst Use 2004; 9: 163171.CrossRefGoogle Scholar
Scheurich, A, Müller, MJ, Wetze, H, Anghelescu, I, Klawe, C, Ruppe, A, et al. Reliability and validity of the German version of the European Addiction Severity Index (EuropASI). J Stud Alcohol 2000; 61: 916–9.CrossRefGoogle ScholarPubMed
McLellan, A, Cacciola, JC, Alterman, AI, Rikoon, SH, Carise, D. The Addiction Severity Index at 25: origins, contributions and transitions. Am J Addict 2006; 15: 113–24.CrossRefGoogle ScholarPubMed
Information Services Division (Scotland). Drug Misuse Statistics Scotland 2009. Scottish Drug Misuse Database, 2010.Google Scholar
Baker, DE, Edmonds, KA, Calvert, ML, Sanders, SM, Bridges, AJ, Rhea, MA, et al. Predicting attrition in long-term residential substance use disorder treatment: a modifiable risk factors perspective. Psychol Serv 2020; 17: 472–82.CrossRefGoogle ScholarPubMed
Deane, FP, Wootton, DJ, Hsu, CI, Kelly, PJ. Predicting dropout in the first 3 months of 12-step residential drug and alcohol treatment in an Australian sample. J Stud Alcohol Drugs 2012; 73: 216–25.CrossRefGoogle Scholar
National Records of Scotland. Age-Standardised Death Rates Calculated Using the European Standard Population. National Records of Scotland, 2022: Table 6.Google Scholar
McKeganey, N, Bloor, M, McIntosh, J, Neale, J. Key Findings from the Drug Outcome Research in Scotland (DORIS) Study. University of Glasgow Centre for Drug Misuse Research, 2008.Google Scholar
Degenhardt, L, Hall, W, Warner-Smith, M. Using cohort studies to estimate mortality among injecting drug users that is not attributable to AIDS. Sex Transm Infect 2006; 82(suppl III): 5663.CrossRefGoogle Scholar
National Records of Scotland. Drug Related Deaths in Scotland 2014: a national statistics publication for Scotland. National Records of Scotland, 2015.Google Scholar
Mogford, DV, Lawrence, RJ. Medical comorbidity and projected survival of patients admitted to a specialist addictions in-patient unit. BJPsych Bull 2016; 40: 255–60.CrossRefGoogle ScholarPubMed
Bradley, A, Martin, A. Reviewing the burden of comorbidity in patients receiving specialist in-patient treatment for drug and alcohol problems. BJPsych Bull 2020; 44: 153–8.10.1192/bjb.2020.4CrossRefGoogle ScholarPubMed
Gossop, M, Marsden, J, Stewart, D, Rolfe, A. Treatment retention and 1 year outcomes for residential programmes in England. Drug Alcohol Depend 1999; 57: 8998.10.1016/S0376-8716(99)00086-1CrossRefGoogle ScholarPubMed
Eastwood, B, Peacock, A, Millar, T, Jones, A, Knight, J, Horgan, P, et al. Effectiveness of inpatient withdrawal and residential rehabilitation interventions for alcohol use disorder: a national observational, cohort study in England. J Subst Abuse Treat 2018; 88: 18.10.1016/j.jsat.2018.02.001CrossRefGoogle ScholarPubMed
King, J, Dow, J, Stevenson, B. Measuring outcomes for TC clients: higher ground drug rehabilitation trust. Ther Commun 2016; 37: 121–30.Google Scholar
Malivert, M, Fatséas, M, Denis, C, Langlois, E, Auriacombe, M. Effectiveness of therapeutic communities: a systematic review. Eur Addict Res 2012; 18: 111.CrossRefGoogle ScholarPubMed
Vanderplasschen, W, Colpaert, K, Autrique, M, Rapp, RC, Pearce, S, Broekaert, E, et al. Therapeutic communities for addictions: a review of their effectiveness from a recovery-oriented perspective. ScientificWorldJournal 2013: 22: 427817.Google ScholarPubMed
Gossop, M, Stewart, D, Browne, N, Marsden, J. Factors associated with abstinence, lapse or relapse to heroin use after residential treatment: protective effect of coping responses. Addiction 2002; 97: 1259–67.CrossRefGoogle ScholarPubMed
Teesson, M, Mills, K, Ross, J, Darke, S, Williamson, A, Havard, A. The impact of treatment on 3 years’ outcome for heroin dependence: findings from the Australian Treatment Outcome Study (ATOS). Addiction 2008; 103: 80–8.CrossRefGoogle ScholarPubMed
Manning, V, Garfield, JB, Best, D, Berends, L, Room, R, Mugavin, J, et al. Substance use outcomes following treatment: findings from the Australian Patient Pathways Study. Aus N Z J Psychiatry 2016; 51: 177–89.10.1177/0004867415625815CrossRefGoogle ScholarPubMed
Hubbard, RL, Craddock, SG, Flynn, PM, Anderson, J, Etheridge, RM. Overview of 1-year follow-up outcomes in the Drug Abuse Treatment Outcome Study (DATOS). Psychol Addict Behav 1997; 11: 261–78.CrossRefGoogle Scholar
Turner, B, Deane, FP. Length of stay as a predictor of reliable change in psychological recovery and well-being following residential substance abuse treatment. Ther Communities 2016; 37: 112–20.CrossRefGoogle Scholar
Gossop, M, Marsden, J, Stewart, D, Treacy, S. Change and stability of change after treatment of drug misuse: 2 year outcomes from the National Treatment Outcome Research Study (UK). Addict Behav 2002a; 27: 155–66.CrossRefGoogle ScholarPubMed
Meier, PS, Best, D. Programme factors that influence completion of residential treatment. Drug Alcohol Rev 2006; 25: 349–55.CrossRefGoogle ScholarPubMed
McKeganey, N, Bloor, M, Roberston, M, Neale, J, MacDougall, J. Abstinence and drug abuse treatment: results from the Drug Outcome Research in Scotland study. Drugs: Edu, Prev Policy 2006; 13: 537–50.Google Scholar
Manning, V, Best, D, Faulkner, N, Titherington, E, Morinan, A, Keaney, F, et al. Does active referral by a doctor or 12-step peer improve 12-step meeting attendance? Results from a pilot randomised control trial. Drug Alcohol Depend 2012; 126: 131–7.CrossRefGoogle ScholarPubMed
Gossop, M, Marsden, J, Stewart, D, Kidd, T. The National Treatment Outcome Research Study (NTORS): 4–5 year follow-up results. Addiction 2003; 98: 291303.CrossRefGoogle ScholarPubMed
Cleary, M, Hunt, GE, Matheson, S, Walter, G. Psychosocial treatments for people with co-occurring severe mental illness and substance misuse: systematic review. J Adv Nurs 2009; 65: 238–58.CrossRefGoogle ScholarPubMed
Bergman, BG, Greene, MC, Slaymaker, V, Hoeppner, BB, Kelly, JF. Young adults with co-occurring disorders: substance use disorder treatment response and outcomes. J Subst Abuse Treat 2014; 46: 420–8.CrossRefGoogle ScholarPubMed
Schoenthaler, SJ, Blum, K, Fried, L, Oscar-Berman, M, Giordano, J, Modestino, EJ, et al. The effects of residential dual diagnosis treatment on alcohol abuse. J Syst Integr Neurosci 2017; 3(4): 10.15761/JSIN.CrossRefGoogle ScholarPubMed
Neale, J, Robertson, M. Comparisons of self-report data and oral fluid testing in detecting drug use among new treatment clients. Drug Alcohol Depend 2003; 71: 5764.CrossRefGoogle ScholarPubMed
De Andrade, D, Elphinston, RA, Quinn, C, Allan, J, Hides, L. The effectiveness of residential treatment services for individuals with substance use disorders: a systematic review. Drug Alcohol Depend 2019; 201: 227–35.CrossRefGoogle ScholarPubMed
Deane, FP, Kelly, PJ, Crowe, TP, Coulson, JC, Lyons, GC. Clinical and reliable change in an Australian residential substance use program using the addiction severity index. J Addict Dis 2013; 32: 194205.CrossRefGoogle Scholar
Bovasso, GB, Alterman, AI, Cacciola, JS, Cook, TG. Predictive validity of the Addiction Severity Index's composite scores in the assessment of 2-year outcomes in a methadone maintenance population. Psychol Addict Behav 2001; 15: 171–6.CrossRefGoogle Scholar
Bultler, SF, Budman, SH, Goldman, RJ, Newman, FJ, Beckley, KE, Trottier, D, et al. Initial validation of a computer-administered Addiction Severity Index: the ASI–MV. Psychol Addict Behav 2001; 15: 412.CrossRefGoogle Scholar
Figure 0

Fig. 1 Flowchart of follow-up rates at each time point.

Figure 1

Table 1 Characteristics at baseline and follow-up for those who completed treatment (‘graduates’) and those who did not (‘non-graduates’)

Figure 2

Table 2 Comparison of outcome measures from baseline to 1 year and 4 years post-treatment

Figure 3

Table 3 Comparison of outcomes for those who completed treatment (‘graduates’) with those who did not (‘non-graduates’)

Figure 4

Fig. 2 Abstinence rates at follow-up points for those who completed treatment (‘graduates’) and those who did not (‘non-graduates’).

Supplementary material: File

MacKenzie et al. supplementary material

Tables S4-S7

Download MacKenzie et al. supplementary material(File)
File 172.7 KB
Submit a response

eLetters

No eLetters have been published for this article.