Hostname: page-component-669899f699-2mbcq Total loading time: 0 Render date: 2025-05-01T08:00:02.791Z Has data issue: false hasContentIssue false

Virtual reality therapy targeting ideas of reference in patients with psychosis: a single-blind parallel-group randomized controlled trial

Published online by Cambridge University Press:  28 April 2025

EunJin Jeon
Affiliation:
Department of Psychiatry, Jeonbuk National University Medical School, Jeonju, Republic of Korea
Ling Li
Affiliation:
Department of Psychiatry, Jeonbuk National University Medical School, Jeonju, Republic of Korea Research Institute of Clinical Medicine, Jeonbuk National University-Biomedical Research Institute of Jeonbuk National University Hospital, Jeonju, Republic of Korea
Thi-Hung Le
Affiliation:
Department of Psychiatry, Jeonbuk National University Medical School, Jeonju, Republic of Korea Research Institute of Clinical Medicine, Jeonbuk National University-Biomedical Research Institute of Jeonbuk National University Hospital, Jeonju, Republic of Korea
Woo-Sung Kim
Affiliation:
Department of Psychiatry, Jeonbuk National University Medical School, Jeonju, Republic of Korea Research Institute of Clinical Medicine, Jeonbuk National University-Biomedical Research Institute of Jeonbuk National University Hospital, Jeonju, Republic of Korea
Soyolsaikhan Odkhuu
Affiliation:
Department of Psychiatry, Jeonbuk National University Medical School, Jeonju, Republic of Korea Research Institute of Clinical Medicine, Jeonbuk National University-Biomedical Research Institute of Jeonbuk National University Hospital, Jeonju, Republic of Korea
Chae Yeong Kang
Affiliation:
Department of Psychiatry, Jeonbuk National University Medical School, Jeonju, Republic of Korea Research Institute of Clinical Medicine, Jeonbuk National University-Biomedical Research Institute of Jeonbuk National University Hospital, Jeonju, Republic of Korea
Ariana Setiani
Affiliation:
Department of Psychiatry, Jeonbuk National University Medical School, Jeonju, Republic of Korea Research Institute of Clinical Medicine, Jeonbuk National University-Biomedical Research Institute of Jeonbuk National University Hospital, Jeonju, Republic of Korea
Fatima Zahra Rami
Affiliation:
Department of Psychiatry, Jeonbuk National University Medical School, Jeonju, Republic of Korea Research Institute of Clinical Medicine, Jeonbuk National University-Biomedical Research Institute of Jeonbuk National University Hospital, Jeonju, Republic of Korea
Young-Chul Chung*
Affiliation:
Department of Psychiatry, Jeonbuk National University Medical School, Jeonju, Republic of Korea Research Institute of Clinical Medicine, Jeonbuk National University-Biomedical Research Institute of Jeonbuk National University Hospital, Jeonju, Republic of Korea
*
Corresponding author: Young-Chul Chung; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

No studies have investigated the effects of virtual reality (VR) on the persecutory idea of reference (IOR) or delusions of reference (DOR) in patients with psychosis. This study examined the efficacy and safety of VR therapy in stable outpatients with psychosis and explored relationships between primary outcomes and psychological factors using path analysis.

Methods

Seventy-eight patients were randomly assigned to either the VR-treatment (VR-T) or VR-control (VR-C) group. The VR-T group viewed three 360° 3D videos or four animated videos; the VR-C group viewed the same seven videos with muted voices or 11 360° 3D videos of natural scenes. Pre- and post-assessments were performed using the Psychotic Symptom Rating Scale-Delusions (PSYRATS-D) and Revised Green et al. Paranoid Thought Scale (R-GPTS) as a primary outcome measure. Several self-rating scales measuring schema, depression, brooding, negative evaluation, attribution bias, and self-esteem were administered. Safety was assessed after sessions 1 and 10, and path models were constructed.

Results

Between-group analysis showed a significant improvement in PSYRATS-D scores in the VR-T group compared with the VR-C group. Regarding self-rating scales, the between-group analysis revealed a significant group × time interaction only for the Social and Occupational Functioning Assessment Scale (SOFAS) score. The frequency of VR sickness was high, but its severity was mild. Fear of Negative Evaluation Scale and Beck Depression Inventory scores were found to have mediating roles.

Conclusions

VR therapy effectively reduced delusions in young, stable psychosis patients with mild and tolerable side effects. Future studies should develop diverse VR content for older populations.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press

Introduction

Ideas of reference (IOR) involve self-attributions about events in one’s surroundings, particularly in social contexts, where unimportant stimuli are interpreted as being directed at oneself (Colori, Reference Colori2017). IOR, among the most common symptoms of psychotic disorders (World Health Organization, 1973), also are observed in various other conditions, including mood and personality disorders (Colori, Reference Colori2017; Meyer & Lenzenweger, Reference Meyer and Lenzenweger2009). They often emerge during the prodromal period of psychosis (Bendala-Rodríguez, Senín-Calderón, Peluso-Crespi, & Rodríguez-Testal, Reference Bendala-Rodríguez, Senín-Calderón, Peluso-Crespi and Rodríguez-Testal2019) and appear in the residual phase of schizophrenia spectrum disorders (SSDs) (Schennach et al., Reference Schennach, Riedel, Obermeier, Spellmann, Musil, Jäger and Naber2015). Many stable outpatients with psychosis report ongoing IOR of a persecutory nature and mild persecutory delusions. Psychological factors or states linked to the development of IOR and persecutory delusions include attributional bias (Kaney & Bentall, Reference Kaney and Bentall1989; Kinderman & Bentall, Reference Kinderman and Bentall1996), depression (Rodríguez-Testal, Bendala-Rodríguez, Perona-Garcelán, & Senín-Calderón, Reference Rodríguez-Testal, Bendala-Rodríguez, Perona-Garcelán and Senín-Calderón2019), low self-esteem (Cicero & Kerns, Reference Cicero and Kerns2011), negative beliefs about the self and others (Freeman et al., Reference Freeman, Garety, Kuipers, Fowler and Bebbington2002; Lyon, Kaney, & Bentall, Reference Lyon, Kaney and Bentall1994), rumination (Wong et al., Reference Wong, Hui, Wong, Suen, Chan, Lee, Chang and Chen2021), and social-evaluative concerns (Freeman et al., Reference Freeman, Garety, Bebbington, Smith, Rollinson, Fowler and Dunn2005). A comprehensive understanding of how these factors interact with each other using path analysis might help in targeting core symptoms in the treatment of patients with IOR.

Virtual reality (VR) has been identified as a potentially revolutionary tool for treating mental disorders. VR can be used to trigger cognitive, emotional, physiological, and behavioral responses to simulated real-life situations (Martens et al., Reference Martens, Antley, Freeman, Slater, Harrison and Tunbridge2019) while offering consistent, controlled, graded, repetitive, and systematic therapeutic training (Freeman et al., Reference Freeman, Reeve, Robinson, Ehlers, Clark, Spanlang and Slater2017). In the field of psychosis, the safety and acceptability of VR were initially tested (Fornells-Ambrojo et al., Reference Fornells-Ambrojo, Barker, Swapp, Slater, Antley and Freeman2008; Valmaggia et al., Reference Valmaggia, Freeman, Green, Garety, Swapp, Antley and McGuire2007), followed by evaluations of its effects on cognition and symptoms (Fajnerová et al., Reference Fajnerová, Rodriguez, Levčík, Konrádová, Mikoláš, Brom and Horáček2014; Ruse et al., Reference Ruse, Harvey, Davis, Atkins, Fox and Keefe2014; Veling et al., Reference Veling, Pot-Kolder, Counotte, van Os and van der Gaag2016). The application of VR has gradually expanded to cognitive remediation, social skills training, vocational training, and the treatment of delusions and auditory hallucinations (Rus-Calafell et al., Reference Rus-Calafell, Garety, Sason, Craig and Valmaggia2018). Seven studies have used VR therapy to manage persecutory delusions, paranoia, and agoraphobic avoidance (Dellazizzo, Potvin, Phraxayavong, & Dumais, Reference Dellazizzo, Potvin, Phraxayavong and Dumais2021; Freeman et al., Reference Freeman, Bradley, Antley, Bourke, DeWeever and Evans2016, Reference Freeman, Lambe, Kabir, Petit, Rosebrock, Yu and O’Regan2022; Gega et al., Reference Gega, White, Clarke, Turner and Fowler2013; Geraets et al., Reference Geraets, Snippe, van Beilen, Pot-Kolder, Wichers, van der Gaag and Veling2020; Moritz et al., Reference Moritz, Voigt, Köther, Leighton, Kjahili, Babur and Grzella2014; Pot-Kolder et al., Reference Pot-Kolder, Geraets, Veling, van Beilen, Staring, Gijsman and van der Gaag2018). However, only four of those studies were randomized controlled trials (RCT) involving multiple sessions. Among these, two measured IOR by using the Green et al. Paranoid Thought Scale (GPTS) (Pot-Kolder et al., Reference Pot-Kolder, Geraets, Veling, van Beilen, Staring, Gijsman and van der Gaag2018) or Revised Green et al. Paranoid Thought Scale (R-GPTS) (Freeman et al., Reference Freeman, Lambe, Kabir, Petit, Rosebrock, Yu and O’Regan2022). The former observed significant improvement of IOR with 16 sessions but the latter no improvement with 6 sessions. It is of note that the baseline score of the GPTS in the former was modestly high and the score of the R-GPTS in the latter was low and similar to ours. In Dellazizzo et al. study (Reference Dellazizzo, Potvin, Phraxayavong and Dumais2021), the target subjects were patients with treatment-resistant schizophrenia and 9 sessions were provided. In Geraets et al. study (Geraets et al., Reference Geraets, Snippe, van Beilen, Pot-Kolder, Wichers, van der Gaag and Veling2020), although patients were recruited with the inclusion criteria of GPTS >40, the outcome measure was an experience sampling method, and 16 sessions were performed. All three non-RCT employed one session. Although Gega et al. study (Gega et al., Reference Gega, White, Clarke, Turner and Fowler2013) used GPTS, they reported only the total score and the number of participants was 6. Several VR studies conducted in Asian countries have mainly focused on social skills and vocational training (Chan, Ngai, Leung, & Wong, Reference Chan, Ngai, Leung and Wong2010; Ku et al., Reference Ku, Han, Lee, Jang, Kim, Park and Kim2007; Park et al., Reference Park, Ku, Choi, Jang, Park, Kim and Kim2011; Tsang & Man, Reference Tsang and Man2013); only one investigated VR-based mindfulness training (Lee et al., Reference Lee, Kim, Lee, Won, Park, Kang and Chung2023). Based on the review of relevant literature, we hypothesized that VR therapy with longer sessions would lead to a reduction in IOR or delusion of reference (DOR) in stable outpatients with psychosis and its therapeutic effects could be mediated by the influence on the psychological factors mentioned above.

The present study aimed to evaluate the efficacy and safety of VR treatment (VR-T) for persecutory IOR and DOR in stable outpatients with psychosis. The primary outcome measures were Psychotic Symptom Rating Scale-Delusions (PSYRATS-D) and Revised Green et al. Paranoid Thought Scale (R-GPTS). In addition, path analysis was conducted to examine direct, indirect, and mediation effects related to the primary outcome measures and pre-defined psychological factors (attributional bias, depression, low self-esteem, negative beliefs, rumination, and social-evaluative concerns).

Methods

Participants

Patients were recruited from six psychiatric outpatient clinics – Jeonbuk National University Hospital, Kyungpook National University Hospital, Chonnam National University Hospital, Catholic University of Korea Seoul St. Mary’s Hospital, Yeungnam University Medical Center, and Inje University Haeundae Paik Hospital – between August 2022 and May 2024. The inclusion criteria were as follows: diagnosis of an SSD (schizophrenia, schizoaffective disorder, or schizophreniform disorder) or another psychotic disorder (other specified schizophrenia spectrum and other psychotic disorders, and unspecified schizophrenia spectrum and other psychotic disorders), age 15–59 years, and stable outpatient status with no medication changes in the preceding 2 months. Diagnoses were based on the criteria of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (American Psychiatric Association & Association, 2013). The exclusion criteria were as follows: intelligence quotient ≤70; history of head trauma; acute, unstable, or severe medical/neurological condition; and pregnancy or lactation. Experienced psychiatrists from each institute evaluated the final diagnosis and invited patients to participate in the study. Initially, 90 individuals who met the criteria were randomly approached, and 12 declined to participate. The remaining 78 patients were randomly assigned to the VR-T or VR-control (VR-C) groups using a validated online randomizer (https://www.randomizer.org/). The authors affirm that all procedures in this study adhere to the ethical standards of the relevant national and institutional review boards and the 1975 Declaration of Helsinki (as amended in 2008). All procedures involving human participants were approved by the Ethics Committee of Jeonbuk National University Hospital (approval number: CUH 2022-04-018). The trial was registered with the Clinical Research Information Service (KCT0007710).

Measures

Sociodemographic data (sex, age, age of onset, and education), clinical information (duration of illness and diagnosis), and medication data were collected by research nurses via chart review and psychiatrists reevaluated. The total daily dose of antipsychotics at baseline was converted to chlorpromazine equivalents based on the defined daily dose (Leucht, Samara, Heres, & Davis, Reference Leucht, Samara, Heres and Davis2016). Psychopathology and functioning were assessed using the Positive and Negative Syndrome Scale (PANSS) (Kay, Fiszbein, & Opler, Reference Kay, Fiszbein and Opler1987; Yi et al., Reference Yi, Ahn, Shin, An, Joo, Kim and Kim2001), PSYRATS-D and PSYRATS-Auditory Hallucinations (PSYRATS-AH) (Haddock, McCarron, Tarrier, & Faragher, Reference Haddock, McCarron, Tarrier and Faragher1999), Clinical Global Impression-Schizophrenia (CGI-SCH) (Busner & Targum, Reference Busner and Targum2007), and Social and Occupational Functioning Assessment Scale (SOFAS) (Goldman, Skodol, & Lave, Reference Goldman, Skodol and Lave1992). The raters were psychiatrists with at least 2 years of experience in administering these scales; they were blinded to the group assignments. The R-GPTS (Freeman et al., Reference Freeman, Loe, Kingdon, Startup, Molodynski, Rosebrock and Bird2021), Brief Core Schema Scale (BCSS) (Fowler et al., Reference Fowler, Freeman, Smith, Kuipers, Bebbington, Bashforth and Dunn2006), Beck Depression Inventory (BDI) (Beck, Steer, & Brown, Reference Beck, Steer and Brown1987), Brooding Scale (BS) (Kim et al., Reference Kim, Piao, Kim, Park, Kang, Lee and Chung2019), Fear of Negative Evaluation Scale (FNES) (Leary, Reference Leary1983), Internal Personal and Situational Attribution Questionnaire (IPSAQ) (Kinderman & Bentall, Reference Kinderman and Bentall1996), and Self Esteem Scale (SES) (Rosenberg, Reference Rosenberg1965) self-rating scales also were used. Assessments were completed within the week before session 1 and within the week after session 10. The PSYRATS-D and R-GPTS scores were the primary outcome measures to operationalize DOR and persecutory IOR. VR sickness was assessed using the Simulator Sickness Questionnaire (Kennedy, Lane, Berbaum, & Lilienthal, Reference Kennedy, Lane, Berbaum and Lilienthal1993).

Procedures

This study was a single-blind randomized clinical trial. Both the raters and the statistician were blinded to group assignments. During the trial, discussing patients by name or other potentially identifying information was strictly prohibited. The VR-T group completed 10 weekly sessions, each supervised by psychiatrists with at least 2 years of experience. Sessions began with a brief conversation (2–3 min) about the patients’ referential thinking over the past week. After donning the head-mounted display (HMD, Meta Quest 2), patients watched 5-min educational videos that were developed by the authors. There were three videos: the first, which addressed the concept and causes of IOR, was viewed during sessions 1–3; the second, focused on raising awareness of low self-esteem, negative thoughts, and past trauma related to IOR, was shown during sessions 4–7; and the third, which covered coping strategies to overcome IOR (including avoiding rumination, practicing self-assertion/healthy aggression, and reality testing), was presented during sessions 8–10. After patients had viewed the educational videos, they were exposed to 360° 3D three treatment videos depicting conversations among actors, all of whom were native Koreans, in settings such as a café, hospital, and walkway, or four animated videos set in a bus station, classroom, hospital, and walkway (Supplementary Figure 1). Patients were encouraged to select videos set in locations where they typically experienced IOR. The conversations either involved activities of daily life (‘chatting’) or focused on ‘gossiping’, with adjustable volume. Because patients were more sensitive to low-volume conversations and gossiping, the volume was controlled to facilitate reality testing. Depending on the duration of the video selected, two or three videos were played during each session which was adjusted to 20–25 min. Between the videos, psychiatrists asked patients whether, and to what extent, they experienced IOR, such as ‘Did you feel that they were talking about you?’ and ‘How confident are you and what percentage are you certain that they were definitely talking about you?’ The conviction percentage (0%–100%) was used in the next session to help patients recognize that the percentage can be decreased or changed when exposed to the same videos and learn that their thoughts could be flexible. For the purpose of reality testing, patients were encouraged not to feel intimidated, but rather to observe the actors’ faces and listen carefully so that they could be aware that the conversation was irrelevant to them.

The VR-C group was supervised by research nurses. These participants individually watched a single educational video across all 10 sessions and were instructed to relax while viewing subsequent control videos. The VR-C group watched the same seven videos as the VR-T group, except the actors’ voices were muted, or they watched 11 360° 3D videos of natural scenes. They selected the videos based on their preference but the average proportion of scenarios to natural scenes in total sessions was arranged to be 1 to 1. Typically, participants were exposed to two or three different control videos. Between the viewings, we simply asked them ‘How was it?’ or ‘Did you enjoy the scenes?’ Although inaudible conversations have elicited IOR in some patients, no therapeutic intervention was provided. The duration of a session and the number of total sessions were matched between the two groups. Both interventions were conducted in the digital therapy room in each hospital.

Statistical analysis

Baseline variables were compared between the groups using the chi-square (χ2) test, Fisher’s exact test, or independent t-test; the paired t-test was used for within-group analyses. Intervention effects were analyzed using two-way repeated-measures (RM) analysis of variance. Two-way RM analysis of covariance was performed with the two variables (negative-self and negative-other schema from the BCSS) showing significant group differences included as covariates. Multiple testing of clinical scales was corrected for main effects and interaction using the False Discovery Rate (FDR). For post-hoc comparison, Bonferroni correction for two time points was applied. The correction was only applied to clinical scales because no significant results were observed with self-rating scales. Partial eta squared (η2p) was calculated for the estimation of group × time interaction effect size. According to Cohen, η2p value of ≥0.01 indicates a small effect, ≥ 0.06 represents a medium effect, and ≥0.14 is considered a large effect (Cohen, Reference Cohen2013). Additionally, Cohen d was calculated for the changes after intervention in each group. For the between- and within-group analyses of VR sickness, the χ2 test and McNemar test were conducted, respectively. All analyses were performed using SPSS for Windows (version 25.0; IBM Corp., Armonk, NY, USA).

Path analysis was conducted to evaluate causality in the relationships between dependent and independent variables. Psychological factors (attributional bias, depression, low self-esteem, negative beliefs, paranoia, rumination, and social-evaluative concern were measured by IPSAQ, BDI, SES, BCSS, R-GPTS, BS, and FNES, respectively.) potentially affecting the primary outcome measures were identified via correlation analysis and based on previous relevant studies. The IPSAQ and SES scores were excluded from the models due to a lack of correlation with the primary outcome measures (Supplementary Table 1). We selected the FNES, BDI, and BS scores as mediators based on previous studies (Cui et al., Reference Cui, Kim, Lee, Kim, Yu, Lee and Chung2019; Fisher et al., Reference Fisher, Schreier, Zammit, Maughan, Munafò, Lewis and Wolke2013; Jaya, Ascone, & Lincoln, Reference Jaya, Ascone and Lincoln2018; Lam et al., Reference Lam, Cheung, Wong, Leung and Chien2022; Morrison, Goldin, & Gross, Reference Morrison, Goldin and Gross2024; Murphy, Murphy, & Shevlin, Reference Murphy, Murphy and Shevlin2015). When the initial model did not show an adequate fit to the data, we removed nonsignificant paths to optimize the model. The model fit indices used were the χ2 p-value (cutoff, p > 0.05), comparative fit index (cutoff >0.95), root mean square error of approximation (cutoff <0.05), standardized root mean square residual (cutoff <0.09), and Tucker–Lewis index (cutoff >0.95) (West, Taylor, & Wu, Reference West, Taylor and Wu2012). The significance of indirect effects was confirmed using the bootstrap method with 2,000 iterations. If there were multiple indirect paths, phantom modeling was applied to calculate the indirect effect of a specific path. Mediators were classified as partial when both indirect and direct effects were significant and as full when only indirect effects were significant. Multiple testing was corrected using FDR.

Results

Participant characteristics

There were no significant differences in demographic or clinical characteristics between the two groups (Table 1). One and two individuals in VR-T and VR-C groups respectively were antipsychotic-free during the entire sessions. Six participants in the VR-T group and two participants in the control group dropped out for various reasons (Supplementary Figure 2).

Table 1. Demographic and clinical characteristics of the participants

Note: Data are presented as mean ± standard deviation or %.

Abbreviations: DUP, Duration of Untreated Psychosis; DI, Duration of Illness; SSDs, Schizophrenia Spectrum Disorders; VR, Virtual Reality.

a SSDs refer to schizophrenia (n = 52), schizophreniform disorder (n = 2), schizoaffective disorder (n = 2).

b Other psychoses refers to other specified schizophrenia spectrum and other psychotic disorders (n = 13), and unspecified schizophrenia spectrum and other psychotic disorders (n = 1).

Treatment effects

Within-group analysis showed improvements in the PANSS and PSYRATS-D scores in both groups; the PSYRATS-AH and CGI-SCH scores improved only in the VR-T group. Between-group analysis revealed a significant main effect of time and a significant group × time interaction at FDR-adjusted level for most measures. However, post hoc t-tests of the result after 10th session revealed significantly greater improvement in the PSYRATS-D score in the VR-T group compared with the VR-C group (emotional domain, Bonferroni-adjusted p = 0.02; total, Bonferroni-adjusted p = 0.04) (Table 2).

Table 2. Results of VR interventions on clinical scalesa

Abbreviations: CGI-SCH, Clinical Global Impression-Schizophrenia; PSYRATS-AH, Psychotic Symptom Rating Scales-Auditory Hallucination; PSYRATS-D, Psychotic Symptom Rating Scales-Delusion; PANSS, Positive and Negative Syndrome Scale; SES, Self Esteem Scale; VR, Virtual reality.

a Two-way repeated measure ANOVA.

b Paired t test.

c Independent t test between treatment and control groups before 1st session.

d Independent t test between treatment and control groups after 10th session; Current p-value is uncorrected one;

* Significant (< 0.05) at false discovery rate correction (for each item, corrected 12 times and for total or overall severity, corrected four times);

Significant after Bonferroni correction for two time points.

Regarding the self-rating measures, within-group analysis showed improvements in the BS and R-GPTS scores in the VR-C group and the SOFAS and R-GPTS scores in the VR-T group. Between-group analysis revealed a significant main effect of time for most measures, although the group × time interaction was significant only for the SOFAS score (p = 0.001). However, there were no significant differences in the SOFAS between groups in both results after 1st and 10th session (Table 3).

Table 3. Results of VR interventions on self-rating scalesa

Abbreviations: BCSS, Brief Core Schema Scale; BDI, Beck Depression Inventory; FNES, Fear of Negative Evaluation Scale; IPSAQ, Internal, Personal and Situational Attributions Questionnaire; R-GPTS, the Revised Green et al., Paranoid Thought Scale; SES, Self Esteem Scale; SOFAS, Social and Occupational Functioning Assessment Scale; VR, Virtual reality.

a Two-way repeated measure ANOVA.

b For the variables showed significant difference at baseline, two-way repeated measure ANCOVA was performed with the baseline data as covariates).

c Paired t test.

d Independent t test between treatment and control groups before 1st session.

e Independent t test between treatment and control groups after 10th session with the variablesb as covariates.

VR sickness

The most common symptoms in both groups were general discomfort, fatigue/eye fatigue, difficulty focusing the eyes, and difficulty concentrating. Within-group analyses did not show significant changes in either group. Significant group differences were observed in general discomfort (p = 0.05), sweating (p = 0.05), and difficulty concentrating (p = 0.03), but only after session 1 (Table 4). There were no significant group differences in the severity of VR sickness symptoms after sessions 1 and 10, except for blurry vision (p = 0.02) (Supplementary Table 2).

Table 4. Symptoms of VR sickness reported after 1st and after 10th session

Abbreviation: VR, Virtual reality.

a McNemar test for comparing the proportion of patients complaining VR sickness within group between two time points.

b Chi-square test for comparing two groups.

Path analysis

When running the analysis between the BCSS-NS and R-GPTS (total score) in the VR-T group, an optimal model showed significant direct effects between the FNES and R-GPTS (r = 0.62, FDR-adjusted p < 0.0005), the BCSS-NS and BDI (r = 0.44, FDR-adjusted p = 0.0025), the BDI and FNES, and the BCSS-NS and FNES (r = 0.37, FDR-adjusted p = 0.0167; r = 0.36, FDR-adjusted p = 0.0263, respectively). There were significant indirect effects between the BCSS-NS and R-GPTS (r = 0.33, FDR-adjusted p = 0.018) and between the BCSS-NS and FNES (r = 0.162, FDR-adjusted p = 0.0285). When the former path was broken down into two paths (BCSS-NS → BDI → FNES → R-GPTS and BCSS-NS → FNES → R-GPTS) using phantom modeling, only FNES in the second path was a significant full mediator (r = 0.224, uncorrected p = 0.04). For the latter path, BDI played a partial mediating role. The analysis between the BCSS-PO and R-GPTS showed significant direct effects between the BCSS-PO and R-GPTS (r = −0.49, FDR-adjusted p < 0.0002), the BDI and R-GPTS (r = 0.29, FDR-adjusted p = 0.024), and the FNES and R-GPTS (r = 0.47, FDR-adjusted p = 0.0067) and between the BDI and FNES (r = 0.53, FDR-adjusted p < 0.0002). A significant indirect effect was identified only between the BDI and R-GPTS (r = 0.25, uncorrected p = 0.03). In this path, FNES played a partial mediating role (Figure 1). On the other hand, analysis between the BCSS-NS and PSYRATS-D (total score) showed no significant results.

Figure 1. Path models between the BCSS-NS or BCSS-PO and R-GPTS: (a) Model depicting paths between the BCSS-NS and R-GPTS (Fit indices: chi-square = 0.97; D.F = 1; CFI = 1; TLI = 1.01; RMSEA = 0; SRMR = 0.04; p = 0.97) and (b) Model depicting paths between the BCSS-PO and R-GPTS.

Fit indices: chi-square = 0.85; D.F = 1; CFI = 1; TLI = 1.02; RMSEA = 0; SRMR = 0.05; p = 0.36; For FDR-adjusted level, * p < .05, ** p < .01, ***p < .001. Note. BCSS-NS, Brief Core Schema Scale-Negative Self; BCSS-PO, Brief Core Schema Scale-Positive Others; BDI, Beck Depression Inventory; FNES, Fear of Negative Evaluation Scale; R-GPTS, the Revised Green et al., Paranoid Thought Scale.

Discussion

IOR and DOR are common symptoms of psychosis. Recently, interest in VR therapy for individuals with psychosis has been increasing. We investigated the effects and safety of VR-T in relation to persecutory IOR and DOR in stable outpatients with psychosis. After session 10, a large and significant effect size was observed especially for the PSYRATS-D score. Although VR sickness had a high incidence, its symptoms generally were mild and transient.

Within-group analysis revealed significant improvements in PANSS, PSYRATS-D, and CGI-SCH scores were observed in both groups, although PSYRATS-AH scores improved only in the VR-T group. Importantly, between-group analysis revealed significant group × time interactions in most of the clinical scales. However, in the post hoc test, a significant difference was only observed in the PSYRATS-D scores after the 10th session. For the results other than the PSYRATS-D, it may signify that the effects of VR therapy become evident over time but not enough to produce significant differences between the two groups after the 10th session. Or it may be that a significant difference was noted between the 1st and 10th sessions. If so, measurement at a minimum of three time points (baseline, mid-point, and end-point) should be considered in future studies. The result of the PSYRATS-D, suggests that VR therapy is beneficial in reducing the severity of delusions among stable outpatients with psychosis. The effect size (Cohen d) was larger than that reported in a meta-analysis of cognitive behavioral therapy (CBT) effects on delusions (0.36) (Van der Gaag, Valmaggia, & Smit, Reference Van der Gaag, Valmaggia and Smit2014). Because the primary outcome measures in previous VR studies differed from those in our study, direct comparisons of the results were difficult. In one study (Freeman et al., Reference Freeman, Bradley, Antley, Bourke, DeWeever and Evans2016), the baseline mean PSYRATS-D score was ~17, which is higher than the score in our study. This suggests that VR therapy is a promising tool to reduce persecutory IOR and DOR, even in patients with mild symptoms. The negative findings regarding the PANSS scores in the post hoc test may be related to the mildness of the patients’ symptoms and the fact that the PANSS is not sufficiently sensitive to detect subtle changes in symptoms.

For self-rating scales, within-group comparisons showed some improvement in the BS and R-GPTS scores in both groups, but there were no significant differences between the groups. Although these findings might appear disappointing, they may reflect the differences between clinical and self-rating scales. Thus, the effects of the VR-T and VR-C interventions on functioning, schema, depression, brooding, negative evaluation, attribution bias, paranoia, and self-esteem subscale scores were minimal. It should be noted that Freeman et al. (Reference Freeman, Lambe, Kabir, Petit, Rosebrock, Yu and O’Regan2022) reported no significant change in R-GPTS scores after six sessions of VR therapy, and the baseline R-GPTS scores were low in a manner similar to the results in our study. However, Pot-Kolder et al. (Reference Pot-Kolder, Geraets, Veling, van Beilen, Staring, Gijsman and van der Gaag2018) reported significant changes in R-GPTS scores after 16 sessions of VR-CBT, although the baseline R-GPTS scores were very high. Hence, it seems that negative findings in the R-GPTS may be related to the low baseline score or a floor effect and limited number of sessions.

Regarding safety, both groups had a moderate-to-high incidence of VR sickness. The most common symptoms in the VR-T group were general discomfort, fatigue, and difficulty concentrating; in the control group, difficulty focusing the eyes and eye fatigue were more prevalent. However, the symptoms generally were mild, and there were no significant group differences in symptom frequency. These findings indicate that our VR intervention is safe for patients with psychosis, consistent with other studies (Fornells-Ambrojo et al., Reference Fornells-Ambrojo, Barker, Swapp, Slater, Antley and Freeman2008; Rus-Calafell et al., Reference Rus-Calafell, Garety, Sason, Craig and Valmaggia2018). This safety may be reflected in the low attrition rates observed in both the VR-T and VR-C groups (15.8% and 5.0%, respectively), which could be considered a strength of VR therapy, especially in young individuals with psychosis. However, it is of note that six participants were dropped out in the VT-T group whereas only two in the VR-C group. Unfortunately, in the VR-T group, one completed suicide and one aggravated due to self-discontinuation of medication. For the former case, we were unable to evaluate association with the VR exposure but for the latter case, no association was found. In general, suicide or symptom aggravation due to VR exposure in psychosis is scarce. Two recent VR studies in SSD reported suicide attempts in the treatment group but its rate was not different compared with the control group (Glenthøj et al., Reference Glenthøj, Smith, Vernal, Mariegaard, Christensen, Jansen and Nordentoft2024a, Reference Glenthøj, Vernal, Due, Mariegaard, Pinkham, Austin and Jeppesen2024b). Nevertheless, these adverse events should be carefully monitored in future studies.

In our path model of the BCSS-NS and R-GPTS scores, the FNES score acted as a full mediator in the VR-T group. This indicates that the BCSS-NS score did not directly affect the R-GPTS score; its influence was indirectly mediated through the FNES score. Additionally, the BDI score served as a partial mediator in the relationship between the BCSS-NS and FNES scores. These findings suggest that psychological and VR therapies targeting paranoia should focus on negative evaluations and depression. We found that the BCSS-PO score was independently and negatively associated with the R-GPTS score, and the FNES score was a partial mediator in the relationship between the BDI and R-GPTS scores. Taken together, the results of our path analyses provide insights into how paranoia may be improved. There was no mediating effect of the BS score on the relationship between the BCSS-NS and PSYRATS-D scores.

Several limitations of the current study should be noted. First is related to the appropriateness of VR-C which consisted of the same videos used in the VR-T group but with muted voices or 360°-3D videos of nature scenes. We chose these conditions to test the efficacy of IOR-related contents versus neutral ones. Nevertheless, as some short reality testing approach was applied in the VR-T, offline CBT sessions could be an alternative control. In addition, mismatching the number of educational videos between the groups might have introduced some bias. Second, because the participants were young and stable outpatients, the generalizability of the findings is limited. Third, the actors in the videos generally were young, and some middle-aged participants felt that the scenarios were not adequately relatable. Fourth, as we evaluated outcomes only at two time points, we may have overlooked significant changes that occurred in the middle. Additionally, one participant dropped out because the HMD did not fit their head size. These issues should be addressed in future studies. As a strength of the study, this was the first VR intervention targeting IOR and DOR in Asian patients with psychosis. Moreover, the scenarios and volume could be adjusted to facilitate reality testing.

In conclusion, our findings suggest that VR therapy is beneficial in reducing delusions in stable young outpatients with psychosis; symptoms of VR sickness were mild and tolerable. Future studies should develop more diverse videos to better meet the needs of older participants.

Supplementary material

To view supplementary material for this article, please visit http://doi.org/10.1017/S0033291725000959.

Acknowledgements

The corresponding author would like to thank all participants in the study and my family for guidance and support (SDG).

Author contribution

Y.C.C. conceptualized the study. W.S.K., Y.C.C., and E.J.J. performed the study and acquired data. S.O., T.H.L., F.Z.R., and C.Y.K. conducted statistical analyses. L.L., A.S., E.J.J., and Y.C.C. analyzed and interpreted the data. E.J.J. drafted the manuscript. Y.C.C. critically revised the manuscript. Y.C.C. received the grant. All authors approved the final manuscript.

Funding statement

YCC was supported by a grant from the Korean Mental Health Technology R&D Project, Ministry of Health & Welfare, Republic of Korea (HL19C0015), a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (HR18C0016) and the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (RS-2024-00335201).

Competing interests

The authors declare no competing interests.

Ethical standard

The authors affirm that all procedures in this study adhere to the ethical standards of the relevant national and institutional review boards and the 1975 Declaration of Helsinki (as amended in 2008). All procedures involving human participants were approved by the Ethics Committee of Jeonbuk National University Hospital (approval number: CUH 2022-04-018).

References

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). APA. https://doi.org/10.1176/appi.books.9780890425596Google Scholar
Beck, A. T., Steer, R. A., & Brown, G. K. (1987). Beck depression inventory. San Antonio, TX: Psychological CorporationGoogle Scholar
Bendala-Rodríguez, P., Senín-Calderón, C., Peluso-Crespi, L., & Rodríguez-Testal, J. F. (2019). Vulnerability to psychosis, ideas of reference and evaluation with an implicit testJournal of Clinical Medicine8(11), 1956. https://doi.org/10.3390/jcm8111956CrossRefGoogle ScholarPubMed
Busner, J., & Targum, S. D. (2007). The clinical global impressions scale: Applying a research tool in clinical practice. Psychiatry (Edgmont), 4(7), 28.Google ScholarPubMed
Chan, C. L., Ngai, E. K., Leung, P. K., & Wong, S. (2010). Effect of the adapted virtual reality cognitive training program among Chinese older adults with chronic schizophrenia: A pilot study. International Journal of Geriatric Psychiatry: A Journal of the Psychiatry of Late Life and Allied Sciences, 25(6), 643649. https://doi.org/10.1002/gps.2403CrossRefGoogle ScholarPubMed
Cicero, D. C., & Kerns, J. G. (2011). Unpleasant and pleasant referential thinking: Relations with self-processing, paranoia, and other schizotypal traits. Journal of Research in Personality, 45(2), 208218. https://doi.org/10.1016/j.jrp.2011.02.002CrossRefGoogle ScholarPubMed
Cohen, J. (2013). Statistical power analysis for the behavioral sciences. Routledge.CrossRefGoogle Scholar
Colori, S. (2017). Understanding referential thinking. Schizophrenia Bulletin, 43(4), 685686. https://doi.org/10.1093/schbul/sbv005CrossRefGoogle ScholarPubMed
Cui, Y., Kim, S. W., Lee, B. J., Kim, J. J., Yu, J. C., Lee, K. Y., … & Chung, Y. C. (2019). Negative schema and rumination as mediators of the relationship between childhood trauma and recent suicidal ideation in patients with early psychosisThe Journal of Clinical Psychiatry80(3), 11438. https://doi.org/10.4088/JCP.17m12088CrossRefGoogle ScholarPubMed
Dellazizzo, L., Potvin, S., Phraxayavong, K., & Dumais, A. (2021). One-year randomized trial comparing virtual reality-assisted therapy to cognitive–behavioral therapy for patients with treatment-resistant schizophrenia. NPJ Schizophrenia, 7(1), 9. https://doi.org/10.1038/s41537-021-00139-2CrossRefGoogle ScholarPubMed
Fajnerová, I., Rodriguez, M., Levčík, D., Konrádová, L., Mikoláš, P., Brom, C., … & Horáček, J. (2014). A virtual reality task based on animal research–spatial learning and memory in patients after the first episode of schizophreniaFrontiers in Behavioral Neuroscience8, 157. https://doi.org/10.3389/fnbeh.2014.00157CrossRefGoogle ScholarPubMed
Fisher, H. L., Schreier, A., Zammit, S., Maughan, B., Munafò, M. R., Lewis, G., & Wolke, D. (2013). Pathways between childhood victimization and psychosis-like symptoms in the ALSPAC birth cohort. Schizophrenia Bulletin, 39(5), 10451055. https://doi.org/10.1093/schbul/sbs088CrossRefGoogle ScholarPubMed
Fornells-Ambrojo, M., Barker, C., Swapp, D., Slater, M., Antley, A., & Freeman, D. (2008). Virtual reality and persecutory delusions: Safety and feasibility. Schizophrenia Research, 104(1–3), 228236. https://doi.org/10.1016/j.schres.2008.05.013CrossRefGoogle ScholarPubMed
Fowler, D., Freeman, D., Smith, B., Kuipers, E., Bebbington, P., Bashforth, H., … & Dunn, G. (2006). The Brief Core Schema Scales (BCSS): Psychometric properties and associations with paranoia and grandiosity in non-clinical and psychosis samples. Psychological Medicine, 36(6), 749759. https://doi.org/10.1017/S0033291719003155ranges, and clinical cut-offs. Psychological Medicine, 51(2), 244–253. https://doi.org/10.1017/S0033291719003155CrossRefGoogle ScholarPubMed
Freeman, D., Garety, P. A., Kuipers, E., Fowler, D., & Bebbington, P. E. (2002). A cognitive model of persecutory delusions. British Journal of Clinical Psychology, 41(4), 331347. https://doi.org/10.1348/014466502760387461CrossRefGoogle ScholarPubMed
Freeman, D., Garety, P. A., Bebbington, P. E., Smith, B., Rollinson, R., Fowler, D., … Dunn, G. (2005). Psychological investigation of the structure of paranoia in a non-clinical population. British Journal of Psychiatry, 186(5), 427435. doi:10.1192/bjp.186.5.427CrossRefGoogle Scholar
Freeman, D., Bradley, J., Antley, A., Bourke, E., DeWeever, N., Evans, N., … Dunn, G. (2016). Virtual reality in the treatment of persecutory delusions: randomised controlled experimental study testing how to reduce delusional conviction. The British Journal of Psychiatry, 209(1), 6267. https://doi.org/10.1192/bjp.bp.115.176438Google Scholar
Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., & Slater, M. (2017). Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychological Medicine, 47(14), 23932400. https://doi.org/10.1017/S003329171700040XCrossRefGoogle ScholarPubMed
Freeman, D., Loe, B. S., Kingdon, D., Startup, H., Molodynski, A., Rosebrock, , … Bird, J. C. (2021). The revised Green et al., Paranoid Thoughts Scale (R-GPTS): psychometric properties, severity ranges, and clinical cut-offs. Psychological medicine, 51(2), 244253. https://doi.org/10.1017/S0033291719003155CrossRefGoogle Scholar
Freeman, D., Lambe, S., Kabir, T., Petit, A., Rosebrock, L., Yu, L.-M., … O’Regan, E. (2022). Automated virtual reality therapy to treat agoraphobic avoidance and distress in patients with psychosis (gameChange): a multicentre, parallel-group, single-blind, randomised, controlled trial in England with mediation and moderation analyses. The Lancet Psychiatry, 9(5), 375388.Google Scholar
Gega, L., White, R., Clarke, T., Turner, R., & Fowler, D. (2013). Virtual environments using video capture for social phobia with psychosis. Cyberpsychology, Behavior, and Social Networking, 16(6), 473479. https://doi.org/10.1089/cyber.2013.1510CrossRefGoogle ScholarPubMed
Geraets, C. N., Snippe, E., van Beilen, M., Pot-Kolder, R. M., Wichers, M., van der Gaag, M., & Veling, W. (2020). Virtual reality based cognitive behavioral therapy for paranoia: Effects on mental states and the dynamics among them. Schizophrenia Research, 222, 227234. https://doi.org/10.1016/j.schres.2020.05.047CrossRefGoogle ScholarPubMed
Glenthøj, L., Smith, L., Vernal, D., Mariegaard, L., Christensen, A., Jansen, J., … Nordentoft, M. (2024a). Virtual reality-assisted therapy targeting persistent auditory verbal hallucinations in patients diagnosed with schizophrenia spectrum disorders: The Challenge single-blind, randomized clinical trial. Research Square. https://doi.org/10.21203/rs.3.rs-5180922/v1CrossRefGoogle Scholar
Glenthøj, L., Vernal, D., Due, A. S., Mariegaard, L., Pinkham, A., Austin, S., … Jeppesen, U. (2024b). Face Your Fears: Virtual reality-based cognitive behavioral therapy (VR-CBT) versus standard CBT for paranoia in patients with schizophrenia spectrum disorders: Results of a randomized clinical trial. Research Square. https://doi.org/10.21203/rs.3.rs-5593252/v1CrossRefGoogle Scholar
Goldman, H. H., Skodol, A. E., & Lave, T. R. (1992). Revising axis V for DSM-IV: A review of measures of social functioning. The American Journal of Psychiatry, 149, 9.Google ScholarPubMed
Haddock, G., McCarron, J., Tarrier, N., & Faragher, E. (1999). Scales to measure dimensions of hallucinations and delusions: The psychotic symptom rating scales (PSYRATS). Psychological Medicine, 29(4), 879889. https://doi.org/10.1017/S0033291799008661CrossRefGoogle ScholarPubMed
Jaya, E. S., Ascone, L., & Lincoln, T. (2018). A longitudinal mediation analysis of the effect of negative-self-schemas on positive symptoms via negative affect. Psychological Medicine, 48(8), 12991307. https://doi.org/10.1017/S003329171700277XCrossRefGoogle ScholarPubMed
Kaney, S., & Bentall, R. P. (1989). Persecutory delusions and attributional style. British Journal of Medical Psychology, 62(2), 191198. https://doi.org/10.1111/j.2044-8341.1989.tb02826.xCrossRefGoogle ScholarPubMed
Kay, S. R., Fiszbein, A., & Opler, L. A. (1987). The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophrenia Bulletin, 13(2), 261276. https://doi.org/10.1093/schbul/13.2.261CrossRefGoogle ScholarPubMed
Kennedy, R. S., Lane, N. E., Berbaum, K. S., & Lilienthal, M. G. (1993). Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology, 3(3), 203220. https://doi.org/10.1207/s15327108ijap0303_3CrossRefGoogle Scholar
Kim, J. H., Piao, Y., Kim, W. S., Park, J. J., Kang, N. I., Lee, K. H., & Chung, Y. C. (2019). The development of the brooding scale. Psychiatry Investigation, 16(6), 443. https://doi.org/10.30773/pi.2019.04.16CrossRefGoogle ScholarPubMed
Kinderman, P., & Bentall, R. P. (1996). A new measure of causal locus: The internal, personal and situational attributions questionnaire. Personality and Individual Differences, 20(2), 261264. https://doi.org/10.1016/0191-8869(95)00186-7CrossRefGoogle Scholar
Ku, J., Han, K., Lee, H. R., Jang, H. J., Kim, K. U., Park, S. H., … Kim, S. I. (2007). VR-based conversation training program for patients with schizophrenia: A preliminary clinical trial. Cyberpsychology & Behavior, 10(4), 567574. https://doi.org/10.1089/cpb.2007.9989CrossRefGoogle ScholarPubMed
Lam, A. H. Y., Cheung, Y. T. D., Wong, K. H., Leung, S. F., & Chien, W. T. (2022). Dispositional mindfulness and psychotic symptoms in schizophrenia spectrum disorders: The mediating roles of rumination and negative emotion. Neuropsychiatric Disease and Treatment, 18, 75. https://doi.org/10.2147/NDT.S338133CrossRefGoogle ScholarPubMed
Leary, M. R. (1983). A brief version of the fear of negative evaluation scale. Personality and Social Psychology Bulletin, 9(3), 371375. https://doi.org/10.1177/0146167283093007CrossRefGoogle Scholar
Lee, B. M., Kim, S.-W., Lee, B. J., Won, S.-H., Park, Y.-H., Kang, C. Y., … Chung, Y.-C. (2023). Effects and safety of virtual reality-based mindfulness in patients with psychosis: A randomized controlled pilot study. Schizophrenia, 9(1), 57. https://doi.org/10.1038/s41537-023-00391-8CrossRefGoogle ScholarPubMed
Leucht, S., Samara, M., Heres, S., & Davis, J. M. (2016). Dose equivalents for antipsychotic drugs: The DDD method. Schizophrenia Bulletin, 42(suppl_1), S90S94. https://doi.org/10.1093/schbul/sbv167CrossRefGoogle ScholarPubMed
Lyon, H. M., Kaney, S., & Bentall, R. P. (1994). The defensive function of persecutory delusions: Evidence from attribution tasks. The British Journal of Psychiatry, 164(5), 637646. https://doi.org/10.1192/bjp.164.5.637CrossRefGoogle ScholarPubMed
Martens, M. A., Antley, A., Freeman, D., Slater, M., Harrison, P. J., & Tunbridge, E. M. (2019). It feels real: Physiological responses to a stressful virtual reality environment and its impact on working memory. Journal of Psychopharmacology, 33(10), 12641273. https://doi.org/10.1177/02698811198601CrossRefGoogle ScholarPubMed
Meyer, E. C., & Lenzenweger, M. F. (2009). The specificity of referential thinking: A comparison of schizotypy and social anxiety. Psychiatry Research, 165(1–2), 7887. https://doi.org/10.1016/j.psychres.2007.10.015CrossRefGoogle ScholarPubMed
Moritz, S., Voigt, M., Köther, U., Leighton, L., Kjahili, B., Babur, Z., …& Grzella, K. (2014). Can virtual reality reduce reality distortion? Impact of performance feedback on symptom change in schizophrenia patients. Journal of Behavior Therapy and Experimental Psychiatry, 45(2), 267271. https://doi.org/10.1016/j.jbtep.2013.11.005CrossRefGoogle ScholarPubMed
Morrison, A. S., Goldin, P. R., & Gross, J. J. (2024). Fear of negative and positive evaluation as mediators and moderators of treatment outcome in social anxiety disorder. Journal of Anxiety Disorders, 104, 102874. https://doi.org/10.1016/j.janxdis.2024.102874CrossRefGoogle ScholarPubMed
Murphy, S., Murphy, J., & Shevlin, M. (2015). Negative evaluations of self and others, and peer victimization as mediators of the relationship between childhood adversity and psychotic experiences in adolescence: The moderating role of loneliness. British Journal of Clinical Psychology, 54(3), 326344. https://doi.org/10.1111/bjc.12077CrossRefGoogle ScholarPubMed
Park, K. M., Ku, J., Choi, S. H., Jang, H. J., Park, J. Y., Kim, S. I., & Kim, J. J. (2011). A virtual reality application in role-plays of social skills training for schizophrenia: A randomized, controlled trial. Psychiatry Research, 189(2), 166172. https://doi.org/10.1016/j.psychres.2011.04.003CrossRefGoogle ScholarPubMed
Pot-Kolder, R. M., Geraets, C. N., Veling, W., van Beilen, M., Staring, A. B., Gijsman, H. J., … & van der Gaag, M. (2018). Virtual-reality-based cognitive behavioural therapy versus waiting list control for paranoid ideation and social avoidance in patients with psychotic disorders: A single-blind randomised controlled trial. The Lancet Psychiatry, 5(3), 217226.CrossRefGoogle ScholarPubMed
Rodríguez-Testal, J. F., Bendala-Rodríguez, P., Perona-Garcelán, S., & Senín-Calderón, C. (2019). Examining the structure of ideas of reference in clinical and community samples. Comprehensive Psychiatry, 93, 4855. https://doi.org/10.1016/j.comppsych.2019.06.006CrossRefGoogle ScholarPubMed
Rosenberg, M. (1965). Rosenberg self-esteem scale (RSE). Acceptance and commitment therapy. Measures package. APA PsycTests, 61(52), 18.Google Scholar
Rus-Calafell, M., Garety, P., Sason, E., Craig, T. J., & Valmaggia, L. R. (2018). Virtual reality in the assessment and treatment of psychosis: A systematic review of its utility, acceptability and effectiveness. Psychological Medicine, 48(3), 362391. https://doi.org/10.1017/S0033291717001945CrossRefGoogle ScholarPubMed
Ruse, S. A., Harvey, P. D., Davis, V. G., Atkins, A. S., Fox, K. H., & Keefe, R. S. (2014). Virtual reality functional capacity assessment in schizophrenia: Preliminary data regarding feasibility and correlations with cognitive and functional capacity performanceSchizophrenia Research: Cognition, 1(1), e21e26. https://doi.org/10.1016/j.scog.2014.01.004Google ScholarPubMed
Schennach, R., Riedel, M., Obermeier, M., Spellmann, I., Musil, R., Jäger, M., …& Naber, D. (2015). What are residual symptoms in schizophrenia spectrum disorder? Clinical description and 1-year persistence within a naturalistic trial. European Archives of Psychiatry and Clinical Neuroscience, 265, 107116. https://doi.org/10.1007/s00406-014-0528-2CrossRefGoogle ScholarPubMed
Tsang, M. M., & Man, D. W. (2013). A virtual reality-based vocational training system (VRVTS) for people with schizophrenia in vocational rehabilitation. Schizophrenia Research, 144(1–3), 5162. https://doi.org/10.1016/j.schres.2012.12.024CrossRefGoogle ScholarPubMed
Valmaggia, L. R., Freeman, D., Green, C., Garety, P., Swapp, D., Antley, A., … McGuire, P. K. (2007). Virtual reality and paranoid ideations in people with an ‘at-risk mental state’ for psychosis. British Journal of Psychiatry, 191(S51), s63s68. https://doi.org/10.1192/bjp.191.51.s63CrossRefGoogle Scholar
Van der Gaag, M., Valmaggia, L. R., & Smit, F. (2014). The effects of individually tailored formulation-based cognitive behavioural therapy in auditory hallucinations and delusions: A meta-analysis. Schizophrenia Research, 156(1), 3037. https://doi.org/10.1016/j.schres.2014.03.016CrossRefGoogle ScholarPubMed
Veling, W., Pot-Kolder, R., Counotte, J., van Os, J., & van der Gaag, M. (2016). Environmental social stress, paranoia and psychosis liability: A virtual reality study. Schizophrenia Bulletin, 42(6), 13631371. https://doi.org/10.1093/schbul/sbw031CrossRefGoogle ScholarPubMed
West, S. G., Taylor, A. B., & Wu, W. (2012). Model fit and model selection in structural equation modeling. Handbook of Structural Equation Modeling, 1(1), 209231.Google Scholar
Wong, S. M., Hui, C. L., Wong, C. S., Suen, Y., Chan, S. K., Lee, E. H., Chang, W., … & Chen, E. Y. (2021). Induced ideas of reference during social unrest and pandemic in Hong Kong. Schizophrenia Research, 229, 4652. https://doi.org/10.1016/j.schres.2021.01.027CrossRefGoogle ScholarPubMed
World Health Organization. (1973). Report of the international pilot study of schizophrenia (Vol. 1). World Health Organization.Google Scholar
Yi, J. S., Ahn, Y. M., Shin, H. K., An, S. K., Joo, Y. H., Kim, S. H., … & Kim, Y. S. (2001). Reliability and validity of the Korean version of the positive and negative syndrome scale. Journal of Korean Neuropsychiatric Association, 40, 10901105.Google Scholar
Figure 0

Table 1. Demographic and clinical characteristics of the participants

Figure 1

Table 2. Results of VR interventions on clinical scalesa

Figure 2

Table 3. Results of VR interventions on self-rating scalesa

Figure 3

Table 4. Symptoms of VR sickness reported after 1st and after 10th session

Figure 4

Figure 1. Path models between the BCSS-NS or BCSS-PO and R-GPTS: (a) Model depicting paths between the BCSS-NS and R-GPTS (Fit indices: chi-square = 0.97; D.F = 1; CFI = 1; TLI = 1.01; RMSEA = 0; SRMR = 0.04; p = 0.97) and (b) Model depicting paths between the BCSS-PO and R-GPTS.Fit indices: chi-square = 0.85; D.F = 1; CFI = 1; TLI = 1.02; RMSEA = 0; SRMR = 0.05; p = 0.36; For FDR-adjusted level, * p < .05, ** p < .01, ***p < .001. Note. BCSS-NS, Brief Core Schema Scale-Negative Self; BCSS-PO, Brief Core Schema Scale-Positive Others; BDI, Beck Depression Inventory; FNES, Fear of Negative Evaluation Scale; R-GPTS, the Revised Green et al., Paranoid Thought Scale.

Supplementary material: File

Jeon et al. supplementary material

Jeon et al. supplementary material
Download Jeon et al. supplementary material(File)
File 5.7 MB