Hostname: page-component-586b7cd67f-rcrh6 Total loading time: 0 Render date: 2024-11-27T11:25:46.514Z Has data issue: false hasContentIssue false

The associations between depressive symptoms, functional impairment, and quality of life, in patients with major depression: undirected and Bayesian network analyses

Published online by Cambridge University Press:  09 November 2022

Jia Zhou
Affiliation:
The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
Jingjing Zhou
Affiliation:
The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
Lei Feng
Affiliation:
The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
Yuan Feng
Affiliation:
The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
Le Xiao
Affiliation:
The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
Xu Chen
Affiliation:
The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
Jian Yang*
Affiliation:
The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
Gang Wang*
Affiliation:
The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
*
Author for correspondence: Jian Yang, E-mail: [email protected]; Gang Wang, E-mail: [email protected]
Author for correspondence: Jian Yang, E-mail: [email protected]; Gang Wang, E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

Depressive symptoms, functional impairment, and decreased quality of life (QOL) are three important domains of major depressive disorder (MDD). However, the possible causal relationship between these factors has yet to be elucidated. Moreover, it is not known whether certain symptoms of MDD are more impairing than others. The network approach is a promising solution to these shortfalls.

Methods

The baseline data of a multicenter prospective project conducted in 11 governances of China were analyzed. In total, 1385 patients with MDD were included. Depressive symptoms, functioning disability, and QOL were evaluated by the 17-item Hamilton Depression Rating Scale (HAMD-17), the Sheehan Disability Scale (SDS), and the Quality of Life Enjoyment and Satisfaction Questionnaire-Short Form (Q-LES-Q-SF). The network was estimated through the graphical Least Absolute Shrinkage and Selection Operator (LASSO) technique in combination with the directed acyclic graph.

Results

Three centrality metrics of the graphical LASSO showed that social life dysfunction, QOL, and late insomnia exhibited the highest strength centrality. The network accuracy and stability were estimated to be robust and stable. The Bayesian network indicated that some depressive symptoms were directly associated with QOL, while other depressive symptoms showed an indirect association with QOL mediated by impaired function. Depressed mood was positioned at the highest level in the model and predicted the activation of functional impairment and anxiety.

Conclusions

Functional disability mediated the relationship between depressive symptoms and QOL. Family functionality and suicidal symptoms were directly related to QOL. Depressed mood played the predominant role in activating both anxiety symptom and functional impairment.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Introduction

In 2017, the World Health Organization reported that major depressive disorder (MDD) was the second most prevalent disorder globally, affecting more than 300 million people worldwide (WHO, 2017). According to the Diagnostic and Statistical Manual of Mental Disorders, 5th Edition (DSM-5) criteria for MDD, at least five of the following symptoms (i.e. persistently low or depressed mood, anhedonia or decreased interest in pleasurable activities, feelings of guilt or worthlessness, lack of energy, poor concentration, appetite changes, psychomotor retardation or agitation, sleep disturbances, or suicidal thoughts) need to be present during the same 2-week period. And of them, at least one must be either depressed mood or loss of interest (or pleasure) (Bains & Abdijadid, Reference Bains and Abdijadid2022). Even though these symptoms are still defining features of MDD, there is a growing consensus that the scope of evaluation should include broader dimensions (Zhao et al., Reference Zhao, Wang, Wu, Hu, Niu, Wang and Wang2017), for instance, functioning (e.g. social and occupational functioning impairments that disrupt work, school, leisure, family life activities, and family responsibilities) (Sheehan, Nakagome, Asami, Pappadopulos, & Boucher, Reference Sheehan, Nakagome, Asami, Pappadopulos and Boucher2017) and quality of life (QOL) (e.g. subjective evaluation covering physical, mental, and social domains) (Rapaport, Clary, Fayyad, & Endicott, Reference Rapaport, Clary, Fayyad and Endicott2005; Yang et al., Reference Yang, Wu, Cao, Wang, Su, Huang and Fang2021).

In fact, depressive symptoms, functional impairment, and QOL are significantly inter-correlated (Greer, Kurian, & Trivedi, Reference Greer, Kurian and Trivedi2010; Prelipceanu, Purnichi, Marinescu, & Matei, Reference Prelipceanu, Purnichi, Marinescu and Matei2015). For example, some cohort studies suggested that depression may lead to functional disability, a type of functional impairment (De Ronchi et al., Reference De Ronchi, Bellini, Berardi, Serretti, Ferrari and Dalmonte2005; Esposito et al., Reference Esposito, Giunta, Nanni, Criscuolo, Manfreda, Del Duca and Troisi2021; Simning & Seplaki, Reference Simning and Seplaki2020), while some other studies indicated that functional disability may increase the risk for subsequent depression (Lyness, Caine, Conwell, King, & Cox, Reference Lyness, Caine, Conwell, King and Cox1993; Noh, Kwon, Park, Oh, & Kim, Reference Noh, Kwon, Park, Oh and Kim2016). In some studies, QOL predicted increased work disability (Koivumaa-Honkanen et al., Reference Koivumaa-Honkanen, Koskenvuo, Honkanen, Viinamäki, Heikkilä and Kaprio2004), whereas some other studies indicated that functional impairment could be an important determinant of QOL, since it occurs early in the course of the disorder and has a significant impact on daily living (Domínguez-Martínez, Kwapil, & Barrantes-Vidal, Reference Domínguez-Martínez, Kwapil and Barrantes-Vidal2015). It has also been proposed that the experience of disability partially mediates the relationship between symptoms and QOL (Hambrick, Turk, Heimberg, Schneier, & Liebowitz, Reference Hambrick, Turk, Heimberg, Schneier and Liebowitz2003). However, the causal relationship between depressive symptoms, disability, and QOL has not been elucidated.

Moreover, individual depressive symptoms may be differentially associated with functional impairments and QOL (Fried et al., Reference Fried, von Stockert, Haslbeck, Lamers, Schoevers and Penninx2020; Gollan et al., Reference Gollan, Fava, Kurian, Wisniewski, Rush, Daly and Trivedi2012). There is a growing need to identify the domain-specific relationships between depressive symptoms, dysfunction, and QOL that might aid in the identification of treatment targets for specific symptoms to improve functioning and QOL. The STAR*D study found that a sad mood and concentration problems had the highest unique associations with dysfunction, whereas hypersomnia, mid-nocturnal insomnia, and weight problems exhibited little contributions to functional impairment (Fried & Nesse, Reference Fried and Nesse2014). Another study found that motivational deficits (reduced interest and drive to initiate and maintain goal-directed activities) demonstrated the most robust impact on functional outcomes (Fervaha, Foussias, Takeuchi, Agid, & Remington, Reference Fervaha, Foussias, Takeuchi, Agid and Remington2016). In terms of QOL, individuals who are depressed may report poorer QOL caused by distress associated with core depressive symptoms, such as negative thinking and low mood (Tang, Thomas, & Larkin, Reference Tang, Thomas and Larkin2019). Wang et al. reported that cognitive symptoms were particularly associated with QOL (Wang, Tan, Ren, & Hammer-Helmich, Reference Wang, Tan, Ren and Hammer-Helmich2020). Self-stigma level has also been reported to have a negative impact on QOL in patients with MDD (Holubova et al., Reference Holubova, Prasko, Ociskova, Marackova, Grambal and Slepecky2016). However, it remains unclear whether certain symptoms are more impairing than others, and if so, what the magnitude of these differences might be.

The network approach is a promising solution as it brings a novel network perspective relating to psychopathology. It would provide unique information on dynamic and causal relationships among depressive symptoms (Borsboom, Reference Borsboom2017) using a developing methodology (Smith et al., Reference Smith, Mason, Crosby, Cao, Leonard, Wetterneck and Moessner2019). The network theory posits that different symptoms are not equivalent or interchangeable (Fried, Reference Fried2017). Recent applications of Bayesian approaches based on the directed acyclic graph (DAG) helped researchers to find the critical pathways of activation among symptoms (McNally, Reference McNally2016). And causality could be inferred by examining the dominant pathways of activation that lead to social dysfunction and a reduction in life satisfaction (Moffa et al., Reference Moffa, Catone, Kuipers, Kuipers, Freeman, Marwaha and Bebbington2017). These methods may propose new directions to improve treatment and may promote a more appropriate allocation of scarce medical resources (O'Driscoll et al., Reference O'Driscoll, Buckman, Fried, Saunders, Cohen, Ambler and Pilling2021).

Based on this background, we hypothesized that there are potential sequential relationships among dimensions of depressive symptoms, functional impairment, and QOL. In addition, we hypothesized that clinical symptoms and dysfunction have domain-specific associations with QOL. These hypotheses were tested on a large sample of patients with MDD using undirected network analyses and DAG.

Methods

Participants and study design

This was a multicenter and prospective project featuring two studies with consistent criteria for enrollment and intervention in the acute phase. The project was conducted at 12 sites in 11 governances of China, including Beijing, Guangdong, Xi'an, Hebei, Shaanxi, Yunnan, Heilongjiang, Jiangsu, Shanghai, Shanxi, Sichuan, and Shenzhen covering the east, south, north, and west of China. These 12 hospitals are located in densely populated cities, of which eight were general hospitals and four were psychiatric hospitals. The patients were enrolled from 9th November 2016 to 30th December 2020. The protocol of the study was approved by the Institutional Review Board (IRB) of Beijing Anding Hospital and an independent medical ethics committee board for all sites. Written informed consent was obtained from all participants. The study protocol was registered and several biomarker studies using single-center biological data have been published (Yang et al., Reference Yang, Zheng, Li, Wu, Tan, Zhou and Xie2020, Reference Yang, Zhou, Zhou, Wang, Sun, Zhu and Wang2022; Zhou et al., Reference Zhou, Zhou, Sun, Feng, Zhu, Yang and Wang2021)

The participants were aged 18–65 years and had been diagnosed with MDD according to the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) criteria. A total score of the 17-item Hamilton Rating Scale for Depression (HAMD-17) ⩾ 14, and a total score on the 16-item Quick Inventory of Depressive Symptoms-Self-Report (QIDS-SR16) ⩾ 11 were required. Patients with serious physical diseases and female patients who were pregnant were excluded. Patients at high risk of suicidal ideation (determined by a HAMD-17 item-3 score >2 points) were not included. Patients were excluded if they had used antidepressants continuously for more than 7 days in the most recent 14 days. A total of 1487 patients were enrolled; 102 cases were excluded due to incomplete questionnaires.

The interviews were conducted by trained interviewers who received uniform training before the project was launched. The training included practice scoring with feedback from an expert group and one-on-one discussion with raters who rated differently from others. Inter-rater reliability (kappa values for categorical measures, intra-class correlation for continuous variables) was >0.8 for all measurements. The study was supervised throughout its duration, and there were unscheduled spot checks to ensure good inter-rater reliability.

Measures

17-item Hamilton Rating Scale for Depression (HAMD-17)

The HAMD-17 was translated into Chinese and validated in patients with depression in 1988 (YP et al., Reference Zheng, Zhao, Philips, Liu, Cai, Sun and Huang1988). It is the most commonly used scale to measure symptomatology and illness severity for MDD and has been used for almost 30 years (Lin et al., Reference Lin, Wang, Dong, Du, Shen, Ding and Xu2018). The HAMD-17 consists of 17 questions with Likert scale responses of either 0–4 or 0–2; the total scores can range from 0 to 52. Internal consistency (Cronbach's α) for the HAMD-17 was 0.829 and 0.615 in a previous study (Ma et al., Reference Ma, Yang, Yang, Kang, Wang, Zhang and Liu2021) and the current baseline sample, respectively. The Cronbach's α for the week 4 HAMD-17 is 0.834.

Sheehan Disability Scale (SDS)

As a global self-rated questionnaire on functional disability, the SDS was used to evaluate the degree of dysfunction relating to family life/home responsibility, social life/leisure activities, and work/school (Sheehan et al., Reference Sheehan, Mancini, Wang, Berggren, Cao, Dueñas and Yue2016). These three items were graded according to a visual analogue scale ranging from 0 to 10; this can also be summed as the total SDS score. Internal consistency (Cronbach's α) for the SDS was 0.940 and 0.819 in a previous study (Leu et al., Reference Leu, Chou, Lee, Cheng, Shao, Hsien and Chen2015) and the current sample, respectively.

Quality of Life Enjoyment and Satisfaction Questionnaire – Short Form (Q-LES-Q-SF)

The Q-LES-Q-SF is a self-administered questionnaire that is used to measure health-related QOL covering various domains of well-being. The Q-LES-Q-SF has been a stand-alone measure used extensively in patients with MDD (Zhao et al., Reference Zhao, Wang, Wu, Hu, Niu, Wang and Wang2017). This questionnaire features 16 items scored on a five-point Likert scale ranging from 1 (very poor) to 5 (very good). The total score was computed by summating the scores on the first 14 items. Items 15 and 16 collate information related to satisfaction with the use of medication and overall life (Katila et al., Reference Katila, Mezhebovsky, Mulroy, Berggren, Eriksson, Earley and Datto2013). This scale has been proven to be a valid and reliable assessment tool for measuring QOL in patients with major psychiatric disorders (Ritsner, Kurs, Gibel, Ratner, & Endicott, Reference Ritsner, Kurs, Gibel, Ratner and Endicott2005). Internal consistency (Cronbach's α) for the Q-LES-Q-SF was 0.87 and 0.842 in a previous study (Lee et al., Reference Lee, Liu, Huang, Sun, Huang and Yeung2014) and the current sample, respectively.

Data analyses

Network analysis

First, the R-package graph package (Epskamp, Cramer, Waldorp, Schmittmann, & Borsboom, Reference Epskamp, Cramer, Waldorp, Schmittmann and Borsboom2012) was used to construct a partial correlation network (Epskamp, Borsboom, & Fried, Reference Epskamp, Borsboom and Fried2018) of (i) 17 symptoms of MDD, (ii) three functional disability items, and (iii) QOL (online Supplementary Table S1) in patients with MDD, using the Least Absolute Shrinkage and Selection Operator (LASSO) (Friedman, Hastie, & Tibshirani, Reference Friedman, Hastie and Tibshirani2008). Within the graphical network, each node depicts a symptom, and varying thicknesses of the edges represent the magnitude of regularized partial correlations between two individual symptoms. The stronger the connection is, the stronger, thicker, and more saturated an edge is. Blue edges reflect positive associations while yellow edges reflect negative associations.

Second, we also calculated centrality measures, such as strength, betweenness, and closeness, for all nodes. These metrics examined the relative importance and influence of symptoms (Boccaletti, Latora, Moreno, Chavez, & Hwang, Reference Boccaletti, Latora, Moreno, Chavez and Hwang2006; Opsahl, Agneessens, & Skvoretz, Reference Opsahl, Agneessens and Skvoretz2010). Node strength was calculated by summating all the edge weights attached to a given node, and it was a common and stable central metric. Betweenness was measured with the number of shortest paths that passed through the node of interest. Closeness referred to the inverse of the sum distance of a node to all other nodes. Highly central symptoms scored the highest on measures of strength centrality, as these strongly affect other symptoms in the network (McNally, Reference McNally2021). The activation of a highly central symptom increases the likelihood of activation spreading to a large number of other symptoms.

Third, network accuracy and stability were estimated using R-package bootnet (Epskamp et al., Reference Epskamp, Borsboom and Fried2018); this involved: (a) estimation of the bootstrapped confidence intervals of edge-weights by calculating their 95% confidence intervals (CIs) derived from a non-parametric bootstrap procedure (n = 1000); (b) evaluation of the stability of centrality indices from a case-drop bootstrap procedure, in which centrality indices were repeatedly calculated from subsets of data with an increasing proportion of cases subtracted. The correlation stability (CS) coefficient was used to quantify the stability of centrality indices and represents the maximum proportion of cases that can be dropped to retain a correlation of 0.7 in at least 95% of the sample. The CS coefficient should not be below 0.25 and preferably above 0.5; (c) bootstrapped difference tests (α = 0.05) for edge-weights and node strength using 1000 bootstrap samples. Gray boxes indicate nodes that do not significantly differ from one another. Black boxes indicate a significant difference.

Fourth, a Bayesian network, derived from the principles of causal reasoning, is defined as the combination of a DAG and a probability distribution (Briganti, Scutari, & McNally, Reference Briganti, Scutari and McNally2022). The DAG encodes conditional independence relationships and characterizes the joint probability distribution of the variables by using graphical separation. The logic behind the use of DAG to depict hypothetical causal structures is set out in detail by Pearl (Pearl, Reference Pearl2000). While causality can never be proved using observational data only, DAG can still provide admissible evidence of causal relationships. It gives information about both the magnitude and direction of the connections between symptoms. DAG has been increasingly used in the psychological context (Moffa et al., Reference Moffa, Catone, Kuipers, Kuipers, Freeman, Marwaha and Bebbington2017). The R-package bnlearn was used in this study. It uses a hill-climbing algorithm (McNally, Reference McNally2016), as described recently (Amore et al., Reference Amore, Murri, Calcagno, Rocca, Rossi, Aguglia and Maj2020; McNally, Mair, Mugno, & Riemann, Reference McNally, Mair, Mugno and Riemann2017). To ensure the stability of the resultant network, we conducted bootstrapping (n = 1000 iterations) and calculated the goodness-of-fit index (i.e. Bayesian Information Criteria, BIC) for each sample (Scutari & Nagarajan, Reference Scutari and Nagarajan2013). If those edges displayed the same direction in at least 85% of these networks, then we retained the edge in the resultant network (França, Gordon, Samra, Rodolpho Duarte, & Jacinto, Reference França, Gordon, Samra, Rodolpho Duarte and Jacinto2020; Moffa et al., Reference Moffa, Catone, Kuipers, Kuipers, Freeman, Marwaha and Bebbington2017). All analyses were carried out in R 3.6.3 (R Foundation for Statistical Computing, Vienna, Austria).

Fifth, we also performed online Supplementary analysis. There was a large gender disparity in participants (only 32% were male), depression was more common in females, and some of the factors examined (e.g. family factors) differed by gender. Given these factors, it was important to examine whether the findings differ in males and females. We compared the gender difference in the network using the recently developed test, the Network Comparison Test (NCT), which allows researchers to test differences in global network strength (i.e. the overall level of connectivity of the network) and global network structure (i.e. the overall structure of the network) between two networks (Borkulo et al., Reference Borkulo, Boschloo, Kossakowski, Tio, Schoevers, Borsboom and Waldorp2017). The Q-LES-Q-SF has 16 items and includes the same content as the general activities section of the longer version (Lee et al., Reference Lee, Liu, Huang, Sun, Huang and Yeung2014). No criteria that can help to categorize the items into dimensions were found. If all individual items of the Q-LES-Q-SF were included as nodes in the network analyses, it would be difficult to interpret. Therefore, only the total score of the Q-LES-Q-SF was included. The result of the undirected network analysis is also added in the online Supplementary material, in which items of the Q-LES-Q-SF were included (online Supplementary Fig. S7). In addition, we used the follow-up data at week 4 to verify the results of the DAG analysis. To sufficiently analyze the results, we also included the longitudinal data (at baseline and week 4) to examine the association found in the DAG analysis. On the one hand, among the variables found in the DAG branch, the levels of the symptoms at baseline were stratified according to the levels of their median, and the two baseline groups' levels of symptoms at week 4 of the two baseline groups at week 4 were compared using the Wilcoxon rank-sum test. On the other hand, the Spearman's correlation was used to analyze the correlation between the change values of any two items that were supposed to have a correlation, as well as the relationship between the baseline level of symptoms and the level of subsequent symptoms at week 4. The curves were fitted through scatter plots.

Results

Sample characteristics

Of the 1385 subjects, 31.55% were male. The mean age was 34.21 ± 12.31 years. The majority (58.70%) have a normal and healthy weight. The mean duration of illness was 34.05 ± 51.04 months and 14.15% (n = 196) had a family history of mental illness. Data relating to demographics and the clinical characteristics of the study population are summarized in Table 1. The mean scores for the HAMD-17 items, SDS items, and Q-LES-Q-SF total scores are reported in Table 2.

Table 1. Basic information n (%) or (mean ± s.d.)

Educational level of two patients was missing.

Employments status of four patients was missing.

Marital status of three patients was missing.

First episode information of two patients was missing.

Duration of illness (months) and age of onset of 20 patients were missing.

Duration of current episode (months) of 18 patients was missing.

Table 2. The mean scores for the HAMD-17, SDS, and Q-LES-Q-SF (mean ± s.d.)

Note: HAMD-17 is the 17-item Hamilton Rating Scale for Depression, SDS is the Sheehan Disability Scale, Q-LES-Q-SF is the Quality of Life Enjoyment and Satisfaction Questionnaire – Short Form.

Undirected network structure (graphical LASSO)

The network for depressive symptoms, functional impairment, and QOL contained 21 nodes (Fig. 1). Most of the edges among depressive symptoms and functional impairment represent positive correlations; however, all links with life satisfaction were negative. The strongest edges were observed between the life satisfaction and family life functional disability nodes, as well as the suicidal ideation node. Nodes within the domain of functional impairment were generally highly interconnected and clustered closely together. Within the depressive symptoms, strong links were found between suicidal ideation and feelings of guilt, depressed mood, and psychological anxiety, as well as early, middle, and late insomnia.

Fig. 1. Undirected networks of depressive symptoms, functional disabilities, and QOL in patients with MDD. Each edge corresponds to a partial correlation (positive in blue, negative in orange, maximum magnitude = 0.43) between two items; the thickness corresponds to the absolute magnitude of the correlation. The colors of the nodes correspond to detected communities in the network: HAMD-17 (pink), SDS (blue), and Q-LES-Q-SF total score (green). Item label abbreviations are defined on the right side of figure.

Three centrality metrics (strength, betweenness, and closeness) of the graphical LASSO are presented in Fig. 2. A node with a higher index of centrality is more central in the network, and this implies close linkage to other symptoms in the network (Opsahl et al., Reference Opsahl, Agneessens and Skvoretz2010). The five symptoms exhibiting the highest strength centrality were social life dysfunction, QOL, late insomnia, family life responsibilities, and somatic symptoms. Somatic symptoms and QOL emerged as the most central nodes in the network for betweenness, indicating that these two symptoms often transmitted information through the network (McElroy, Shevlin, Murphy, & McBride, Reference McElroy, Shevlin, Murphy and McBride2018). Somatic symptoms and psychological anxiety had the highest centrality for closeness, indicating that these are key nodes that are more likely to affect other symptoms in a rapid manner (Bringmann, Lemmens, Huibers, Borsboom, & Tuerlinckx, Reference Bringmann, Lemmens, Huibers, Borsboom and Tuerlinckx2015).

Fig. 2. Node centrality metrics of the network. The left, middle, and right panels show the strength, betweenness, and closeness estimates for each node of the network, respectively.

Data acquired through the case-drop procedure suggested a robust estimation of centrality (Fig. 3). The correlations between the measures of centrality using the full sample and a subset of 30% of the data were higher than 0.25. This indicates that, even when 70% of the sample were randomly removed, the network structure remained highly stable. The network also appeared quite stable across bootstrapped difference tests for edge weights and node strength (online Supplementary Figs S1 and S2). The result of bootstrapped 95% confidence intervals for the edge weights is shown in online Supplementary materials (Fig. S3).

Fig. 3. Stability of the centrality indices: point estimates and corresponding 95% CIs. This was determined by average correlations between the centrality indices of networks sampled with patients dropped and the original sample. Lines indicate the means and areas indicate the range from the 2.5th quantile to the 97.5th quantile.

The results relating to gender difference in the network indicated that the global network strength was larger in the female network than in the male network (S = 2.202, p = 0.0278), although this was not accompanied by differences in the network structure (M = 0.149, p = 0.1008). Depressed mood symptom plays a more central role in the female network, while in the male network this role is played by somatic symptoms. These results are shown in the online Supplementary material (Figs S4–S6).

Bayesian network

Figure 4 depicts the DAG arising from the Bayesian network analysis and illustrates connections between depressive symptoms, functional disabilities, and QOL in patients with MDD. Edge thickness indicates the importance of the connections in terms of network structure; the position of different items is indicative of predictive priority over other items. Depressed mood was positioned at the highest level in the model, suggesting its causal priority. Depressed mood predicted the activation of functional impairment, including disability related to work, activities, social life, and family life, thus activating the QOL. In another important branch, the depressed mood node triggered anxiety including psychological anxiety, somatic anxiety, and general somatic symptoms. As evident in the regularized partial correlation network, a feeling of guilt directly influences suicidal ideation (with a strong association), thus influencing the QOL. While the DAG estimated several branches of activation, some nodes (e.g. QOL and somatic symptom) appeared to act as ‘bridges’ between these pathways. In total, 1025 patients with MDD (74.0% of the total sample) were followed at week 4 (HAMD-17 total score = 11.07 ± 6.31). Generally, the DAG of the week 4 follow-up data was consistent with the baseline result. The three impact pathways identified by the baseline DAG were validated by the 4-week data, namely (first branch: depressed mood – disrupted work and activities – disrupted social life – disrupted family life – QOL; second branch: depressed mood – psychological anxiety – somatic anxiety – general somatic symptoms; third branch: feeling of guilt – suicidal ideation – QOL). These results are shown in the online Supplementary material (Fig. S8).

Fig. 4. Directed acyclic graph (DAG) of depressive symptoms, functional disabilities, and QOL in patients with MDD. Arrows indicate the direction of the assumed causal relationships. Edge thickness indicates confidence that the predicted direction of edge points in the direction displayed in the graph.

The result of the analysis using the longitudinal data indicated that compared with the group with a lower baseline level of depressive symptoms in the DAG branch, the group with a higher baseline level has a higher level of subsequent symptoms at week 4, p < 0.05 (Fig. 5). And this between-group difference was not found between the variables with no connections indicated in the DAG (e.g. the suicide item and the insomnia middle item; the insight item and the feelings of guilt item), p > 0.05 (online Supplementary Fig. S9). A significant correlation was found between the baseline level of symptoms and the level of subsequent symptoms at week 4 (e.g. the depressed mood item at baseline was positively associated with the work and activity item at week 4). The curves were also fitted through scatter plots (online Supplementary Fig. S10). The correlation between the change values (from baseline to week 4) of any two items in the DAG branch that were supposed to have a correlation was significant. For example, the reduction of the score of the work and the activity items was positively associated with the reduction of the score of the depressed mood item (r = 0.25, p < 0.001), the reduction of psychological anxiety was positively associated with the reduction of the score of the depressed mood item (r = 0.37, p < 0.001), and the reduction of the score of the suicide item was positively associated with the reduction of the score of the feelings of guilt item (r = 0.26, p < 0.001). The curves were also fitted through scatter plots (online Supplementary Fig. S11).

Fig. 5. Longitudinal data (baseline and week 4) used to examine the association found in DAG analysis.

Note: (a) Branch 1: depressed mood – work and activity – work or school disability – social life disability – family life disability – quality of life – somatic symptoms; (b) Branch 2: depressed mood – psychological anxiety – somatic anxiety – somatic symptoms general; (c) Branch 3: feelings of guilt – suicide – quality of life. The levels of the symptoms at baseline were stratified according to the levels of their median. The groups with lower baseline item/scale score are depicted in red, and the groups with higher baseline score are in teal.

Discussion

To the best of our knowledge, this is the first study to examine the associations between depressive symptoms, functional impairment, and QOL in major depressive patients using both undirected and Bayesian network analyses. The sample is representative of the general population, to an extent. On the one hand, the male-to-female ratio in our study was close to 1:2. It is in line with the gender difference in the prevalence of depression that women are twice as likely to experience depression compared with men, and this finding has been replicated across many cultures as one of the most robust findings in psychiatric epidemiology (Bone, Lewis, & Lewis, Reference Bone, Lewis and Lewis2020; Salk, Hyde, & Abramson, Reference Salk, Hyde and Abramson2017). On the other hand, the participants of this study had various demographic and clinical characteristics, e.g. education levels, employments status, marital status, episodes, and duration of illness. The results clearly indicated that functional disability was an important mediator between depressive symptoms and QOL. Depressed mood played a predominant role in activating both anxiety symptom and functional impairment. The factors most directly related to QOL were family functionality and suicidal symptoms.

Our results indicated that some depressive symptoms (e.g. suicidal ideation and hypochondriasis) were directly associated with QOL, while other depressive symptoms (e.g. depressed mood and a loss of interest in activity, hobbies, or work) showed an indirect association with QOL mediated by impaired function. These results are examined using longitudinal data available and are consistent with the results of most previous studies that attempted to identify the relationship between depressive symptoms, family function, and QOL (Akosile et al., Reference Akosile, Mgbeojedo, Maruf, Okoye, Umeonwuka and Ogunniyi2018; Alessandrini et al., Reference Alessandrini, Lançon, Fond, Faget-Agius, Richieri, Faugere and Boyer2016; Gardsjord et al., Reference Gardsjord, Romm, Røssberg, Friis, Barder, Evensen and Melle2018). The indirect path suggests that the depressive symptoms' impact on function can cause an alteration of QOL, not necessarily the symptoms themselves. Alessandrini et al. also revealed a highly significant path between depression and QOL, as well as a minor significant indirect path between depression and QOL mediated by function, using a structural equation modeling approach (Alessandrini et al., Reference Alessandrini, Lançon, Fond, Faget-Agius, Richieri, Faugere and Boyer2016). Conversely, some previous studies showed that depression is an intermediary factor for the relationship between function and QOL (Chan, Pan, Xu, & Yeung, Reference Chan, Pan, Xu and Yeung2021; Clements, Frazier, Moser, Lennie, & Chung, Reference Clements, Frazier, Moser, Lennie and Chung2020; Lu, Yuan, Lin, Zhou, & Pan, Reference Lu, Yuan, Lin, Zhou and Pan2017). The reasons for this inconsistency were likely different study populations and measurement models.

As one of core symptoms defined by DSM-5 to diagnose MDD (APA., 2013), depressed mood was located at the top of the DAG. Therefore, depressed mood was estimated to have greater priority and to contribute to the rapid activation of interrelated symptoms (Armour, Fried, Deserno, Tsai, & Pietrzak, Reference Armour, Fried, Deserno, Tsai and Pietrzak2017). It should be noted that, in this result, depressed mood induced functional impairment through the loss of interest in activity, hobbies, or work. These results underline the potential clinical importance of the core criterion, and support a previous study reporting that the core symptoms of DSM were of the highest impact in terms of the impairment of psychosocial functioning (Fried & Nesse, Reference Fried and Nesse2014). Moreover, depressed mood also triggered the activation of anxiety symptoms. Anxiety was proposed to be reclassified within depressive disorders as a continuum from depression to anxiety (Park & Kim, Reference Park and Kim2020). These conditions overlap substantially and are organized within a larger psychopathological network (Cramer, Waldorp, van der Maas, & Borsboom, Reference Cramer, Waldorp, van der Maas and Borsboom2010; Fried & Nesse, Reference Fried and Nesse2015; Goekoop & Goekoop, Reference Goekoop and Goekoop2014). This means that once a few specific symptoms have been activated, these activated signals can spread from symptoms of depression to those of anxiety via highly central symptoms (Fried, Epskamp, Nesse, Tuerlinckx, & Borsboom, Reference Fried, Epskamp, Nesse, Tuerlinckx and Borsboom2016). Some findings show that the symptoms of depression are no more central than anxiety symptoms for patients with MDD (Park & Kim, Reference Park and Kim2020). For example, the results of the STAR*D study suggested that DSM symptoms (e.g. sad mood) and non-DSM symptoms (e.g. anxiety) were among the most central symptoms, while DSM criteria were no more central than non-DSM criteria (Fried et al., Reference Fried, Epskamp, Nesse, Tuerlinckx and Borsboom2016). However, our results showed that ‘depressed mood’ was still the key symptom that contributes to the rapid activation of interrelated symptoms and dysfunction. So, we emphasized the importance of ‘depressed mood’ as the therapeutic target for early intervention. A possible reason for the difference between the results of our study and that of STAR*D is that the network analysis in STAR*D focused purely on the comparison among depressive symptoms, whereas our study had some expansion on the dimensions of social functioning and QOL.

Our results indicated that family functionality and suicidal symptoms were the factors that were most directly related to QOL. Both undirected and directed analyses identified a connection between suicidal ideation and a reduced QOL and the most likely direction was from suicidal ideation to QOL, rather than vice versa. This was in line with other studies finding that suicidal ideation was associated with QOL (Almeida et al., Reference Almeida, Bezerra-Filho, Studart-Bottó, Léda-Rego, Silva, Kapczinski and Miranda-Scippa2021; Beşirli, Alptekin, Kaymak, & Özer, Reference Beşirli, Alptekin, Kaymak and Özer2020; van Spijker et al., Reference van Spijker, Batterham, Calear, Wong, Werner-Seidler and Christensen2020) and suicidal thinking may reduce QOL (Hidalgo-Rasmussen & Martín, Reference Hidalgo-Rasmussen and Martín2015; Kim et al., Reference Kim, Kim, Kang, Bae, Kim, Shin and Yoon2019; van Spijker, van Straten, Kerkhof, Hoeymans, & Smit, Reference van Spijker, van Straten, Kerkhof, Hoeymans and Smit2011). It should be noted that there are also some previous studies indicating that a low QOL could be a risk factor for suicidal ideation (Fairweather-Schmidt, Batterham, Butterworth, & Nada-Raja, Reference Fairweather-Schmidt, Batterham, Butterworth and Nada-Raja2016; Faure et al., Reference Faure, Urquidi, Bustamante, Florenzano, Ampuero, Terán and Giacaman2018; Sinclair, Hawton, & Gray, Reference Sinclair, Hawton and Gray2010; van Spijker et al., Reference van Spijker, Batterham, Calear, Wong, Werner-Seidler and Christensen2020). For instance, in a prospective study based on a Finnish twin cohort, QOL was found to exert a long-term effect on the risk of suicide throughout a 20-year follow-up period (Koivumaa-Honkanen et al., Reference Koivumaa-Honkanen, Honkanen, Viinamäki, Heikkilä, Kaprio and Koskenvuo2001). Additionally, a study found that functional impairment in family life/home responsibilities would lead to a direct reduction in QOL. One explanation could be that family relationships are usually considered the major source of emotional comforts which exert a significant influence on the QOL (Lu et al., Reference Lu, Yuan, Lin, Zhou and Pan2017).

Centrality analysis indicated that social life dysfunction exhibited the highest strength centrality. The potential explanation for this finding is that social life dysfunction is often manifested as hyper-sensitivity to social rejection and impaired social perception (Kupferberg, Bicks, & Hasler, Reference Kupferberg, Bicks and Hasler2016). These conditions predict higher rates of internal life stressors (Liu, Kraines, Massing-Schaffer, & Alloy, Reference Liu, Kraines, Massing-Schaffer and Alloy2014) and subsequent depressive symptoms (Liu et al., Reference Liu, Kraines, Massing-Schaffer and Alloy2014). It should be admitted that betweenness and closeness centrality seem to be especially poorly suited to most psychological networks, as they come with strong assumptions that may not hold. However, many alternative measures that were introduced over a substantial period of time also have these problems (Bringmann et al., Reference Bringmann, Elmer, Epskamp, Krause, Schoch, Wichers and Snippe2019). Thus, strength, betweenness, and closeness are still the most common centrality indices used in psychological network research (Ye et al., Reference Ye, Zalesky, Lv, Loi, Cetin-Karayumak, Rathi and Di Biase2021).

About the networks developed in terms of gender, we found significant differences in the network global strength. Symptom networks of female patients were more strongly connected, as global strength was higher in the female group than in the male group, and this result is consistent with previous findings (Jin et al., Reference Jin, Sun, Lam, Su, Hall and Cheung2022; Steen, van Borkulo, & van Loo, Reference Steen, van Borkulo and van Loo2021). This result supports the notion that the cluster of dynamic mechanisms of depressive symptoms in women is more complex compared with men (Cramer et al., Reference Cramer, van Borkulo, Giltay, van der Maas, Kendler, Scheffer and Borsboom2016), which may be related to a greater vulnerability to depression and a less positive prognosis (van Borkulo et al., Reference van Borkulo, Boschloo, Borsboom, Penninx, Waldorp and Schoevers2015). On the other hand, our results indicated that symptoms central to the network were similar in general between the sexes. While depressed mood has a greater presence in women, somatic symptoms are more central in men. This finding supports the Gender Responding Framework (Castellanos, Ausin, Bestea, Gonzalez-Sanguino, & Munoz, Reference Castellanos, Ausin, Bestea, Gonzalez-Sanguino and Munoz2020; Price, Gregg, Smith, & Fiske, Reference Price, Gregg, Smith and Fiske2018; Rodgers et al., Reference Rodgers, Grosse Holtforth, Muller, Hengartner, Rossler and Ajdacic-Gross2014), which indicated that men tend to present more externalized symptoms, and women tend to present more internalized symptoms. These differences can be critical for providing important additional information about the relationships among depression symptoms in males and females, as well as making a more complete evaluation of MDD.

This study was strengthened by a large, multi-site sample of individuals suffering from MDD and the use of network models that are appropriate for describing complex dynamic systems (Nelson, McGorry, Wichers, Wigman, & Hartmann, Reference Nelson, McGorry, Wichers, Wigman and Hartmann2017). However, our study has some limitations that need to be mentioned. First, even though the DAG provides preliminary clues to both the strength and direction of the possible connections among the variables under analysis, caution is still required as causal inference is only fully defensible when all assumptions are completely met (Moffa et al., Reference Moffa, Catone, Kuipers, Kuipers, Freeman, Marwaha and Bebbington2017). Longitudinal studies focusing on disease development are needed for further validation (Bringmann et al., Reference Bringmann, Vissers, Wichers, Geschwind, Kuppens, Peeters and Tuerlinckx2013). Second, although a wide range of clinical dimensions were assessed, these network structures must be explained under the assumption of the absence of unmeasured confounders or selection variables. These variables may include shame, self-esteem, or cognitive biases. The inclusion of those variables in future network-based studies may enrich the research of MDD. Third, the study excluded patients with suicidal ideation item score >2 (as high risk for suicide), which may impact the relationship of suicidal ideation with other depressive symptoms, QOL, and functioning.

Despite these limitations, to our knowledge, this study was the first to elucidate the associations between depressive symptoms, functional impairment, and QOL in patients with MDD at the level of individual symptoms. We found that functional disability mediated the relationship between depressive symptoms and QOL. Depressed mood played the predominant role in activating both anxiety symptoms and functional impairment. Family functionality and suicidal symptoms were directly related to QOL. The study has important guiding value for the further understanding of MDD and the adjustment of treatment strategies for patients with this disease.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291722003385

Acknowledgments

None.

Author contributions

Jia Zhou: methodology, formal analysis, and writing – original draft. Jingjing Zhou: writing – original draft. Yuan Feng, Le Xiao, and Xu Chen: resources and investigation. Lei Feng: project administration. Jian Yang: writing – review and editing. Gang Wang: conceptualization. All authors contributed to the article and approved the submitted version.

Financial support

This work was supported by the National Key Research & Development Program of China (No. 2016YFC1307200), Beijing Demonstrative Research Ward (Grant No. BCRW202009), Beijing Municipal Administration of Hospitals Incubating Program (No. PX2020073), the Capital's Funds for Health Improvement and Research (No. 2020-2-1171), Beijing Talents Project (2020A38), Beijing Young Top-Notch Talent Support project (Grant No. 2018000021223ZK36).

Conflict of interest

None.

Footnotes

*

These authors contributed equally to this work.

References

Akosile, C. O., Mgbeojedo, U. G., Maruf, F. A., Okoye, E. C., Umeonwuka, I. C., & Ogunniyi, A. (2018). Depression, functional disability and quality of life among Nigerian older adults: Prevalences and relationships. Archives of Gerontology and Geriatrics, 74, 3943. https://doi.org/10.1016/j.archger.2017.08.011.CrossRefGoogle ScholarPubMed
Alessandrini, M., Lançon, C., Fond, G., Faget-Agius, C., Richieri, R., Faugere, M., … Boyer, L. (2016). A structural equation modelling approach to explore the determinants of quality of life in schizophrenia. Schizophrenia Research, 171(1–3), 2734. https://doi.org/10.1016/j.schres.2016.01.012.CrossRefGoogle ScholarPubMed
Almeida, V. F., Bezerra-Filho, S., Studart-Bottó, P., Léda-Rego, G., Silva, I. T. F., Kapczinski, F., & Miranda-Scippa, Â (2021). History of suicide attempts in patients with bipolar disorder type I: Socio-demographic and clinical factors, quality of life and functioning. Nordic Journal of Psychiatry, 75(4), 306313. https://doi.org/10.1080/08039488.2020.1853230.CrossRefGoogle ScholarPubMed
Amore, M., Murri, M. B., Calcagno, P., Rocca, P., Rossi, A., Aguglia, E., … Maj, M. (2020). The association between insight and depressive symptoms in schizophrenia: Undirected and Bayesian network analyses. European Psychiatry, 63(1), 121. https://doi.org/10.1192/j.eurpsy.2020.45.CrossRefGoogle ScholarPubMed
APA. (2013). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: American Psychiatric Association.Google Scholar
Armour, C., Fried, E. I., Deserno, M. K., Tsai, J., & Pietrzak, R. H. (2017). A network analysis of DSM-5 posttraumatic stress disorder symptoms and correlates in U.S. military veterans. Journal of Anxiety Disorders, 45, 4959. https://doi.org/10.1016/j.janxdis.2016.11.008.CrossRefGoogle ScholarPubMed
Bains, N., & Abdijadid, S. (2022). Major depressive disorder. In StatPearls. Treasure Island (FL): StatPearls Publishing Copyright © 2022, StatPearls Publishing LLC.Google Scholar
Beşirli, A., Alptekin, J., Kaymak, D., & Özer, Ö. A. (2020). The relationship between anxiety, depression, suicidal ideation and quality of life in patients with rheumatoid arthritis. Psychiatric Quarterly, 91(1), 5364. https://doi.org/10.1007/s11126-019-09680-x.CrossRefGoogle ScholarPubMed
Boccaletti, S., Latora, V., Moreno, Y., Chavez, M., & Hwang, D. U. (2006). Complex networks: Structure and dynamics. Physics Reports, 424(4), 175308. https://doi.org/https://doi.org/10.1016/j.physrep.2005.10.009.CrossRefGoogle Scholar
Bone, J. K., Lewis, G., & Lewis, G. (2020). The role of gender inequalities in adolescent depression. The Lancet Psychiatry, 7(6), 471472. https://doi.org/10.1016/s2215-0366(20)30081-x.CrossRefGoogle ScholarPubMed
Borkulo, C. D. V., Boschloo, L., Kossakowski, J. J., Tio, P., Schoevers, R. A., Borsboom, D., & Waldorp, L. J. (2017). Comparing network structures on three aspects: A permutation test.Google Scholar
Borsboom, D. (2017). A network theory of mental disorders. World Psychiatry, 16(1), 513. https://doi.org/10.1002/wps.20375.CrossRefGoogle ScholarPubMed
Briganti, G., Scutari, M., & McNally, R. J. (2022). A tutorial on Bayesian networks for psychopathology researchers. Psychological Methods. https://doi.org/10.1037/met0000479. Epub ahead of print.Google ScholarPubMed
Bringmann, L. F., Elmer, T., Epskamp, S., Krause, R. W., Schoch, D., Wichers, M., … Snippe, E. (2019). What do centrality measures measure in psychological networks? Journal of Abnormal Psychology, 128(8), 892903. https://doi.org/10.1037/abn0000446.CrossRefGoogle ScholarPubMed
Bringmann, L. F., Lemmens, L. H., Huibers, M. J., Borsboom, D., & Tuerlinckx, F. (2015). Revealing the dynamic network structure of the Beck Depression Inventory-II. Psychological Medicine, 45(4), 747757. https://doi.org/10.1017/s0033291714001809.CrossRefGoogle ScholarPubMed
Bringmann, L. F., Vissers, N., Wichers, M., Geschwind, N., Kuppens, P., Peeters, F., … Tuerlinckx, F. (2013). A network approach to psychopathology: New insights into clinical longitudinal data. PLoS ONE, 8(4), e60188. https://doi.org/10.1371/journal.pone.0060188.CrossRefGoogle ScholarPubMed
Castellanos, M. A., Ausin, B., Bestea, S., Gonzalez-Sanguino, C., & Munoz, M. (2020). A network analysis of major depressive disorder symptoms and age- and gender-related differences in people over 65 in a Madrid community sample (Spain). International Journal of Environmental Research and Public Health, 17(23), 113. https://doi.org/10.3390/ijerph17238934.CrossRefGoogle Scholar
Chan, S. H., Pan, Y., Xu, Y., & Yeung, K. C. (2021). Life satisfaction of 511 elderly Chinese stroke survivors: Moderating roles of social functioning and depression in a quality of life model. Clinical Rehabilitation, 35(2), 302313. https://doi.org/10.1177/0269215520956908.CrossRefGoogle Scholar
Clements, L., Frazier, S. K., Moser, D. K., Lennie, T. A., & Chung, M. L. (2020). The mediator effects of depressive symptoms on the relationship between family functioning and quality of life in caregivers of patients with heart failure. Heart & Lung, 49(6), 737744. https://doi.org/10.1016/j.hrtlng.2020.08.011.CrossRefGoogle ScholarPubMed
Cramer, A. O., van Borkulo, C. D., Giltay, E. J., van der Maas, H. L., Kendler, K. S., Scheffer, M., & Borsboom, D. (2016). Major depression as a complex dynamic system. PLoS ONE, 11(12), e0167490. https://doi.org/10.1371/journal.pone.0167490.CrossRefGoogle ScholarPubMed
Cramer, A. O., Waldorp, L. J., van der Maas, H. L., & Borsboom, D. (2010). Comorbidity: A network perspective. Behavioral and Brain Sciences, 33(2–3), 137150, discussion 150–193. https://doi.org/10.1017/s0140525x09991567.CrossRefGoogle ScholarPubMed
De Ronchi, D., Bellini, F., Berardi, D., Serretti, A., Ferrari, B., & Dalmonte, E. (2005). Cognitive status, depressive symptoms, and health status as predictors of functional disability among elderly persons with low-to-moderate education: The Faenza Community Aging Study. American Journal of Geriatric Psychiatry, 13(8), 672685. https://doi.org/10.1176/appi.ajgp.13.8.672.CrossRefGoogle ScholarPubMed
Domínguez-Martínez, T., Kwapil, T. R., & Barrantes-Vidal, N. (2015). Subjective quality of life in At-Risk Mental State for psychosis patients: Relationship with symptom severity and functional impairment. Early Intervention in Psychiatry, 9(4), 292299. https://doi.org/10.1111/eip.12111.CrossRefGoogle ScholarPubMed
Epskamp, S., Borsboom, D., & Fried, E. I. (2018). Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods, 50(1), 195212. https://doi.org/10.3758/s13428-017-0862-1.CrossRefGoogle ScholarPubMed
Epskamp, S., Cramer, A. O. J., Waldorp, L. J., Schmittmann, V. D., & Borsboom, D. (2012). qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48(4), 116. https://doi.org/10.18637/jss.v048.i04.CrossRefGoogle Scholar
Esposito, M., Giunta, A., Nanni, R. C., Criscuolo, S., Manfreda, V., Del Duca, E., … Troisi, A. (2021). Depressive symptoms and insecure attachment predict disability and quality of life in psoriasis independently from disease severity. Archives for Dermatological Research. Archiv für Dermatologische Forschung, 313(6), 431437. https://doi.org/10.1007/s00403-020-02116-8.CrossRefGoogle ScholarPubMed
Fairweather-Schmidt, A. K., Batterham, P. J., Butterworth, P., & Nada-Raja, S. (2016). The impact of suicidality on health-related quality of life: A latent growth curve analysis of community-based data. Journal of Affective Disorders, 203, 1421. https://doi.org/10.1016/j.jad.2016.05.067.CrossRefGoogle ScholarPubMed
Faure, M. I., Urquidi, C., Bustamante, F., Florenzano, R., Ampuero, K., Terán, L., … Giacaman, E. (2018). [Association of health-related quality of life and suicidal risk in adolescents: A cross-sectional study]. Revista Chilena de Pediatría, 89(3), 318324. https://doi.org/10.4067/s0370-41062018005000103, (Asociación entre la calidad de vida relacionada con la salud y riesgo suicida en adolescentes: estudio transversal.).Google ScholarPubMed
Fervaha, G., Foussias, G., Takeuchi, H., Agid, O., & Remington, G. (2016). Motivational deficits in major depressive disorder: Cross-sectional and longitudinal relationships with functional impairment and subjective well-being. Comprehensive Psychiatry, 66, 3138. https://doi.org/10.1016/j.comppsych.2015.12.004.CrossRefGoogle ScholarPubMed
França, A. B., Gordon, A. L., Samra, R., Rodolpho Duarte, E. S., & Jacinto, A. F. (2020). Symptoms of mood disorders in family carers of older people with dementia who experience caregiver burden: A network approach. Age and Ageing, 49(4), 628633. https://doi.org/10.1093/ageing/afaa008.CrossRefGoogle ScholarPubMed
Fried, E. I. (2017). The 52 symptoms of major depression: Lack of content overlap among seven common depression scales. Journal of Affective Disorders, 208, 191197. https://doi.org/10.1016/j.jad.2016.10.019.CrossRefGoogle ScholarPubMed
Fried, E. I., Epskamp, S., Nesse, R. M., Tuerlinckx, F., & Borsboom, D. (2016). What are ‘good’ depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis. Journal of Affective Disorders, 189, 314320. https://doi.org/10.1016/j.jad.2015.09.005.CrossRefGoogle Scholar
Fried, E. I., & Nesse, R. M. (2014). The impact of individual depressive symptoms on impairment of psychosocial functioning. PLoS ONE, 9(2), e90311. https://doi.org/10.1371/journal.pone.0090311.CrossRefGoogle ScholarPubMed
Fried, E. I., & Nesse, R. M. (2015). Depression is not a consistent syndrome: An investigation of unique symptom patterns in the STAR*D study. Journal of Affective Disorders, 172, 96102. https://doi.org/10.1016/j.jad.2014.10.010.CrossRefGoogle Scholar
Fried, E. I., von Stockert, S., Haslbeck, J. M. B., Lamers, F., Schoevers, R. A., & Penninx, B. (2020). Using network analysis to examine links between individual depressive symptoms, inflammatory markers, and covariates. Psychological Medicine, 50(16), 26822690. https://doi.org/10.1017/s0033291719002770.CrossRefGoogle ScholarPubMed
Friedman, J., Hastie, T., & Tibshirani, R. (2008). Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9(3), 432441. https://doi.org/10.1093/biostatistics/kxm045.CrossRefGoogle ScholarPubMed
Gardsjord, E. S., Romm, K. L., Røssberg, J. I., Friis, S., Barder, H. E., Evensen, J., … Melle, I. (2018). Depression and functioning are important to subjective quality of life after a first episode psychosis. Comprehensive Psychiatry, 86, 107114. https://doi.org/10.1016/j.comppsych.2018.07.014.CrossRefGoogle ScholarPubMed
Goekoop, R., & Goekoop, J. G. (2014). A network view on psychiatric disorders: Network clusters of symptoms as elementary syndromes of psychopathology. PLoS ONE, 9(11), e112734. https://doi.org/10.1371/journal.pone.0112734.CrossRefGoogle ScholarPubMed
Gollan, J. K., Fava, M., Kurian, B., Wisniewski, S. R., Rush, A. J., Daly, E., … Trivedi, M. H. (2012). What are the clinical implications of new onset or worsening anxiety during the first two weeks of SSRI treatment for depression? Depression and Anxiety, 29(2), 94101. https://doi.org/10.1002/da.20917.CrossRefGoogle ScholarPubMed
Greer, T. L., Kurian, B. T., & Trivedi, M. H. (2010). Defining and measuring functional recovery from depression. CNS Drugs, 24(4), 267284. https://doi.org/10.2165/11530230-000000000-00000.CrossRefGoogle ScholarPubMed
Hambrick, J. P., Turk, C. L., Heimberg, R. G., Schneier, F. R., & Liebowitz, M. R. (2003). The experience of disability and quality of life in social anxiety disorder. Depression and Anxiety, 18(1), 4650. https://doi.org/10.1002/da.10110.CrossRefGoogle ScholarPubMed
Hidalgo-Rasmussen, C., & Martín, A. H. (2015). Suicidal-related behaviors and quality of life according to gender in adolescent Mexican high school students. Ciência & Saúde Coletiva, 20(11), 34373445. https://doi.org/10.1590/1413-812320152011.18692014.CrossRefGoogle ScholarPubMed
Holubova, M., Prasko, J., Ociskova, M., Marackova, M., Grambal, A., & Slepecky, M. (2016). Self-stigma and quality of life in patients with depressive disorder: A cross-sectional study. Neuropsychiatric Disease and Treatment, 12, 26772687. https://doi.org/10.2147/ndt.S118593.CrossRefGoogle ScholarPubMed
Jin, Y., Sun, H. L., Lam, S. C., Su, Z., Hall, B. J., Cheung, T., … International Research Collaboration on COVID-19. (2022). Depressive symptoms and gender differences in older adults in Hong Kong during the COVID-19 pandemic: A network analysis approach. International Journal of Biological Sciences, 18(10), 39343941. https://doi.org/10.7150/ijbs.69460.CrossRefGoogle Scholar
Katila, H., Mezhebovsky, I., Mulroy, A., Berggren, L., Eriksson, H., Earley, W., & Datto, C. (2013). Randomized, double-blind study of the efficacy and tolerability of extended release quetiapine fumarate (quetiapine XR) monotherapy in elderly patients with major depressive disorder. American Journal of Geriatric Psychiatry, 21(8), 769784. https://doi.org/10.1016/j.jagp.2013.01.010.CrossRefGoogle ScholarPubMed
Kim, J. M., Kim, J. W., Kang, H. J., Bae, K. Y., Kim, S. W., Shin, I. S., … Yoon, J. S. (2019). Suicidal ideation predicts functioning and quality of life over one year after acute coronary syndrome. Psychiatry Investigation, 16(1), 6570. https://doi.org/10.30773/pi.2018.10.22.2.CrossRefGoogle ScholarPubMed
Koivumaa-Honkanen, H., Honkanen, R., Viinamäki, H., Heikkilä, K., Kaprio, J., & Koskenvuo, M. (2001). Life satisfaction and suicide: A 20-year follow-up study. American Journal of Psychiatry, 158(3), 433439. https://doi.org/10.1176/appi.ajp.158.3.433.CrossRefGoogle ScholarPubMed
Koivumaa-Honkanen, H., Koskenvuo, M., Honkanen, R. J., Viinamäki, H., Heikkilä, K., & Kaprio, J. (2004). Life dissatisfaction and subsequent work disability in an 11-year follow-up. Psychological Medicine, 34(2), 221228. https://doi.org/10.1017/s0033291703001089.CrossRefGoogle Scholar
Kupferberg, A., Bicks, L., & Hasler, G. (2016). Social functioning in major depressive disorder. Neuroscience & Biobehavioral Reviews, 69, 313332. https://doi.org/10.1016/j.neubiorev.2016.07.002.CrossRefGoogle ScholarPubMed
Lee, Y. T., Liu, S. I., Huang, H. C., Sun, F. J., Huang, C. R., & Yeung, A. (2014). Validity and reliability of the Chinese version of the Short Form of Quality of Life Enjoyment and Satisfaction Questionnaire (Q-LES-Q-SF). Quality of Life Research, 23(3), 907916. https://doi.org/10.1007/s11136-013-0528-0.CrossRefGoogle ScholarPubMed
Leu, S. H., Chou, J. Y., Lee, P. C., Cheng, H. C., Shao, W. C., Hsien, W. L., … Chen, V. C. (2015). Validity and reliability of the Chinese version of the Sheehan Disability Scale (SDS-C). Asia-Pacific Psychiatry, 7(2), 215222. https://doi.org/10.1111/appy.12182.CrossRefGoogle ScholarPubMed
Lin, J., Wang, X., Dong, F., Du, Y., Shen, J., Ding, S., … Xu, H. (2018). Validation of the Chinese version of the Hamilton Rating Scale for Depression in adults with epilepsy. Epilepsy & Behavior, 89, 148152. https://doi.org/10.1016/j.yebeh.2018.10.009.CrossRefGoogle ScholarPubMed
Liu, R. T., Kraines, M. A., Massing-Schaffer, M., & Alloy, L. B. (2014). Rejection sensitivity and depression: Mediation by stress generation. Psychiatry, 77(1), 8697. https://doi.org/10.1521/psyc.2014.77.1.86.CrossRefGoogle ScholarPubMed
Lu, C., Yuan, L., Lin, W., Zhou, Y., & Pan, S. (2017). Depression and resilience mediates the effect of family function on quality of life of the elderly. Archives of Gerontology and Geriatrics, 71, 3442. https://doi.org/10.1016/j.archger.2017.02.011.CrossRefGoogle ScholarPubMed
Lyness, J. M., Caine, E. D., Conwell, Y., King, D. A., & Cox, C. (1993). Depressive symptoms, medical illness, and functional status in depressed psychiatric inpatients. American Journal of Psychiatry, 150(6), 910915. https://doi.org/10.1176/ajp.150.6.910.Google ScholarPubMed
Ma, S., Yang, J., Yang, B., Kang, L., Wang, P., Zhang, N., … Liu, Z. (2021). The patient health questionnaire-9 vs. the Hamilton rating scale for depression in assessing major depressive disorder. Frontiers in Psychiatry, 12, 747139. https://doi.org/10.3389/fpsyt.2021.747139.CrossRefGoogle ScholarPubMed
McElroy, E., Shevlin, M., Murphy, J., & McBride, O. (2018). Co-occurring internalizing and externalizing psychopathology in childhood and adolescence: A network approach. European Child and Adolescent Psychiatry, 27(11), 14491457. https://doi.org/10.1007/s00787-018-1128-x.CrossRefGoogle ScholarPubMed
McNally, R. J. (2016). Can network analysis transform psychopathology? Behaviour Research and Therapy, 86, 95104. https://doi.org/10.1016/j.brat.2016.06.006.CrossRefGoogle ScholarPubMed
McNally, R. J. (2021). Network analysis of psychopathology: Controversies and challenges. Annual Review of Clinical Psychology, 17, 3153. https://doi.org/10.1146/annurev-clinpsy-081219-092850.CrossRefGoogle ScholarPubMed
McNally, R. J., Mair, P., Mugno, B. L., & Riemann, B. C. (2017). Co-morbid obsessive-compulsive disorder and depression: A Bayesian network approach. Psychological Medicine, 47(7), 12041214. https://doi.org/10.1017/s0033291716003287.CrossRefGoogle ScholarPubMed
Moffa, G., Catone, G., Kuipers, J., Kuipers, E., Freeman, D., Marwaha, S., … Bebbington, P. (2017). Using directed acyclic graphs in epidemiological research in psychosis: An analysis of the role of bullying in psychosis. Schizophrenia Bulletin, 43(6), 12731279. https://doi.org/10.1093/schbul/sbx013.CrossRefGoogle ScholarPubMed
Nelson, B., McGorry, P. D., Wichers, M., Wigman, J. T. W., & Hartmann, J. A. (2017). Moving from static to dynamic models of the onset of mental disorder: A review. JAMA Psychiatry, 74(5), 528534. https://doi.org/10.1001/jamapsychiatry.2017.0001.CrossRefGoogle ScholarPubMed
Noh, J. W., Kwon, Y. D., Park, J., Oh, I. H., & Kim, J. (2016). Relationship between physical disability and depression by gender: A panel regression model. PLoS ONE, 11(11), e0166238. https://doi.org/10.1371/journal.pone.0166238.CrossRefGoogle Scholar
O'Driscoll, C., Buckman, J. E. J., Fried, E. I., Saunders, R., Cohen, Z. D., Ambler, G., … Pilling, S. (2021). The importance of transdiagnostic symptom level assessment to understanding prognosis for depressed adults: Analysis of data from six randomised control trials. BMC Medicine, 19(1), 109. https://doi.org/10.1186/s12916-021-01971-0.CrossRefGoogle ScholarPubMed
Opsahl, T., Agneessens, F., & Skvoretz, J. (2010). Node centrality in weighted networks: Generalizing degree and shortest paths. Social Networks, 32(3), 245251. https://doi.org/https://doi.org/10.1016/j.socnet.2010.03.006.CrossRefGoogle Scholar
Park, S. C., & Kim, D. (2020). The centrality of depression and anxiety symptoms in major depressive disorder determined using a network analysis. Journal of Affective Disorders, 271, 1926. https://doi.org/10.1016/j.jad.2020.03.078.CrossRefGoogle ScholarPubMed
Pearl, J. (2000). Causality: Models, reasoning, and inference (2nd ed., Vol. 29, pp. 200256). Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511803161.Google Scholar
Prelipceanu, D., Purnichi, T., Marinescu, V., & Matei, V. (2015). The daily functionality in a major depressive episode cohort of Romanian patients – a non-interventional study. Maedica (Bucur), 10(1), 3943.Google Scholar
Price, E. C., Gregg, J. J., Smith, M. D., & Fiske, A. (2018). Masculine traits and depressive symptoms in older and younger men and women. American Journal of Men's Health, 12(1), 1929. https://doi.org/10.1177/1557988315619676.CrossRefGoogle ScholarPubMed
Rapaport, M. H., Clary, C., Fayyad, R., & Endicott, J. (2005). Quality-of-life impairment in depressive and anxiety disorders. American Journal of Psychiatry, 162(6), 11711178. https://doi.org/10.1176/appi.ajp.162.6.1171.CrossRefGoogle ScholarPubMed
Ritsner, M., Kurs, R., Gibel, A., Ratner, Y., & Endicott, J. (2005). Validity of an abbreviated quality of life enjoyment and satisfaction questionnaire (Q-LES-Q-18) for schizophrenia, schizoaffective, and mood disorder patients. Quality of Life Research, 14(7), 16931703. https://doi.org/10.1007/s11136-005-2816-9.CrossRefGoogle ScholarPubMed
Rodgers, S., Grosse Holtforth, M., Muller, M., Hengartner, M. P., Rossler, W., & Ajdacic-Gross, V. (2014). Symptom-based subtypes of depression and their psychosocial correlates: A person-centered approach focusing on the influence of sex. Journal of Affective Disorders, 156, 92103. https://doi.org/10.1016/j.jad.2013.11.021.CrossRefGoogle ScholarPubMed
Salk, R. H., Hyde, J. S., & Abramson, L. Y. (2017). Gender differences in depression in representative national samples: Meta-analyses of diagnoses and symptoms. Psychological Bulletin, 143(8), 783822. https://doi.org/10.1037/bul0000102.CrossRefGoogle ScholarPubMed
Scutari, M., & Nagarajan, R. (2013). Identifying significant edges in graphical models of molecular networks. Artificial Intelligence in Medicine, 57(3), 207217. https://doi.org/10.1016/j.artmed.2012.12.006.CrossRefGoogle ScholarPubMed
Sheehan, D. V., Mancini, M., Wang, J., Berggren, L., Cao, H., Dueñas, H. J., & Yue, L. (2016). Assessment of functional outcomes by Sheehan Disability Scale in patients with major depressive disorder treated with duloxetine versus selective serotonin reuptake inhibitors. Human Psychopharmacology, 31(1), 5363. https://doi.org/10.1002/hup.2500.CrossRefGoogle ScholarPubMed
Sheehan, D. V., Nakagome, K., Asami, Y., Pappadopulos, E. A., & Boucher, M. (2017). Restoring function in major depressive disorder: A systematic review. Journal of Affective Disorders, 215, 299313. https://doi.org/10.1016/j.jad.2017.02.029.CrossRefGoogle ScholarPubMed
Simning, A., & Seplaki, C. L. (2020). Association of the cumulative burden of late-life anxiety and depressive symptoms with functional impairment. International Journal of Geriatric Psychiatry, 35(1), 8090. https://doi.org/10.1002/gps.5221.CrossRefGoogle ScholarPubMed
Sinclair, J. M., Hawton, K., & Gray, A. (2010). Six year follow-up of a clinical sample of self-harm patients. Journal of Affective Disorders, 121(3), 247252. https://doi.org/10.1016/j.jad.2009.05.027.CrossRefGoogle ScholarPubMed
Smith, K. E., Mason, T. B., Crosby, R. D., Cao, L., Leonard, R. C., Wetterneck, C. T., … Moessner, M. (2019). A comparative network analysis of eating disorder psychopathology and co-occurring depression and anxiety symptoms before and after treatment. Psychological Medicine, 49(2), 314324. https://doi.org/10.1017/s0033291718000867.CrossRefGoogle ScholarPubMed
Steen, O. D., van Borkulo, C. D., & van Loo, H. M. (2021). Symptom networks in major depression do not diverge across sex, familial risk, and environmental risk. Journal of Affective Disorders, 294, 227234. https://doi.org/10.1016/j.jad.2021.07.002.CrossRefGoogle Scholar
Tang, A. L., Thomas, S. J., & Larkin, T. (2019). Cortisol, oxytocin, and quality of life in major depressive disorder. Quality of Life Research, 28(11), 29192928. https://doi.org/10.1007/s11136-019-02236-3.CrossRefGoogle ScholarPubMed
van Borkulo, C., Boschloo, L., Borsboom, D., Penninx, B. W., Waldorp, L. J., & Schoevers, R. A. (2015). Association of symptom network structure with the course of [corrected] depression. JAMA Psychiatry, 72(12), 12191226. https://doi.org/10.1001/jamapsychiatry.2015.2079.CrossRefGoogle Scholar
van Spijker, B. A., van Straten, A., Kerkhof, A. J., Hoeymans, N., & Smit, F. (2011). Disability weights for suicidal thoughts and non-fatal suicide attempts. Journal of Affective Disorders, 134(1-3), 341347. https://doi.org/10.1016/j.jad.2011.05.020.CrossRefGoogle ScholarPubMed
van Spijker, B. A. J., Batterham, P. J., Calear, A. L., Wong, Q. J. J., Werner-Seidler, A., & Christensen, H. (2020). Self-reported disability and quality of life in an online Australian community sample with suicidal thoughts. Journal of Affective Disorders, 263, 707714. https://doi.org/10.1016/j.jad.2019.11.050.CrossRefGoogle Scholar
Wang, G., Tan, K. H. X., Ren, H., & Hammer-Helmich, L. (2020). Impact of cognitive symptoms on health-related quality of life and work productivity in Chinese patients with major depressive disorder: Results from the PROACT study. Neuropsychiatric Disease and Treatment, 16, 749759. https://doi.org/10.2147/ndt.S230403.CrossRefGoogle ScholarPubMed
WHO. (2017). Depression and other common mental disorders: Global health estimates. Geneva, Switzerland: World Health Organisation. Retrieved from April 21, 2019, https://www.who.int/mental_health/management/depression/prevalence_global_health_estimates/en/.Google Scholar
Yang, J., Zheng, P., Li, Y., Wu, J., Tan, X., Zhou, J., … Xie, P. (2020). Landscapes of bacterial and metabolic signatures and their interaction in major depressive disorders. Science Advances, 6(49), 111. https://doi.org/10.1126/sciadv.aba8555.CrossRefGoogle ScholarPubMed
Yang, J., Zhou, J., Zhou, J., Wang, H., Sun, Z., Zhu, X., … Wang, G. (2022). Serum amyloid p component level is associated with clinical response to escitalopram treatment in patients with major depressive disorder. Journal of Psychiatric Research, 146, 172178. https://doi.org/10.1016/j.jpsychires.2021.12.051.CrossRefGoogle ScholarPubMed
Yang, L., Wu, Z., Cao, L., Wang, Y., Su, Y., Huang, J., … Fang, Y. (2021). Predictors and moderators of quality of life in patients with major depressive disorder: An AGTs-MDD study report. Journal of Psychiatric Research, 138, 96102. https://doi.org/10.1016/j.jpsychires.2021.03.063.CrossRefGoogle ScholarPubMed
Ye, H., Zalesky, A., Lv, J., Loi, S. M., Cetin-Karayumak, S., Rathi, Y., … Di Biase, M. A. (2021). Network analysis of symptom comorbidity in schizophrenia: Relationship to illness course and brain white matter microstructure. Schizophrenia Bulletin, 47(4), 11561167. https://doi.org/10.1093/schbul/sbab015.CrossRefGoogle ScholarPubMed
Zhao, N., Wang, X., Wu, W., Hu, Y., Niu, Y., Wang, X., … Wang, G. (2017). Gender differences in quality of life and functional disability for depression outpatients with or without residual symptoms after acute phase treatment in China. Journal of Affective Disorders, 219, 141148. https://doi.org/10.1016/j.jad.2017.05.021.CrossRefGoogle ScholarPubMed
Zheng, Y., Zhao, J., Philips, M., Liu, J., Cai, M., Sun, S., … Huang, M. (1988). Validity and reliability of the Chinese Hamilton depression rating scale. The British Journal of Psychiatry : the Journal of Mental Science, 152, 660664.CrossRefGoogle ScholarPubMed
Zhou, J., Zhou, J., Sun, Z., Feng, L., Zhu, X., Yang, J., & Wang, G. (2021). Development and internal validation of a novel model to identify inflammatory biomarkers of a response to escitalopram in patients with major depressive disorder. Frontiers in Psychiatry, 12, 593710. https://doi.org/10.3389/fpsyt.2021.593710.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Basic information n (%) or (mean ± s.d.)

Figure 1

Table 2. The mean scores for the HAMD-17, SDS, and Q-LES-Q-SF (mean ± s.d.)

Figure 2

Fig. 1. Undirected networks of depressive symptoms, functional disabilities, and QOL in patients with MDD. Each edge corresponds to a partial correlation (positive in blue, negative in orange, maximum magnitude = 0.43) between two items; the thickness corresponds to the absolute magnitude of the correlation. The colors of the nodes correspond to detected communities in the network: HAMD-17 (pink), SDS (blue), and Q-LES-Q-SF total score (green). Item label abbreviations are defined on the right side of figure.

Figure 3

Fig. 2. Node centrality metrics of the network. The left, middle, and right panels show the strength, betweenness, and closeness estimates for each node of the network, respectively.

Figure 4

Fig. 3. Stability of the centrality indices: point estimates and corresponding 95% CIs. This was determined by average correlations between the centrality indices of networks sampled with patients dropped and the original sample. Lines indicate the means and areas indicate the range from the 2.5th quantile to the 97.5th quantile.

Figure 5

Fig. 4. Directed acyclic graph (DAG) of depressive symptoms, functional disabilities, and QOL in patients with MDD. Arrows indicate the direction of the assumed causal relationships. Edge thickness indicates confidence that the predicted direction of edge points in the direction displayed in the graph.

Figure 6

Fig. 5. Longitudinal data (baseline and week 4) used to examine the association found in DAG analysis.Note: (a) Branch 1: depressed mood – work and activity – work or school disability – social life disability – family life disability – quality of life – somatic symptoms; (b) Branch 2: depressed mood – psychological anxiety – somatic anxiety – somatic symptoms general; (c) Branch 3: feelings of guilt – suicide – quality of life. The levels of the symptoms at baseline were stratified according to the levels of their median. The groups with lower baseline item/scale score are depicted in red, and the groups with higher baseline score are in teal.

Supplementary material: File

Zhou et al. supplementary material

Zhou et al. supplementary material

Download Zhou et al. supplementary material(File)
File 982.2 KB