Hostname: page-component-cd9895bd7-mkpzs Total loading time: 0 Render date: 2024-12-27T05:11:33.610Z Has data issue: false hasContentIssue false

Not intended, still embarrassed: Social anxiety is related to increased levels of embarrassment in response to unintentional social norm violations

Published online by Cambridge University Press:  01 January 2020

Janna Marie Bas-Hoogendam*
Affiliation:
aInstitute of Psychology, Leiden University, Wassenaarseweg 52, 2333 AK, Leiden, The Netherlands bDepartment of Psychiatry, Leiden University Medical Center, Albinusdreef 2, 2333 ZA, Leiden, The Netherlands cLeiden Institute for Brain and Cognition, Leiden, The Netherlands
Henk van Steenbergen
Affiliation:
aInstitute of Psychology, Leiden University, Wassenaarseweg 52, 2333 AK, Leiden, The Netherlands cLeiden Institute for Brain and Cognition, Leiden, The Netherlands
Nic J.A. van der Wee
Affiliation:
bDepartment of Psychiatry, Leiden University Medical Center, Albinusdreef 2, 2333 ZA, Leiden, The Netherlands cLeiden Institute for Brain and Cognition, Leiden, The Netherlands
P. Michiel Westenberg
Affiliation:
aInstitute of Psychology, Leiden University, Wassenaarseweg 52, 2333 AK, Leiden, The Netherlands cLeiden Institute for Brain and Cognition, Leiden, The Netherlands
*
*Corresponding author at: Developmental and Educational Psychology, Institute of Psychology, Leiden University, Wassenaarseweg 52, Pieter de la Court Building, room 3.B43, 2333 AK, Leiden, The Netherlands. E-mail address: [email protected] (J.M. Bas-Hoogendam).

Abstract

Background:

Social anxiety disorder (SAD) is associated with altered social norm (SN) processing: SAD-patients rate stories on SN violations as more inappropriate and more embarrassing than healthy participants, with the most prominent effect for stories on unintentional SN violations (i.e. committing a blunder). Until now it’s unknown how levels of social anxiety (SA) are related to ratings of SN violations in the general population, in which SA-symptoms are present at a continuum. More insight in this relationship could improve our understanding of the symptom profile of SAD. Therefore, we investigated the relation between ratings of SN violations and SA-levels in the general population.

Methods:

Adults and adolescents (n = 87) performed the revised Social Norm Processing Task (SNPT-R) and completed self-report questionnaires on social anxiety. Repeated-measures ANCOVAs were used to investigate the effect of SA on the ratings of inappropriateness and embarrassment.

Results:

As hypothesized, participants with higher SA-levels rated SN violations as more inappropriate and more embarrassing. Whereas participants with low-to-intermediate SA-levels rated unintentional SN violations as less embarrassing than intentional SN violations, participants with high SA-levels (z-score SA ≥ 1.6) rated unintentional SN violations as equally embarrassing as intentional SN violations.

Conclusion:

These findings indicate that increased embarrassment for unintentional SN violations is an important characteristic of social anxiety. These high levels of embarrassment are likely related to the debilitating concern of socially-anxious people that their skills and behavior do not meet expectations of others, and to their fear of blundering. This concern might be an important target for future therapeutic interventions.

Type
Original article
Copyright
Copyright © European Psychiatric Association 2018

1. Introduction

Social anxiety (SA) is an emotion that is experienced by most people with some regularity. Typically, people want to make a good impression when they are in a social situation, and when committing a blunder in the presence of others, people tend to feel embarrassed or ashamed. However, the experience of social anxiety varies between people, ranging from discomfort in specific social situations for some individuals to an intense fear in almost all social situations for others [Reference Miskovic and Schmidt1]. At the upper end of ‘this continuum of social anxiety’ [Reference Rapee and Spence2] lies social anxiety disorder (SAD), a psychiatric condition which is, according to the Diagnostic and Statistical Manual of Mental Disorders (DSM-5), characterized by an intense fear of being negatively evaluated in social situations [Reference American Psychiatric Association3]. This fear of social-evaluative stimuli [Reference Wong and Rapee4], which is out of proportion to the actual threat and to the sociocultural context [Reference Leichsenring and Leweke5, Reference Heimberg, Hofmann, Liebowitz, Schneier, Smits and Stein6] leads to the avoidance of social situations and results in significant disturbances in a person’s everyday life [Reference American Psychiatric Association3, Reference Stein and Stein7]. The typical onset of SAD is during childhood or adolescence and several environmental as well as intrinsic factors like genetic influences, biological factors as well as cognitive biases interact in the development of the disorder [Reference Spence and Rapee8].

Previous studies have indicated that SAD-patients experience disturbances in self-referential processing and have biases concerning the opinion of others about them: they have increased self-portrayal concerns [Reference Moscovitch, Rowa, Paulitzki, Ierullo, Chiang and Antony9], for example when it concerns their social rank [Reference Berger, Keshet and Gilboa-Schechtman10, Reference Gilboa-Schechtman, Keshet, Livne, Berger, Zabag and Hermesh11] or their own social performance [Reference Gavric, Moscovitch, Rowa and McCabe12, Reference Glazier and Alden13], they overestimate the negative consequences of their own social blunders [Reference Moscovitch, Waechter, Bielak, Rowa and McCabe14] and are characterized by negatively biased learning about themselves from social feedback [Reference Koban, Schneider, Ashar, Andrews-Hanna, Landy and Moscovitch15]. Furthermore, clinical SAD is associated with an increased belief in negative interpretations of social situations [Reference Loscalzo, Giannini and Miers16] and SAD-patients focus predominantly on potentially embarrassing events when they evaluate themselves in a social context [Reference Blair and Blair17]. Such negative self-beliefs, which are already present in adolescents with SAD [Reference Schreiber and Steil18, Reference Blöte, Miers, Heyne, Clark and Westenberg19], are related to increased negative emotions like fear and anxiety, and induce maladaptive behavioral responses like safety behaviors, which, consecutively, lead to the maintenance of social anxiety [Reference Goldin, Manber-Ball, Werner, Heimberg and Gross20, Reference Piccirillo, Dryman and Heimberg21]. It has been argued that SAD-patients are ‘uniquely and primarily concerned about characteristics of self that they perceive as being deficient or contrary to perceived societal expectations or norms’ [Reference Moscovitch22]. According to this view, one of the main concerns of SAD-patients is the fear that they will unintentionally commit an embarrassing behavioral blunder in a social situation [Reference Moscovitch22], which let us to hypothesize that social anxiety is specifically related to the experience of increased embarrassment in reaction to unintentional social norm violations.

This idea was previously examined by investigating the behavioral data of a functional Magnetic Resonance Imaging (fMRI) study using the social norm processing task (SNPT) [Reference Blair, Geraci, Hollon, Otero, DeVido and Majestic23]. In this task, participants read three types of short stories: stories describing neutral social situations, stories on unintentional social norm (SN) transgressions (i.e. committing a blunder) and stories describing intentional SN transgressions (i.e. breaking conventional rules) and they are asked to imagine themselves in the situation described. Subsequently, participants rate the stories on inappropriateness and embarrassment. Thereby, the SNPT enables investigating the effect of intention on these ratings. Blair and colleagues [Reference Blair, Geraci, Hollon, Otero, DeVido and Majestic23] showed that, while SAD-patients had higher self-reported levels of inappropriateness and embarrassment across all conditions, the effect of SAD was most pronounced for unintentional SN violations: adult patients with generalized SAD (n = 16) rated these unintentional transgressions as significantly more embarrassing when compared to healthy participants (n = 16). Furthermore, the fMRI analyses revealed that reading the unintentional stories evoked increased activation in the ventromedial prefrontal cortex in SAD. This activation was considered to represent increased self-referential processing and was taken to indicate that SAD-patients judge unintentional SN violations as more self-relevant than healthy participants [Reference Blair, Geraci, Hollon, Otero, DeVido and Majestic23].

The results of this study [Reference Blair, Geraci, Hollon, Otero, DeVido and Majestic23], which was the first, and, to the best of our knowledge, the only study to date investigating the difference between processing intentional and unintentional SN violations in SAD, provide important initial evidence that the intention underlying a SN violation is a determining factor in the experience of embarrassment in social anxiety: although SAD-patients reported higher embarrassment for all social situations, they differed most from control participants when they considered unintentional transgressions [Reference Blair, Geraci, Hollon, Otero, DeVido and Majestic23]. However, the sample size of the study was relatively small. In addition, participants performed an ‘impersonal’ version of the SNPT, in which the stories described behavior of an unknown character like ‘Joanna’ (cf. [Reference Berthoz, Armony, Blair and Dolan24]), as a result of which it could be questioned whether the ratings reflect the participants’ opinion about their own SN violations. Furthermore, it is unknown if the effect of intention on the level of embarrassment also holds for participants with higher SA-levels in the general population.

Here, we investigated the relation between self-reported SA and behavioral ratings of SN violations in a sample of adults and adolescents from the general population (n = 87), using the revised Social Norm Processing Task (SNPT-R) [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg25]. In the SNPT-R, the three types of stories were written in second-person, in order to let the ratings reflect how participants think about their own SN violations. Data of this sample on the SNPT-R have been published previously [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg25].

Based on previous work [Reference Blair, Geraci, Hollon, Otero, DeVido and Majestic23], we hypothesized that higher SA-levels within the general population would be predictive of a general effect of SA, reflected by higher ratings of inappropriateness and embarrassment for all stories and of an intention-specific effect of SA, namely an even more pronounced increase in embarrassment ratings for stories on unintentional SN violations. More insight in this relationship could help further unravel mechanisms involved in the etiology and maintenance of social anxiety and may identify potential novel targets for prevention and intervention.

2. Methods

2.1. Participants

Participants were adults and adolescents from the general population (n = 87; age range 12.5–32.6 y), the same as those described previously [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg25]; details of the inclusion procedure are described in the Supplemental Methods. They had Dutch as their first language and were free of past and present psychopathology as assessed by a self-report questionnaire. After explanation of the procedure, all participants (and in case of minors below 18 years of age, both parents) signed informed consent according to the Declaration of Helsinki. The Psychology Research Ethics Committee of Leiden University approved the experiment.

2.2. Social norm processing task

Participants performed the revised Social Norm Processing Task (SNPT-R), described in detail previously [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg25]. The SNPT-R consists of two phases.

In the first phase, participants read three types of short stories: stories on situations in which no social norm (SN) was violated (neutral condition; for example: ‘You are baking an apple pie with your friends. You use the amount of sugar the recipe calls for’), stories describing unintentional SN violations (unintentional condition; ‘You are baking an apple pie with your friends. You use salt instead of sugar without realizing’) and stories outlining intentional SN violations (intentional condition; ‘You are baking an apple pie with your friends. You use salt instead of sugar as a joke’). Stories in the unintentional and intentional condition described relatively innocent violations of conventional social norms, in situations where at least one other person was present. The intentional and unintentional stories differed only in the intention of the actor, while the actual result of the violation (for example: a distasteful cake) was kept as much as possible the same. Stories were written in second-person and participants were instructed to imagine themselves in the situations, in order to maximize their personal involvement (cf. [Reference Finger, Marsh, Kamel, Mitchell and Blair26]). Therefore, four age- and genderspecific versions of the task were used: for boys <18 years, girls <18 years, men ≥18 years and women ≥18 years. The task consisted of 78 stories and a full list of stories is provided in Bas-Hoogendam et al. [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg25]. We refer the reader to this work and to the Open Science Framework (OSF)-project [dataset] [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg27] for more details on task parameters and scripts for task presentation.

Secondly, there was an unannounced rating-phase, in which participants were asked to rate all stories on a 5-point Likert scale on embarrassment (from 1, not embarrassing at all, to 5, extremely embarrassing) and inappropriateness (from 1, not inappropriate at all, to 5, extremely inappropriate). These ratings were the output-measures used in this study.

Both phases of the SNPT-R were presented using E-Prime software (version 2.0.10, Psychology Software Tools; available at osf.io/pt4qt [dataset]) [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg27].

2.3. Self-report questionnaires

As there exists, to the best of our knowledge, no instrument which is suitable to reliably assess the level of social anxiety in both adults and adolescents, two questionnaires were used to determine social anxiety: depending on their age, participants completed the self-report version of the Liebowitz Social Anxiety Scale (LSAS) [Reference Heimberg, Horner, Juster, Safren, Brown and Schneier28] or the Social Anxiety Scale for Adolescents (SAS-A) [Reference La Greca and Lopez29]. The LSAS is a questionnaire for adults measuring fear in and avoidance of situations that are likely to elicit social anxiety [Reference Heimberg, Horner, Juster, Safren, Brown and Schneier28, Reference Fresco, Coles, Heimberg, Liebowitz, Hami and Stein30]. The SAS-A [Reference La Greca and Lopez29] measures social anxiety in adolescents, with satisfactory levels of internal consistency [Reference Miers, Blöte, de Rooij, Bokhorst and Westenberg31].

Boys and girls did not differ in self-reported SA as measured with the SAS-A (independent-samples t-test: t(27) = −0.41, p = 0.69), while women reported significantly more SA-symptoms compared to men, as measured with the LSAS (t(56) = −3.24, p = 0.002) (cf. [Reference Turk, Heimberg, Orsillo, Holt, Gitow and Street32Reference Ingles, La Greca, Marzo, Garcia-Lopez and Garcia-Fernandez36]) (Table 1). Because we aimed to investigate the relation between self-reported SA and ratings on the SNPT-R within each group of participants (boys <18 years; girls <18 years; men ≥18 years; women ≥18 years), rather than over the whole sample (an analysis which could be influenced by age- and gender differences), we normalized the scores on the LSAS and SAS-A within each group and used the z-scores (SA-Z) for further analyses. The validity of this measure was established by additional analyses, separate for the adolescent and adult sample, using the original LSAS and SAS-A scores; in these analyses, we observed in general the same pattern of results as described in the Results-section. Furthermore, exploratory analyses indicated no significant interactions between SA-Z, age-group (adult vs. adolescents) and behavioral ratings.

Table 1 Characteristics participants.

Values are expressed as mean ± SD (range).

LSAS: Liebowitz Social Anxiety Scale [Reference Heimberg, Horner, Juster, Safren, Brown and Schneier28]; SAS-A: Social Anxiety Scale for Adolescents [Reference La Greca and LopezFootnote 29]; n/a: not applicable

After z-standardizing the scores on the LSAS and SAS-A within each group, one participant (male) was considered an outlier (SA-Z = 3.27) and removed from subsequent analyses (remaining sample: n = 86).

2.4. Procedure

The experiment took place at the Faculty of Social and Behavioural Sciences, Leiden University, the Netherlands (adult participants) and at a secondary school in the Netherlands (adolescent participants). Participants performed both phases of the SNPT-R and the self-report questionnaires on a laptop in a quiet environment.

2.5. Data analysis

Statistical analyses of the ratings of embarrassment and inappropriateness for the SNPT-R stories were performed using IBM SPSS Statistics for Mac (Version 24.0). The relationships between behavioral ratings of inappropriateness and embarrassment and social anxiety were investigated using repeated-measures ANCOVAs with condition (intentional; unintentional; neutral) as within-subjects factor and SA-Z as covariate. Significant effects of condition were further investigated using paired-samples t-tests; significant effects of SA-Z were examined using separate regression analyses for each condition (independent variable: SA-Z; dependent variables: ratings), while significant interactions between condition and SA-Z were explored using regression analyses with the difference scores of the ratings as dependent variables (e.g., ΔIntentional_unintentional = intentional score minus unintentional score). For reasons of completeness and in line with the analyses reported previously [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg25], we repeated the above described ANCOVAs with group (based on the four versions of the task; group 1: boys <18 years of age; group 2: girls <18 years of age; group 3: men ≥18 years of age; group 4; women ≥18 years of age) as additional between-subjects factor. Results of these analyses are summarized in Table S1 and Table S2 and discussed in the Supplemental Results.

For all analyses, significance level was set at p ≤ 0.05; Greenhouse–Geisser correction was used when the assumption of sphericity was violated.

3. Results

3.1. Participants

Characteristics of the participants, divided into groups based on the age- and genderspecific versions of the SNPT-R, are summarized in Table 1. Data are also available at osf.io/j58yc/[dataset] [Reference Bas-Hoogendam, van Steenbergen, van der Wee and Westenberg37]. Using literature-based cutoff scores, 8 adults (14% of the adult sample; LSAS score ≥ 60 [Reference Mennin, Fresco, Heimberg, Schneier, Davies and Liebowitz38]) and 2 adolescents (7% of the adolescent sample; SAS-A score ≥ 50 [Reference Storch, Masia-Warner, Dent, Roberti and Fisher39]) met the criteria for generalized SAD.

3.2. Relationship between ratings and self-reported social anxiety

Ratings of inappropriateness and embarrassment on the SNPT-R are summarized in Table 2; for group-specific ratings, we refer the reader to [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg25].

Table 2 Ratings of embarrassment and inappropriateness on the SNPT- R.

Data are presented as means ± SD.

3.2.1. Inappropriateness

A repeated-measures ANCOVA (condition x SA-Z) on inappropriateness ratings indicated a main effect of condition (F(1.8, 149.5) = 2230.9, p < 0.001, partial η2 = 0.97), a main effect of SA-Z (F(1, 84) = 7.1, p = 0.009, partial η2 = 0.08), and an interaction between condition and SA-Z (F(1.8, 149.5) = 3.9, p = 0.026, partial η2 = 0.05). Paired-samples t-tests revealed that intentional stories were rated more inappropriate than unintentional stories (t(85) = 27.4, p < 0.001) and unintentional stories as more inappropriate than neutral stories (t(85) = 33.6, p < 0.001), as reported previously [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg25]. As illustrated in Fig. 1 (left panel), subsequent regression analyses revealed positive relationships between SA-Z and ratings of inappropriateness in the unintentional (β = 0.30, p = 0.005; 95% confidence interval (CI): 0.10 – 0.55) and neutral condition (β = 0.25, p = 0.020; 95% CI: 0.04 – 0.50), but not in the intentional condition (β = 0.085, ns; 95% CI: −0.14 – 0.33). The interaction between SA-Z and condition was further investigated using regression analyses on difference scores. Results showed that SA-Z was positively related to ΔUnintentional_intentional (β = 0.243, p = 0.024; 95% CI: 0.04 - 0.49) and to ΔUnintentional_neutral (β = 0.23, p = 0.033; 95% CI: 0.20 – 0.48), but not related to ΔIntentional_neutral (β = −0.05, ns; 95% CI: −0.29 – 0.18). These findings indicate that the slope of the regression line for the relationship between SA-Z and inappropriateness in the unintentional condition is significantly steeper when compared to the slopes of the regression lines for the relationships between SA-Z and inappropriateness in the intentional and neutral condition.

Fig 1. Relationships between social anxiety (z-standardized) and ratings on the SNPT-R.

Shaded areas represent 95% confidence intervals (Colour online).

3.2.2. Embarrassment

A repeated-measures ANCOVA on the ratings of embarrassment showed a main effect of condition (F(1.8,151.0) = 909.9, p < 0.001, partial η2 = 0.92), a main effect of SA-Z (F(1, 84) = 7.4, p = 0.008, partial η2 = 0.08), and an interaction between condition and SA-Z (F(1.8, 151.0) = 4.7, p = 0.013, partial η2 = 0.05). Intentional stories were rated as more embarrassing than unintentional stories (t(85) = 4.5, p < 0.001) and unintentional stories as more embarrassing than neutral stories (t(85) = 39.9, p < 0.001) [Reference Bas-Hoogendam, van Steenbergen, Kreuk, van der Wee and Westenberg25]. Regression analyses revealed significant positive relationships between SA-Z and embarrassment in the unintentional condition (β = 0.40, p < 0.001; 95% CI: 0.22 – 0.65) and the neutral condition (β = 0.28, p = 0.008; 95% CI: 0.08 – 0.53), but not between SA-Z and embarrassment in the intentional condition (β = 0.06, ns; 95% CI: −0.17 – 0.30) (Fig. 1, right panel). The interaction between SA-Z and condition was further investigated using regression analyses on difference scores. Results showed a significant positive relationship between SA-Z and ΔUnintentional_intentional (β = 0.28, p = 0.01; 95% CI: 0.07–0.53), a positive relationship with ΔUnintentional_neutral (β = 0.32, p = 0.003; 95% CI: 0.12–0.57), but no relationship between SA_Z and ΔIntentional_neutral (β = −0.03, ns; 95% CI: −0.27–0.20). Again, these findings indicate that the effect of SA-Z is most pronounced (i.e., steepest slope) on the embarrassment ratings in the unintentional condition. Interestingly, the regression lines depicting the relationships between SA-Z and embarrassment on the intentional and unintentional condition intersect at intermediate-to-high SA-levels (SA-Z = 1.6; Fig. 1, right panel): while individuals with low SA-levels give lower embarrassment scores for unintentional versus intentional SN transgressions, this effect disappears with increasing levels of social anxiety and is no longer significant at high SA-levels in our sample.

4. Discussion

We investigated the relationship between self-reported levels of social anxiety (SA) and behavioral ratings on the revised Social Norm Processing Task (SNPT-R) in adults and adolescents from the general population. Previous research showed that patients with social anxiety disorder (SAD) rated all SNPT-stories as significantly more inappropriate and more embarrassing compared to healthy participants, with the most noticeable effect for the unintentional condition [Reference Blair, Geraci, Hollon, Otero, DeVido and Majestic23]. These findings support the hypothesis proposed by Moscovitch [Reference Moscovitch22] that one of the main concerns of SAD-patients is the fear that they will unintentionally commit an embarrassing behavioral blunder in a social situation. Building upon this work, we predicted a general effect of SA, namely, that higher SA-levels in the general population would be associated with higher ratings of inappropriateness and embarrassment. Furthermore, we expected to find an intention-specific effect of SA, reflected by a more pronounced effect of SA on embarrassment ratings for stories on unintentional SN violations.

These hypotheses were confirmed: overall, participants with higher SA-levels rated the stories as more inappropriate and more embarrassing (Fig. 1), while subsequent regression analyses revealed how this general effect of SA was related to the different conditions of the inappropriateness and embarrassment ratings. In the intentional condition, inappropriateness and embarrassment ratings were unrelated to SA, suggesting that SA did not influence people’s basic judgment of SN violations: breaking conventional rules is simply considered ‘not done’ and evokes embarrassment independent of the level of SA. However, SA-levels were positively related to inappropriateness and embarrassment in the neutral condition, which might reflect the general tendency of socially-anxious individuals to feel uncomfortable in social situations [Reference Miskovic and Schmidt1]. The strongest positive relationships were present between SA-levels and ratings of inappropriateness and embarrassment in the unintentional condition. Importantly, we found an intention-specific effect of SA for embarrassment when comparing the unintentional and intentional conditions. While participants with low-to-intermediate SA-levels rated stories on unintentional SN violations as less embarrassing than stories describing intentional SN violations, participants with high SA-levels (z-score SA ≥1.6) rated unintentional SN violations as equally embarrassing as intentional SN violations (Fig. 1, right panel). In other words, participants with lower SA-levels distinguish between breaking conventional rules and committing a blunder in their embarrassment ratings: they take the intention underlying the transgression into account and report less embarrassment when the action was unintentional. However, participants with higher SA-levels do not make this distinction. Note that this intention-specific effect of SA was not found for inappropriateness: individuals with higher SA-levels did still distinguish between intentional and unintentional SN violations with respect to inappropriateness.

These findings hint at a dissimilarity in the cognitive and affective evaluation of SN violations: at the cognitive level (evaluation of inappropriateness), individuals with high SA-levels are not all that different from those with low SA-levels; at the affective level (evaluation of embarrassment), however, they fail to make the distinction between intentional and unintentional SN violations. This increased experience of embarrassment could contribute to the development and maintenance of SAD, as embarrassment is a self-conscious emotion with two sides: although it is a prosocial emotion signaling the recognition of misbehavior and holding the promise that the mistake will not happen again, it also represents negative self-evaluations [Reference Jankowski and Takahashi40Reference Feinberg, Willer and Keltner42]. When embarrassment occurs too often and too intensely, these negative self-evaluations can lead to an overestimation of the extent to which a misstep is important to others, to misplaced and needless concerns about other people’s judgment, and to timid, passive behavior [Reference Miller, Tracy, Robins and Tangney43] – a tendency that characterizes socially-anxious people.

The results reported here extend those of Blair and colleagues [Reference Blair, Geraci, Hollon, Otero, DeVido and Majestic23], by showing that the aberrant behavioral response to unintentional SN violations observed in SAD-patients is also present in participants from the general population with high SA-levels. Furthermore, our finding of increased embarrassment for unintentional SN violations is in line with previous work, which indicated that both SAD-patients as well as participants with high SA-levels overestimate the negative consequences of unintentional social blunders [Reference Moscovitch, Waechter, Bielak, Rowa and McCabe14, Reference Moscovitch, Rodebaugh and Hesch44]. In addition, our results link to the idea that both negative interpretation biases as well as disordered self-referential processing, at the cognitive and neural level, are important characteristics of SA [Reference Blair and Blair17, Reference Kreifelts, Brück, Ritter, Ethofer, Domin and Lotze45Reference Morrison and Heimberg55]. Furthermore, studies have indicated that SA is associated with increased levels of perfectionism, especially with heightened concerns over making mistakes [Reference Antony, Purdon, Huta and Swinson56Reference Newby, Pitura, Penney, Klein, Flett and Hewitt59] and with high levels of self-criticism [Reference Cox, Fleet and Stein60]. Together with these observations, our results support the idea that participants with high SA-levels are characterized by a fear of blundering in a social situation and by a strong concern that their skills and behavior do not meet perceived societal expectations [Reference Moscovitch22]. Thereby, our findings contribute to understanding the symptom profile in at-risk populations and in SAD-patients and could aid in improving preventive and therapeutic interventions for this disorder. Cognitive behavioral therapy could, for example, challenge the concern of patients that their self-characteristics are deficient and do not satisfy societal norms and help patients to realize that the consequences of unintentional blunders are probably not as bad as they consider them to be [Reference Moscovitch22]. This is of importance, given that the increased experience of embarrassment leads to maladaptive coping strategies like avoidance and safety behaviors, which are maintaining factors of SAD [Reference Wong and Rapee4, Reference Piccirillo, Dryman and Heimberg21, Reference Hofmann61].

A limitation of the present study is the relatively small sample size, especially given the fact that participants were divided into four groups based on the versions of the SNPT-R (versions for respectively boys, girls, men and women). Especially the number of included adolescents is limited, as a result of which we were unable to investigate whether age influences the relationship between SA and embarrassment. Given that adolescence is a critical time period for the onset of SAD [Reference Haller, Cohen Kadosh, Scerif and Lau62], a longitudinal study on a large sample of adolescents could give more insight in the role of embarrassment in the development of SAD. In addition, the presence of past and present psychopathology in the sample was only assessed by self-report, which could lead to an underestimation of psychopathology. For example, SAD-patients are often underestimating their condition and refrain from consulting their general practitioner, which may lead to underdiagnosis [Reference Dingemans, van Vliet, Couvée and Westenberg63]. Actually, ten participants of the current sample met the criteria for generalized SAD as based on the cutoff scores for the LSAS and SAS-A [Reference Mennin, Fresco, Heimberg, Schneier, Davies and Liebowitz38, Reference Storch, Masia-Warner, Dent, Roberti and Fisher39], but due to the lack of structured clinical interview, these diagnoses could not be confirmed by a clinician.

Furthermore, we did not acquire neuroimaging data, thus we could not relate our data to neural activity (cf. [Reference Blair, Geraci, Hollon, Otero, DeVido and Majestic23]). Future imaging studies could investigate whether SA-levels alter activation in brain regions involved in SN processing. Because increased activation in the ventromedial prefrontal cortex in SAD-patients in response to unintentional SN violations has been reported [Reference Blair, Geraci, Hollon, Otero, DeVido and Majestic23], we hypothesize that higher SA-levels are related to differential activation within this region. Such an experiment could provide more insight in the neural basis of the altered SN processing associated with high SA-levels. Furthermore, family-studies involving SAD-patients as well as their relatives could investigate whether altered SN processing and the associated neural pattern are heritable characteristics, representing an endophenotype of SAD [Reference Bas-Hoogendam, Blackford, Brühl, Blair, van der Wee and Westenberg64, Reference Bas-Hoogendam, Harrewijn, van der Molen, van Steenbergen, van Vliet and Houwing-Duistermaat65]. This could enhance our understanding of the familial component of SAD.

5. Conclusions

To conclude, the data presented here show that high levels of social anxiety in the general population are associated with increased embarrassment for unintentional social norm violations. Although the generalizability of our results might be limited by the relatively small sample size, these findings provide more insight in the core fear of socially-anxious individuals and offer clues for therapeutic interventions.

Disclosure statement

No potential conflict of interest was reported by the authors.

Funding sources

Janna Marie Bas-Hoogendam is funded by the Leiden University Research Profile ‘Health, Prevention and the Human Life Cycle’. The funding source had no involvement in writing this paper nor in the decision to submit this work for publication.

Acknowledgement

We gratefully thank Tanja Kreuk who was involved in designing the study and data acquisition as part of her research master thesis project.

Appendix A. Supplementary data

Supplementary data associated with this article can be found, in the online version, at https://doi.org/10.1016/j.eurpsy.2018.03.002.

References

Miskovic, VSchmidt, LASocial fearfulness in the human brain. Neurosci Biobehav Rev 2012; 36:459–78 doi:http://dx.doi.org/10.1016/j.neubiorev.2011.08.002.CrossRefGoogle ScholarPubMed
Rapee, RMSpence, SHThe etiology of social phobia: empirical evidence and an initial model. Clin Psychol Rev 2004; 24:737–67 doi:http://dx.doi.org/10.1016/j.cpr.2004.06.004.CrossRefGoogle ScholarPubMed
American Psychiatric Association, Diagnostic and statistical manual of mental disorders 5th ed. (dsm-5) 2013.CrossRefGoogle Scholar
Wong, QJJRapee, RMThe aetiology and maintenance of social anxiety disorder: a synthesis of complimentary theoretical models and formulation of a new integrated model. J Affect Disord 2016; 203:84100 doi:http://dx.doi.org/10.1016/j.jad.2016.05.069.CrossRefGoogle ScholarPubMed
Leichsenring, FLeweke, FSocial anxiety disorder. New Engl J Med 2017; 376:2255–64 doi:http://dx.doi.org/10.1056/NEJMcp1614701.CrossRefGoogle ScholarPubMed
Heimberg, RGHofmann, SGLiebowitz, MRSchneier, FRSmits, JAJStein, MBet al.Social anxiety disorder in DSM-5. Depress Anxiety 2014; 31:472–9 doi:http://dx.doi.org/10.1002/da.22231.CrossRefGoogle ScholarPubMed
Stein, MBStein, DJSocial anxiety disorder. Lancet 2008; 371:1115–25 doi:http://dx.doi.org/10.1016/S0140-6736(08)60488-2.CrossRefGoogle ScholarPubMed
Spence, SHRapee, RMThe etiology of social anxiety disorder: an evidence-based model. Behav Res Ther 2016; 86:5067 doi:http://dx.doi.org/10.1016/j.brat.2016.06.007.CrossRefGoogle Scholar
Moscovitch, DARowa, KPaulitzki, JRIerullo, MDChiang, BAntony, MMet al.Self-portrayal concerns and their relation to safety behaviors and negative affect in social anxiety disorder. Behav Res Ther 2013; 51:476–86 doi:http://dx.doi.org/10.1016/j.brat.2013.05.002.CrossRefGoogle ScholarPubMed
Berger, UKeshet, HGilboa-Schechtman, ESelf-evaluations in social anxiety: the combined role of explicit and implicit social-rank. Pers Individ Dif 2017; 104:368–73 doi:http://dx.doi.org/10.1016/j.paid.2016.08.023.CrossRefGoogle Scholar
Gilboa-Schechtman, EKeshet, HLivne, TBerger, UZabag, RHermesh, Het al.Explicit and implicit self-evaluations in social anxiety disorder. J Abnorm Psychol 2017; 126:285–90 doi:http://dx.doi.org/10.1037/abn0000261.CrossRefGoogle ScholarPubMed
Gavric, DMoscovitch, DARowa, KMcCabe, REPost-event processing in social anxiety disorder: examining the mediating roles of positive metacognitive beliefs and perceptions of performance. Behav Res Ther 2017; 91:112 doi:http://dx.doi.org/10.1016/j.brat.2017.01.002.CrossRefGoogle Scholar
Glazier, BLAlden, LESocial anxiety and biased recall of positive information: it’s not the content, it’s the valence. Behav Ther 2017; 48:533–43 doi:http://dx.doi.org/10.1016/j.beth.2016.08.001.CrossRefGoogle Scholar
Moscovitch, DAWaechter, SBielak, TRowa, KMcCabe, REOut of the shadows and into the spotlight: social blunders fuel fear of self-exposure in social anxiety disorder. J Anxiety Disord 2015; 34:2432 doi:http://dx.doi.org/10.1016/j.janxdis.2015.06.004.CrossRefGoogle ScholarPubMed
Koban, LSchneider, RAshar, YKAndrews-Hanna, JRLandy, LMoscovitch, DAet al.Social anxiety is characterized by biased learning about performance and the self. Emotion 2017 doi:http://dx.doi.org/10.1037/emo0000296.CrossRefGoogle ScholarPubMed
Loscalzo, YGiannini, MMiers, ACSocial anxiety and interpretation bias: examining clinical and subclinical components in adolescents. Child Adolesc Ment Health 2017 doi:http://dx.doi.org/10.1111/camh.12221.Google Scholar
Blair, KSBlair, RJRA cognitive neuroscience approach to generalized anxiety disorder and social phobia. Emot Rev 2012; 4:133–8 doi:http://dx.doi.org/10.1177/1754073911430251.CrossRefGoogle Scholar
Schreiber, FSteil, RHaunting self-images? The role of negative self-images in adolescent social anxiety disorder. J Behav Ther Exp Psychiatry 2013; 44:158–64 doi:http://dx.doi.org/10.1016/j.jbtep.2012.10.003.CrossRefGoogle ScholarPubMed
Blöte, AWMiers, ACHeyne, DAClark, DMWestenberg, PMThe relation between social anxiety and audience perception: examining clark and wells’ 1995 model among adolescents. Behav Cogn Psychother 2014; 42:555–67 doi:http://dx.doi.org/10.1017/S1352465813000271.CrossRefGoogle ScholarPubMed
Goldin, PRManber-Ball, TWerner, KHeimberg, RGross, JJNeural mechanisms of cognitive reappraisal of negative self-beliefs in social anxiety disorder. Biol Psychiatry 2009; 66:1091–9 doi:http://dx.doi.org/10.1016/j.biopsych.2009.07.014.CrossRefGoogle ScholarPubMed
Piccirillo, MLDryman, MTHeimberg, RGSafety behaviors in adults with social anxiety: review and future directions. Behav Ther 2016; 47:675–87 doi:http://dx.doi.org/10.1016/J.BETH.2015.11.005.CrossRefGoogle ScholarPubMed
Moscovitch, DAWhat is the core fear in social phobia? A new model to facilitate individualized case conceptualization and treatment. Cogn Behav Pract 2009; 16:123–34 doi:http://dx.doi.org/10.1016/j.cbpra.2008.04.002.CrossRefGoogle Scholar
Blair, KSGeraci, MHollon, NOtero, MDeVido, JMajestic, Cet al.Social norm processing in adult social phobia: a typically increased ventromedial frontal cortex responsiveness to unintentional (embarrassing) transgressions. Am J Psychiatry 2010; 167:1526–32 doi:http://dx.doi.org/10.1176/appi.ajp.2010.09121797.CrossRefGoogle Scholar
Berthoz, SArmony, JLBlair, RJRDolan, RJAn fMRI study of intentional and unintentional (embarrassing) violations of social norms. Brain 2002; 125:16967–08 doi:http://dx.doi.org/10.1093/brain/awf190.CrossRefGoogle ScholarPubMed
Bas-Hoogendam, JMvan Steenbergen, HKreuk, Tvan der Wee, NJAWestenberg, PMHow embarrassing! The behavioral and neural correlates of processing social norm violations. PLoS One 2017; 12:e0176326 doi:http://dx.doi.org/10.1371/journal.pone.0176326.CrossRefGoogle ScholarPubMed
Finger, ECMarsh, AAKamel, NMitchell, DGVBlair, JRCaught in the act: the impact of audience on the neural response to morally and socially inappropriate behavior. Neuroimage 2006; 33:414–21 doi:http://dx.doi.org/10.1016/j.neuroimage.2006.06.011.CrossRefGoogle ScholarPubMed
Bas-Hoogendam, JMvan Steenbergen, HKreuk, Tvan der Wee, NJAWestenberg, PMRevised social norm processing task (SNPT-R). Database Open Sci Framew 2017 doi:http://dx.doi.org/10.17605/OSF.IO/M8R76.Google Scholar
Heimberg, RGHorner, KJJuster, HRSafren, SABrown, EJSchneier, FRet al.Psychometric properties of the liebowitz social anxiety scale. Psychol Med 1999; 29:1992–12 doi:http://dx.doi.org/10.1017/S0033291798007879.CrossRefGoogle ScholarPubMed
La Greca, AMLopez, NSocial anxiety among adolescents: linkages with peer relations and friendships. J Abnorm Child Psychol 1998; 26:8394 doi:http://dx.doi.org/10.1023/A:1022684520514.CrossRefGoogle ScholarPubMed
Fresco, DMColes, MEHeimberg, RGLiebowitz, MRHami, SStein, MBet al.The Liebowitz Social Anxiety Scale: a comparison of the psychometric properties of self-report and clinician-administered formats. Psychol Med 2001; 31:1025–35 doi:http://dx.doi.org/10.1017/S0033291701004056.CrossRefGoogle ScholarPubMed
Miers, ACBlöte, AWde Rooij, MBokhorst, CLWestenberg, PMTrajectories of social anxiety during adolescence and relations with cognition, social competence, and temperament. J Abnorm Child Psychol 2013; 41:97110 doi:http://dx.doi.org/10.1007/s10802-012-9651-6.CrossRefGoogle ScholarPubMed
Turk, CLHeimberg, RGOrsillo, SMHolt, CSGitow, AStreet, LLet al.An investigation of gender differences in social phobia. J Anxiety Disord 1998; 12:209–23 doi:http://dx.doi.org/10.1016/S0887-6185(98)00010-3.CrossRefGoogle ScholarPubMed
Duke, DKrishnan, MFaith, MStorch, EAThe psychometric properties of the brief fear of negative evaluation scale. J Anxiety Disord 2006; 20:807–17 doi:http://dx.doi.org/10.1016/j.janxdis.2005.11.002.CrossRefGoogle ScholarPubMed
Carleton, RNCollimore, KCAsmundson, GJGSocial anxiety and fear of negative evaluation: construct validity of the BFNE-II. J Anxiety Disord 2007; 21:131–41 doi:http://dx.doi.org/10.1016/j.janxdis.2006.03.010.CrossRefGoogle ScholarPubMed
Asher, MAsnaani, AAderka, IMGender differences in social anxiety disorder: a review. Clin Psychol Rev 2017; 56:112 doi:http://dx.doi.org/10.1016/j.cpr.2017.05.004.CrossRefGoogle ScholarPubMed
Ingles, CJLa Greca, AMMarzo, JCGarcia-Lopez, LJGarcia-Fernandez, JMSocial Anxiety Scale for Adolescents: factorial invariance and latent mean differences across gender and age in Spanish adolescents. J Anxiety Disord 2010; 24:847–55 doi:http://dx.doi.org/10.1016/j.janxdis.2010.06.007.CrossRefGoogle ScholarPubMed
Bas-Hoogendam, JMvan Steenbergen, Hvan der Wee, NJAWestenberg, PMRelationship between ratings SNPT-R and social anxiety. Database Open Sci Framew 2017 doi:http://dx.doi.org/10.17605/OSF.IO/J58YC.Google Scholar
Mennin, DSFresco, DMHeimberg, RGSchneier, FRDavies, SOLiebowitz, MRScreening for social anxiety disorder in the clinical setting: using the Liebowitz Social Anxiety Scale. J Anxiety Disord 2002; 16:661–73 doi:http://dx.doi.org/10.1016/S0887-6185(02)00134-2.CrossRefGoogle ScholarPubMed
Storch, EAMasia-Warner, CDent, HCRoberti, JWFisher, PHPsychometric evaluation of the social anxiety scale for adolescents and the social phobia and anxiety inventory for children: construct validity and normative data. J Anxiety Disord 2004; 18:665–79 doi:http://dx.doi.org/10.1016/j.janxdis.2003.09.002.CrossRefGoogle ScholarPubMed
Jankowski, KFTakahashi, HCognitive neuroscience of social emotions and implications for psychopathology: examining embarrassment, guilt, envy, and schadenfreude. Psychiatry Clin Neurosci 2014; 68:319–36 doi:http://dx.doi.org/10.1111/pcn.12182.CrossRefGoogle ScholarPubMed
Miller, RSEmbarrassment and social anxiety disorder: fraternal twins or distant cousins?Hofmann, SGDiBartolo, PMSoc. anxiety clin. dev. soc. perspect. 3rd ed. 2014, Academic Press, Elsevier 117–40 doi:http://dx.doi.org/10.1016/B978-0-12-394427-6.00005-4.Google Scholar
Feinberg, MWiller, RKeltner, DFlustered and faithful: embarrassment as a signal of prosociality. J Pers Soc Psychol 2012; 102:8197 doi:http://dx.doi.org/10.1037/a0025403.CrossRefGoogle ScholarPubMed
Miller, RSIs embarrassment a blessing or a curse? Tracy, JLRobins, RWTangney, JPSelf-conscious Emot 1st ed. 2007, The Guilford Press New York245–62.Google Scholar
Moscovitch, DARodebaugh, TLHesch, BDHow awkward! Social anxiety and the perceived consequences of social blunders. Behav Res Ther 2012; 50:142–9 doi:http://dx.doi.org/10.1016/j.brat.2011.11.002.CrossRefGoogle ScholarPubMed
Müller-Pinzler, LGazzola, VKeysers, CSommer, JJansen, AFrässle, Set al.Neural pathways of embarrassment and their modulation by social anxiety. Neuroimage 2015; 119:252–61 doi:http://dx.doi.org/10.1016/j.neuroimage.2015.06.036.CrossRefGoogle ScholarPubMed
Boehme, SMiltner, WHRStraube, TNeural correlates of self-focused attention in social anxiety. Soc Cogn Affect Neurosci 2015; 10:856–62 doi:http://dx.doi.org/10.1093/scan/nsu128.CrossRefGoogle ScholarPubMed
Giménez, MPujol, JOrtiz, HSoriano-Mas, CLópez-Solà, MFarré, Met al.Altered brain functional connectivity in relation to perception of scrutiny in social anxiety disorder. Psychiatry Res 2012; 202:214–23 doi:http://dx.doi.org/10.1016/j.pscychresns.2011.10.008.CrossRefGoogle ScholarPubMed
Abraham, AKaufmann, CRedlich, RHermann, AStark, RStevens, Set al.Self-referential and anxiety-relevant information processing in subclinical social anxiety: an fMRI study. Brain Imaging Behav 2013; 7:3548 doi:http://dx.doi.org/10.1007/s11682-012-9188-x.CrossRefGoogle ScholarPubMed
Blair, KSGeraci, MOtero, MMajestic, COdenheimer, SJacobs, Met al.Atypical modulation of medial prefrontal cortex to self-referential comments in generalized social phobia. Psychiatry Res 2011; 193:3845 doi:http://dx.doi.org/10.1016/j.pscychresns.2010.12.016.CrossRefGoogle ScholarPubMed
Miers, ACBlöte, AWBögels, SMWestenberg, PMInterpretation bias and social anxiety in adolescents. J Anxiety Disord 2008; 22:1462–71 doi:http://dx.doi.org/10.1016/j.janxdis.2008.02.010.CrossRefGoogle ScholarPubMed
Kreifelts, BBrück, CRitter, JEthofer, TDomin, MLotze, Met al.They are laughing at me: cerebral mediation of cognitive biases in social anxiety. PLoS One 2014; 9:e99815 doi:http://dx.doi.org/10.1371/journal.pone.0099815.CrossRefGoogle ScholarPubMed
Hirsch, CRClark, DMInformation-processing bias in social phobia. Clin Psychol Rev 2004; 24:7998–25 doi:http://dx.doi.org/10.1016/j.cpr.2004.07.005.CrossRefGoogle ScholarPubMed
Clark, DMMcManus, FInformation processing in social phobia. Biol Psychiatry 2002; 51:92100 doi:http://dx.doi.org/10.1016/S0006-3223(01)01296-3.CrossRefGoogle ScholarPubMed
Ziv, MGoldin, PRJazaieri, HHahn, KSGross, JJIs there less to social anxiety than meets the eye? Behavioral and neural responses to three socio-emotional tasks. Biol Mood Anxiety Disord 2013; 3:5 doi:http://dx.doi.org/10.1186/2045-5380-3-5.CrossRefGoogle ScholarPubMed
Morrison, ASHeimberg, RGSocial anxiety and social anxiety disorder. Annu Rev Clin Psychol 2013; 9:249–74 doi:http://dx.doi.org/10.1146/annurev-clinpsy-050212-185631.CrossRefGoogle ScholarPubMed
Antony, MMPurdon, CLHuta, VSwinson, RPDimensions of perfectionism across the anxiety disorders. Behav Res Ther 1998; 36:1143–54 doi:http://dx.doi.org/10.1016/S0005-7967(98)00083-7.CrossRefGoogle ScholarPubMed
Ashbaugh, AAntony, MMLiss, ASummerfeldt, LJMcCabe, RESwinson, RPChanges in perfectionism following cognitive-behavioral treatment for social phobia. Depress Anxiety 2007; 24:169–77 doi:http://dx.doi.org/10.1002/da.20219.CrossRefGoogle ScholarPubMed
Cox, SLChen, JPerfectionism: a contributor to social anxiety and its cognitive processes. Aust J Psychol 2015; 67:231–40 doi:http://dx.doi.org/10.1111/ajpy.12079.CrossRefGoogle Scholar
Newby, JPitura, VAPenney, AMKlein, RGFlett, GLHewitt, PLNeuroticism and perfectionism as predictors of social anxiety. Pers Individ Dif 2017; 106:263–7 doi:http://dx.doi.org/10.1016/j.paid.2016.10.057.CrossRefGoogle Scholar
Cox, BJFleet, CStein, MBSelf-criticism and social phobia in the US national comorbidity survey. J Affect Disord 2004; 82:227–34 doi:http://dx.doi.org/10.1016/j.jad.2003.12.012.CrossRefGoogle ScholarPubMed
Hofmann, SGCognitive factors that maintain social anxiety disorder: a comprehensive model and its treatment implications. Cogn Behav Ther 2007; 36:1932–09 doi:http://dx.doi.org/10.1080/16506070701421313.CrossRefGoogle ScholarPubMed
Haller, SPWCohen Kadosh, KScerif, GLau, JYFSocial anxiety disorder in adolescence: how developmental cognitive neuroscience findings may shape understanding and interventions for psychopathology. Dev Cogn Neurosci 2015; 13:1120 doi:http://dx.doi.org/10.1016/j.dcn.2015.02.002.CrossRefGoogle ScholarPubMed
Dingemans, Avan Vliet, ICouvée, JWestenberg, HCharacteristics of patients with social phobia and their treatment in specialized clinics for anxiety disorders in the Netherlands. J Affect Disord 2001; 65:123–9 doi:http://dx.doi.org/10.1016/S0165-0327(00)00238-X.CrossRefGoogle ScholarPubMed
Bas-Hoogendam, JMBlackford, JUBrühl, ABBlair, KSvan der Wee, NJAWestenberg, PMNeurobiological candidate endophenotypes of social anxiety disorder. Neurosci Biobehav Rev 2016; 71:362–78 doi:http://dx.doi.org/10.1016/j.neubiorev.2016.08.040.CrossRefGoogle ScholarPubMed
Bas-Hoogendam, JMHarrewijn, Avan der Molen, MJWvan Steenbergen, Hvan Vliet, IHouwing-Duistermaat, Jet al.Profiling endophenotypes in social anxiety disorder: a neurocognitive approach. General background and key question of project 2014 osf.io/e368 h.Google Scholar
Figure 0

Table 1 Characteristics participants.

Figure 1

Table 2 Ratings of embarrassment and inappropriateness on the SNPT- R.

Figure 2

Fig 1. Relationships between social anxiety (z-standardized) and ratings on the SNPT-R.Shaded areas represent 95% confidence intervals (Colour online).

Supplementary material: File

Bas-Hoogendam et al. supplementary material

Bas-Hoogendam et al. supplementary material
Download Bas-Hoogendam et al. supplementary material(File)
File 27.8 KB
Submit a response

Comments

No Comments have been published for this article.