Hostname: page-component-586b7cd67f-g8jcs Total loading time: 0 Render date: 2024-11-30T20:22:31.010Z Has data issue: false hasContentIssue false

Dairy veterinarians’ skills in motivational interviewing are linked to client verbal behavior

Published online by Cambridge University Press:  19 May 2020

C. Svensson*
Affiliation:
Department of Clinical Sciences, Swedish University of Agricultural Sciences, P.O. Box 7054, SE-750 07Uppsala, Sweden
L. Forsberg
Affiliation:
MIC Lab AB, Drottninggatan 55, SE-111 21Stockholm, Sweden
U. Emanuelson
Affiliation:
Department of Clinical Sciences, Swedish University of Agricultural Sciences, P.O. Box 7054, SE-750 07Uppsala, Sweden
K. K. Reyher
Affiliation:
The Bristol Veterinary School, University of Bristol, Langford House, Langford, North SomersetBS40 5DU, UK
A. M. Bard
Affiliation:
The Bristol Veterinary School, University of Bristol, Langford House, Langford, North SomersetBS40 5DU, UK
S. Betnér
Affiliation:
Department of Energy and Technology, Unit of Applied Statistics and Mathematics, Swedish University of Agricultural Sciences, P.O. Box 7032, SE-750 07Uppsala, Sweden
C. von Brömssen
Affiliation:
Department of Energy and Technology, Unit of Applied Statistics and Mathematics, Swedish University of Agricultural Sciences, P.O. Box 7032, SE-750 07Uppsala, Sweden
H. Wickström
Affiliation:
MeetMe Psykologkonsult AB, Åvägen 16, SE-443 31Lerum, Sweden
*

Abstract

Veterinarians often give advice in a persuasive form, a style that has been shown to evoke resistance to change in clients experiencing psychological ambivalence (i.e. those who see both advantages and disadvantages to changing). With this style of communication, veterinarians run the risk of counteracting their purpose to encourage clients to follow recommendations. Motivational interviewing (MI) is a client-centered communication methodology that aims to facilitate clients’ internal motivation to change. In MI, Change Talk represents clients’ own statements expressing consideration of, motivation for or commitment to behavior change and has been shown to be strongly correlated with behavior change. Sustain Talk is corresponding statements related to maintaining the status quo. The aim of this exploratory study was to evaluate the potential of MI to facilitate behavior change in veterinary herd health management (VHHM) by investigating the effect of dairy cattle veterinarians’ MI skills on client Change and Sustain Talk. We recorded VHHM consultancies on 170 Swedish cattle farms performed by 36 veterinarians, randomly distributed into 2 groups: MI veterinarians (n = 18) had received 6-month training in MI and control veterinarians (n = 18) had not received any training. Veterinarians’ MI skills were assessed using the Motivational Interviewing Treatment Integrity coding system 4.2.1 and categorized as poor_untrained, poor_trained, near moderate and moderate. Client communication was coded using the Client Language Easy Rating coding system. The effect of MI skills on Change Talk, Sustain Talk and Proportion of Change Talk(Change Talk divided by the sum of Sustain Talk plus Change Talk) was investigated using cross-classified regression models with random intercepts for veterinarian and client (farm). The models also included additional explanatory variables (e.g. type of veterinarian and client’s satisfaction with the consultation). The veterinarian’s MI skills were associated with the client’s Change Talk, but results regarding Sustain Talk or Proportion of Change Talk were inconclusive. Clients of veterinarians reaching the highest (i.e. moderate) MI skills expressed 1.5 times more Change Talk than clients of untrained veterinarians. Clients of general large animal practitioners expressed less Sustain Talk than clients of animal health veterinarians and had higher Proportion of Change Talk. Results indicate that learning to practice MI may be one means to improve adherence to veterinary recommendations and to improve efficiency in VHHM services.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2020. Published by Cambridge University Press on behalf of The Animal Consortium

Implications

We investigated communication between clients and veterinarians with different skills in the client-centered communication methodology motivational interviewing. Clients of veterinarians with the highest skills in motivational interviewing (from among the sampled veterinarians) spoke most favorably about behavior change. Such communication (in favor of change) previously has been shown to be correlated with clients later changing behavior. This finding therefore indicates that learning motivational interviewing may be a means by which veterinarians can inspire farms to implement preventive measures to improve animal health. Herd health advisory services should be revised so that veterinarians give further attention to client motivation and perspectives.

Introduction

Communication skills are increasingly being acknowledged as important in the veterinary profession (Cake et al., Reference Cake, Bell, Williams, Brown, Dozier, Rhind and Baillie2016; Ritter et al., Reference Ritter, Adams, Kelton and Barkema2019). Veterinary herd health management (VHHM) services constitute an increasing proportion of work for cattle veterinarians and often focus on changing management routines (i.e. behavior change). In these types of services, change-orientated communication skills therefore may be of special importance. A shared power elicited by relationship-oriented communication and use of a high proportion of empathy statements has been demonstrated to be positively associated with behavior change (Kanji et al., Reference Kanji, Coe, Adams and Shaw2012; Moyers and Miller, Reference Moyers and Miller2013). However, veterinarians working in VHHM have been found to show very few of these behaviors (Bard et al., Reference Bard, Main, Haase, Whay, Roe and Reyher2017; Ritter et al., Reference Ritter, Adams, Kelton and Barkema2018; Svensson et al., Reference Svensson, Emanuelson, Bard, Forsberg, Wickström and Reyher2019a). Instead their conversations were dominated by information gathering, questions and persuasion (Bard et al., Reference Bard, Main, Haase, Whay, Roe and Reyher2017; Svensson et al., Reference Svensson, Emanuelson, Bard, Forsberg, Wickström and Reyher2019a). Ritter et al. (Reference Ritter, Adams, Kelton and Barkema2019) recently demonstrated that dominance in the veterinarian and a high use of information gathering in consultations were associated with a lower stated likelihood by farmers to implement veterinary advice. In a similar vein, persuasion and confrontation are behaviors that have been shown to be negatively associated with behavior change in consultancies (Miller and Moyers, Reference Miller and Moyers2017). Hence, veterinarians speaking in this way run the risk of counteracting their purpose to encourage clients to follow veterinary recommendations.

One change-orientated evidence-based communication methodology being increasingly implemented across numerous sectors is motivational interviewing (MI; Miller and Moyers, Reference Miller and Moyers2017). This methodology was developed in alcohol abuse consultations and has successfully been used to reduce tobacco and drug use and to promote positive lifestyle changes (Hettema et al., Reference Hettema, Steele and Miller2005; Lundahl et al., Reference Lundahl, Kunz, Brownell, Tollefson and Burke2010). Lately, the MI methodology has also been found to be a helpful tool in enforcement situations for food safety, health safety and environmental inspectors (Forsberg et al., Reference Forsberg, Wickström and Källmén2014; Wickström et al., Reference Wickström, Herzing, Forsberg, Jacobsson and Källmén2017) and was rated by cattle veterinarians as highly relevant to their profession (Svensson et al., Reference Svensson, Wickström, Emanuelson, Bard, Reyer and Forsberg2020).

For veterinarians to continue to be effective and valued consultants in animal health, efficiency in their services is of importance. Given the weaknesses demonstrated in veterinarians’ communications skills, adopting a client-centered communication methodology such as MI may be one means to increase efficiency in VHHM services, as suggested by Bard et al. (Reference Bard, Main, Haase, Whay, Roe and Reyher2017) and Svensson et al. (Reference Svensson, Emanuelson, Bard, Forsberg, Wickström and Reyher2019a). Veterinary herd health management services involve complex consultancies and little is known about the communication style best suited for veterinarians to be efficient. To estimate the potential of MI to facilitate clients’ implementation of preventive measures in VHHM, studies that objectively measure the effect of the methodology on these client behaviors are warranted.

In MI, Change Talk is defined as the client’s own statements expressing consideration of, motivation for or commitment to behavior change. Motivational interviewing research uses the amount of Change Talk expressed by the client as an outcome measure of communication skills, because it has been shown to be strongly correlated with clients later adopting the behavior change in question (Apodaca and Longabaugh, Reference Apodaca and Longabaugh2009). Several instruments have been developed to assess client verbal responses in consultations. However, the most valid are time consuming and therefore costly (Martin et al., Reference Martin, Moyers, Houck, Christopher and Miller2005). A more practical and economically reasonable instrument is the Client Language Easy Rating (CLEAR) coding system (Hagen and Moyers, Reference Hagen and Moyers2012). Client Language Easy Rating assesses and summarizes clients’ responses in three categories: Change Talk, Sustain Talk (i.e. corresponding statements related to the status quo) and Neutral Talk. When the amount of Change Talk and Sustain Talk in a session is all that is of interest, CLEAR is believed to represent an appropriate and efficient way to characterize these types of client language (Hagen and Moyers, Reference Hagen and Moyers2012).

The aim of the present study was to evaluate the potential of MI to facilitate client behavior change in VHHM by investigating the effect of dairy cattle veterinarians’ MI skills on client Change Talk and Sustain Talk during VHHM visits. More specifically, the study aimed to test the hypothesis that clients conversing with veterinarians who had greater MI skills would express more Change Talk and less Sustain Talk than clients conversing with veterinarians who had a lower level of MI skills. Preliminary results from the present study have previously been published in abstract form (Svensson et al., 2019c).

Material and methods

In total, 36 cattle veterinarians audio-recorded VHHM consultancies on 170 Swedish cattle farms (164 dairy, 4 cow-calf beef and 2 specialized beef) using digital voice recorders. Recordings were made between June 2016 and January 2017 (n = 18) or between June 2017 and January 2018 (n = 18). Veterinarians wore voice recorders and uploaded recordings to a webpage at the coding laboratory MIC Lab AB, Stockholm (www.miclab.se). Professional coders at MIC Lab AB coded the clients’ Change Talk and Sustain Talk using the CLEAR coding system. The quality of the recordings varied and was sometimes reduced by sounds from cows, machinery and interrupting telephone calls. The quality, however, was generally acceptable for coding. Each veterinarian was requested to record five consultancies; details about these consultancies have been reported by Svensson et al. (Reference Svensson, Lind, Reyher, Bard and Emanuelson2019b).

Half of the veterinarians (n = 18) had participated in a 6-month MI training program between September 2016 and March 2017(before they recorded their conversations); the rest were untrained. Before the consultancies took place, we assessed veterinarians’ MI skills from role-play conversations with professional actors. At the start of the project, the veterinarians had filled in a web questionnaire (https://www.netigate.net/sv/) about their characteristics (Svensson et al., Reference Svensson, Emanuelson, Bard, Forsberg, Wickström and Reyher2019a), from which we received information about their gender and experience in VHHM. Veterinarians had also filled in a web questionnaire about (1) the conditions of their farm visit, (2) their view about the consultation and (3) the outcomes of the consultation. From Part (1) of this questionnaire, we retrieved information about type of visit (pre-defined categories) and the number of participants from the farm; from Part (2) we received information about whether veterinarians felt that they and the client, respectively, had allocated sufficient time to the consultation (Likert scale 1 to 6). After the consultations, clients were interviewed via telephone and data about their age, gender, education, role on the farm, satisfaction with the consultation and if they felt that they and the veterinarian, respectively, had allocated sufficient time to the consultation were collected. The telephone interviews have been further described by Svensson et al. (Reference Svensson, Lind, Reyher, Bard and Emanuelson2019b). The study design is outlined in Figure 1.

Figure 1 Design of the study investigating effect of veterinary motivational interviewing (MI) skills on client responses in veterinary herd health management conversations on 170 Swedish cattle farms.

Participating veterinarians and farms

The selection of participating veterinarians has been described previously by Svensson et al. (Reference Svensson, Emanuelson, Bard, Forsberg, Wickström and Reyher2019a). In short, volunteers were selected by the two largest employers of Swedish dairy cattle veterinarians – the District Veterinary Organization (Swedish Board of Agriculture) and the regional dairy associations – or among self-employed dairy cattle practitioners involved in the main Swedish VHHM network. Out of the total number of Swedish dairy cattle veterinarians involved in VHHM (n = 97: 56 employed by District Veterinary Organization, 23 by dairy associations and 18 self-employed), 42 veterinarians participated in the project and were randomly distributed into 2 groups (trained MI group and untrained control group). The training, described in detail by Svensson et al. (Reference Svensson, Wickström, Emanuelson, Bard, Reyer and Forsberg2020), consisted of six workshops with theoretical lectures and practical training. During the time between workshops, participants were to read and reflect on chapters in the main MI handbook by Miller and Rollnick (Reference Miller and Rollnick2012) and to practice their skills. Due to lack of time, four veterinarians terminated their participation in the project before they started their training, one never finished the training and one never recorded any consultancies. Out of the 36 veterinarians included in the present study, there were 2 men and 34 women. Eighteen were district veterinarians, 13 were animal health veterinarians from the regional dairy associations and 5 were self-employed veterinarians. Veterinarians were stationed all over the country, in both intensive farming areas and woodland areas. All 36 veterinarians received MI training without any cost as part of the project. Control veterinarians received training from September 2017 to March 2018 (i.e. after they had finished all their recordings for the present study).

The selection of participating farms has been described previously by Svensson et al. (Reference Svensson, Lind, Reyher, Bard and Emanuelson2019b). In short, a convenience sample of farms chosen by the veterinarians from among their clients was included and farmers were informed by the veterinarians about the purpose and design of the project. Clients received no compensation to participate in the study. We asked veterinarians in both groups (trained MI group and untrained control group) to provide the same information about the communication training in the project so that farms would be blinded to whether the veterinarian had received MI training or not. Six farms were visited by two different veterinarians. One farm was visited in the same year by two different veterinarians who were both trained in MI. Recommendations from these two veterinarians dealt with totally different areas (biosecurity and udder health); the biosecurity conversation was considered to have negligible impact on the response talk in the udder health conversation and vice versa. Both observations therefore remained in the study. The other five farms were first visited by a control veterinarian and one year later by a veterinarian trained in MI.

Assessing motivational interviewing skills

Each veterinarian conducted three role-play conversations reflecting telephone consultations with a client whom the veterinarian previously had met on the farm when the time had been restricted and an agreement therefore had been made to continue and finish the discussion over the telephone. The role-plays were designed to provide controlled conditions for veterinarians to demonstrate relevant MI skills. For reference, veterinarians’ MI skills were also assessed from the 170 audio-recorded on-farm VHHM consultancies mentioned above. Veterinarians’ MI skills were assessed using the Motivational Interviewing Treatment Integrity coding system 4.2.1 (MITI; Moyers et al., Reference Moyers, Manuel and Ernst2014). The MITI identifies frequency counts of 10 verbal behaviors as well as assessments of 4 global scores on a Likert scale ranging from 1 (‘low’) to 5 (‘high’) based on 20 min of a conversation. The coding manual also specifies six summary measurements derived from the 14 original variables (Moyers et al., Reference Moyers, Manuel and Ernst2014). The role-plays and MITI codings (coded by MIC Lab AB) have previously been described in detail by Svensson et al. (Reference Svensson, Emanuelson, Bard, Forsberg, Wickström and Reyher2019a and Reference Svensson, Wickström, Emanuelson, Bard, Reyer and Forsberg2020).

Based on the MITI coding results, we categorized veterinarians’ MI skills as ‘poor’, ‘near moderate’ and ‘moderate’. We further sub-categorized ‘poor’ skills into ‘poor_untrained’ and ‘poor_trained’, because differences between untrained and trained veterinarians in MI skills other than those expressed by the MITI variables could not be excluded. In order to categorize in this way, we used the summary MITI variables Relational and MI-non-adherent behaviors and the original MITI variable Cultivating Change Talk. The MITI variable Relational was calculated as (Partnership + Empathy)/2, where Partnership expressed the extent to which the advisor actively fostered collaboration and power sharing with the client, and Empathy was how the advisor understood or made an active effort to grasp the client’s perspective and experience. MI-non-adherent behaviors were Persuade (overt attempts to change a client’s opinions, attitudes or behaviors using tools such as logic, compelling arguments, self-disclosure, facts, biased information, advice, suggestions, tips, opinions or solutions to problems) and Confront (directly and unambiguously disagreeing, arguing, correcting, shaming, blaming, criticizing, labeling, warning, moralizing, ridiculing or questioning a client’s honesty). Cultivating Change Talk expressed the extent to which the advisor actively encouraged the client’s own language in favor of the behavior change goal as well as the client’s confidence to make the change. Because information about client ambivalence was lacking for the on-farm VHHM consultancies, we did not use MI-non-adherent behaviors in the reference categorization based on the on-farm recordings but used only Relational and Cultivating Change Talk.

We used the following thresholds to define the veterinarians who reached ‘near moderate’ and ‘moderate’ competency: ‘moderate’ competency – Relational ⩾3.5, Cultivating Change Talk ⩾3 and MI-non-adherent behaviors ⩽2; ‘near moderate’ competency – Relational ⩾3.5, Cultivating Change Talk ⩾2.7 and MI-non-adherent behaviors <4. Veterinarians who did not reach these thresholds were categorized as ‘poor’. In the reference categorization based on the on-farm recordings, thresholds were ‘moderate’ competency – Relational or Empathy ⩾3 and Cultivating Change Talk ⩾2; ‘poor’ competency – Relational or Empathy ⩽2 or Cultivating Change Talk ⩽1.2. Veterinarians who did not meet these thresholds were categorized as ‘near moderate’. Thresholds were chosen based on MI literature and experience of MITI coding of conversations in different contexts. Relational ⩾3.5 and Cultivating Change Talk ⩾3 are thresholds suggested in the MITI manual (Moyers et al., Reference Moyers, Manuel and Ernst2014). We deleted one veterinarian who only had one recorded VHHM visit from the reference categorization based on on-farm recordings, as one recording was not considered sufficient to give a reliable measurement.

Assessing client Change Talk

Three coders performed all CLEAR codings of the 170 audio-recordings from on-farm VHHM consultations according to the CLEAR manual, translated to Swedish (Hagen and Moyers, Reference Hagen and Moyers2012). The professional coders at MIC Lab AB perform MITI codings continuously and had been trained in CLEAR coding before the present study. To sustain coders’ competence, coders at MIC Lab AB participate in a quality assurance program. The program comprises weekly training sessions based on independently coded recordings. Coders also discuss especially difficult coding sessions between themselves regularly. Further information about the quality assurance program is provided in Supplementary Material S1. The CLEAR manual specifies frequency counts of two main categories of client talk, Change Talk and Sustain Talk, each comprising seven sub-categories. Change Talk comprises the sub-categories Desire to change, Ability to change, Reason to change, Need to change, Commitment to change, Taking steps towards change and Other Change Talk. The seven sub-categories of Sustain Talk are Desire not to change, Ability not to change, Reason not to change, Need to not change, Commitment not to change, Taking steps away from change and Other Sustain Talk. We summarized client responses as Change Talk and Sustain Talk. We also calculated another outcome variable, Proportion of Change Talk, defined as Change Talk frequency over the sum of Change Talk frequency plus Sustain Talk frequency (%Change Talk = Change Talk/(Change Talk + Sustain Talk)).

Coders started CLEAR coding the on-farm VHHM recordings when all veterinarians (from both groups) had recorded all consultancies. The order in which coders coded the recordings was randomized so that consultancies from both MI-trained veterinarians and untrained control veterinarians were coded in parallel. Consultations were encrypted during uploading to the web page and registered in a database at a protected server. Coders did not know the identities of veterinarians nor their group. For reliability reasons, the MITI recommends to code 20 min of each consultation. Because recordings were used both for MITI and CLEAR coding, we coded 20 min of each consultation. Veterinarians were instructed to record a minimum of 20 min consultation on each farm and to select the time period during which they were consulting the client about any behavior change (i.e. implementation of preventive measures). However, 21 recordings (all included in the present study) were shorter (10 to 17 min). If veterinarians recorded longer consultations, we coded those parts indicated by the veterinarians to be about behavior change. When veterinarians had indicated longer sequences than 20 min as relevant, we chose random sequences of 20 min to code. Veterinarians were not specifically informed that the audio-recordings would be subjected to CLEAR coding.

Data editing and statistical analyses

Descriptive statistics of Change Talk and Sustain Talk were calculated using Microsoft Excel (Microsoft Corp., Redmond, WA, USA). The frequencies of Change and Sustain Talk for conversations shorter than 20 min were adjusted to 20 min by multiplying the frequency with 20/(number of minutes of the recordings).We investigated the effect of MI skills on client response talk using three cross-classified regression models. Two Poisson regression models, with random intercepts for veterinarian and client (farm) and offset for number of minutes of the recordings, were estimated in the statistical software R (Version 3.5.3., R Core Team 2019, https://www.R-project.org/) using the package glmmTMB (R package version 0.2.3. Brooks et al., Reference Brooks, Kristensen, van Benthem, Magnusson, Berg, Nielsen, Skaug, Maechler and Bolker2017) for the two response variables Change Talk and Sustain Talk. The offset in models standardizes the response variable to the length of the recording, thus, in our case, making the rate of the different types of client speech the modeled response. A logistic regression model with the same random intercepts but with the response variable Proportion of Change Talk was also estimated using the same package. The effects of the following extra explanatory variables were assessed: gender, VHHM experience and type of veterinarian, age, education and role of the client, if both client and veterinarian felt that the time allocated for the consultancy was sufficient, if the gender of the client and veterinarian were the same (gender concordance), number of participants from the farm, visit type and the client’s satisfaction with the consultation. Interactions and sequence of veterinarians’ visits (time within veterinarian) were not investigated because of the limited number of observations. The R code is provided in Supplementary Material S2. All extra explanatory variables except age of the veterinarian were categorical; categories of each variable are shown in Table 1. Animal health veterinarians worked with preventive medicine only, whereas general large animal practitioners also made treatment visits. Lower education was defined as primary or secondary level of education and higher education as tertiary level education. The variable Sufficient time was created from the responses (Likert scale 1 to 6) by the veterinarian in the web questionnaire (own and the client’s time) and by the client in the telephone interview (own and veterinarian’s time) so that Sufficient time was classified as ‘no’ when either the veterinarian or the client rated a time variable below four and as ‘yes’ in all other cases. The client was denoted as satisfied with the consultation if she or he had rated the satisfaction with both the veterinarian’s behavior and competency (Likert scale 1 to 6) as more than three or the sum of the two ratings was eight or more.

Table 1 Results from multivariable Poisson regression modela of the associations between veterinarians’ (n = 36) skills in motivational interviewing (MI) and rate of client Change Talk in 170 veterinary herd health management (VHHM) consultations on Swedish cattle farms

a SD of random intercept of veterinarian: 0.21 (standard error (SE): 0.079) and client (farm): 0.38 (SE: 0.052).

b 95% confidence interval.

c Overall P-value for chi-square test for variables with more than two categories.

For each model, randomized quantile residuals were obtained by the R package DHARMa (R package version 0.2.4. https://CRAN.R-project.org/package=DHARMa) and assessed graphically and with tests of residual distribution, together with tests of under- and overdispersion and zero inflation. None of the models showed any clear visual deviation for the residual distribution from the assumed error distribution, and none of the tests of deviations from typical model misspecifications indicated any problems. Multicollinearity was assessed for each model with generalized variance inflation factor, due to the presence of categorical explanatory variables. No evidence of multicollinearity was found, with a rule of thumb threshold at three which corresponded to an ordinary variance inflation factor of nine. Results from the model validation are shown in Supplementary Material S3.

Results

The frequency count of Change Talk per 20 min ranged from 0 to 18 (median: 6; interquartile range: 4 to 8) and of Sustain Talk from 0 to 13 (median: 2; interquartile range: 1 to 4). Distribution of characteristics of veterinarians, clients and consultancies is shown in Table 1. The age of clients ranged from 20 to 74 (median: 49; interquartile range: 38 to 56) years; 91 were men and 64 were women, whereas both genders were represented in 15 of the conversations with multiple clients. Clients were overall highly satisfied with their veterinarians. On the 170 farms, all but 10 (94%) clients scored satisfaction with the veterinarian’s attitude at 5 or 6 (range: 3 to 6; median: 6; interquartile range: 5 to 6) and all but 14 (92%) stated their satisfaction with the veterinarian’s competency to be 5 or 6 (range: 1 to 6; median: 5; interquartile range: 5 to 6). None of the untrained control veterinarians reached MI skills comparable to the thresholds set to categorize ‘near moderate’ competency (i.e. the MI skills of all untrained veterinarians were categorized as poor_untrained). Of the trained veterinarians, six reached ‘moderate’ skill, six ‘near moderate’ skills and six were categorized as having ‘poor’ skills (Table 1). Before training, none of the trained veterinarians had reached ‘near moderate’ skills.

Table 1 also presents the results from the cross-classified model investigating associations with Change Talk. The veterinarian’s MI skills were associated with the client’s Change Talk, with clients speaking to veterinarians that had reached ‘moderate’ skills expressing 1.6 times more Change Talk (P = 0.008) than clients speaking to untrained veterinarians. Results regarding Sustain Talk and Proportion of Change Talk were inconclusive (Tables 2 and 3). Clients of animal health veterinarians expressed more Sustain Talk (P = 0.003; Table 2) and a lower Proportion of Change Talk (P = 0.01; Table 3) than clients of general large animal practitioners. There was 1.2 times more Change Talk in conversations with clients of the same gender as the veterinarian compared to conversations without gender concordance, but the confidence interval (CI) was 0.98 to 1.50. The multiplicative effects of Change Talk in conversations from visits regarding herd health problems or visits of other types (as compared to strategic visits) were 0.69 and 0.81, but CIs were 0.50 to 0.95 and 0.63 to 1.00, respectively (Table 1). The odds ratio for the Proportion of Change Talk for clients satisfied with the conversation (as compared to for unsatisfied clients) was 2.8, but CI was 0.95 to 8.40 (Table 3). Using the veterinarian’s MI skills based on on-farm conversations rather than on role-play conversations in the multivariable analyses gave the same results (results not shown).

Table 2 Results from a multivariable Poisson regression modela of the associations between veterinarians’ (n = 36) skills in motivational interviewing (MI) and rate of client Sustain Talk in 170 veterinary herd health management (VHHM) consultancies on Swedish cattle farms

a SD of random intercept of veterinarian: 0.08(SE: 0.26) and client (farm): 0.55 (SE: 0.078).

b 95% confidenceinterval.

c Overall P-value for chi-square test for variables with more than two categories.

Table 3 Results from a multivariable logistic regression modela of the associations between veterinarians’ (n = 36) skills (n = 36) in motivational interviewing (MI) and Proportion of Change Talk in 170 veterinary herd health management (VHHM) consultations on Swedish cattle farms

a SD of random intercept of veterinarian: <0.001 (SE: 0.44) and client (farm): 0.24 (SE: 0.12).

b 95% confidence interval.

c Overall P-value for chi-square test for variables with more than two categories.

Discussion

Veterinarians’ MI skills were associated with client Change Talk, but results regarding Sustain Talk and Proportion of Change Talk were inconclusive. Previous studies have demonstrated associations between MI skills and all three variables. Magill et al. (Reference Magill, Longabaugh, Borsari, Gaume, Hoadley, Gordon, Tonigan and Moyers2018) reported from a meta-analysis of 36 studies that MI skills of non-veterinary consultants in interventions targeting a range of behavioral outcomes (alcohol use, drug use, gambling, diet, exercise and medical adherence) were positively associated with both Change Talk and Sustain Talk. However, on average, improved MI skills were associated with more Change Talk rather than Sustain Talk. This is consistent with the method of MI, which explores ambivalence and, as the conversation continues, helps the client to resolve this ambivalence into commitment to change (Miller and Rollnick, Reference Miller and Rollnick2012). A link between Change Talk and behavior change at follow-up has been demonstrated in several studies (Amrhein et al., Reference Amrhein, Miller, Yahne, Palmer and Fulcher2003; Moyers et al., Reference Moyers, Martin, Houck, Christopher and Tonigan2009; Pirlott et al., Reference Pirlott, Kisbu-Sakarya, Defrancesco and Mackinnon2012), and a systematic review of studies found that Change Talk was consistently related to positive client outcome (Romano and Peters, Reference Romano and Peters2016). This highlights the importance of the findings in the present study and demonstrates an indirect link to outcome of VHHM consultancies suggesting that learning to practice MI may be one means to increase efficiency of veterinary services.

It is unclear what level of MI fidelity is ‘good enough’ to facilitate change within particular contexts and thus the level of MI skills a veterinarian should have to get results. In the present study, we categorized veterinarians’ MI skills based on both relational and technical skills (the MITI variables Relational, MI-non-adherent behaviors and Cultivating Change Talk). These variables were chosen because the skill of empathy has been positively associated and MI-non-adherent behaviors negatively associated with outcome. The technical skill Cultivating Change Talk has been positively associated with Change Talk (Lindqvist et al., Reference Lindqvist, Forsberg, Enebrink, Andersson and Rosendahl2017). For role-play conversations, the thresholds for Relational and Cultivating Change Talk were based on those suggested to represent ‘fair competency’ in the MITI manual (Moyers et al., Reference Moyers, Manuel and Ernst2014). Although firm suggestions are lacking with regard to MI-non-adherent behaviors, it is generally recognized that this type of speech should ideally not occur in MI consultations. Coding is difficult, and because the veterinary context was new to the coders before we trained them for the present study, they may have misinterpreted some situations and miscoded speech as MI-non-adherent. To account for this, we chose ⩽2 as a threshold for ‘moderate’ skills for this variable. Thresholds for ‘near moderate’ skills in role-play conversations and for the on-farm conversations were chosen based on experience of MITI coding of conversations in different contexts. In the on-farm conversations, none of the veterinarians reached the threshold used for the role-play conversations. Although previous studies have demonstrated associations between MI skills and outcome, research has not yet been able to specify clear thresholds (Magill et al., Reference Magill, Longabaugh, Borsari, Gaume, Hoadley, Gordon, Tonigan and Moyers2018). A definition of ‘moderate’ MI skills was associated with Change Talk, but results regarding ‘near moderate’ or ‘poor’ skills were inconclusive. This may indicate that a certain level of MI skills is needed to have an impact. Further studies are needed to explore the most suitable thresholds to define various levels of MI skills in the veterinary profession.

Svensson et al. (Reference Svensson, Wickström, Emanuelson, Bard, Reyer and Forsberg2020) demonstrated that cattle veterinarians were able to reach ‘moderate’ MI skills from a 6-month training program consisting of 6 days of workshops separated by period of literature studies and practical training of their new skills. However, the majority of participating veterinarians in this study did not reach this level of skills, highlighting the challenges of teaching MI methodology and the need for sufficient practice. Motivational interviewing takes time to learn and to maintain, and it may not be possible to fit sufficient practice into the every-day-work of a cattle practitioner.

There was a higher rate of Sustain Talk and lower Proportion of Change Talk in consultations with animal health veterinarians compared to in those with a general large animal practitioner. This finding is difficult to explain but may be due to animal health veterinarians being more tempted to use their expertise and suggest actions to their clients (MITI variable Persuade). Animal health veterinarians generally have larger volumes of VHHM services in their work compared to general large animal practitioners and may have been more confident in their advisory role. Confidence may be built not only from longer experience as veterinarians or years in VHHM but also from larger volumes of VHHM. Svensson et al. (Reference Svensson, Emanuelson, Bard, Forsberg, Wickström and Reyher2019a) found that veterinarians with more years in practice had lower Relational scores and expressed more persuasion than those with more recent veterinary degrees. In line with that finding, Svensson et al. (Reference Svensson, Wickström, Emanuelson, Bard, Reyer and Forsberg2020) reported that veterinarians with longer experience in VHHM did not improve in practicing Cultivating Change Talk after their MI training.

The variable with largest average effect on proportion of Change Talk was client satisfaction (odds ratio: 2.8; CI: 0.95 to 8.40). Ritter et al. (Reference Ritter, Adams, Kelton and Barkema2019) previously suggested client satisfaction to be a proxy for farmers’ preparedness to adopt veterinary advice. Just as in the study by Ritter et al. (Reference Ritter, Adams, Kelton and Barkema2019), clients in the present study were highly satisfied with their veterinarian. In fact, only two clients stated they were unsatisfied; hence, these results should be interpreted with caution.

The results of the present study suggest that the association between Change Talk and type of visit should be further evaluated in future studies. Strategic visits aim to optimize animal health and production in a longer perspective, and it may be more logical to discuss farm goals in this type of consultations compared to on VHHM visits initiated as a consequence of specific herd health problems and other advisory visits. The focus on farm goals may improve veterinarian–client relations and trust that in turn may render clients to view their relationship with the veterinarian more positively and to adopt veterinary advice, as indicated by findings by Svensson et al. (Reference Svensson, Lind, Reyher, Bard and Emanuelson2019b) and Bard et al. (Reference Bard, Main, Roe, Haase, Whay and Reyher2019).

Methodological considerations

We chose to assess veterinarians’ MI skills based on role-play with professional actors. This approach was chosen as role-play methodology has shown promise in comparison with using real clients (Imel et al., Reference Imel, Baldwin, Baer, Hartzler, Dunn, Rosengren and Atkins2014) and our previous work suggested veterinarians’ communication patterns between role-play and real contexts were stylistically similar (Svensson et al. Reference Svensson, Emanuelson, Bard, Forsberg, Wickström and Reyher2019a). Additionally, this approach standardized the conditions for MI communication, allowing for reliable categorization of veterinarians in terms of estimating their MI skills. The role-plays were designed and the actors were trained to provide controlled conditions for participants to demonstrate all their relevant MI skills; consultations had clear behavior targets and actor clients had ambivalent perceptions. To ensure methodological validity, we also assessed how veterinarians would have been categorized based on performance within the same on-farm consultations from which client CLEAR coding data were drawn. Minor differences were found in overall skills categorization, but this method provided the same associations with outcome variables (results available on request) indicating the basis for categorization of MI skills was not critical to these results. Further research is needed to explore if more nuanced differences may exist between such sample groups.

Because of its exploratory nature, multiple testing issues have not been considered in the present study. Observed effects should be verified in future studies and until then interpreted with caution. The limited spread in MI skills among veterinarians (few veterinarians reached ‘moderate’ skills, and none reached higher levels of MI skills) may have reduced the power of this study, making it less possible to identify associations with client responses. Future research using samples with larger variation may be used to verify the present results and to find further associations between veterinarians’ MI skills and client responses.

Also, we were unable to use one of the most accurate coding instruments, the Motivational Interviewing Sequential Code for Observing Process Exchanges (SCOPE; Martin et al., Reference Martin, Moyers, Houck, Christopher and Miller2005), to assess client response. The SCOPE requires that recorded consultations are transcribed and that coders go through the recordings twice to assess each client utterance against one of 16 client codes. In contrast, CLEAR coding does not require a transcript and the coder only needs to listen to the recorded conversation once. Client Language Easy Rating does not code global ratings but only counts of Change Talk, Sustain Talk and Neutral Talk. Client Language Easy Rating coding is also not sequential, so behaviors are coded using only tallies. Future studies with larger budgets enabling more precise methods may reveal more associations. Furthermore, qualitative methodologies may complement quantitative efforts such as the present study, offering nuanced and in-depth insight into how veterinarians and farmers understand and experience these MI advisory consultations in the VHHM sphere.

Information about coder was not available and the effect of coder could not be included in the statistical models. However, to sustain coders’ competence, coders at MIC Lab AB participated in a quality assurance program. Furthermore, codings were performed in a randomized order, which was likely to reduce further any effects of coder. It is therefore unlikely that the results were biased due to systematic differences between coders. We chose to include a random effect of client (farm) as multiple veterinarians occasionally visited the same farm. Inclusion of a random client (farm) effect even though most farms were only visited once is also a common remedy against so-called overdispersion (i.e. excess variation that is not described by the standard Poisson or logistic regression model). For all models, the variance of the random effect of client (farm) was substantially larger than the variance of the random effect of veterinarian, indicating a larger unexplained variation between clients (farms) than between veterinarians (see also Supplementary Materials S4 and S5). A discussion on potential bias related to the veterinarians’ selection of recordings for coding is presented in Supplementary Material S1.

Clients were a convenience sample selected by the veterinarians from among their customers. Many of the veterinarians had difficulty finding five farms where they could record a 20-min advisory conversation for the study. However, when more farms were available, it is likely that clients perceived by the veterinarians as more satisfied with their services would have had a higher chance of being selected. It is therefore not unlikely that the present study may have overestimated the level of satisfaction by clients and that this may have resulted in higher counts of Change Talk. A bias in the effect of MI skill on client response talk in these data is not anticipated because the same sampling method was used by all veterinarians to select clients.

The participating veterinarians were not from a random sample, but most likely represented cattle veterinarians most interested in communication and advisory services. Participants were randomized into the two groups and we also controlled for factors that may have been unequally distributed in spite of the randomization (type of veterinarian, gender, VHHM experience and type of visits) in the cross-classified analyses. Coders did not know the identity or the group of veterinarian, and codings for both groups (trained MI-veterinarians and untrained control veterinarians) were made in parallel and in a randomized order. Veterinarians from both groups were instructed to provide the same information to the farms so that clients would be unaware if their veterinarian was trained or untrained. This approach should merit valid comparisons.

Conclusions

To conclude, in this exploratory study we identified an association between veterinarians’ MI skills and client Change Talk, a variable known to be correlated with clients’ adopting of behavior change. The results suggest that MI may be a valuable methodology in VHHM as these services largely focus on changing management routines on farms. Learning to practice MI may be one means to improve adherence to veterinary recommendations and to improve efficiency in VHHM services.

Acknowledgements

This study was funded by The Swedish Research Council for Environment, Agricultural Sciences and Spatial Planning (942-2015-960). The authors thank the participating veterinarians for providing their time and efforts in the project and participating farmers for their time and effort for the interviews and for their kindness to allow recordings of their conversations with the veterinarians. Distriktsveterinärerna (Jönköping), Växa Sverige (Stockholm) and Skånesemin (Hörby) are acknowledged for their cooperation. The authors are grateful to Åsa Karlin, Nanny Nilsson, Emilia Roosmann, Daniel Ohlsson and Martin Preisler at MIC Lab AB (Stockholm) for their role-play acting performances and to Mahlena Wiveson, Helena Chaomar and Marie Illerbrand at MIC Lab AB (Stockholm) for coding the recordings. Johan Glimskog (MIC Lab AB, Stockholm) is acknowledged for data retrieval.

C. Svensson 0000-0002-2591-3020

Declaration of interests

Lars Forsberg is a partner at MIC Lab AB and Hans Wickström a partner at MeetMe Psykologkonsult AB. Research results demonstrating positive effects of MI on outcome in veterinary medicine may increase the market for codings for MIC Lab AB and the market for educational concepts in MI for MeetMe Psykologkonsult AB. Catarina Svensson, Ulf Emanuelson, Kristen Reyher, Alison Bard, Staffan Betnér and Claudia von Brömssen have no conflict of interest to report.

Ethics statement

The study was granted ethics approval by the Regional Ethical Review Board in Uppsala (reference number 2016/041), ensuring procedures met ethical guidelines for research with human participants. Participation in the study was voluntary both for farms and veterinarians. Veterinarians informed their clients about the purpose and methods of the study. Both veterinarians and farm owners and staff provided written consent for sharing data from recordings and questionnaires with the research team. Participants were assured that all information would be treated anonymously and that they could withdraw from the study at any time. They were also assured that data would be stored at the Swedish University of Agricultural Sciences and that no unauthorized person would be able to access the data.

Software and data repository resources

None of the data were deposited in an official repository.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/S175173112000107X

Footnotes

*

These two authors contributed equally to this work.

References

Amrhein, PC, Miller, WR, Yahne, CE, Palmer, M and Fulcher, L 2003. Client commitment language during motivational interviewing predicts drug use outcomes. Journal of Consulting and Clinical Psychology 71, 862878. doi: 10.1037/0022-006X.71.5.8622003-07816-003.CrossRefGoogle ScholarPubMed
Apodaca, TR and Longabaugh, OR 2009. Mechanism of change in motivational interviewing: a review and preliminary evaluation of the evidence. Addiction 104, 705715.CrossRefGoogle Scholar
Bard, AM, Main, DCJ, Haase, AM, Whay, HR, Roe, EJ and Reyher, KK 2017. The future of veterinary communication: partnership or persuasion? A qualitative investigation of veterinary communication in the pursuit of client behaviour change. PLoS ONE 12, e0171380. doi: 10.1371/journal.pone.0171380.CrossRefGoogle ScholarPubMed
Bard, A, Main, D, Roe, E, Haase, A, Whay, HR and Reyher, KK 2019. To change or not to change? Factors influencing farmers’ enactment of veterinary advice on UK dairy farms. Journal of Dairy Science, 102, 1037910394. doi: 10.3168/jds.2019-16364.CrossRefGoogle ScholarPubMed
Brooks, ME, Kristensen, K, van Benthem, KJ, Magnusson, A, Berg, CW, Nielsen, A, Skaug, HJ, Maechler, M and Bolker, BM 2017. glmmTMB balances speed and flexibility among packages for zero-inflated generalized linear mixed modeling. The R Journal 9, 378400.CrossRefGoogle Scholar
Cake, MA, Bell, MA, Williams, JC, Brown, FJL, Dozier, M, Rhind, SM and Baillie, S 2016. Which professional (non-technical) competencies are most important to the success of graduate veterinarians? A Best Evidence Medical Education (BEME) systematic review: BEME guide. Medical Teacher 38, 550563. doi: 10.3109/0142159X.2016.1173662.CrossRefGoogle Scholar
Forsberg, L, Wickström, H and Källmén, H 2014. Motivational interviewing may facilitate professional interactions with inspectees during environmental inspection and enforcement conversations. Peer Journal 2, e508. doi: 10.7717/peerj.508.CrossRefGoogle Scholar
Hagen, LG and Moyers, TB 2012. Manual for the Client Language Easy Rating (CLEAR) coding system: formerly “Motivational Interviewing Skill Code (MISC) 1.1”. Retrieved on 13 September 2019 from http://casaa.unm.edu/download/CLEAR.pdfGoogle Scholar
Hettema, J, Steele, J and Miller, WR 2005. Motivational interviewing. Annual Review of Clinical Psychology 1, 91111. doi: 10.1146/annurev.clinpsy.1.102803.143833.CrossRefGoogle ScholarPubMed
Imel, ZE, Baldwin, SA, Baer, JS, Hartzler, B, Dunn, C, Rosengren, DB and Atkins, DC 2014. Evaluating therapist adherence in motivational interviewing by comparing performance with standardized and real patients. Journal of Consulting and Clinical Psychology 82, 472481. doi: 10.1037/a0036158.CrossRefGoogle ScholarPubMed
Kanji, N, Coe, JB, Adams, CL and Shaw, JR 2012. Effect of veterinarian-client-patient interactions on client adherence to dentistry and surgery recommendations in companion-animal practice. Journal of American Veterinary Medical Association 240, 427436. doi: 10.2460/javma.240.4.427.CrossRefGoogle ScholarPubMed
Lindqvist, H, Forsberg, L, Enebrink, P, Andersson, G and Rosendahl, I 2017. The relationship between counselors’ technical skills, clients’ in-session verbal responses, and outcome in smoking cessation treatment. Journal of Substance Abuse Treatment 77, 141149. doi: 10.1016/j.jsat.2017.02.004.CrossRefGoogle ScholarPubMed
Lundahl, BW, Kunz, C, Brownell, C, Tollefson, D and Burke, DL 2010. A meta-analysis of motivational interviewing: twenty-five years of empirical studies. Research on Social Work Practice 20, 137160. doi: 10.1177/1049731509347850.CrossRefGoogle Scholar
Magill, M, Longabaugh, R, Borsari, B, Gaume, J, Hoadley, A, Gordon, REF, Tonigan, JS and Moyers, T 2018. A meta-analysis of motivational interviewing process: technical, relational, and conditional process models of change. Journal of Consulting and Clinical Psychology 86, 140157. doi: 10.1037/ccp0000250.CrossRefGoogle ScholarPubMed
Martin, M, Moyers, TB, Houck, J, Christopher, P and Miller, WR 2005. Motivational Interviewing Sequential Code for Observing Process Exchanges (MI-SCOPE) coder’s manual. Retrieved on 13 September 2019 from https://casaa.unm.edu/codinginst.htmlGoogle Scholar
Miller, WR and Moyers, TB 2017. Motivational interviewing and the clinical science of Carl Rogers. Journal of Consulting and Clinical Psychology 85, 757766. doi: 10.1037/ccp0000179.CrossRefGoogle ScholarPubMed
Miller, WR and Rollnick, S 2012. Motivational interviewing. Helping people change, 3rd edition Guilford Press, New York, NY, USA.Google Scholar
Moyers, TB, Manuel, JK and Ernst, DA 2014. Motivational interviewing treatment integrity coding manual 4.2.1. Retrieved on 13 September 2019 from http://casaa.unm.edu/download/MITI4_2.pdfGoogle Scholar
Moyers, TB, Martin, T, Houck, JM, Christopher, PJ and Tonigan, JS 2009. From in-session behaviors to drinking outcomes: A causal chain for motivational interviewing. Journal of Consulting and Clinical Psychology 77, 11131124. doi: 10.1037/a0017189.supp.CrossRefGoogle ScholarPubMed
Moyers, TB and Miller, WR 2013. Is low therapist empathy toxic? Psychology of Addictive Behaviors 27, 878884. doi: 10.1037/a0030274.CrossRefGoogle ScholarPubMed
Pirlott, AG, Kisbu-Sakarya, Y, Defrancesco, CA and Mackinnon, DP 2012. Mechanisms of motivational interviewing in health promotion. A Bayesian mediation analysis. International Journal of Behavioral Nutrition and Physical Activity 9, 69. http://www.ijbnpa.org/content/9/1/69CrossRefGoogle ScholarPubMed
Ritter, C, Adams, CL, Kelton, DF and Barkema, HW 2018. Clinical communication patterns of veterinary practitioners during dairy herd health and production management farm visits. Journal of Dairy Science 101, 10337110350. doi: 10.3168/jds.2018-14741.CrossRefGoogle ScholarPubMed
Ritter, C, Adams, CL, Kelton, DF and Barkema, HW 2019. Factors associated with dairy farmers’ satisfaction and preparedness to adopt recommendations after veterinary herd health visits. Journal of Dairy Science 102, 114. doi: 10.3168/jds.2018-15825.CrossRefGoogle ScholarPubMed
Romano, M and Peters, L 2016. Understanding the process of motivational interviewing: A review of the relational and technical hypotheses. Psychotherapy Research 26, 220240. doi: 10.1080/10503307.2014.954154.CrossRefGoogle ScholarPubMed
Svensson, C, Emanuelson, U, Bard, AM, Forsberg, L, Wickström, H and Reyher, KK 2019a. Communication styles of Swedish veterinarians involved in dairy herd health management: A Motivational Interviewing perspective. Journal of Dairy Science 102, 1017310185. doi: 10.3168/jds.2018-15731.CrossRefGoogle ScholarPubMed
Svensson, C, Lind, N, Reyher, KK, Bard, AM and Emanuelson, U 2019b. Trust, feasibility and priorities influence Swedish dairy farmers’ adherence and non-adherence to veterinary advice. Journal of Dairy Science, 102, 1036010368. doi: 10.3168/jds.2019-16470.CrossRefGoogle Scholar
Svensson, C, Wickström, H, Emanuelson, U, von Brömssen, C, Betnér, S and Forsberg, L 2020c. Dairy veterinarians’ skill in Motivational Interviewing is linked to enhanced veterinary herd health management consultations. In Proceedings of the 17th International Conference on Production Diseases in Farm Animals, 27–29 June 2019, Bern, Switzerland, p. 149. doi: 10.7892/boris.131406.CrossRefGoogle Scholar
Svensson, C, Wickström, H, Emanuelson, U, Bard, AM, Reyer, KK and Forsberg, L 2020. Training in motivational interviewing improves cattle veterinarians’ communication skills in veterinary herd health management. Veterinary Record. doi: 10.1136/vr.105646.CrossRefGoogle Scholar
Wickström, H, Herzing, M, Forsberg, L, Jacobsson, A and Källmén, H 2017. Applying Motivational Interviewing to induce compliance with radon gas radiation legislation – a feasibility study. Psychology and Education Journal 54, 122.Google Scholar
Figure 0

Figure 1 Design of the study investigating effect of veterinary motivational interviewing (MI) skills on client responses in veterinary herd health management conversations on 170 Swedish cattle farms.

Figure 1

Table 1 Results from multivariable Poisson regression modela of the associations between veterinarians’ (n = 36) skills in motivational interviewing (MI) and rate of client Change Talk in 170 veterinary herd health management (VHHM) consultations on Swedish cattle farms

Figure 2

Table 2 Results from a multivariable Poisson regression modela of the associations between veterinarians’ (n = 36) skills in motivational interviewing (MI) and rate of client Sustain Talk in 170 veterinary herd health management (VHHM) consultancies on Swedish cattle farms

Figure 3

Table 3 Results from a multivariable logistic regression modela of the associations between veterinarians’ (n = 36) skills (n = 36) in motivational interviewing (MI) and Proportion of Change Talk in 170 veterinary herd health management (VHHM) consultations on Swedish cattle farms

Supplementary material: PDF

Svensson et al. supplementary material

Svensson et al. supplementary material

Download Svensson et al. supplementary material(PDF)
PDF 550.6 KB