Hostname: page-component-78c5997874-fbnjt Total loading time: 0 Render date: 2024-11-02T18:47:24.729Z Has data issue: false hasContentIssue false

Behavioral Integration of Individual Psychological Assessment Feedback: Assessor and Social Support

Published online by Cambridge University Press:  14 June 2021

Simon Trudeau*
Affiliation:
Université de Montréal ( Canada)
Jean-Sébastien Boudrias
Affiliation:
Université de Montréal ( Canada)
Annabelle Cournoyer
Affiliation:
Université de Montréal ( Canada)
*
Correspondence concerning this article should be addressed to Jean-Sébastien Boudrias. Université de Montréal. Département de Psychologie. C.P. 6128 Succ. Centre-ville, Montréal, Québec, H3C 3J7 (Canada). E-mail: [email protected] Phone: +1–5143432344.

Abstract

The present study investigates the role of perceived social support and development-focused feedback techniques on behavioral integration of feedback in the context of individual psychological assessment. We hypothesized that development-focused techniques would predict participants’ motivational intention to act on feedback and tested whether perceived social support would mediate or moderate the relationship between motivational intention and behavioral outcomes. We performed structural equation modeling analyses on data collected at two time-points. Two hundred and forty (N = 240) participants completed questionnaires immediately after their feedback session (T1) and 138 of them completed questionnaires three months later (T2). The model results, χ2 = 230.09, p < .01, CFI = .97, TLI = .97, SRMR = .06, RMSEA = .03 90% CI [.02, .05], suggest that development-focused techniques predict motivational intention, social support mediates the relationship between motivational intention and developmental activities (R2 = .31), and social support also interacts with development-focused techniques to predict behavior change (R2 = .40). The relationship between social support and behavioral change is higher when the assessor uses few development-focused techniques (at –1 SD, b = .32, p < .001, 95% CI [.27, .36]). The study provides empirical insights about how behavioral change unfolds in an IPA feedback context and suggests that participants could benefit from obtaining social support to act on feedback. Assessors should focus on development during feedback and encourage the participant to seek social support to facilitate their subsequent professional development. Because the findings rely on self-reported data, future studies would benefit from including observed measures.

Type
Research Article
Copyright
© Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2021

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Conflicts of interest: None.

Funding statement: This work was supported by a small grant from University of Montreal/CRSH (PVX20020). This research was also supported by a SSHRC Joseph-Armand-Bombardier Canada Graduate Scholarship awarded to Simon Trudeau (doctoral scholarship, Award Number 767–2017–1150).

References

Bandura, A. (1997). Self-efficacy: The exercise of control. W. H. Freeman and Company.Google Scholar
Becker, T. E., Atinc, G., Breaugh, J. A., Carlson, K. D., Edwards, J. R., & Spector, P. E. (2016). Statistical control in correlational studies: 10 essential recommendations for organizational researchers. Journal of Organizational Behavior, 37(2), 157167. https://doi.org/10.1002/job.2053.CrossRefGoogle Scholar
Berg, J. M., Wrzesniewski, A., & Dutton, J. E. (2010). Perceiving and responding to challenges in job crafting at different ranks: When proactivity requires adaptivity. Journal of Organizational Behavior, 31, 158186. https://doi.org/10.1002/job.645.CrossRefGoogle Scholar
Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010). Transfer of training: A meta-analytic review. Journal of Management, 36(4), 10651105. https://doi.org/10.1177/0149206309352880.CrossRefGoogle Scholar
Boudrias, J.-S., Bernaud, J.-L., & Plunier, P. (2014). Candidates’ integration of individual psychological assessment feedback. Journal of Managerial Psychology, 29, 341359. https://doi.org/10.1108/JMP-01-2012-0016.CrossRefGoogle Scholar
Byham, T. M. (2005). Factors affecting the acceptance and application of developmental feedback from an executive assessment program [Doctoral dissertation, University of Akron]. OhioLINK Electronic Theses & Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=akron1133214086.Google Scholar
Dimotakis, N., Mitchell, D., & Maurer, T. (2017). Positive and negative assessment center feedback in relation to development self-efficacy, feedback seeking, and promotion. Journal of Applied Psychology, 102, 15141527. https://doi.org/10.1037/apl0000228.CrossRefGoogle ScholarPubMed
Downing, J. R. (2004). “It’s easier to ask someone I know”: Call center technicians’ adoption of knowledge management tools. The Journal of Business Communication, 41(2), 166191. https://doi.org/10.1177/0021943603262140.CrossRefGoogle Scholar
Enders, C. K., & Bandalos, D. L. (2001). The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Structural Equation Modeling, 8(1), 430457.CrossRefGoogle Scholar
Fedor, D. B. (1991). Recipient responses to performance feedback: A proposed model and its implications. Research in Personnel and Human Resources Management, 9, 73120.Google Scholar
Forsythe, A., & Johnson, S. (2017). Thanks, but no-thanks for the feedback. Assessment & Evaluation in Higher Education, 42, 850859. https://doi.org/10.1080/02602938.2016.1202190.CrossRefGoogle Scholar
Forsythe, A., & Jellicoe, M. (2018). Predicting gainful learning in Higher Education: A goal-orientation approach. Higher Education Pedagogies, 3, 103117. https://doi.org/10.1080/23752696.2018.1435298.CrossRefGoogle Scholar
Haemer, H. D., Borges-Andrade, J. E., & Cassiano, S. K. (2017). Learning strategies at work and professional development. Journal of Workplace Learning, 29, 490506. https://doi.org/10.1108/JWL-05-2016-0037.CrossRefGoogle Scholar
Hazucha, J. F., Ramesh, A., Goff, M., Crandell, S., Gerstnen, C., Sloan, E., Bank, J., & van Katwyk, P. (2011). Individual psychological assessment: The poster child of blended science and practice. Industrial and Organizational Psychology: Perspectives on Science and Practice, 4, 297301. https://doi.org/10.1111/j.1754-9434.2011.01342.x.CrossRefGoogle Scholar
Ilgen, D. R., Fisher, C. D., & Taylor, M. S. (1979). Consequences of individual feedback on behavior in organizations. Journal of Applied Psychology, 64, 349371. https://doi.org/10.1037/0021-9010.64.4.349.CrossRefGoogle Scholar
Isidro-Filho, A., Guimarães, T. D. A., Perin, M. G., & Leung, R. C. (2013). Workplace learning strategies and professional competencies in innovation contexts in Brazilian hospitals. BAR-Brazilian Administration Review, 10(2), 121134. https://doi.org/10.1590/S1807-76922013000200002.CrossRefGoogle Scholar
Kinicki, A. J., Prussia, G. E., Wu, B. J., & McKee-Ryan, F. M. (2004). A covariance structure analysis of employees’ response to performance feedback. Journal of Applied Psychology, 89(6), 10571069. https://doi.org/10.1037/0021-9010.89.6.1057.CrossRefGoogle ScholarPubMed
Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254284. https://doi.org/10.1037/0033-2909.119.2.254.CrossRefGoogle Scholar
Korpelainen, E., & Kira, M. (2010). Employees’ choices in learning how to use information and communication technology systems at work: Strategies and approaches. International Journal of Training and Development, 14(1), 3253. https://doi.org/10.1111/j.1468-2419.2009.00339.x.CrossRefGoogle Scholar
Lauzier, M., & Mercier, G. (2018). The effect of error orientation, motivation to learn, and social support on training transfer intentions: A moderated mediation model. Canadian Journal of Administrative Sciences, 35(3), 419428. https://doi.org/10.1002/cjas.1429.CrossRefGoogle Scholar
Leavy, R. L. (1983). Social support and psychological disorder: A review. Journal of Community Psychology, 11, 321. https://doi.org/10.1002/1520-6629(198301)11:1<3::AID-JCOP2290110102>3.0.CO;2-E.3.0.CO;2-E>CrossRefGoogle ScholarPubMed
Lessard, F. E. (2019). Identifier, mesurer et évaluer l’efficacité des techniques de rétroaction dans un contexte d’évaluation de potentiel [Identifying, measuring, and evaluating the effectiveness of feedback techniques in an individual psychological assessment context, Doctoral Dissertation, University of Montreal]. Papyrus: Institutional Deposit University of Montreal. http://hdl.handle.net/1866/22685.Google Scholar
Locke, E. A., & Latham, G. P. (1990). A theory of goal setting and task performance. Englewood Cliffs.Google Scholar
London, M. (2003). Job feedback: Giving, seeking, and using feedback for performance improvement (2nd Ed.). Psychology Press. http://doi.org/10.4324/9781410608871.CrossRefGoogle Scholar
London, M., & Smither, J. W. (2002). Feedback orientation, feedback culture, and the longitudinal performance management process. Human Resource Management Review, 12, 81100. https://doi.org/10.1016/S1053-4822(01)00043-2.CrossRefGoogle Scholar
Maurer, T. J., Mitchell, D. R., & Barbeite, F. G. (2002). Predictors of attitudes toward a 360‐degree feedback system and involvement in post‐feedback management development activity. Journal of Occupational and Organizational Psychology, 75, 87107. https://doi.org/10.1348/096317902167667.CrossRefGoogle Scholar
Miller, W. R., & Rollnick, S. (2013). Motivational interviewing: Helping people change (3rd Ed.). Guilford Press.Google Scholar
Moses, J. (2011). Individual psychological assessment: You pay for what you get. Industrial and Organizational Psychology, 4, 334337. https://doi.org/10.1111/j.1754-9434.2011.01350.x.CrossRefGoogle Scholar
Plunier, P., Boudrias, J.-S., & Savoie, A. (2013). Appropriation cognitive du feedback en évaluation du potentiel: Validation d’une mesure [Validation of a measure of cognitive integration of feedback following individual psychological assessment]. European Review of Applied Psychology, 63, 8797. https://doi.org/10.1016/j.erap.2012.06.002.CrossRefGoogle Scholar
Rollnick, S., Miller, W. R., & Butler, C. (2008). Motivational interviewing in health care: Helping patients change behavior. Guilford Press.Google Scholar
Savalei, V., & Rhemtulla, M. (2012). On obtaining estimates of the fraction of missing information from full information maximum likelihood. Structural Equation Modeling: A Multidisciplinary Journal, 19(3), 477494. https://doi.org/10.1080/10705511.2012.687669.CrossRefGoogle Scholar
Schumacker, R. E., & Lomax, R. G. (2010). A beginner’s guide to structural equation modeling (3rd Ed.). Routledge/Taylor & Francis Group.Google Scholar
Silzer, R. J., & Jeanneret, R. (2011). Individual psychological assessment: A practice and science in search of common ground. Industrial and Organizational Psychology: Perspectives on Science and Practice, 4, 270296. https://doi.org/10.1111/j.1754-9434.2011.01341.x.CrossRefGoogle Scholar
Taris, T. W., & Kompier, M. A. J. (2014). Cause and effect: Optimizing the designs of longitudinal studies in occupational health psychology. Work & Stress, 28, 18. https://doi.org/10.1080/02678373.2014.878494.CrossRefGoogle Scholar
Thornton, G. C. III. Hollenbeck, G. P., & Johnson, S. K. (2010). Selecting leaders: Executives and high potentials. In Farr, J. L. & Tippins, N. T. (Eds.), Handbook of employee selection (pp. 823840). Routledge. http://doi.org/10.13140/2.1.4886.5286.Google Scholar
Trudeau, S., & Boudrias, J.-S. (2019). L’appropriation comportementale de la rétroaction en évaluation du potentiel: étude exploratoire de l’effet de la difficulté de développement des compétences et de leur nombre [Behavioural integration of individual psychological assessment feedback: Exploratory study of the number and effect of developmental difficulty of competencies]. Canadian Journal of Behavioural Science/Revue Canadienne des Sciences du Comportement, 51, 192200. https://doi.org/10.1037/cbs0000132.CrossRefGoogle Scholar
Trudeau, S., Suissa, A. H., & Boudrias, J.-S. (2019). Favoriser le développement professionnel avec le feedback: les engagements affectif et calculé envers l’objectif comme modérateurs de la relation intention–comportement [Promoting professional development through feedback: Affective and continuance goal commitments as moderators of the intention-behaviour relationship]. Psychologie du Travail et des Organisations, 25, 152166. https://doi.org/10.1016/j.pto.2019.02.004.CrossRefGoogle Scholar
Wang, J., & Wang., X. (2012). Structural equation modeling: Applications using Mplus. Wiley- Blackwell. http://doi.org/10.1002/9781118356258.CrossRefGoogle Scholar
Webb, T. L., & Sheeran, P. (2006). Does changing behavioral intentions engender behavior change? A meta-analysis of the experimental evidence. Psychological Bulletin, 132, 249268. http://doi.org/10.1037/0033-2909.132.2.249.CrossRefGoogle Scholar
Winstone, N. E., Nash, R. A., Parker, M., & Rowntree, J. (2017). Supporting learners’ agentic engagement with feedback: A systematic review and a taxonomy of recipience processes. Educational Psychologist, 52, 1737. https://doi.org/10.1080/00461520.2016.1207538.CrossRefGoogle Scholar
Woo, S. E., Sims, C. S., Rupp, D. E., & Gibbons, A. M. (2008). Development engagement within and following developmental assessment centers: Considering feedback favorability and self–assessor agreement. Personnel Psychology, 61, 727759. https://doi.org/10.1111/j.1744-6570.2008.00129.x.CrossRefGoogle Scholar
Wrzesniewski, A., & Dutton, J. E. (2001). Crafting a job: Revisioning employees as active crafters of their work. Academy of Management Review, 26, 179201. https://doi.org/10.5465/amr.2001.4378011.CrossRefGoogle Scholar