Hostname: page-component-586b7cd67f-dsjbd Total loading time: 0 Render date: 2024-12-01T00:28:53.573Z Has data issue: false hasContentIssue false

The baby and the bathwater: On the need for substantive–methodological synergy in organizational research

Published online by Cambridge University Press:  14 December 2021

Joeri Hofmans*
Affiliation:
Vrije UniversiteitBrussel, Belgium
Alexandre J. S. Morin
Affiliation:
Concordia University, Canada
Heiko Breitsohl
Affiliation:
University of Klagenfurt, Austria
Eva Ceulemans
Affiliation:
KU Leuven, Belgium
Léandre Alexis Chénard-Poirier
Affiliation:
Université du Québec à Montréal, Canada
Charles C. Driver
Affiliation:
University of Zurich, Switzerland
Claude Fernet
Affiliation:
Université du Québec à Trois-Rivières, Canada
Marylène Gagné
Affiliation:
Curtin University, Australia
Nicolas Gillet
Affiliation:
Université de Tours, France, & Institut Universitaire de France (IUF), France
Vicente González-Romá
Affiliation:
University of Valencia, Spain
Kevin J. Grimm
Affiliation:
Arizona State University, USA
Ellen L. Hamaker
Affiliation:
Utrecht University, The Netherlands
Kit-Tai Hau
Affiliation:
The Chinese University of Hong Kong, Hong Kong SAR
Simon A. Houle
Affiliation:
Concordia University, Canada
Joshua L. Howard
Affiliation:
Monash University, Australia
Rex B. Kline
Affiliation:
Concordia University, Canada
Evy Kuijpers
Affiliation:
Vrije UniversiteitBrussel, Belgium
Theresa Leyens
Affiliation:
Vrije UniversiteitBrussel, Belgium
David Litalien
Affiliation:
Université Laval, Canada
Anne Mäkikangas
Affiliation:
Tampere University, Finland
Herbert W. Marsh
Affiliation:
Australian Catholic University, Australia, & The University of Oxford, UK
Matthew J. W. McLarnon
Affiliation:
Mount Royal University, Canada
John P. Meyer
Affiliation:
The University of Western Ontario, Canada & Curtin University, Australia
Jose Navarro
Affiliation:
University of Barcelona, Spain
Elizabeth Olivier
Affiliation:
Université de Montréal, Canada
Thomas A. O’Neill
Affiliation:
University of Calgary, Canada
Reinhard Pekrun
Affiliation:
University of Essex, United Kingdom, and Australian Catholic University, Australia
Katariina Salmela-Aro
Affiliation:
University of Helsinki, Finland
Omar N. Solinger
Affiliation:
Vrije Universiteit Amsterdam, The Netherlands
Sabine Sonnentag
Affiliation:
University of Mannheim, Germany
Louis Tay
Affiliation:
Purdue University, USA
István Tóth-Király
Affiliation:
Concordia University, Canada
Robert J. Vallerand
Affiliation:
Université du Québec à Montréal, Canada
Christian Vandenberghe
Affiliation:
HEC Montréal, Canada
Yvonne G. T. van Rossenberg
Affiliation:
Institute for Management Research, Radboud University, the Netherlands
Tim Vantilborgh
Affiliation:
Vrije UniversiteitBrussel, Belgium
Jasmine Vergauwe
Affiliation:
Ghent University, Belgium
Jesse T. Vullinghs
Affiliation:
Vrije UniversiteitBrussel, Belgium
Mo Wang
Affiliation:
University of Florida, USA
Zhonglin Wen
Affiliation:
South China Normal University, China
Bart Wille
Affiliation:
Ghent University, Belgium
*
*Corresponding author. Email: [email protected]

Abstract

Image of the first page of this content. For PDF version, please use the ‘Save PDF’ preceeding this image.'
Type
Commentaries
Copyright
© The Author(s), 2021. Published by Cambridge University Press on behalf of the Society for Industrial and Organizational Psychology

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

The first and second author contributed equally to this article and their order was determined at random. Both should be considered first authors. Beyond the first and second authors, the order of appearance of all other coauthors was determined alphabetically (as a function of their family names).

The second author was supported by a grant from the Social Sciences and Humanities Research Council of Canada (435-2018-0368).

References

Asparouhov, T., Muthén, B. O., & Morin, A. J. S. (2015). Bayesian structural equation modeling with cross-loadings and residual covariances: Comments on Stromeyer et al. Journal of Management, 41(6), 15611577.10.1177/0149206315591075CrossRefGoogle Scholar
Borsboom, D. (2006). The attack of the psychometricians. Psychometrika, 71(3), 425440.10.1007/s11336-006-1447-6CrossRefGoogle ScholarPubMed
Breitsohl, H. (2019). Beyond ANOVA: An introduction to structural equation models for experimental designs. Organizational Research Methods, 22(3), 649677.10.1177/1094428118754988CrossRefGoogle Scholar
Chénard-Poirier, L. A., Morin, A. J. S., & Boudrias, J. S. (2017). On the merits of coherent leadership empowerment behaviors: Amixture regression approach. Journal of Vocational Behavior, 103, 6675.10.1016/j.jvb.2017.08.003CrossRefGoogle Scholar
Cole, D. A., & Maxwell, S. E. (2003). Testing mediational models with longitudinal data. Journal of Abnormal Psychology, 112(4), 558577.10.1037/0021-843X.112.4.558CrossRefGoogle ScholarPubMed
Edmondson, A. C., & McManus, S. E. (2007). Methodological fit in management field research. Academy of Management Review, 32(4), 11551179.10.5465/amr.2007.26586086CrossRefGoogle Scholar
Fernet, C., Morin, A. J. S., Austin, S., Gagné, M., Litalien, D., Lavoie-Tremblay, M., & Forest, J. (2020). Self-determination trajectories at work: Agrowth mixture analysis. Journal of Vocational Behavior, 121, Article 103473 10.1016/j.jvb.2020.103473CrossRefGoogle Scholar
Gillet, N., Morin, A. J. S., Huart, I., Colombat, P., & Fouquereau, E. (2020). The forest and the trees: Investigating the globability and specificity of employees’ basic need satisfaction at work. Journal of Personality Assessment, 102(5), 702713.10.1080/00223891.2019.1591426CrossRefGoogle ScholarPubMed
Hamaker, E. L., Mulder, J. D., van Ijzendoorn, M. H. (2020). Description, prediction and causation: Methodologic challenges of studying child and adolescent development. Developmental Cognitive Neuroscience, 46, Article 100867.10.1016/j.dcn.2020.100867CrossRefGoogle Scholar
Hätinen, M., Kinnunen, U., Mäkikangas, A., Kalimo, R., Tolvanen, A., & Pekkonen, M. (2009). Burnout during a long-term rehabilitation: Comparing low burnout, high burnout -benefited, and high burnout -not benefited trajectories. Anxiety, Stress & Coping, 22(3), 341360.10.1080/10615800802567023CrossRefGoogle ScholarPubMed
Healy, K. (2017). Fuck nuance. Sociological Theory, 35(2), 118127.10.1177/0735275117709046CrossRefGoogle Scholar
Hofmans, J. (2017). Modeling psychological contract violation using dual regime models: An event-based approach. Frontiers in Psychology, 8, Article 1948.10.3389/fpsyg.2017.01948CrossRefGoogle Scholar
Hofmans, J., Wille, B., & Schreurs, B. (2020). Person-centered methods in vocational research. Journal of Vocational Behavior, 118, Article 103398.10.1016/j.jvb.2020.103398CrossRefGoogle Scholar
Lawler, E. E. (1992). The ultimate advantage: Creating the high involvement organization. Jossey-Bass.Google Scholar
Mäkikangas, A., & Kinnunen, U. (2016). The person-oriented approach to burnout: Asystematic review. Burnout Research, 3(1), 1123.10.1016/j.burn.2015.12.002CrossRefGoogle Scholar
Marsh, H. W., & Hau, K-T. (1996). Assessing goodness of fit: Is parsimony always desirable? Journal of Experimental Education, 64(4), 364390.10.1080/00220973.1996.10806604CrossRefGoogle Scholar
Marsh, H. W., & Hau, K-T. (2007). Applications of latent-variable models in educational psychology: The need for methodological-substantive synergies. Contemporary Educational Psychology, 32(1), 151171.10.1016/j.cedpsych.2006.10.008CrossRefGoogle Scholar
Marsh, H. W., Hau, K.-T., Wen, Z., Nagengast, B., & Morin, A. J. S. (2013). Moderation. In Little, T. D. (Ed.), Oxford handbook of quantitative methods, vol. 2 (pp. 361386). Oxford University Press.Google Scholar
Marsh, H. W., Kuyper, H., Morin, A. J. S., Parker, P. D., & Seaton, M. (2014). Big-fish-little-pond social comparison and local dominance effects: Integrating new statistical models, methodology, design, theory and substantive implications. Learning & Instruction, 33, 5066.10.1016/j.learninstruc.2014.04.002CrossRefGoogle Scholar
Marsh, H. W., Scalas, L. F., & Nagengast, B. (2010a). Longitudinal tests of competing factor structures for the Rosenberg self-esteem scale. Psychological Assessment, 22(2), 366381.10.1037/a0019225CrossRefGoogle ScholarPubMed
Marsh, H. W., Seaton, M., Kuyper, H., Dumas, F., Huguet, P., Regner, I., Buunk, A. P., Monteil, J. M, Blanton, H., & Gibbons, F. X. (2010b). Phantom behavioral assimilation effects: Systematic biases in social comparison choice studies. Journal of Personality, 78(2), 671710.10.1111/j.1467-6494.2010.00630.xCrossRefGoogle ScholarPubMed
McCormick, B. W., Reeves, C. J., Downes, P. E., Li, N., & Ilies, R. (2020). Scientific contributions of within-person research in management. Journal of Management, 46(2), 321350.10.1177/0149206318788435CrossRefGoogle Scholar
McLarnon, M. J. W., Carswell, J. J., & Schneider, T. J. (2015). A case of mistaken identity? Latent profiles in vocational interests. Journal of Career Assessment, 23(1), 166185.10.1177/1069072714523251CrossRefGoogle Scholar
Meyer, J. P., & Morin, A. J. S. (2016). A person-centered approach to commitment research: Theory, research, and methodology. Journal of Organizational Behavior, 37(4), 584612.10.1002/job.2085CrossRefGoogle Scholar
Morin, A. J. S., Blais, A.-R., & Chénard-Poirier, L.-A. (2021). Doubly latent multilevel procedures for organizational assessment and prediction. Journal of Business and Psychology. https://doi.org/10.1007/s10869-021-09736-5 CrossRefGoogle Scholar
Morin, A. J. S., Boudrias, J.-S., Marsh, H. W., McInerney, D. M., Dagenais-Desmarais, V., Madore, I., & Litalien, D. (2017). Complementary variable- and person-centered approaches to exploring the dimensionality of psychometric constructs: Application to psychological wellbeing at work. Journal of Business and Psychology, 32, 395419.10.1007/s10869-016-9448-7CrossRefGoogle Scholar
Morin, A. J. S., Maïano, C., Marsh, H. W., Nagengast, B., & Janosz, M. (2013). School life and adolescents’ self-esteem trajectories. Child Development, 84(6), 19671988.10.1111/cdev.12089CrossRefGoogle ScholarPubMed
Morin, A.J.S., Myers, N.D., & Lee, S. (2020). Modern factor analytic techniques: Bifactor models, exploratory structural equation modeling (ESEM) and bifactor-ESEM. In Tenenbaum, G. & Eklund, R.C. (Eds.), Handbook of Sport Psychology, 4th Edition (pp. 1044–1073). London, UK: Wiley 10.1002/9781119568124.ch51CrossRefGoogle Scholar
Murphy, K. R. (2021). In praise of table 1: The importance of making better use of descriptive statistics. Industrial and Organizational Psychology: Perspectives on Science and Practice, 14(4), 461477.Google Scholar
Navarro, J., Rueff-Lopes, R. & Rico, R. (2020). New nonlinear and dynamic avenues for the study of work and organizational psychology: an introduction to the special issue. European Journal of Work and Organizational Psychology, 29(4), 477482.10.1080/1359432X.2020.1794952CrossRefGoogle Scholar
O’Neill, T. A., McLarnon, M. J. W., & Carswell, J. J. (2015). Variance components of job performance ratings. Human Performance, 28(1), 6691.10.1080/08959285.2014.974756CrossRefGoogle Scholar
O’Neill, T. A., McLarnon, M. J. W., Hoffart, G. C., Woodley, H. J., & Allen, N.J. (2018). The structure and function of team conflict profiles. Journal of Management, 44(1), 811836.10.1177/0149206315581662CrossRefGoogle Scholar
Perinelli, E., & Alessandri, G. (2020). A latent state-trait analysis of global self-esteem: Areconsideration of its state-like component in an organizational setting. International Journal of Selection and Assessment, 28(4), 465483.10.1111/ijsa.12308CrossRefGoogle Scholar
Saylors, R., & Trafimow, D. (2021). Why the increasing use of complex causal models is a problem: On the danger sophisticated theoretical narratives pose to truth. Organizational Research Methods, 24(3), 616629.10.1177/1094428119893452CrossRefGoogle Scholar
Schreurs, B., Hofmans, J., & Wille, B. (2021). Multilevel modeling for careers research. In Murphy, W. & Tosti-Kharas, J. (Eds.), Handbook for research methods in careers (pp. 210234). Edward Elgar.10.4337/9781788976725.00018CrossRefGoogle Scholar
Sheldon, K., & Niemiec, C. (2006). It’s not just the amount that counts: Balanced need satisfaction also affects well-being. Journal of Personality and Social Psychology, 91(2), 331341.10.1037/0022-3514.91.2.331CrossRefGoogle Scholar
Solinger, O. N., van Olffen, W., Roe, R. A., & Hofmans, J. (2013). On becoming (un)committed: Ataxonomy and test of newcomer onboarding scenarios. Organization Science, 24(6), 16401661.10.1287/orsc.1120.0818CrossRefGoogle Scholar
Tay, L., Parrigon, S., Huang, Q., & LeBreton, J. M. (2016). Graphical descriptives: Away to improve data transparency and methodological rigor in psychology. Perspectives on Psychological Science, 11(5), 692701.10.1177/1745691616663875CrossRefGoogle Scholar
Tóth-Király, I., Morin, A. J. S., Bőthe, B., Rigó, A., & Orosz, G. (2021). Toward an improved understanding of work motivation profiles. Applied Psychology: An International Review, 70(3), 9861017.10.1111/apps.12256CrossRefGoogle Scholar
Tsoukas, H. (2017). Don’t simplify, complexify: From disjunctive to conjunctive theorizing in organization and management studies. Journal of Management Studies, 54(2), 132153.10.1111/joms.12219CrossRefGoogle Scholar
Woo, S. E., Tay, L., & Proctor, R. W. (Eds.). (2020). Big data in psychological research. American Psychological Association.10.1037/0000193-000CrossRefGoogle Scholar
Zhao, X., Lynch, J. G., & Chen, Q. (2010). Reconsidering Baron and Kenny: Myths and trusts about mediation analysis. Journal of Consumer Research, 37(2), 197206.10.1086/651257CrossRefGoogle Scholar