Hostname: page-component-745bb68f8f-g4j75 Total loading time: 0 Render date: 2025-01-07T18:06:27.208Z Has data issue: false hasContentIssue false
  • English
  • Français

Fitting Multivariage Normal Finite Mixtures Subject to Structural Equation Modeling

Published online by Cambridge University Press:  01 January 2025

Conor V. Dolan  and
Han L. J. van der Maas
Conor V. Dolan
Affiliation:
Vrije Universiteit
Han L. J. van der Maas*
Affiliation:
University of Amsterdam
*
Requests for reprints should be sent to Han L. J. van der Maas, Developmental Psychology, Psychology Faculty, University of Amsterdam, Roetersstraat 15, 1018WB Amsterdam, THE NETHERLANDS.
Get access Rights & Permissions [Opens in a new window]

Abstract

This paper is about fitting multivariate normal mixture distributions subject to structural equation modeling. The general model comprises common factor and structural regression models. The introduction of covariance and mean structure models reduces the number of parameters to be estimated in fitting the mixture and enables one to investigate a variety of substantive hypotheses concerning the differences between the components in the mixture. Within the general model, individual parameters can be subjected to equality, nonlinear and simple bounds constraints. Confidence intervals are based on the inverse of the Hessian and on the likelihood profile. Several illustrations are given and results of a simulation study concerning the confidence intervals are reported.

Keywords

structural equation modelingmultivariate normal mixturesquasi-NewtonLISREL
Type
Original Paper
Information
Psychometrika , Volume 63 , Issue 3 , September 1998 , pp. 227 - 253
Copyright
Copyright © 1998 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

We thank Harrie Vorst for his generous support. We thank Yiu-Fai Yung for kindly making available his thesis (Yung, 1994), and a copy of his, at the time of revising the present paper, unpublished Psychometrika article (Yung, 1997). We thank Petra Stein for making available her paper with Gerhard Arminger (Arminger & Stein, 1997). A total of five reviews provided by anonymous referees, and additional comments by the editors resulted in a good number of improvements. Finally, we thank Peter Molenaar for his critical comments.

This paper was first submitted to Psychometrika in May of 1996, after a period of about 6 months in which we developed and tested our FORTRAN routines. In two rounds of highly constructive reviews, two dissertations (Stein, 1997; Yung, 1994), and several articles were brought to our attention, that were either submitted (Arminger & Stein), or in press (Yung, Jedidi et al.). In the mean time, a number of these papers have appeared (Jedidi et al. 1997a, 1997b), and more are sure to follow (Yung, 1997; Arminger & Stein, 1997). It is clear that the subject of structural equation modeling within normal mixtures has taken off over the past few years (though Blåfield's pioneering thesis appeared in 1980). Although we were unaware of the work that was on-going, or indeed completed, when we embarked on this project, it is with pleasure that we acknowledge the precedence of those, whose work, in press, submitted, or otherwise, has come to our attention since first submitting this paper to Psychometrika.

References

Agha, M., & Branker, D. S. (1997). Maximum Likelihood estimations and goodness of fit tests for mixtures of distributions (AS 317). Applied Statistics, 46, 399–407.Google Scholar
Aitchison, J., & Silvey, S. D. (1958). Maximum-likelihood estimation of parameters subject to restraints. Annals of Mathematical Statistics, 29, 813–828.CrossRefGoogle Scholar
Arminger, G., & Stein, P. (1997). Finite mixtures of covariance structure models with regressions: likelihood, function, minimum distance estimation, fit indices, and a complex example. Submitted.Google Scholar
Azzalini, A. (1996). Statistical inference based on the likelihood, London: Chapman and Hall.Google Scholar
Blåfield, E. (1980). Clustering of observations from finite mixtures with structural information, Jyväskylä, Finland: Jyväskylä University.Google Scholar
Dolan, C. V., & Molenaar, P. C. M. (1991). A comparison of 4 methods of calculating standard errors of maximum likelihood estimates in the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 44, 359–368.CrossRefGoogle Scholar
Everitt, B. S., & Hand, D. J. (1981). Finite mixture distributions, London: Champan and Hall.CrossRefGoogle Scholar
Farmacotherapeutisch Kompas (1994). Farmacotherapeutisch kompas: medisch farmaceutisch voorlichting, Amstelveen: Ziekenfonsraad.Google Scholar
Feng, Z. D., & McCulloch, C. E. (1996). Using bootstrap likelihood ratios in finite mixture models. Journal of the Royal Statistical Society, Series B, 58, 609–617.CrossRefGoogle Scholar
Gill, P. E., Murray, W., & Wright, M. H. (1981). Practical Optimization, London: Academic Press.Google Scholar
Goldberg, D. E. (1989). Genetic algorithms in search, optimization and machine learning, Reading: Addison-Wesley.Google Scholar
Graybill, F. A. (1983). Matrices with applications in statistics 2nd ed.,, Belmont, CA: Wadsworth.Google Scholar
Hamilton, J. D. (1990). Analysis of time series subject to changes in regime. Journal of Econometrics, 45, 39–70.CrossRefGoogle Scholar
Hamilton, J. D. (1991). A quasi-Bayesian approach to estimating parameters for mixtures of normal distributions. Journal of Business and Economic Statistics, 9, 27–39.CrossRefGoogle Scholar
Hathaway, R. J. (1985). A constrained formulation of maximum-likelihood estimation for normal mixture distributions. The Annals of Statistics, 13, 795–800.CrossRefGoogle Scholar
Hosmer, D. W. (1974). Maximum Likelihood estimates of parameters of a mixture of two regression lines. Communication in Statistics. Theory and Methods, 3, 995–1006.Google Scholar
Jedidi, K., Jagpal, H. S., & DeSarbo, W. S. (1997). Finite-mixture structural equation models for response-based segmentation and unobserved heterogeneity. Marketing Science, 16, 39–59.CrossRefGoogle Scholar
Jedidi, K., Jagpal, H. S., & DeSarbo, W. S. (1976). STEMM: A general finite mixture structural equation model. Journal of Classification, 14, 23–50.CrossRefGoogle Scholar
Jöreskog, K. G. (1970). Estimation and fitting of simplex models. British Journal of Mathematical and Statistical Psychology, 23, 121–145.CrossRefGoogle Scholar
Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 57, 409–426.CrossRefGoogle Scholar
Jöreskog, K. G. (1977). Structural equation models in the social sciences: Specification, estimation and testing. In Krishnaiah, P. R. (Eds.), Applications of Statistics, Amsterdam: North-Holland.Google Scholar
Jöreskog, K. G., & Sörbom, D. (1993). LISREL 8 user's reference and guide, Chicago: Scientific Software International.Google Scholar
McLachlan, G. J. (1987). On bootstrapping the likelihood ratio test statistic for the number of components in a normal mixture. Applied Statistics, 36, 318–324.CrossRefGoogle Scholar
Murphy, A. E., & Bolling, D. R. (1967). Testing of a single locus hypothesis where there is incomplete separation of the phenotypes. American Journal of Human Genetics, 19, 322–334.Google Scholar
Numerical, Alogorithms Group (1990). The NAG Fortran Manual, Mark 4, Oxford: Author.Google Scholar
Neale, M. C. (1995). Mx: Statistical Modeling 3rd ed.,, Richmond, VA: Medical College of Virginia.Google Scholar
Neale, M. C., & Miller, M. (1997). The use of likelihood-based confidence intervals in genetic models. Behavior Genetics, 27, 113–120.CrossRefGoogle ScholarPubMed
Piaget, J., & Inhelder, B. (1969). The psychology of the child, New York: Basic Books.Google Scholar
Sörbom, D. (1974). A general method for studying differences in factor means and factor structures between groups. British Journal of Mathematical and Statistical Psychology, 27, 229–239.CrossRefGoogle Scholar
Stein, P. (1997). Mischungen von konditionalen Mittlewertund Kovarianzstrukturmodellen mit Anwendungen auf die analyse von Lebensstilen, Disburg, Germany: Department of Social Science, Gerhard Mercator University.Google Scholar
Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1985). Statistical analysis of finite mixture distributions, Chicester: John Wiley & Sons.Google Scholar
Van der Maas, H. J. L. (1993). Catastrophe analysis of stagewise cognitive development: models, method and applications, Amsterdam: University of Amsterdam, Psychology Faculty.Google Scholar
van der Maas, H. J. L., & Raijmakers, M. E. J. (1997). Optimizing latent class models by genetic alogorithms, Amsterdam: University of Amsterdam, Developmeental Psychology, Psychology Faculty.Google Scholar
Venzon, D. J., & Moolgavkar, S. H. (1988). A method for computing profile-likelihood-based confidence intervals. Applied Statistics, 37, 87–94.CrossRefGoogle Scholar
Wedel, M. (1995). GLIMMIX, A program for mixtures of generalized linear regression models, and its applications in marketing. Kwantitatieve Methoden, 50, 55–70.Google Scholar
Wedel, M., & DeSarbo, W. S. (1994). A review of recent developments in latent class regression models. In Bagozzi, R. P. (Eds.), Advanced methods of marketing research (pp. 352–388). Cambridge, MA: Blackwell.Google Scholar
Wedel, M., & DeSarbo, W. S. (1995). A mixture likelihood approach for generalized linear models. Journal of Classification, 12, 21–55.CrossRefGoogle Scholar
Wolfe, J. H. (1970). Pattern clustering by multivariate mixture analysis. Multivariate Behavioral Research, 5, 329–350.CrossRefGoogle ScholarPubMed
Yung, Y. F. (1994). Finite mixtures in confirmatory factor-analytic models, Los Angeles: University of California.Google Scholar
Yung, Y. F. (1997). Finite Mixtures in Confirmatory Factor-Analysis Models. Psychometrika, 62, 297–330.CrossRefGoogle Scholar