Most existing tests for significance of difference between means require specific assumptions concerning the distribution function in the parent population. The need for a test which can be applied without making any such assumption is stressed. Such a statistical test is derived. The application of the test involves converting scores to rank orders. The exact probabilities may then be calculated for specified differences between samples by means of which the null hypothesis may be tested. The application of the test is simple and requires a minimum of calculation. The test loses in precision because of the conversion to rank orders but gains in generality since it may be safely used with any kind of distribution.

The standard tobit or censored regression model is typically utilized for regression analysis when the dependent variable is censored. This model is generalized by developing a conditional mixture, maximum likelihood method for latent class censored regression. The proposed method simultaneously estimates separate regression functions and subject membership in K latent classes or groups given a censored dependent variable for a cross-section of subjects. Maximum likelihood estimates are obtained using an EM algorithm. The proposed method is illustrated via a consumer psychology application.

A chain of lower-bound inequalities leading to the greatest lower bound to reliability is established for the internal consistency of a composite of unit-weighted components. The chain includes the maximum split-half coefficient, the lowest coefficient consistent with nonimaginary common factors, and the lowest coefficient consistent with nonimaginary common and unique factors. Optimization theory is utilized to determine the conditions that are requisite for the inequalities. Convergence proofs demonstrate that the coefficients can be attained. Rapid algorithms obtain estimates of the coefficients with sample data. The theory yields methods for splitting items into maximally similar sets and for exploratory factor analysis based on a theoretical solution to the communality problem.

A coefficient derived from communalities of test parts has been proposed as greatest lower bound to Guttman's “immediate retest reliability.” The communalities have at times been calculated from covariances between item sets, which tends to underestimate appreciably. When items are experimentally independent, a consistent estimate of the greatest defensible internal-consistency coefficient is obtained by factoring item covariances. In samples of modest size, this analysis capitalizes on chance; an estimate subject to less upward bias is suggested. For estimating alternate-forms reliability, communality-based coefficients are less appropriate than stratified alpha.

A lognormal model for response times is used to check response times for aberrances in examinee behavior on computerized adaptive tests. Both classical procedures and Bayesian posterior predictive checks are presented. For a fixed examinee, responses and response times are independent; checks based on response times offer thus information independent of the results of checks on response patterns. Empirical examples of the use of classical and Bayesian checks for detecting two different types of aberrances in response times are presented. The detection rates for the Bayesian checks outperformed those for the classical checks, but at the cost of higher false-alarm rates. A guideline for the choice between the two types of checks is offered.

By proposing that the latent or true nature of subjects is identified with a limited number of response patterns (the Guttman scale patterns), the probability of an observed response pattern can be written as the sum of products of the probability of the true type multiplied by the chance of sufficient response error to cause the observed pattern to appear. This model contains the proportions of the true types as parameters plus some misclassification probabilities as parameters. Maximum likelihood methods are used to make estimates and test the fit for some examples.

The Dutch Identity is a useful way to reexpress the basic equations of item response models that relate the manifest probabilities to the item response functions (IRFs) and the latent trait distribution. The identity may be exploited in several ways. For example: (a) to suggest how item response models behave for large numbers of items—they are approximate submodels of second-order loglinear models for 2J tables; (b) to suggest new ways to assess the dimensionality of the latent trait—principle components analysis of matrices composed of second-order interactions from loglinear models; (c) to give insight into the structure of latent class models; and (d) to illuminate the problem of identifying the IRFs and the latent trait distribution from sample data.

Established results on latent variable models are applied to the study of the validity of a psychological test. When the test predicts a criterion by measuring a unidimensional latent construct, not only must the total score predict the criterion, but the joint distribution of criterion scores and item responses must exhibit a certain pattern. The presence of this population pattern may be tested with sample data using the stratified Wilcoxon rank sum test. Often, criterion information is available only for selected examinees, for instance, those who are admitted or hired. Three cases are discussed: (i) selection at random, (ii) selection based on the current test, and (iii) selection based on other measures of the latent construct. Discriminant validity is also discussed.

A method is derived for finding the average Spearman rank correlation coefficient of N sets of ranks with a single dependent or criterion ranking of n items without computing any of the individual coefficients. Procedures for calculating the exact distribution of ρav for small values of N and n are described for the null case. The first four moments about zero of this distribution are derived, and it is concluded that for samples as small as N = 4 and n = 4 the normal distribution can be used safely in testing the hypothesis ρav = 0.

A procedure for generating multivariate nonnormal distributions is proposed. Our procedure generates average values of intercorrelations much closer to population parameters than competing procedures for skewed and/or heavy tailed distributions and for small sample sizes. Also, it eliminates the necessity of conducting a factorization procedure on the population correlation matrix that underlies the random deviates, and it is simpler to code in a programming language (e.g., FORTRAN). Numerical examples demonstrating the procedures are given. Monte Carlo results indicate our procedure yields excellent agreement between population parameters and average values of intercorrelation, skew, and kurtosis.

We consider models which combine latent class measurement models for categorical latent variables with structural regression models for the relationships between the latent classes and observed explanatory and response variables. We propose a two-step method of estimating such models. In its first step, the measurement model is estimated alone, and in the second step the parameters of this measurement model are held fixed when the structural model is estimated. Simulation studies and applied examples suggest that the two-step method is an attractive alternative to existing one-step and three-step methods. We derive estimated standard errors for the two-step estimates of the structural model which account for the uncertainty from both steps of the estimation, and show how the method can be implemented in existing software for latent variable modelling.

This paper deals with the determination of optimal weights for points on scoring scales for subjective comparative experiments. A scoring scale with a specific number of points is considered, and it is assumed that verbal or other indications imply an order to the scale points. The optimal spacing for the scale points is obtained in the sense that treatment or item differences are maximized relative to error or within-treatment variation. The method is presented in sufficiently generalized form to be used directly with any experimental design leading to the analysis of variance. An iterative procedure, suitable for computer use, yields the optimal differences among the ordered scale points. Properties of this procedure are discussed.

Simple procedures are described for obtaining maximum likelihood estimates of the location and uncertainty parameters of the Hefner model. This model is a probabilistic, multidimensional scaling model, which assigns a multivariate normal distribution to each stimulus point. It is shown that for such a model, standard nonmetric and metric algorithms are not appropriate.

A procedure is also described for constructing incomplete data sets, by taking into consideration the degree of familiarity the subject has for each stimulus. Maximum likelihood estimates are developed both for complete and incomplete data sets.

For the point distribution model of Lazarsfeld's latent structure analysis, the general matrix equation is stated which relates the manifest data in the form of joint occurrence matrices to the latent parameters. The relationship of the item responses and these joint occurrence matrices is also indicated in matrix form. A general solution for the latent parameters is then presented, which is based on the notion of factoring two joint occurrence matrices. The solution is valid under certain conditions which will usually be fulfilled. The solution assumes that estimates are available for the elements in the joint occurrence matrices with recurring subscripts, analogous to item communality or reliability. Some alternative methods of obtaining these estimates are discussed. Finally a fictitious 3-class, 8-item example is presented in detail.

Given the preference ordering of each of a number of individuals over a set of stimuli, it is proposed that if the preference orderings are generated in a Euclidean space of r dimensions which can be recovered by unfolding the preference orderings, then a factor analysis of the correlations between individual's preference orderings will yield a space of r + 1 dimensions with the original r-space embedded in it, and the additional dimension will be one of social utility. The proposition is clearly shown to be satisfied by means of the Monte Carlo technique for both random and lattice stimuli in three dimensions and for two other examples with random stimuli in one and two dimensions.

Multinomial processing tree (MPT) models are theoretically motivated stochastic models for the analysis of categorical data. Here we focus on a crossed-random effects extension of the Bayesian latent-trait pair-clustering MPT model. Our approach assumes that participant and item effects combine additively on the probit scale and postulates (multivariate) normal distributions for the random effects. We provide a WinBUGS implementation of the crossed-random effects pair-clustering model and an application to novel experimental data. The present approach may be adapted to handle other MPT models.

A definition of essential independence is proposed for sequences of polytomous items. For items satisfying the reasonable assumption that the expected amount of credit awarded increases with examinee ability, we develop a theory of essential unidimensionality which closely parallels that of Stout. Essentially unidimensional item sequences can be shown to have a unique (up to change-of-scale) dominant underlying trait, which can be consistently estimated by a monotone transformation of the sum of the item scores. In more general polytomous-response latent trait models (with or without ordered responses), an M-estimator based upon maximum likelihood may be shown to be consistent for θ under essentially unidimensional violations of local independence and a variety of monotonicity/identifiability conditions. A rigorous proof of this fact is given, and the standard error of the estimator is explored. These results suggest that ability estimation methods that rely on the summation form of the log likelihood under local independence should generally be robust under essential independence, but standard errors may vary greatly from what is usually expected, depending on the degree of departure from local independence. An index of departure from local independence is also proposed.

Recently, there has been increasing interest in reporting subscores. This paper examines reporting of subscores using multidimensional item response theory (MIRT) models (e.g., Reckase in Appl. Psychol. Meas. 21:25–36, 1997; C.R. Rao and S. Sinharay (Eds), Handbook of Statistics, vol. 26, pp. 607–642, North-Holland, Amsterdam, 2007; Beguin & Glas in Psychometrika, 66:471–488, 2001). A MIRT model is fitted using a stabilized Newton–Raphson algorithm (Haberman in The Analysis of Frequency Data, University of Chicago Press, Chicago, 1974; Sociol. Methodol. 18:193–211, 1988) with adaptive Gauss–Hermite quadrature (Haberman, von Davier, & Lee in ETS Research Rep. No. RR-08-45, ETS, Princeton, 2008). A new statistical approach is proposed to assess when subscores using the MIRT model have any added value over (i)  the total score or (ii)  subscores based on classical test theory (Haberman in J. Educ. Behav. Stat. 33:204–229, 2008; Haberman, Sinharay, & Puhan in Br. J. Math. Stat. Psychol. 62:79–95, 2008). The MIRT-based methods are applied to several operational data sets. The results show that the subscores based on MIRT are slightly more accurate than subscore estimates derived by classical test theory.

Multilevel factor analysis models are widely used in the social sciences to account for heterogeneity in mean structures. In this paper we extend previous work on multilevel models to account for general forms of heterogeneity in confirmatory factor analysis models. We specify various models of mean and covariance heterogeneity in confirmatory factor analysis and develop Markov Chain Monte Carlo (MCMC) procedures to perform Bayesian inference, model checking, and model comparison.

We test our methodology using synthetic data and data from a consumption emotion study. The results from synthetic data show that our Bayesian model perform well in recovering the true parameters and selecting the appropriate model. More importantly, the results clearly illustrate the consequences of ignoring heterogeneity. Specifically, we find that ignoring heterogeneity can lead to sign reversals of the factor covariances, inflation of factor variances and underappreciation of uncertainty in parameter estimates. The results from the emotion study show that subjects vary both in means and covariances. Thus traditional psychometric methods cannot fully capture the heterogeneity in our data.

The partial credit model is considered under the assumption of a certain linear decomposition of the item × category parameters δih into “basic parameters” αj. This model is referred to as the “linear partial credit model”. A conditional maximum likelihood algorithm for estimation of the αj is presented, based on (a) recurrences for the combinatorial functions involved, and (b) using a “quasi-Newton” approach, the so-called Broyden-Fletcher-Goldfarb-Shanno (BFGS) method; (a) guarantees numerically stable results, (b) avoids the direct computation of the Hesse matrix, yet produces a sequence of certain positive definite matrices Bk, k = 1, 2, ..., converging to the asymptotic variance-covariance matrix of the \documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\hat \alpha _j $$\end{document}. The practicality of these numerical methods is demonstrated both by means of simulations and of an empirical application to the measurement of treatment effects in patients with psychosomatic disorders.