An analysis of empirical data often leads to a rejection of a hypothesized model, even if the researcher has spent considerable efforts in including all available information in the formulation of the model. Thus, the researcher must reformulate the model in some way, but in most instances there is, at least theoretically, an overwhelming number of possible actions that could be taken. In this paper a “modification index” will be discussed which should serve as a guide in the search for a “better” model. In statistical terms, the index measures how much we will be able to reduce the discrepancy between model and data, as defined by a general fit function, when one parameter is added or freed or when one equality constraint is relaxed. The modification index discussed in this paper is an improvement of the one incorporated in the LISREL V computer program in that it takes into account changes in all the parameters of the model when one particular parameter is freed.

The problem of detecting instructional sensitivity (“item basis”) in test items is considered. An illustration is given which shows that for tests with many biased items, traditional item bias detection schemes give a very poor assessment of bias. A new method is proposed instead. This method extends item response theory (IRT) by including item-specific auxiliary measurement information related to opportunity-to-learn. Item-specific variation in measurement relations across students with varying opportunity-to-learn is allowed for.

Four measurement designs are presented for use with correlation coefficients corrected, in one variable, for attenuation due to unreliability—coefficients that we term partially disattenuated correlation coefficients. Asymptotic expressions are derived for the variances and covariances of the estimates accompanying each design. Empirical simulation results that bear on the preceding mathematical developments are then presented. In addition to providing insights into the distributions of the estimates, the empirical results demonstrate satisfactory Type I error control for typical inferential applications. Power is shown to be equal to or greater than that of corresponding product-moment correlations in three of the four designs. Implications for practice are discussed.

Using the theory of pseudo maximum likelihood estimation the asymptotic covariance matrix of maximum likelihood estimates for mean and covariance structure models is given for the case where the variables are not multivariate normal. This asymptotic covariance matrix is consistently estimated without the computation of the empirical fourth order moment matrix. Using quasi-maximum likelihood theory a Hausman misspecification test is developed. This test is sensitive to misspecification caused by errors that are correlated with the independent variables. This misspecification cannot be detected by the test statistics currently used in covariance structure analysis.

Applications of item response theory, which depend upon its parameter invariance property, require that parameter estimates be unbiased. A new method, weighted likelihood estimation (WLE), is derived, and proved to be less biased than maximum likelihood estimation (MLE) with the same asymptotic variance and normal distribution. WLE removes the first order bias term from MLE. Two Monte Carlo studies compare WLE with MLE and Bayesian modal estimation (BME) of ability in conventional tests and tailored tests, assuming the item parameters are known constants. The Monte Carlo studies favor WLE over MLE and BME on several criteria over a wide range of the ability scale.

In the course of the medical program at the University of Limburg, students complete a total of 24 progress tests, consisting of items drawn from a constant itembank. A model is presented for the growth of knowledge reflected by these results. The Rasch model is used as a starting point, but both ability and difficulty parameters are taken to be random, and moreover the logistic distribution is replaced by the normal. Both individual and group abilities are estimated and explained through simple linear regression. Application to real data shows that the model fits very well.

Millsap and Meredith (1988) have developed a generalization of principal components analysis for the simultaneous analysis of a number of variables observed in several populations or on several occasions. The algorithm they provide has some disadvantages. The present paper offers two alternating least squares algorithms for their method, suitable for small and large data sets, respectively. Lower and upper bounds are given for the loss function to be minimized in the Millsap and Meredith method. These can serve to indicate whether or not a global optimum for the simultaneous components analysis problem has been attained.

We propose a method for detecting influential observations in iterative principal factor analysis. For this purpose we derive the influence functions I(x; LLT) and I(x; Δ) for the common variance matrix T =LLT and the unique variance matrix Δ, respectively, in the common factor decomposition Σ =LLT + Δ. A numerical example is given for illustration.

In very simple test theory models such as the Rasch model, a single parameter is used to represent the ability of any examinee or the difficulty of any item. Simple models such as these provide very important points of departure for more detailed modeling when a substantial amount of data are available, and are themselves of real practical value for small or even medium samples. They can also serve a normative role in test design.

As an alternative to the Rasch model, or the Rasch model with a correction for guessing, a simple model is introduced which characterizes strength of response in terms of the ratio of ability and difficulty parameters rather than their difference. This model provides a natural account of guessing, and has other useful things to contribute as well. It also offers an alternative to the Rasch model with the usual correction for guessing. The three models are compared in terms of statistical properties and fits to actual data. The goal of the paper is to widen the range of “minimal” models available to test analysts.

A method for multidimensional scaling that is highly resistant to the effects of outliers is described. To illustrate the efficacy of the procedure, some Monte Carlo simulation results are presented. The method is shown to perform well when outliers are present, even in relatively large numbers, and also to perform comparably to other approaches when no outliers are present.

The DEDICOM model is a model for representing asymmetric relations among a set of objects by means of a set of coordinates for the objects on a limited number of dimensions. The present paper offers an alternating least squares algorithm for fitting the DEDICOM model. The model can be generalized to represent any number of sets of relations among the same set of objects. An algorithm for fitting this three-way DEDICOM model is provided as well. Based on the algorithm for the three-way DEDICOM model an algorithm is developed for fitting the IDIOSCAL model in the least squares sense.

An old problem in personnel psychology is to characterize distributions of test validity correlation coefficients. The proposed model views histograms of correlation coefficients as observations from a mixture distribution which, for a fixed sample size n, is a conditional mixture distribution h(r|n) = Σjλjh(r; ρj, n), where R is the correlation coefficient, ρj are population correlation coefficients and λj are the mixing weights. The associated marginal distribution of R is regarded as the parent distribution underlying histograms of empirical correlation coefficients. Maximum likelihood estimates of the parameters ρj and λj can be obtained with an EM algorithm solution and tests for the number of components t are achieved after the (one-component) density of R is replaced with a tractable modeling density h(r; ρj, n). Two illustrative examples are provided.