We investigate under what conditions the matrix of factor loadings from the factor analysis model with equal unique variances will give a good approximation to the matrix of factor loadings from the regular factor analysis model. We show that the two models will give similar matrices of factor loadings if Schneeweiss' condition, that the difference between the largest and the smallest value of unique variances is small relative to the sizes of the column sums of squared factor loadings, holds. Furthermore, we generalize our results and discus the conditions under which the matrix of factor loadings from the regular factor analysis model will be well approximated by the matrix of factor loadings from Jöreskog's image factor analysis model. Especially, we discuss Guttman's condition (i.e., the number of variables increases without limit) for the two models to agree, in relation with the condition we have shown, and conclude that Schneeweiss' condition is a generalization of Guttman's condition. Some implications for practice are discussed.

Scale invariance is a property shared by many covariance structure models employed in practice. An example is provided by the well-known LISREL model subject only to classical normalizations and zero constraints on the parameters. It is shown that scale invariance implies that the estimated covariance matrix must satisfy certain equations, and the nature of these equations depends on the fitting function used. In this context, the paper considers two classes of fitting functions: weighted least squares and the class of functions proposed by Swain.

A closed form estimator of the uniqueness (unique variance) in factor analysis is proposed. It has analytically desirable properties—consistency, asymptotic normality and scale invariance. The estimation procedure is given through the application to the two sets of Emmett's data and Holzinger and Swineford's data. The new estimator is shown to lead to values rather close to the maximum likelihood estimator.

Principal components analysis can be redefined in terms of the regression of observed variables upon component variables. Two criteria for the adequacy of a component representation in this context are developed and are shown to lead to different component solutions. Both criteria are generalized to allow weighting, the choice of weights determining the scale invariance properties of the resulting solution. A theorem is presented giving necessary and sufficient conditions for equivalent component solutions under different choices of weighting. Applications of the theorem are discussed that involve the components analysis of linearly derived variables and of external variables.

A reparameterization is formulated that yields estimates of scale-invariant parameters in recursive path models with latent variables, and (asymptotically) correct standard errors, without the use of constrained optimization. The method is based on the logical structure of the reticular action model.

The small-world phenomenon, the principle that we are all linked by a short chain of intermediate acquaintances, has been investigated in mathematics and social sciences. It has been shown to be pervasive both in nature and in engineering systems like the World Wide Web. Work of Jon Kleinberg has shown that people, using only local information, are very effective at finding short paths in a network of social contacts. In this paper we argue that the underlying key to finding short paths is scale invariance. In order to appreciate scale invariance we suggest a continuum setting, since true scale invariance happens at all scales, something which cannot be observed in a discrete model. We introduce a random-connection model that is related to continuum percolation, and we prove the existence of a unique scale-free model, among a large class of models, that allows the construction, with high probability, of short paths between pairs of points separated by any distance.

In this article, we present a self-contained review of recent work on complex biological systems which exhibit no characteristic scale. This property can manifest itself with fractals (spatial scale invariance), flicker noise or 1/f-noise where f denotes the frequency of a signal (temporal scale invariance) and power laws (scale invariance in the size and duration of events in the dynamics of the system). A hypothesis recently put forward to explain these scale-free phenomomena is criticality, a notion introduced by physicists while studying phase transitions in materials, where systems spontaneously arrange themselves in an unstable manner similar, for instance, to a row of dominoes. Here, we review in a critical manner work which investigates to what extent this idea can be generalized to biology. More precisely, we start with a brief introduction to the concepts of absence of characteristic scale (power-law distributions, fractals and 1/f- noise) and of critical phenomena. We then review typical mathematical models exhibiting such properties: edge of chaos, cellular automata and self-organized critical models. These notions are then brought together to see to what extent they can account for the scale invariance observed in ecology, evolution of species, type III epidemics and some aspects of the central nervous system. This article also discusses how the notion of scale invariance can give important insights into the workings of biological systems.