Hostname: page-component-586b7cd67f-t7czq Total loading time: 0 Render date: 2024-11-27T16:58:46.875Z Has data issue: false hasContentIssue false

Evaluation of treatment effects by ranking

Published online by Cambridge University Press:  26 February 2008

U. HALEKOH*
Affiliation:
Unit of Statistics and Decision Analysis, Department of Genetics and Biotechnology, Faculty of Agricultural Sciences, University of Aarhus, Blichers Allé 20, PO 50, DK-8830 Tjele, Denmark
K. KRISTENSEN
Affiliation:
Unit of Statistics and Decision Analysis, Department of Genetics and Biotechnology, Faculty of Agricultural Sciences, University of Aarhus, Blichers Allé 20, PO 50, DK-8830 Tjele, Denmark
*
*To whom all correspondence should be addressed. Email: [email protected]

Summary

In crop experiments measurements are often made by a judge evaluating the crops' conditions after treatment. In the present paper an analysis is proposed for experiments where plots of crops treated differently are mutually ranked. In the experimental layout the crops are treated on consecutive plots usually placed side by side in one or more rows. In the proposed method a judge ranks several neighbouring plots, say three, by ranking them from best to worst. For the next observation the judge moves on by no more than two plots, such that up to two plots will be re-evaluated again in a comparison with the new plot(s). Data from studies using this set-up were analysed by a Thurstonian random utility model, which assumed that the judge's rankings were obtained by comparing latent continuous utilities or treatment effects. For the latent utilities a variance component model was considered to account for the repeated measurements. The estimation was based on a Bayesian approach, which was analysed via Markov Chain Monte Carlo sampling. A simulation study showed that the approach was able to estimate the relative ordering of the treatments. The efficiency of the estimation increased with the overlap of the ranked observations. The approach was compared with a more traditional analysis of variance analysis applied to a proportional score for each plot by applying both methods to a real experiment. The relative ranking of the treatment effects were almost the same for both approaches. This method seems to be less sensitive to the judge and also eliminates any possible drift over the judging process in the more traditional method.

Type
Crops and Soils
Copyright
Copyright © 2008 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Böckenholt, U. (1993). Applications of Thurstonian models to ranking data. In Probability Models and Statistical Analysis for Ranking Data (Eds Fligner, M. A. & Verducci, J. S.), pp. 157172. New York: Springer.Google Scholar
Böckenholt, U. & Dillon, W. R. (1997). Modeling within-subject dependencies in ordinal paired comparison data. Psychometrika 62, 411434.Google Scholar
Bradshaw, N. J. & Bain, R. A. (2005). Potato blight control – is a sustainable approach a realistic option? Aspects of Applied Biology 76, 183190.Google Scholar
Brooks, S. P. & Gelman, A. (1998). General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics 7, 434455.Google Scholar
Brunner, E. & Dette, H. (1992). Rank procedures for the two-factor mixed model. Journal of the American Statistical Association 87, 884888.CrossRefGoogle Scholar
Brunner, E., Domhof, S. & Langer, F. (2002). Nonparametric Analysis of Longitudinal Data in Factorial Experiments. New York: Wiley.Google Scholar
David, H. A. (1988). The Method of Paired Comparisons. London: Griffin.Google Scholar
Firth, D. (1992). Bias reduction, the Jeffreys prior and GLIM. In Advances in GLIM and Statistical Modelling (Eds Fahrmeir, L., Francis, B. J., Gilchrist, R. & Tutz, G.), pp. 91100. Heidelberg, Germany: Springer.CrossRefGoogle Scholar
Gelman, A., Carlin, J. B., Stern, H. S. & Rubin, D. R. (2004). Bayesian Data Analysis, 2nd edn.London: Chapman and Hall.Google Scholar
Gelman, A. & Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science 7, 457472.Google Scholar
Gilks, W. R., Richardson, S. & Spiegelhalter, D. J. (1996). Markov Chain Monte Carlo in Practice. London: Chapman and Hall.Google Scholar
Kousgaard, N. (1984). Analysis of a sound field experiment by a model for paired comparisons with explanatory variables. Scandinavian Journal of Statistics 11, 5157.Google Scholar
Manski, C. F. (2004). The structure of random utility models. Theory and Decision 8, 229254.Google Scholar
Piepho, H.-P. & Kalka, E. (2003). Threshold models with fixed and random effects for ordered categorical data. Food Quality and Preference 14, 343357.Google Scholar
Plummer, M., Best, N., Cowles, K. & Vines, K. (2004). Coda (Convergence Diagnostics and Output Analysis): Output Analysis and Diagnostics for MCMC. R Package version 0.8-3. Available online at http://www-fis.iarc.fr/coda/ (verified 7/11/07).Google Scholar
R Development Core Team (2006). R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. Available online at http://www.R-project.org (verified 8/11/07).Google Scholar
Skillings, J. H. & Mack, G. A. (1981). On the use of a Friedman-type statistic in balanced and unbalanced block designs. Technometrics 23, 171177.Google Scholar
Sturtz, S., Ligges, U. & Gelman, A. (2005). R2WinBUGS: a package for running WinBUGS from R. Journal of Statistical Software 12, 116.Google Scholar
Thomas, A., O'Hara, B., Ligges, U. & Sturtz, S. (2006). Making BUGS open. R News, 6, 1217. Available online at http://cran.R-project.org/doc/Rnews/Rnews_2006-1.pdf (verified 8/11/07).Google Scholar
Thurstone, L. L. (1927). A law of comparative judgement. Psychological Review 34, 273286.Google Scholar
Van der Laan, P. & Verdooren, L. R. (1987). Classical analysis of variance methods and nonparametric counterparts. Biometrical Journal 29, 635665.Google Scholar
Yao, G. & Böckenholt, U. (1999). Bayesian estimation of Thurstonian ranking models based on the Gibbs sample. British Journal of Mathematical and Statistical Psychology 52, 7992.CrossRefGoogle Scholar