Hostname: page-component-669899f699-g7b4s Total loading time: 0 Render date: 2025-05-02T10:55:28.262Z Has data issue: false hasContentIssue false
  • English
  • Français

Are Judicial Performance Evaluations Fair to Women and Minorities? A Cautionary Tale from Clark County, Nevada

Published online by Cambridge University Press:  01 January 2024

Rebecca D. Gill ,
Sylvia R. Lazos  and
Mallory M. Waters
Get access Rights & Permissions [Opens in a new window]

Abstract

Because voters rely on judicial performance evaluations when casting their ballots, policymakers should work diligently to compile valid, reliable, and unbiased information about our sitting judges. Although some claim that judicial performance evaluations are fair, the systematic research needed to establish such a proposition has not been done. By the use of attorney judicial performance survey data from Clark County, Nevada, this analysis shows that objective measures of judicial performance cannot explain away differences in scores based on race and sex. Minority judges and female judges score consistently and significantly lower than do their white and male counterparts, all other things being equal. These results are consistent with the hypothesis that judicial performance evaluation surveys may carry with them unexamined and unconscious gender/race biases. Future research must compare judicial performance evaluation structure, content, and execution across states in order to identify those evaluation mechanisms least susceptible to unconscious gender and race bias.

Type
Articles
Information
Law & Society Review , Volume 45 , Issue 3 , September 2011 , pp. 731 - 759
Copyright
© 2011 Law and Society Association.

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

For helpful comments on previous versions of this article, the authors wish to thank Chris W. Bonneau, Eric Waltenburg, Udi Sommer, and Malia Reddick.

References

References

American Bar Association (1985) “Guidelines for the Evaluation of Judicial Performance.” Washington, DC: American Bar Association.Google Scholar
American Bar Association (1992) Legal Education and Professional Development: An Educational Continuum. Washington, DC: American Bar Association.Google Scholar
American Bar Association (2005) “Guidelines for the Evaluation of Judicial Performance with Commentary.” Chicago, IL: American Bar Association.Google Scholar
American Bar Association (2007) ABA Model Code of Judicial Conduct. Washington, DC: American Bar Association.Google Scholar
American Psychological Association (1991) “In the Supreme Court of the United States: Price Waterhouse v. Ann B. Hopkins: Amicus curae brief for The American Psychological Association,” 46 American Psychologist 1061–70.Google Scholar
Andersen, Seth S. (2000) “Judicial Retention Evaluation Programs,” 34 Loyola L.A. Law Rev. 1375–89.Google Scholar
American Tort Reform Foundation (2008) “Judicial Hellholes 2008/2009.” Washington, DC: American Tort Reform Foundation.Google Scholar
Baum, Lawrence (2001) American Courts: Process and Policy, 5th ed. Boston: Houghton Mifflin.Google Scholar
Beck, Nathaniel, & Katz, Jonathan (1995) “What To Do (and Not To Do) With Time-Series Cross-Section Data,” 89 American Political Science Rev. 634–47.CrossRefGoogle Scholar
Bertrand, Maria, & Mullainathan, Sendhil (2004) “Are Emily and Brendan More Employable than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination,” 94 American Economic Rev. 991–1014.CrossRefGoogle Scholar
Bielby, William T. (2000) “Minimizing Workplace Gender and Racial Bias,” 29 Contemporary Sociology 120–9.CrossRefGoogle Scholar
Bonneau, Chris W., & Hall, Melinda Gann (2009) In Defense of Judicial Elections. New York: Routledge.CrossRefGoogle Scholar
Brenner, Saul, & Hagle, Timothy M. (1996) “Opinion Writing and Acclimation Effects,” 18 Political Behavior 235–61.CrossRefGoogle Scholar
Brody, David C. (2000) “Judicial Performance Evaluations by State Governments: Informing the Public While Avoiding the Pitfalls,” 21 Justice System J. 333–56.CrossRefGoogle Scholar
Brody, David C. (2008) “The Use of Judicial Performance Evluation to Enhance Judicial Accountability, Judicial Independence, and Public Trust,” 86 Denver Univ. Law Rev. 1–42.Google Scholar
Burger, Gary K. (2007) “Attorney's Ratings of Judges: 1998–2006.” Mound City, MO: Report to the Mound City Bar.Google Scholar
Choi, Stephen J., et al. (2007) “Professionals or Politicians: The Uncertain Empirical Case for an Elected Rather than Appointed Judiciary,” Olin Working Paper, University of Chicago Law and Economics, Chicago, IL.CrossRefGoogle Scholar
Choi, Stephen J., et al. (2009) “Are Judges Overpaid? A Skeptical Response to the Judicial Salary Debate.” 1 Journal of Legal Analysis 47–117.CrossRefGoogle Scholar
Cohen, Thomas (2006) “Appeals from General Civil Trials in 46 Large Counties, 2001–2005.” Washington, DC: Bureau of Justice Statistics, U.S. Department of Justice.Google Scholar
Colorado Office of Judicial Performance Evaluation (2008) “Judicial Performance Reviews.” Available online at http://www.coloradojudicialperformance.gov/review.cfm. Accessed March 17, 2010.Google Scholar
Commission on Women in the Profession (2009) “A Current Glance at Women in the Law 2009.” Chicago, IL: American Bar Association.Google Scholar
Committee on Judicial Independence (2006) “Resource Kit on Fair and Impartial Courts,” Chicago, IL: American Bar Association.Google Scholar
Cordell, La Doris H. (2008) “The Joy of Judging,” 43 Harvard Civil Rights—Civil Liberties Law Rev. 639–43.Google Scholar
Correll, Joshua, et al. (2007) “Across the Thin Blue Line: Police Officers and Racial Bias in the Decision to Shoot.” 96 J. of Personality and Social Psychology 1006–23.Google Scholar
Dillman, Don (2000) “The Role of Behavioral Survey Methodologists in National Statistical Agencies.” 68 International Statistical Rev. 200–13.Google Scholar
Dovido, John F., & Gaertner, Samuel L. (2000) “Aversive Racism in Selection Decisions: 1989 and 1999.” 11 Psychological Science 315–19.Google Scholar
Downey, Nancy (2008) “Las Vegas Review Journal Judicial Performance Evaluation 2008.” Las Vegas, NV: Downey Research Associates.Google Scholar
Driscoll, John C., & Kraay, Aart C. (1998) “Consistent Covariance Matrix Estimation With Spatially Dependent Panel Data,” 80 Rev. of Economics and Statistics 549–60.CrossRefGoogle Scholar
Durham, Christine M. (2000) “Gender and Professional Identity: Unexplored Issues in Judicial Performance Evaluation,” 39 Judges' J. 13–16.Google Scholar
Epstein, Lee, et al. (2003) “The Norm of Prior Judicial Experience and Its Consequences for Career Diversity on the U.S. Supreme Court,” 91 California Law Rev. 903–65.CrossRefGoogle Scholar
Esterling, Kevin M. (1998) “Judicial Accountability the Right Way,” 82 Judicature 206–15.Google Scholar
Esterling, Kevin M., & Sampson, Kathleen M. (1998) Judicial Retention Evaluation Programs in Four States: A Report with Recommendations. Chicago, IL: American Judicature Society.Google Scholar
Feeney, Floyd (1987) “Evaluating Trial Court Performance,” 12 Justice System J. 148–70.Google Scholar
Flango, Victor Eugene, & Ducat, Craig R. (1979) “What Difference Does Method of Judicial Selection Make? Selection Procedures in State Courts of Last Resort,” 5 Justice System J. 25–45.Google Scholar
Glick, Henry R. (1978) “The Promise and the Performance of the Missouri Plan: Judicial Selection in the Fifty States,” 32 Univ. of Miami Law Rev. 509–43.Google Scholar
Glick, Henry R., & Emmert, Craig F. (1986) “Selection Systems and Judicial Characteristics: The Recruitment of State Supreme Court Judges,” 70 Judicature 228–35.Google Scholar
Griffin, Jacqueline R. (1994) “Judging the Judges,” 21 Litigation 5.Google Scholar
Haire, Susan B. (2001) “Rating the Ratings of the American Bar Association Standing Committee on Federal Judiciary,” 22 Justice System J. 1–18.Google Scholar
Hedlund, Ronald D., et al. (1979) “The Electability of Women Candidates: The Effects of Sex Role Stereotypes,” 41 The J. of Politics 513–24.CrossRefGoogle Scholar
Heilman, Madeline E. (1983) “Sex Bias in Work Settings: The Lack of Fit Model,” 5 Research in Organizational Behavior 269–98.Google Scholar
Heilman, Madeline E., et al. (2004) “Penalties for Success: Reactions to Women Who Succeed at Male Gender-Typed Tasks,” 89 J. of Applied Psychology 416–27.CrossRefGoogle ScholarPubMed
Hettinger, Virginia A., et al. (2003) “Acclimation Effects and Separate Opinion Writing on the United States Courts of Appeals,” 84 Social Science Q. 792–810.CrossRefGoogle Scholar
Hoechle, Daniel (2007) “Robust Standard Errors for Panel Regressions with Cross-Sectional Dependence,” 7 Stata Journal 281–312.CrossRefGoogle Scholar
Hopkins, A. D. (2008) “Judging the Judges: Nearly 800 Lawyers Turn in Judicial Performance Evaluation Grades,” Las Vegas Rev. J. May 18.Google Scholar
Institute for the Advancement of the American Legal System (2008) “The Bench Speaks on Judicial Performance Evaluation: A Survey of Colorado Judges.” Denver, CO: Institute for the Advancement of the American Legal System.CrossRefGoogle Scholar
Institute for the Advancement of the American Legal System (2010) “Current Projects: Judicial Performance Evaluation,” Institute for the Advancement of the American Legal System. Available online at http://www.du.edu/legalinstitute. Accessed August 11, 2010.Google Scholar
Jackson, Jeffrey (2007) “Beyond Quality: First Principles in Judicial Selection and their Application to a Commission-Based Selection System,” 34 Fordham Urban Law J. 125–61.Google Scholar
Kagan, Elena (2006) “Women and the Legal Profession–A Status Report,” 61 The Record 37–48.Google Scholar
Kearney, Richard C. (1999) “Judicial Performance Evaluation in the States,” 22 Public Administration Q. 468–89.Google Scholar
Kearney, Richard C., & Sellers, Holly (1996) “Sex on the Docket: Reports of State Task Forces on Gender Bias,” 56 Public Administration Rev. 587–92.CrossRefGoogle Scholar
Lane, Kristin A., et al. (2007) “Implicit Social Cognition and the Law,” 19 Annual Rev. of Law and Social Science 1–25.Google Scholar
Laube, Heather, et al. (2007) “The Impact of Gender on the Evaluation of Teaching: What We Know and What We Can Do,” 19 National Women's Studies Association J. 87–104.Google Scholar
Lauck, Scott (2006) “Missouri Bar Poll Has Little Pull with Voters,” Missouri Lawyers Weekly 13 November.Google Scholar
Martell, Richard F. (1991) “Sex Bias at Work: The Effects of Attentional and Memory Demands on Performance Ratings of Men and Women,” 21 J. of Applied Social Psychology 1939–60.CrossRefGoogle Scholar
McMurdo, Doug (2010) “Judging the Judges: Many Lawyers Seek Appointment System,” Las Vegas Review Journal May 14.Google Scholar
Missouri Bar Judicial Evaluation Survey Committee (2007) “Report of the Judicial Evaluation Survey Committee.” Jefferson City, MO: The Missouri Bar.Google Scholar
Nieva, Veronica F., & Gutek, Barbara A. (1980) “Sex Effects on Evaluation,” 5 Academy of Management Rev. 267–76.CrossRefGoogle Scholar
O'Connor, Sandra Day (2009) “Judicial Independence and Civic Education,” 22 Utah Bar J. 10–19.Google Scholar
Pelander, A. John (1998) “Judicial Performance Review in Arizona: Goals, Practical Effects and Concerns,” 30 Arizona State Law J. 643.Google Scholar
Posner, Richard A. (2000) “Is the Ninth Circuit Too Large? A Statistical Study of Judicial Quality,” 29 The J. of Legal Studies 711–19.CrossRefGoogle Scholar
Posner, Richard A. (2005) “Judicial Behavior and Performance: An Economic Approach,” 32 Florida State Univ. Law Rev. 1259–79.Google Scholar
Rachlinski, Jeffrey J., et al. (2008) “Does Unconscious Racial Bias Affect Trial Judges?,” 84 Notre Dame Law Rev. 1195–246.Google Scholar
Rottman, David B. (2004) “Trends and Issues in the State Courts: Challenges and Achievements,” in The Book of the States: 2004. Lexington, KY: Council of State Governments.Google Scholar
Sackett, Paul R., et al. (1991) “Tokenism in Performance Evaluation: The Effects of Work Group Representation on Male-Female and White-Black Differences in Performance Ratings,” 76 J. of Applied Psychology 263–7.CrossRefGoogle Scholar
Schaeffer, Nora Cate, & Presser, Stanley (2003) “The Science of Asking Questions,” 29 Annual Rev. of Sociology 65–88.CrossRefGoogle Scholar
Schafran, Lynn Hecht, & Wikler, Norma J. (2001) “Gender Fairness in the Courts: Action in the New Millennium.” Washington, DC: National Judicial Education Program, NOW Legal Defense and Education Fund.Google Scholar
Slotnick, Elliot E. (1983) “The ABA Standing Committee on Federal Judiciary: A Contemporary Assessment–Part 1,” 66 Judicature 349–62.Google Scholar
Sprague, Joey, & Massoni, Kelley (2005) “Student Evaluations and Gendered Expectations: What We Can't Count Can Hurt Us,” 53 Sex Roles 779–93.CrossRefGoogle Scholar
Standing Committee on Judicial Independence (2000) “Standards on State Judicial Selection: Report of the Commission on State Judicial Selection Standards.” Chicago, IL: American Bar Association.Google Scholar
Steinpreis, Rhea E., Anders, Katie A., & Ritzke, Dawn (1999) “The Impact of Gender on the Review of the Curricula Vitae of Job Applicants,” 41 Sex Roles 509–28.CrossRefGoogle Scholar
Sternlight, Jean (1996) “Symbiotic Legal Theory and Legal Practice: Advocating a Common Sense Jurisprudence of Law and Practical Applications,” 50 Univ. of Miami Law Rev. 707–78.Google Scholar
Thomas, Rebecca M., et al. (2009) “Nevada Judicial Evaluation Pilot Project: Final Report.” Reno, NV: Grant Sawyer Center for Justice Studies.Google Scholar
Titus, Ronald R., et al. (2009) “Annual Report of the Nevada Judiciary, Fiscal Year 2009,” Carson City, NV: Administrative Office of the Courts.Google Scholar
Valian, Virginia (1998) Why So Slow? The Advancement of Women. Boston, MA: MIT Press.Google Scholar
Walker, Thomas G., & Barrow, Deborah J. (1985) “The Diversification of the Federal Bench: Policy and Process Ramifications,” 47 Journal of Politics 596–617.CrossRefGoogle Scholar
Whitely, Joan (2006) “Judging the Judges: About the Survey,” Las Vegas Review-Journal Apr. 30.Google Scholar

Cases Cited

Caperton v. A. T. Massey Coal Co., Inc. (2009) 556 U.S. ___.Google Scholar
Price Waterhouse v. Hopkins (1989) 490 U.S. 288.Google Scholar