Law as Data pp. 83–115
DOI: 10.37911/9781947864085.05
5. Style and Substance on the US Supreme Court
Authors: Keith Carlson, Dartmouth College; Daniel N. Rockmore, Dartmouth College; Allen Riddell, Indiana University Bloomington; Jon Ashley, University of Virginia; and Michael A. Livermore, University of Virginia
Excerpt
The United States Supreme Court is a singular institution within the American judiciary. It has many unique institutional features, such as the ability to select the cases that it will decide, and it plays a unique role in American political and social life. However, while as an institution the Supreme Court is distinctive, it remains recognizably a court of law. The Supreme Court shares certain rituals with other US judicial institutions, such as the black robe and gavel. It also shares many procedures with other courts, including adversarial hearings and restrictions on ex-parte contacts. Perhaps most important is that its mode of decision-making is through case-by-case adjudication, typically in the course of hearing an appeal from a lower court decision. As such, when the court creates, amends, or clarifies legal obligations, it does so not through directly stated rules (as in a statute or regulation) but through the justificatory documents that accompany a disposition in a particular case, largely embodied in the written opinions of the court and its justices.
The judicial opinions of the US Supreme Court serve as among the most important pieces of “data” in understanding the evolution of legal thought and sociopolitical dynamics in the United States. The judicial opinions issued by the Supreme Court have provided legal scholars (and others) with fodder for analysis since the dawn of the American legal academy. Recent advances in natural language processing and computational text analysis provide new ways to examine and understand the work of the court. In this chapter, we will discuss our research using these kinds of tools on two sets of questions concerning the court that are particularly well suited to such analysis. First, we examine trends in writing style on the court through sentiment analysis and a form of stylometry based on the frequency of function words in a text. Second, we examine whether the Supreme Court has begun to carve out a unique judicial genre by examining how the content of Supreme Court opinions differs from the federal appellate courts that it supervises.
Why Study Style?
Judges, lawyers, legal academics, and law students have frequently turned their attention to noncontent, stylistic features of legal writing. For example, legal writing courses at American law schools evidence a desire to teach students appropriate writing style, in addition to facilitating a mastery of legal content (Romantz 2003). Practicing lawyers are often called on to persuade through the written word, and stylistic features of a text can contribute to (or detract from) its persuasive force. Guides on legal writing, geared toward law students and practicing attorneys, often pay substantial attention to noncontent textual characteristics (Garner 2013). A host of stylistic conventions distinguish legal writing from standard written English, and a lawyer’s competence is judged, in part, by the degree to which his or her individual stylistic voice conforms to this particular “professional discourse community” (McArdle 2006, 501).
Bibliography
Black, R. C., R. J. Owens, J. Wedeking, and P. C. Wohlfarth. 2016. US Supreme Court Opinions and Their Audiences. Cambridge, UK: Cambridge University Press.
Black, Ryan C., and James F. Spriggs II. 2008. “An Empirical Analysis of the Length of US Supreme Court Opinions.” Houston Law Review 45 (3): 622–682.
Blei, D. M. 2012. “Probabilistic Topic Models.” Communications of the ACM 55 (4): 77–84.
Caldeira, G. A., and J. L. Gibson. 1992. “The Etiology of Public Support for the Supreme Court.” American Journal of Political Science 36 (3): 635–664.
Caldeira, G. A., J. R. Wright, and C. J. W. Zorn. 1999. “Sophisticated Voting and Gate-Keeping in the Supreme Court.” Journal of Law, Economics & Organization 15 (3): 549–572.
Carlson, K., M. A. Livermore, and D. Rockmore. 2016. “A Quantitative Analysis of Writing Style on the US Supreme Court.” Washington University Law Review 93 (6): 1461–1510.
Choi, S. J., and G. M. Gulati. 2005. “Which Judges Write Their Opinions (And Should We Care?)” Florida State University Law Review 32 (4): 1077–1122.
Chow, G. C. 1960. “Tests of Equality Between Sets of Coefficients in Two Linear Regressions.” Econometrica 28 (3): 591–605.
Easton, D. 1965. A Systems Analysis Of Political Life. London, UK: John Wiley & Sons Ltd.
Ferguson, R. A. 1990. “The Judicial Opinion as Literary Genre.” Yale Journal of Law & Humanities 2 (1): 201–219.
Garner, B. A. 2013. Legal Writing in Plain English: A Text with Exercises. Chicago, IL: University of Chicago Press.
Gibson, J. L., and G. A. Caldeira. 2009. Citizens, Courts, and Confirmations. Princeton, NJ: Princeton University Press.
Gibson, J. L., G. A. Caldeira, and L. K. Spence. 2003. “Measuring Attitudes toward the United States Supreme Court.” American Journal of Political Science 47 (2): 354–367.
Gibson, J. L., M. Lodge, and B. Woodson. 2014. “Losing, but Accepting: Legitimacy, Positivity Theory, and the Symbols of Judicial Authority.” Law & Society Review 48 (4): 837–866.
Gibson, J. L., and M. J. Nelson. 2014. “The Legitimacy of the US Supreme Court: Conventional Wisdoms and Recent Challenges Thereto.” Annual Review of Law & Social Science 10 (1): 201–219.
Hansen, B. E. 2001. “The New Econometrics of Structural Change: Dating Breaks in US Labor Productivity.” Journal of Economic Perspectives 15 (4): 117–128.
Hughes, J. M., N. J. Foti, D. C. Krakauer, and D. N. Rockmore. 2012. “Quantitative Patterns of Stylistic Influence in the Evolution of Literature.” Proceedings of the National Academy of Sciences 109 (20): 7682–7686.
Johnson, S. M. 2014. “The Changing Discourse of the Supreme Court.” New Hampshire Law Review 12 (1): 29–68.
Little, L. E. 1998. “Hiding with Words: Obfuscation, Avoidance, and Federal Jurisdiction Opinions.” UCLA Law Review 46 (1): 75–112.
Livermore, M. A., A. Riddell, and D. Rockmore. 2017. “The Supreme Court and the Judicial Genre.” Arizona Law Review 59 (4): 837–901.
Long, L. N., and W. F. Christensen. 2013. “When Justices (Subconsciously) Attack: The Theory of Argumentative Threat and the Supreme Court.” Oregon Law Review 91 (3): 933–960.
McArdle, A. 2006. “Teaching Writing in Clinical, Lawyering, and Legal Writing Courses: Negotiating Professional and Personal Voice.” Clinical Law Review 12 (2): 501–539.
Mosteller, F., and D. L. Wallace. 1963. “Inference in an Authorship Problem: A Comparative Study of Discrimination Methods Applied to the Authorship of the Disputed Federalist Papers.” Journal of the American Statistical Association 58 (302): 275–309.
Owens, R. J., and J. P. Wedeking. 2011. “Justices and Legal Clarity: Analyzing the Complexity of US Supreme Court Opinions.” Law & Society Review 45 (4): 1027–1061.
Peppers, T. C. 2006. Courtiers Of The Marble Palace: The Rise And Influence Of The Supreme Court Law Clerk. Palo Alto, CA: Stanford Law & Politics.
Peppers, T. C., and C. Zorn. 2008. “Law Clerk Influence on Supreme Court Decision Making: An Empirical Assessment.” Depaul Law Review 58 (1): 51–78.
Perron, P. 2006. “Dealing with Structural Breaks.” In Palgrave Handbook of Econometrics: Econometric Theory, edited by T. C. Mills and K. Patterson, 278–352.
Posner, R. A. 1995. “Judges’ Writing Styles (And Do They Matter?)” University of Chicago Law Review 62 (4): 1421–1449.
Quinn, K. M., B. L. Monroe, M. Colaresi, M. H. Crespin, and D. R. Radev. 2010. “How to Analyze Political Attention with Minimal Assumptions and Costs.” American Journal of Political Science 54 (1): 209–228.
Riddell, A. 2014. “How to Read 22,198 Journal Articles: Studying the History of German Studies with Topic Models.” In Distant Readings: Topologies of German Culture in the Long Nineteenth Century, edited by M. Erlin and L. Tatlock, 91–114. Rochester, NY: Camden House.
Romantz, D. S. 2003. “The Truth About Cats and Dogs: Legal Writing Courses and the Law School Curriculum.” University of Kansas Law Review 52 (1): 105–146.
Rosenthal, J. S., and A. H. Yoon. 2011. “Detecting Multiple Authorship of United States Supreme Court Legal Decisions Using Function Words.” Annals of Applied Statistics 5 (1): 283–308.
Scheb, J. M., and W. Lyons. 2000. “The Myth of Legality and Public Evaluation of the Supreme Court.” Social Science Quarterly 81 (4): 928–940.
Sulam, I. 2014. Editor in Chief: Opinion Authorship and Clerk Influence on the Supreme Court. Unpublished manuscript.
Tanenhaus, J., M. Schick, M. Muraskin, and D. Rosen. 1963. “The Supreme Court’s Certiorari Jurisdiction: Cue Theory.” In Judicial Decision-Making, edited by G. Schubert, 113–115. Glencoe, IL: Free Press.
Wahlbeck, P. J., J. F. Spriggs II, and L. Sigelman. 2002. “Ghostwriters on the Court? A Stylistic Analysis of US Supreme Court Opinion Drafts.” American Politics Research 30 (2): 166–192.
Yates, J., D. M. Cann, and B. D. Boyea. 2013. “Judicial Ideology and the Selection of Disputes for US Supreme Court Adjudication.” Journal of Empirical Legal Study 10 (4): 847–865.