Law as Data pp. 117–150
DOI: 10.37911/9781947864085.06
6. Predicting Legislative Floor Action
Authors: Vlad Eidelman, FiscalNote; Anastassia Kornilova, FiscalNote; and Daniel Argyle, FiscalNote
Excerpt
Federal institutions in the United States, such as Congress and the Supreme Court, play a significant role in lawmaking and, in many observable ways, define our legal system. Thus, legal scholarship has been largely focused on understanding these entities and the role they play in our society. As federal legislative and regulatory data have become more readily available, political scientists and legal scholars have become increasingly quantitative, adopting objective data-driven methods for characterizing political and legal behavior and outcomes. Computationally driven analysis has extended into all areas of law, including analyzing the behavior of Supreme Court justices (Katz, Bommarito, and Blackman 2017; Lauderdale and Clark 2014), congressional legislators (Poole and Rosenthal 2007; Slapin and Proksch 2008), and administrative agencies (Livermore, Eidelman, and Grom 2018; Kirilenko, Mankad, and Michailidis 2014). The aim of most of this research is to move away from purely subjective analysis that is limited in its ability to quantitatively measure and empirically explain observable legal phenomena.
Although many issue areas are regulated primarily at the federal level, state governments also wield significant power, and an increasing number of issues are now being decided at the state or local levels, including emerging industries and technologies such as the gig economy and autonomous vehicles (Hedge 1998). In fact, the total quantity of state legislative activity dwarfs that of Congress. There are 535 members of Congress who introduce over ten thousand pieces of legislation a session,1 of which less than 5% is enacted. In contrast, in the aggregate there are over seven thousand state legislators introducing over one hundred thousand pieces of legislation, with over 30% being enacted.
All US state legislatures work according to a committee system in which, for a bill to be enacted, it must pass through one or more legislative committees and then be considered on the chamber floor (which we refer to as “floor action”). The final step is pivotal (Rosenthal 1974; Hamm 1980; Francis 1989; Rakoff and Sarner 1975), and reaching it is not a given: on average only 41% of bills receive floor action, with most legislation languishing in committees.
Bibliography
Bergstra, J. S., R. Bardenet, Y. Bengio, and K. Balázs. 2011. “Algorithms for Hyper-Parameter Optimization.” In Proceedings of the 24th International Conference on Neural Information Processing Systems, 2546–2554. Red Hook, NY: Curran Associates.
Bergstra, J., D. Yamins, and D. D. Cox. 2013. “Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms.” In Proceedings of the 12th Python in Science Conference, 13–20. Austin, TX: SciPy.
Bertrand, M., M. Bombardini, R. Fisman, and F. Trebbi. 2018. “Tax-Exempt Lobbying: Corporate Philanthropy as a Tool for Political Influence.” NBER Working Paper No. 24451, National Bureau of Economic Research, Cambridge, MA. http://www.nber.org/papers/w24451.
Bradley, A. P. 1997. “The Use of the Area Under the ROC Curve in the Evaluation of Machine Learning Algorithms.” Pattern Recognition 30 (7): 1145–1159.
Breiman, L. 1996. “Stacked Regressions.” Machine Learning 24 (1): 49–64.
Canfield-Davis, K., S. Jain, D. Wattam, J. McMurtry, and M. Johnson. 2010. “Factors of Influence on Legislative Decision Making: A Descriptive Study.” Journal of Legal, Ethical & Regulatory Issues 13 (2): 55–68.
Clinton, J., S. Jackman, and D. Rivers. 2004. “The Statistical Analysis of Roll Call Data.” American Political Science Review 98 (2): 355–370.
Cohen, L., K. B. Diether, and C. Malloy. 2012. “Legislating Stock Prices.” NBER Working Paper No. 18291, National Bureau of Economic Research, Cambridge, MA. https://www.nber.org/papers/w18291.
Fowler, J. H. 2006. “Connecting the Congress: A Study of Cosponsorship Networks.” Political Analysis 14 (4): 456–487.
Francis, W. L. 1989. The Legislative Committee Game: A Comparative Analysis of Fifty States. Columbus, OH: Ohio State University Press.
Friedman, J. H. 2000. “Greedy Function Approximation: A Gradient Boosting Machine.” Annals of Statistics 29 (5): 1189–1232.
Gerrish, S., and D. M. Blei. 2011. “Predicting Legislative Roll Calls from Text.” In Proceedings of the 28th International Conference on International Conference on Machine Learning, 489–496. Madison, WI: Omnipress.
Gray, V., and D. Lowery. 1995. “Interest Representation and Democratic Gridlock.” Legislative Studies Quarterly 20 (4): 531–552.
Hamm, K. E. 1980. “US State Legislative Committee Decisions: Similar Results in Different Settings.” Legislative Studies Quarterly 5 (1): 31–54.
Hamm, K., R. Hedlund, and N. M. Miller. 2014. “State Legislatures.” In The Oxford Handbook of State and Local Government, edited by D. Haider-Markel, 293–318. Oxford, UK: Oxford University Press.
Harbridge, Laurel M. 2016. “Book Review: Legislative Effectiveness in the United States Congress: The Lawmakers by Craig Volden and Alan E. Wiseman.” Journal of Politics 78 (1): e3–e4.
Hedge, D. 1998. Governance and the Changing American States. New York, NY: Routledge.
Hicks, W., and D. Smith. 2009. “Do Parties Matter? Explaining Legislative Productivity in the American States.” Presented at The State of the Parties: 2008 and Beyond Conference, October 2009, The Bliss Institute, University of Akron, OH.
Hill, M., W. Kelly, B. Lockhart, and R. Ness. 2013. “Determinants and Effects of Corporate Lobbying.” Financial Management 42 (4): 931–957.
Iyyer, M., P. Enns, J. L. Boyd-Graber, and P. Resnik. 2014. “Political Ideology Detection Using Recursive Neural Networks.” In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 1113–1122. Stroudsburg, PA: Association for Computational Linguistics.
Jurafsky, D., and J. H. Martin. 2000. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. Upper Saddle River, NJ: Prentice Hall.
Katz, D. M., M. J. Bommarito, and J. Blackman. 2017. “A General Approach for Predicting the Behavior of the Supreme Court of the United States.” PLoS ONE 12 (1): e0174698.
Kirilenko, A., S. Mankad, and G. Michailidis. 2014. “Do US Regulators Listen to the Public? Testing the Regulatory Process with the RegRank Algorithm,” 1–2. New York, NY: Association for Computing Machinery.
Kornilova, A., D. Argyle, and V. Eidelman. 2018. “Party Matters: Enhancing Legislative Embeddings with Author Attributes for Vote Prediction.” In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 510–515. Stroudsburg, PA: Association for Computational Linguistics.
Lauderdale, B. E., and T. S. Clark. 2014. “Scaling Politically Meaningful Dimensions Using Texts and Votes.” American Journal of Political Science 58 (3): 754–771.
Linder, F., B. A. Desmarais, M. Burgess, and E. Giraudy. 2018. “Text as Policy: Measuring Policy Similarity Through Bill Text Reuse.” Working paper, Social Science Research Network (SSRN). https://ssrn.com/abstract=2812607.
Livermore, M. A., V. Eidelman, and B. Grom. 2018. “Computationally Assisted Regulatory Participation.” Notre Dame Law Review 93 (3): 977–1034.
Mikolov, T., I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. 2013. “Distributed Representations of Words and Phrases and their Compositionality.” In Advances in Neural Information Processing Systems 26, 3111–3119. Red Hook, NY: Curran Associates.
Nay, J. J. 2017. “Predicting and Understanding Law-Making with Word Vectors and an Ensemble Model.” PLoS ONE 12 (5): e0176999.
Nguyen, V.-A., J. L. Boyd-Graber, P. Resnik, and K. Miler. 2015. “Tea Party in the House: A Hierarchical Ideal Point Topic Model and Its Application to Republican Legislators in the 112th Congress.” In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, 1438–1448. Stroudsburg, PA: Association for Computational Linguistics.
Niculescu-Mizil, A., and R. Caruana. 2005. “Predicting Good Probabilities with Supervised Learning.” In Proceedings of the 22nd International Conference on Machine Learning, 625–632. New York, NY: Association for Computing Machinery.
Pedregosa, F., G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, et al. 2011. “Scikit-learn: Machine Learning in Python.” Journal of Machine Learning Research 12:2825–2830.
Poole, K. T., and H. L. Rosenthal. 1985. “A Spatial Model for Legislative Roll Call Analysis.” American Journal of Political Science 29 (2): 357–384.
———. 2007. Ideology and Congress. New Brunswick, NJ: Transaction Publishers.
Rakoff, S. H., and R. Sarner. 1975. “Bill History Analysis: A Probability Model of the State Legislative Process.” Polity 7 (3): 402–414.
Rosenthal, A. 1974. Legislative Performance in the States: Explorations of Committee Behavior. New York, NY: Free Press.
Shor, B., C. Berry, and N. McCarty. 2010. “A Bridge to Somewhere: Mapping State and Congressional Ideology on a Cross-Institutional Common Space.” Legislative Studies Quarterly 35 (3): 417–448.
Shor, B., and N. McCarty. 2011. “The Ideological Mapping of American Legislatures.” American Political Science Review 105 (3): 530–551.
Slapin, J. B., and S.-O. Proksch. 2008. “A Scaling Model for Estimating Time-Series Party Positions from Texts.” American Journal of Political Science 52 (3): 705–722.
Squire, P. 2007. “Measuring State Legislative Professionalism: The Squire Index Revisited.” State Politics & Policy Quarterly 7 (2): 211–227.
Talbert, J. C., and M. Potoski. 2002. “Setting the Legislative Agenda: The Dimensional Structure of Bill Cosponsoring and Floor Voting.” Journal of Politics 64 (3): 864–891.
Thomas, M., B. Pang, and L. Lee. 2006. “Get out the Vote: Determining Support or Opposition from Congressional Floor-Debate Transcripts.” In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing (EMNLP 2006), 327–335. Stroudsburg, PA: Association for Computational Linguistics.
Wang, S. I., and C. D. Manning. 2012. “Baselines and Bigrams: Simple, Good Sentiment and Topic Classification.” In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, 2:90–94. Stroudsburg, PA: Association for Computational Linguistics.
Yano, T., N. A. Smith, and J. D. Wilkerson. 2012. “Textual Predictors of Bill Survival in Congressional Committees.” In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 793–802. Stroudsburg, PA: Association for Computational Linguistics.