Legal Profession Commons^™

Legalbench: A Collaboratively Built Benchmark For Measuring Legal Reasoning In Large Language Models, Neel Guha, Julian Nyarko, Daniel E. Ho, Christopher Ré, Adam Chilton, Aditya Narayana, Alex Chohlas-Wood, Austin Peters, Brandon Waldon, Daniel Rockmore, Diego A. Zambrano, Dmitry Talisman, Enam Hoque, Faiz Surani, Frank Fagan, Galit Sarfaty, Gregory M. Dickinson, Haggai Porat, Jason Hegland, Jessica Wu, Joe Nudell, Joel Niklaus, John Nay, Jonathan H. Choi, Kevin Tobia, Margaret Hagan, Megan Ma, Michael A. Livermore, Nikon Rasumov-Rahe, Nils Holzenberger, Noam Kolt, Peter Henderson, Sean Rehaag, Sharad Goel, Shang Gao, Spencer Williams, Sunny Gandhi, Tom Zur, Varun Iyer, Zehua Li

All Papers

The advent of large language models (LLMs) and their adoption by the legal community has given rise to the question: what types of legal reasoning can LLMs perform? To enable greater study of this question, we present LegalBench: a collaboratively constructed legal reasoning benchmark consisting of 162 tasks covering six different types of legal reasoning. LegalBench was built through an interdisciplinary process, in which we collected tasks designed and hand-crafted by legal professionals. Because these subject matter experts took a leading role in construction, tasks either measure legal reasoning capabilities that are practically useful, or measure reasoning skills that lawyers …

Ai And Legal Scholarship : Reflections On Evolution And Influences, Jonathon W. Penney

Articles & Book Chapters

Leading Legal Disruption: Artificial Intelligence and a Toolkit for Lawyers and the Law is designed to challenge lawyers with the practical implications that emerging technologies will have on delivering legal services and thinking about legal issues to navigate their digital transformation. By inviting thought leaders across the world and in different disciplines, ranging from privacy, contract law, and torts to governance and policy, this book goes beyond abstract and general philosophical observations on matters that concern practitioners. This practical approach has generated a wide range of global perspectives, which are refreshingly novel and timely for what are increasingly global issues. …

Legal Writing, Therapeutic Jurisprudence, And Professionalism, Shelley Kierstead

Articles & Book Chapters

“Professionalism as a personal characteristic is revealed in an attitude and approach to an occupation that is commonly characterized by intelligence, integrity, maturity, and thoughtfulness.”

“Words are the principal tool of lawyers and judges, whether we like it or not.”

The quotes above refer to two quintessential aspects of lawyers’ work. First, as members of a self-regulated profession, we must aspire to a level of professionalism that is characterized by intelligence, maturity, and thoughtfulness. Second, regardless of the tasks we undertake, words are critically important to lawyers. Not only must we be able to conduct comprehensive and coherent legal analysis; …

That's Just The Way It Is: Langille On Law, Allan C. Hutchinson

Articles & Book Chapters

This article is a defence of the sceptical critique of the legitimacy of law and adjudication. It is a direct reply to the arguments of Professor Brian Langille, whose article "Revolution Without Foundation: The Grammar of Scepticism and Law" appeared in Volume 33 of this Journal. In that article, Langille defended the viability of law, legal discourse and legal critique primarily by attacking the claim that scepticism based on the "indeterminacy of language" can be grounded in the philosophy of Ludwig Wittgenstein. Professor Hutchinson concentrates his spirited response on the indeterminacy of language. He contends that law fails to meet …