Legal Profession Commons^™

The Unreasonable Effectiveness Of Large Language Models In Zero-Shot Semantic Annotation Of Legal Texts, Jaromir Savelka, Kevin D. Ashley

Articles

The emergence of ChatGPT has sensitized the general public, including the legal profession, to large language models' (LLMs) potential uses (e.g., document drafting, question answering, and summarization). Although recent studies have shown how well the technology performs in diverse semantic annotation tasks focused on legal texts, an influx of newer, more capable (GPT-4) or cost-effective (GPT-3.5-turbo) models requires another analysis. This paper addresses recent developments in the ability of LLMs to semantically annotate legal texts in zero-shot learning settings. Given the transition to mature generative AI systems, we examine the performance of GPT-4 and GPT-3.5-turbo(-16k), comparing it to the previous …

Survey Says--How To Engage Law Students In The Online Learning Environment, Andrele Brutus St. Val

Articles

The pandemic experience has made it clear that not everyone loves teaching or learning remotely. Many professors and students alike are eager to return to the classroom. However, our experiences over the last year and a half have also demonstrated the potentials and possibilities of learning online and have caused many professors to recalibrate their approaches to digital learning. While the tools for online learning were available well before March of 2020, many instructors are only now beginning to capitalize on their potential. The author of this article worked in online legal education before the pandemic, utilizing these tools and …

Distance Legal Education: Lessons From The *Virtual* Classroom, Jacqueline D. Lipton

Articles

Abstract

In the 2018-2019 revision of the American Bar Association (ABA) Standards and Rules of Procedure for Approval of Law Schools, the ABA further relaxed the requirements relating to distance education in J.D. programs. However, outside of a handful of schools that have received permission to teach J.D. courses almost entirely online, most experiments in distance legal education have occurred in post-graduate (i.e. post-J.D.) programs: LL.M. degrees, and various graduate certificates and Master’s degrees in law-related subjects. These programs can be taught completely online without requiring special ABA permission.

This essay reflects on the author’s experiences over a number of …

Automatically Extracting Meaning From Legal Texts: Opportunities And Challenges, Kevin D. Ashley

Articles

This paper examines impressive new applications of legal text analytics in automated contract review, litigation support, conceptual legal information retrieval, and legal question answering against the backdrop of some pressing technological constraints. First, artificial intelligence (Al) programs cannot read legal texts like lawyers can. Using statistical methods, Al can only extract some semantic information from legal texts. For example, it can use the extracted meanings to improve retrieval and ranking, but it cannot yet extract legal rules in logical form from statutory texts. Second, machine learning (ML) may yield answers, but it cannot explain its answers to legal questions or …

Using Ai To Analyze Patent Claim Indefiniteness, Dean Alderucci, Kevin D. Ashley

Articles

In this Article, we describe how to use artificial intelligence (AI) techniques to partially automate a type of legal analysis, determining whether a patent claim satisfies the definiteness requirement. Although fully automating such a high-level cognitive task is well beyond state-of-the-art AI, we show that AI can nevertheless assist the decision maker in making this determination. Specifically, the use of custom AI technology can aid the decision maker by (1) mining patent text to rapidly bring relevant information to the decision maker attention, and (2) suggesting simple inferences that can be drawn from that information.

We begin by summarizing the …

Tenure Redux, Jacqueline D. Lipton

Articles

This essay is a reflection on some of the questions that arose during the author's tenure process that are likely pertinent to others on the tenure track today particularly with respect to questions about writing style in tenure pieces, and on whether early scholars should focus on general law reviews or specialty journals--depending on their areas of expertise--or a combination of both. It also reflects on choice of subject matter for tenure work, and whether some of that work may or may not stand the test of time, as well as on differences between the U.S. legal scholarship process and …

Lawyers At Work: A Study Of The Reading, Writing, And Communication Practices Of Legal Professionals, Ann N. Sinsheimer, David J. Herring

Articles

This paper reports the results of a three-year ethnographic study of attorneys in the workplace. The authors applied ethnographic methods to identify how junior associates in law firm settings engaged in reading and writing tasks in their daily practice. The authors were able to identify the types of texts junior associates encountered in the workplace and to isolate the strategies these attorneys used to read and compose texts.

The findings suggest that lawyering is fundamentally about reading. The attorneys observed for this study read constantly, encountering a large variety of texts and engaging in many styles of reading, including close …

Teaching Law And Digital Age Legal Practice With An Ai And Law Seminar: Justice, Lawyering And Legal Education In The Digital Age, Kevin D. Ashley

Articles

A seminar on Artificial Intelligence ("Al") and Law can teach law students lessons about legal reasoning and legal practice in the digital age. Al and Law is a subfield of Al/computer science research that focuses on designing computer programs—computational models—that perform legal reasoning. These computational models are used in building tools to assist in legal practice and pedagogy and in studying legal reasoning in order to contribute to cognitive science and jurisprudence. Today, subject to a number of qualifications, computer programs can reason with legal rules, apply legal precedents, and even argue like a legal advocate.

This article provides a …

Learning By Doing: An Experience With Outcomes Assessment, Mary Crossley, Lu-In Wang

Articles

An emphasis on assessment and outcomes measures is a drum beat that is growing louder in American legal education. Prompted initially by the demands of regional university accreditation bodies, the attention paid to outcomes assessment is now growing with the forecast that the ABA will revise its accreditation standards to incorporate outcomes measures. For the past three years, the University of Pittsburgh School of Law has been developing a system for assessing the learning outcomes of its students. By describing our experience here at Pitt Law, with both its high and low points, we hope to suggest some helpful pointers …

The Technology Of Law, Bernard J. Hibbitts

Articles

This paper argues that contemporary fascination with the law of technology (IP, cyberlaw, etc.) has led us to overlook the fundamental impact of the "technology of law," and offers suggestions for creating "neterate" lawyers more comfortable with and cognizant of technology itself. The author describes how the legal news service JURIST implements many of these suggestions and provides a unique learning experience for its law student staffers.

Writing To Learn Law And Writing In Law: An Intellectual Property Illustration, Michael J. Madison

Articles

This essay, prepared as part of a Symposium on teaching intellectual property law, describes a method of combining substantive law teaching with a species of what is commonly called "skills" training. The method involves assessing students not via traditional final exams but instead via research memos patterned after assignments that junior lawyers might encounter in actual legal practice. The essay grounds the method in the theoretical disposition known generally as "writing to learn." It argues that students are likely to learn intellectual property law effectively if they learn to practice as intellectual property lawyers, and specifically to write as intellectual …

Legal Scholarship, Humility, And The Scientific Method, David J. Herring

Articles

This essay responds to the question of What next for law and behavioral biology? by describing an approach to legal scholarship that relies on the scientific method. There are two steps involved in this approach to legal scholarship. First, the legal scholar must become familiar with an area of scientific research that is relevant to the development of law and policy. (This essay uses behavioral biology research as an example.) Second, the legal scholar must seek and form relationships across disciplines, becoming an active member of a scientific research team that conducts studies relevant to particular issues of law and …

Computer Models For Legal Prediction, Kevin D. Ashley, Stephanie Bruninghaus

Articles

Computerized algorithms for predicting the outcomes of legal problems can extract and present information from particular databases of cases to guide the legal analysis of new problems. They can have practical value despite the limitations that make reliance on predictions risky for other real-world purposes such as estimating settlement values. An algorithm's ability to generate reasonable legal arguments also is important. In this article, computerized prediction algorithms are compared not only in terms of accuracy, but also in terms of their ability to explain predictions and to integrate predictions and arguments. Our approach, the Issue-Based Prediction algorithm, is a program …

Capturing The Dialectic Between Principles And Cases, Kevin D. Ashley

Articles

Theorists in ethics and law posit a dialectical relationship between principles and cases; abstract principles both inform and are informed by the decisions of specific cases. Until recently, however, it has not been possible to investigate or confirm this relationship empirically. This work involves a systematic study of a set of ethics cases written by a professional association's board of ethical review. Like judges, the board explains its decisions in opinions. It applies normative standards, namely principles from a code of ethics, and cites past cases. We hypothesized that the board's explanations of its decisions elaborated upon the meaning and …

The Lawyer As Legal Scholar, Michael J. Madison

Articles

I review Eugene Volokh's recent book, Academic Legal Writing. The book is nominally directed to law students and those who teach them (and for those audiences, it is outstanding), but it also contains a number of valuable lessons for published scholars. The book is more than a writing manual, however. I argue that Professor Volokh suggests implicitly that scholarship is underappreciated as a dimension of the legal profession. A well-trained lawyer, in other words, should have experience as a scholar. The argument sheds new light on ongoing discussions about the character of law schools.

Designing Electronic Casebooks That Talk Back: The Cato Program, Kevin D. Ashley

Articles

Electronic casebooks offer important benefits of flexibility in control of presentation, connectivity, and interactivity. These additional degrees of freedom, however, also threaten to overwhelm students. If casebook authors and instructors are to achieve their pedagogical goals, they will need new methods for guiding students. This paper presents three such methods developed in an intelligent tutoring environment for engaging students in legal role-playing, making abstract concepts explicit and manipulable, and supporting pedagogical dialogues. This environment is built around a program known as CATO, which employs artificial intelligence techniques to teach first-year law students how to make basic legal arguments with cases. …