Education Commons^™

The Unreasonable Effectiveness Of Large Language Models In Zero-Shot Semantic Annotation Of Legal Texts, Jaromir Savelka, Kevin D. Ashley

Articles

The emergence of ChatGPT has sensitized the general public, including the legal profession, to large language models' (LLMs) potential uses (e.g., document drafting, question answering, and summarization). Although recent studies have shown how well the technology performs in diverse semantic annotation tasks focused on legal texts, an influx of newer, more capable (GPT-4) or cost-effective (GPT-3.5-turbo) models requires another analysis. This paper addresses recent developments in the ability of LLMs to semantically annotate legal texts in zero-shot learning settings. Given the transition to mature generative AI systems, we examine the performance of GPT-4 and GPT-3.5-turbo(-16k), comparing it to the previous …

Collaborative Constructions: Designing High School History Curriculum With The Lost & Found Game Series, Owen Gottlieb, Shawn Clybor

Articles

This chapter addresses design research and iterative curriculum design for the Lost & Found games series. The Lost & Found card-to-mobile series is set in Fustat (Old Cairo) in the twelfth century and focuses on religious laws of the period. The first two games focus on Moses Maimonides’ Mishneh Torah, a key Jewish law code. A new expansion module which was in development at the time of the fieldwork described in this article that introduces Islamic laws of the period, and a mobile prototype of the initial strategy game has been developed with support National Endowment for the Humanities. The …

An Ethical Discussion About The Responsibility For Protection Of Minors In The Digital Environment: A State-Of-The-Art Review, Charles Alves De Castro, Aiden Carthy, Isobel Oreilly Dr

Articles

Many ethical questions have been raised regarding the use of social media and the internet, mainly related to the protection of young people in the digital environment. In order to critically address the research question "who is responsible for ethically protecting minors in the digital environment?", this paper will review the main literature available to understand the role of parents, the government, and companies in protecting young people within the digital environment. We employed a holistic process that covers a state-of-the-art review and desk research. The article is divided into four sessions; (1) Government Policies from the European Union (EU) …

Calls For Change: Seeing Cancel Culture From A Multi-Level Perspective, Tomar Pierson-Brown

Articles

Transition Design offers a framework and employs an array of tools to engage with complexity. “Cancel culture” is a complex phenomenon that presents an opportunity for administrators in higher education to draw from the Transition Design approach in framing and responding to this trend. Faculty accused of or caught using racist, sexist, or homophobic speech are increasingly met with calls to lose their positions, titles, or other professional opportunities. Such calls for cancellation arise from discreet social networks organized around an identified lack of accountability for social transgressions carried out in the professional school environment. Much of the existing discourse …

Playing At The Crossroads Of Religion And Law: Historical Milieu, Context And Curriculum Hooks In Lost & Found, Owen Gottlieb

Articles

This chapter presents the use of Lost & Found – a purpose-built tabletop to mobile game series – to teach medieval religious legal systems. The series aims to broaden the discourse around religious legal systems and to counter popular depiction of these systems which often promote prejudice and misnomers. A central element is the importance of contextualizing religion in period and locale. The Lost & Found series uses period accurate depictions of material culture to set the stage for play around relevant topics – specifically how the law promoted collaboration and sustainable governance practices in Fustat (Old Cairo) in twelfth-century …

Acts Of Meaning, Resource Diagrams, And Essential Learning Behaviors: The Design Evolution Of Lost & Found, Owen Gottlieb, Ian Schreiber

Articles

Lost & Found is a tabletop-to-mobile game series designed for teaching medieval religious legal systems. The long-term goals of the project are to change the discourse around religious laws, such as foregrounding the prosocial aspects of religious law such as collaboration, cooperation, and communal sustainability. This design case focuses on the evolution of the design of the mechanics and core systems in the first two tabletop games in the series, informed by over three and a half years’ worth of design notes, playable prototypes, outside design consultations, internal design reviews, playtests, and interviews.

Exploring Diversity With A "Culture Box" In First-Year Legal Writing, Ann N. Sinsheimer

Articles

Studying law is in many ways like studying another culture. Students often feel as though they are learning a new language with unfamiliar vocabulary and different styles of communication. Throughout their legal education, students are also exposed to a profession comprised of unique traditions and expectations. As a result, learning law takes time and energy. It can be both engaging and frustrating and may even challenge some of students’ values and belief systems. To ease her students’ transition to law school, the author starts her course each year with a “culture box” exercise, which encourages students to examine who they …

Automatically Extracting Meaning From Legal Texts: Opportunities And Challenges, Kevin D. Ashley

Articles

This paper examines impressive new applications of legal text analytics in automated contract review, litigation support, conceptual legal information retrieval, and legal question answering against the backdrop of some pressing technological constraints. First, artificial intelligence (Al) programs cannot read legal texts like lawyers can. Using statistical methods, Al can only extract some semantic information from legal texts. For example, it can use the extracted meanings to improve retrieval and ranking, but it cannot yet extract legal rules in logical form from statutory texts. Second, machine learning (ML) may yield answers, but it cannot explain its answers to legal questions or …

Using Ai To Analyze Patent Claim Indefiniteness, Dean Alderucci, Kevin D. Ashley

Articles

In this Article, we describe how to use artificial intelligence (AI) techniques to partially automate a type of legal analysis, determining whether a patent claim satisfies the definiteness requirement. Although fully automating such a high-level cognitive task is well beyond state-of-the-art AI, we show that AI can nevertheless assist the decision maker in making this determination. Specifically, the use of custom AI technology can aid the decision maker by (1) mining patent text to rapidly bring relevant information to the decision maker attention, and (2) suggesting simple inferences that can be drawn from that information.

We begin by summarizing the …

Finding Lost & Found: Designer’S Notes From The Process Of Creating A Jewish Game For Learning, Owen Gottlieb

Articles

This article provides context for and examines aspects of the design process of a game for learning. Lost & Found (2017a, 2017b) is a tabletop-to-mobile game series designed to teach medieval religious legal systems, beginning with Moses Maimonides’ Mishneh Torah (1180), a cornerstone work of Jewish legal rabbinic literature. Through design narratives, the article demonstrates the complex design decisions faced by the team as they balance the needs of player engagement with learning goals. In the process the designers confront challenges in developing winstates and in working with complex resource management. The article provides insight into the pathways the team …

Syllable Circles For Pronunciation Learning And Teaching, Charlie Cullen, Keith Gardiner, John B. Whipple

Articles

Syllable Circles is an interactive visualization representing prominence as a feature in short phrases or multi-syllable words. They were designed for Computer Aided Pronunciation Teaching as a part of English Language Teaching. This study explores the question of if and how interactive visualizations can affect English Language Learners’ awareness of prominence, or stress, in English pronunciation. The study followed seven learners and three teachers. Think-aloud protocols, notes from direct observation and interviews of two groups allowed for six streams of data. It was found that interactive visualizations of syllable circles facilitate noticing prominence. Learners and teachers believed interactive visualizations were …

Teaching Law And Digital Age Legal Practice With An Ai And Law Seminar: Justice, Lawyering And Legal Education In The Digital Age, Kevin D. Ashley

Articles

A seminar on Artificial Intelligence ("Al") and Law can teach law students lessons about legal reasoning and legal practice in the digital age. Al and Law is a subfield of Al/computer science research that focuses on designing computer programs—computational models—that perform legal reasoning. These computational models are used in building tools to assist in legal practice and pedagogy and in studying legal reasoning in order to contribute to cognitive science and jurisprudence. Today, subject to a number of qualifications, computer programs can reason with legal rules, apply legal precedents, and even argue like a legal advocate.

This article provides a …

Computer-Supported Peer Review In A Law School Context, Kevin D. Ashley, Ilya Goldin

Articles

Legal instructors have been urged to incorporate peer reviewing into law school courses as a way to provide students much needed feedback. Peer review can benefit legal education, but only if law school instructors adopt peer review on a large scale, and for that, computer-supported peer review systems are crucial. These web-based systems orchestrate the mechanics of students submitting written assignments on-line and distributing them to other students for anonymous review, making it considerably easier for instructors to manage.

Beyond the problem of orchestrating mechanics, however, a deeper obstacle to widespread acceptance of peer review in legal education is the …

The Discourses Of Higher Education In Ireland: Religion, Nationalism And Economic Development, Nora French

Articles

Higher education is shaped and changed by the context in which it operates. For the past several decades, it has been shaped in Ireland by plans for economic development and the focus has been on education as an enabler of wealth creation. It is claimed to have been an important factor in the rise of the Celtic Tiger economy, and the government are again looking to education as a main contributor to recovery from the current recession. This focus marked a major change in Irish higher education. It was in sharp opposition to the deep-seated tradition of liberal education based …

Technology-Aided Participative Methods In Environmental Assessment: An International Perspective, Ainhoa Gonzalez, Alan Gilmer, Ronan Foley, John Sweeney, John Fry

Articles

Provisions for citizen involvement in the assessment of potential environmental effects of certain plans, programmes and projects are present in current legislation. An international survey revealed that public participation is common practice in European and some other countries worldwide. However, a number of issues are observed to affect public involvement in EIA/SEA processes and expert opinion differs when evaluating the effectiveness of existing participative methods. Results suggest that technology-aided methods can improve traditional participation processes. In particular, GIS has the potential to increase community knowledge and enhance involvement by communicating information more effectively. Variable accessibility to technology and data quality …

Computer Models For Legal Prediction, Kevin D. Ashley, Stephanie Bruninghaus

Articles

Computerized algorithms for predicting the outcomes of legal problems can extract and present information from particular databases of cases to guide the legal analysis of new problems. They can have practical value despite the limitations that make reliance on predictions risky for other real-world purposes such as estimating settlement values. An algorithm's ability to generate reasonable legal arguments also is important. In this article, computerized prediction algorithms are compared not only in terms of accuracy, but also in terms of their ability to explain predictions and to integrate predictions and arguments. Our approach, the Issue-Based Prediction algorithm, is a program …

The Role Of Foreign Languages In Educating Lawyers For Transnational Challenges, Vivian Grosswald Curran

Articles

In a world in which every other country seems intent on teaching English to their youth, and in which the United States educational system does not place a high priority on teaching foreign languages, the American law student, dean and professor may doubt if foreign language knowledge is anything more than marginally helpful to law graduates. Similarly, educators at the primary school level may not be likely to assess foreign language education as warranting a greater allocation of scarce public resources.

The usefulness of foreign languages to the United States lawyer gradually has been gaining increased recognition in the profession, …

Capturing The Dialectic Between Principles And Cases, Kevin D. Ashley

Articles

Theorists in ethics and law posit a dialectical relationship between principles and cases; abstract principles both inform and are informed by the decisions of specific cases. Until recently, however, it has not been possible to investigate or confirm this relationship empirically. This work involves a systematic study of a set of ethics cases written by a professional association's board of ethical review. Like judges, the board explains its decisions in opinions. It applies normative standards, namely principles from a code of ethics, and cites past cases. We hypothesized that the board's explanations of its decisions elaborated upon the meaning and …

Designing Electronic Casebooks That Talk Back: The Cato Program, Kevin D. Ashley

Articles

Electronic casebooks offer important benefits of flexibility in control of presentation, connectivity, and interactivity. These additional degrees of freedom, however, also threaten to overwhelm students. If casebook authors and instructors are to achieve their pedagogical goals, they will need new methods for guiding students. This paper presents three such methods developed in an intelligent tutoring environment for engaging students in legal role-playing, making abstract concepts explicit and manipulable, and supporting pedagogical dialogues. This environment is built around a program known as CATO, which employs artificial intelligence techniques to teach first-year law students how to make basic legal arguments with cases. …