Science and Technology Law Commons^™

There Is No Free Benchmark: An Institutional View Of Legal Ai Benchmarking, Neel Guha, Andy K. Zhang, Christine Tsang, Christopher D. Manning, Julian Nyarko, Daniel E. Ho

Faculty Scholarship

Despite substantial excitement around the use of AI in law, little information exists on the performance and associated risks of the domain’s widely marketed tools. Recent work, for instance, has demonstrated the significant potential for “hallucinations” — wherein models make up facts, law, and precedent — leading Chief Justice Roberts to spotlight this risk in his annual report on the judiciary. We argue that there is a need for public AI benchmarking in law. First, relative to other AI application domains, the legal AI ecosystem lacks legibility — there is little information about the design and performance of many commercial …

The Impact Of Ai Companions On Family Law, Clare Huntington

Faculty Scholarship

People of all ages and backgrounds regularly use AI companions — virtual friends, lovers, and confidantes powered by artificial intelligence. As a new form of relationship, this development poses novel doctrinal and policy questions for family law. As a doctrinal matter, what does child neglect look like when a parent delegates caretaking to an AI companion? How should standards for elder neglect adapt to the widespread use of robotic caregivers? Should lawmakers impose mandatory reporting requirements on therapy bots if children share experiences of abuse or neglect? And can people designate an AI companion as a health care proxy? As …

Ai Suppression: E-Discovery Software And Brady, Jason Hartline, Liren Shan, Alec Sun, Rebecca Wexler

Faculty Scholarship

Prosecutors regularly rely on AI e-discovery software, known as technology assisted review (TAR) tools, to sort and prioritize digital evidence. These tools implicate constitutional concerns: they can either risk suppressing or help to surface exculpatory and impeachment evidence that prosecutors must disclose under the Brady due process rule. Yet doctrine, agency guidance, and scholarship offer virtually no direction on their use.

This Article examines how TAR affects Brady compliance. Using computer science simulations on synthetic data sets, we show that TAR can either hide or help to expose Brady evidence, depending on how it is configured and the configurations of …

How Ai Destroys Institutions, Woodrow Hartzog, Jessica Silbey

Faculty Scholarship

Civic institutions—the rule of law, universities, and a free press—are the backbone of democratic life. They are the mechanisms through which complex societies encourage cooperation and stability, while also adapting to changing circumstances. The real superpower of institutions is their ability to evolve and adapt within a hierarchy of authority and a framework for roles and rules, while maintaining legitimacy for the knowledge produced and the actions taken. Purpose-driven institutions built around transparency, cooperation, and accountability empower individuals to take intellectual risks and challenge the status quo. This happens through the machinations of interpersonal relationships within those institutions, which broaden …

Metrics Not Thresholds: How To Regulate Ai And Other Expert Methods For Use In Criminal Investigations And Proceedings, Rebecca Wexler

Faculty Scholarship

Should regulators set performance thresholds for AI tools used in the criminal legal system? This Article draws on U.S. evidence law for guidance. Its answer is ... don’t. Instead of gatekeeping with ex ante performance thresholds, regulators should require or incentivize metrics of reliability that can be clearly communicated to end-user decisionmakers.

Grading Machines: Can Ai Exam-Grading Replace Law Professors?, Kevin L. Cope, Jen Frankenreiter, Scott Hirst, Eric A. Posner, Daniel Schwarcz, Dane Thorley

Faculty Scholarship

In the past few years, large language models (LLMs) have achieved significant technical advances, such that legal-advocacy organizations are increasingly adopting them as complements to—or substitutes for—lawyers and other human experts. Several studies have examined LLMs' performance in taking law school exams, finding mixed results. Yet there have been no published studies systematically analyzing LLMs' competence at one of law professors' chief responsibilities: grading law school exams. This paper presents results of an analysis of how LLMs perform in evaluating student responses to legal analysis questions of the kind typically administered in law school exams. The underlying data come from …

On Predicting And Stopping Dystopia, Evan Selinger, Woodrow Hartzog

Faculty Scholarship

Is it reasonable to be dystopian about how the future will likely unfold? We think so. For some time, we have been arguing that facial recognition technology is a perfect tool of oppression, and that its pernicious affordances are leading society down a slippery slope toward the evisceration of privacy by obscurity. This is a soft form of “determinism”—the notion that while technology is not an unstoppable force and the future is not preordained, there nevertheless are identifiable factors, such as the invitingness of affordances, human nature, and incentives that drive technology in certain directions and make some social outcomes …

Tokenized Real Estate: The Law And Tech Of Digital Deeds, Christopher K. Odinet, Andrea Tosato

Faculty Scholarship

The advent of blockchain technology has generated bold claims that non-fungible tokens (NFTs) can fundamentally transform real estate. Proponents assert that digital assets can tokenize real property interests: the concept of using digital tokens to represent ownership rights in physical property. Their goal is to allow buyers and sellers to transfer real estate through simple blockchain transactions, thereby eliminating traditional intermediaries, reducing costs, and accelerating deal velocity. This Essay provides the first comprehensive legal analysis examining whether American law actually supports such a direct tokenization of real estate rights.

Our investigation reveals a stark disconnect between technological capability and legal …

The Business Of Ai-Producing Startups: Evidence From A Worldwide Survey, James Bessen, Stephen Michael Impink, Robert Seamans

Faculty Scholarship

We report results from a multi-year, worldwide survey of artificial intelligence (AI)-producing startups to describe the types of technologies, frameworks, data protection, and partnerships nascent firms use to develop their AI products. Analyses of our survey findings also inform how startups gather the resources to commercialize their AI applications in alignment with their entrepreneurial strategies, address competitive barriers, and respond to regulations. These data provide initial evidence of the perceived impact of these products on their customers’ tasks and industries, suggesting that these firms’ AI products not only reduce labor costs but augment human capabilities.

Bankrupt Crypto Organizations, Kara Bruce, Christopher K. Odinet, Andrea Tosato

Faculty Scholarship

This Article provides the first comprehensive analysis of the intersection between decentralized autonomous organizations (DAOs) and American bankruptcy law. DAOs are blockchain-based entities that enable individuals to pursue common goals using decentralized decision-making and automated governance. Since their recent emergence, DAOs have proliferated dramatically—with over 20,000 organizations managing over $20 billion in assets and engaging in activities ranging from investment management to real estate and even attempting to purchase historic copies of the U.S. Constitution. Yet like any other organization, DAOs can fail, creating an urgent need to understand what happens when unstoppable code meets immovable bankruptcy law.

Our investigation …

Transforming Blood Management Systems In Developing Countries Through Technological And Artificial Intelligence-Driven Innovations, Sandeep Bhargava, Shaun Aaron Abram, Srividhya Ragavan

Faculty Scholarship

It is critical to ensure the safe and quality supply of blood among various stakeholders; however, this remains a significant challenge in today’s world, especially in developing countries. These countries face severe problems, including blood shortages, fragmented regulatory frameworks, and inconsistent quality control measures. To tackle these challenges, countries like India are trying to implement the use of artificial intelligence (AI) and its derivative platforms to transform blood collection, testing, storage, and distribution by enabling interoperability, real-time compliance monitoring, automated donor screening, optimized inventory management, and advanced component separation. The article argues that developing countries must adopt both regulatory reform …

Unlocking The Benefits Of Transparent And Reusable Science For Climate Risk Management, Adam B. Pollack, Lisa Auermuller, Casey D. Burleyson, Jentry Campbell, Madison Condon, Courtney Cooper, Matteo Coronese, Sönke Dangendorf, James Doss-Gollin, Prabhat Hegde, Casey Helgeson, Robert E. Kopp, Jan Kwakkel, Corey Lesk, Justin Mankin, Robert E. Nicholas, Jennie Rice, Samantha Roth, Vivek Srikrishnan, Moira Scheeler, Nancy Tuana, Chris Vernon, Mengqi Zhao, Klaus Keller

Faculty Scholarship

People around the world seek climate risk information to guide their decisions. For instance, projections about future flood risk inform where households choose to live, how lenders manage credit risks, and which communities receive federal funding. Yet data limitations and fundamental validation challenges raise important concerns about the reliability of such projections. The principles of transparency and reusability help address these concerns by enabling scrutiny of assumptions and methods, development of foundational data and tools, and consistent application of evaluation standards. While there is ongoing debate about how much transparency commercial climate risk services should provide, many expect noncommercial actors …

Exploit Machina, Andrea Matwyshyn

Faculty Scholarship

Over half a century ago, Hannah Arendt cautioned us to “think what we are doing” when we build new technologies. Engaging with her counsel and a set of historical case studies, this Article frames what it calls exploit machina problems. Exploit machina refers to situations where broken technologies and broken governance combine to irreparably harm the public. In other words, exploit machina involves organizational choices to knowingly leverage technology as part of legally problematic conduct, including various forms of fraud. In the language of data science, exploit machina situations implicate strategic decisions in building and managing artificial intelligence (AI); they …

Beyond Digital Pessimism: How A Focus On Trust Can Enhance Eu Digital Law, Neil Richards, Woodrow Hartzog, Claire Boine, Lea Despotis

Faculty Scholarship

Lawmakers looking to foster technological innovation on the European market are adopting laws they hope will promote consumer trust in digital products. Their strategy can be broken down into three components. First, they aim to empower consumers to choose how much data they want to share with companies through an express consent framework. Second, they seek to avoid harms from digital products through product safety law such as adapting the Product Safety Regulation to digital products or adopting the AI Act. Third, they endeavor to prevent manipulation of consumers through digital means.

In this essay, we argue that while laudable, …

Uncorrected, Janet Freilich, W. Nicholson Price Ii

Faculty Scholarship

In addition to making rules and deciding outcomes, the legal system generates, curates and shares information. When the system gets rules and outcomes wrong, it is obviously a problem, and much effort (and scholarly attention) goes into identifying those mistakes and fixing them. But the system also gets information wrong; a problem mostly overlooked by policymakers and scholars. Those information mistakes matter too: they are prevalent and harmful. We show here that even when the mistakes are widely known and the errors broadly acknowledged, the information very often goes uncorrected. As a result, people make decisions based on bad information …

Against Ai Half Measures, Woodrow Hartzog, Neil Richards, Ryan Durrie, Jordan Francis

Faculty Scholarship

So far, U.S. consumer protection policy for artificial intelligence (AI) accountability has largely consisted of industry-led approaches such as encouraging transparency, mitigating bias, promoting principles of ethics, and empowering people. These approaches are vital, but they are only half measures. To bring AI within the rule of law, lawmakers must start drawing substantive lines.

In this Article, we identify four AI regulatory approaches to consumer, data, and democratic harms as half measures. First, transparency does not produce accountability on its own. Second, while mitigating bias in AI systems is critical, even unbiased systems are a threat to the vulnerable. Third, …

Obscurity And The Fallacy Of No Privacy In Public Information, Woodrow Hartzog

Faculty Scholarship

The main thesis of this chapter is that because there are so many different possible interpretations of ‘public information’, the concept cannot be used to justify data practices and surveillance without first articulating a more precise meaning that recognises what is at stake. By disposing of the myth that there is an objective and dispassionate concept of public information, judges and lawmakers can clear the way for information rules based on overt value choices. In short, if the concept of ‘public’ is going to shape people’s social and legal obligations, its meaning and neutrality should not be assumed.

My argument …

Information Law Pluralism, Hannah Bloch-Wehba

Faculty Scholarship

Information-intensive activities are reshaping political, social, and economic institutions. As they respond to these shifts, legislators and regulators are embracing information as a regulatory device for tech. Far from limiting themselves to public disclosure, consumer notice, and other traditional mechanisms of fostering transparency and information flows, however, legislators are using other, more nuanced tools to incentivize regulated entities to obtain, generate, and share information.

This Article maps the landscape of the emerging information-based regimes for regulating tech and assesses their conceptual and practical implications. It canvasses an extensive set of recently enacted laws regulating the information economy and shows that, …

Equal Justice & Generative Ai, Milan R. Markovic

Faculty Scholarship

The United States has long suffered from unequal access to justice, with countless low-and middle-income Americans forced to navigate the legal system alone. Recently, prominent judges, lawyers, and scholars have seized on generative AI as a potential corrective. These techno-optimists maintain that ChatGPT and other large language models can demystify the law and address unmet legal needs. Chief Justice John Roberts has proclaimed that AI-based tools "have the welcome potential to smooth out any mismatch between available resources and urgent needs in our court system."

Although AI will be an increasingly important source of legal assistance for underserved populations, the …

Copyright, Incentives, And Popular Music Composition, Glynn S. Lunney Jr.

Faculty Scholarship

The rise of file sharing and the subsequent collapse in sales of recorded music offer a rare glimpse into a counterfactual world where copyright, for a time, was weakened. Comparing creative output before and after this exogenous shock allows us to test empirically whether incentives to copyright owners were correlated with creative output. In this article, I extend previous work on this issue from recording artists to songwriters and search for a correlation between incentives and popular music composition. In particular, I test three hypotheses. First, I test whether more incentives were associated with more or better popular musical compositions. …

Data As Policy, Janet Freilich, W. Nicholson Price Ii

Faculty Scholarship

A large literature on regulation highlights the many different methods of policy-making: command-and-control rulemaking, informational disclosures, tort liability, taxes, and more. But the literature overlooks a powerful method to achieve policy objectives: data. The state can provide (or suppress) data as a regulatory tool to solve policy problems. For administrations with expansive views of government’s purpose, government-provided data can serve as infrastructure for innovation and push innovation in socially desirable directions; for administrations with deregulatory ambitions, suppressing or choosing not to collect data can reduce regulatory power or serve as a back-door mechanism to subvert statutory or common law rules. …

Bridging The Fair Share Gap For Antibacterial Innovation: An Observational Analysis Of Antibacterial Revenues In The G7 And Eu27, Maple Goh, Matt Mcenany, Rachel Freeman, Max Newton, Aaron S. Kesselheim, Kevin Outterson

Faculty Scholarship

Background

Antimicrobial resistance (AMR) poses an important global health challenge, including insufficient investment in research and development. This study quantifies the required “fair share” contributions from the G7+EU27 countries for an effective set of pull incentives for antibacterial research and development.

Methods

Fair share targets within the G7+EU27 were calculated from GDP data and revenue targets from the literature, adjusted for inflation. Cefiderocol and ceftazidime-avibactam were selected as representative of key antibacterials. Revenues and volumes from IQVIA MIDAS data on these drugs were used to assess alignment with fair share targets. The study period was January 2015–December 2024.

Findings

The …

The Gamification Of Banking, Colleen Baker, Christopher K. Odinet

Faculty Scholarship

Gamification is coming to banking. This phenomenon is already gain-ing ground in advertising, healthcare, manufacturing, and, more recently, with the GameStop and AMC meme stock saga in securities trading. The idea behind gamification is to make transactions seem fun, playful, and even casino-like in order to elicit habit-forming, addictive-like effects with consumers. This Article argues that the rise of financial technology (“fintech”) firms and their ever-growing business relationships with incumbent financial institutions has created the necessary conditions for gamification to take hold in the banking sector. In order to explore this observation, we undertake a study of current examples of …

The Sec Proposed Cybersecurity Infrastructure Rules And New Disclosure Requirements, Neal F. Newman, Lawrence J. Trautman, Brian Elzweig

Faculty Scholarship

In addition to regulation of securities market issuers, the Securities & Exchange Commission (SEC) is also responsible for regulation of those entities that provide the networks, either electronic or physical, that enable the functioning of our securities markets. On February 9, 2022, the Commission published a Release for Cybersecurity Risk Management for Investment Advisers, Registered Investment Companies, and Business Development Companies containing proposals that, if adopted, would establish a new cybersecurity incident reporting and disclosure regime and require registered investment advisers (“advisers”) and investment companies (“funds”) to implement policies and procedures designed to address cyber risks. The comment period for …

Traditional And Computational Canons, Eric H. Martinez

Faculty Scholarship

As part of the rise of modern textualism, dictionaries and linguistic canons have become a ubiquitous part of legal interpretation. One longstanding question is whether judges citing these tools sincerely attempt to follow the meaning of a text, or if their invocation is merely window-dressing for a preferred outcome. The practical significance of this question extends across all major doctrinal areas, and with the Supreme Court’s overturning of Chevron deference, its importance is only to grow, as courts are now instructed to use every tool at their disposal to resolve ambiguity when interpreting a law. This Article is the first …

Stakeholder Views On Lessons Learned For The Antimicrobial Resistance Panel From Previous International Science Panels [Version 1], Iruka N. Okeke, Ayodele A. Akinyele, Javier Guzman, Kevin Outterson

Faculty Scholarship

The United Nations General Assembly called in September 2024 for the establishment of an independent panel for actionable evidence against antimicrobial resistance (IPEA). The task of designing the panel was given to the Quadripartite Joint Secretariat (QJS) on Antimicrobial Resistance (AMR) with a delivery timeline of 15 months. To promote stakeholder thought and input around what this panel should look like and how it should work, which could feed into the QJS’s consultation process, we independently commissioned seven papers to examine lessons that could be learned from other high-level scientific panels. We then called a convening of stakeholders that were …

Dark Patterns As Disloyal Design, Johanna Gunawan, Woodrow Hartzog, Neil Richards, David Choffnes, Christo Wilson

Faculty Scholarship

Lawmakers have started to regulate “dark patterns,” understood to be design practices meant to influence technology users’ decisions through manipulative or deceptive means. Most agree that dark patterns are undesirable, but open questions remain as to which design choices should be subjected to scrutiny, much less the best way to regulate them.

In this Article, we propose adapting the concept of dark patterns to better fit legal frameworks. Critics allege that the legal conceptualizations of dark patterns are overbroad, impractical, and counterproductive. We argue that law and policy conceptualizations of dark patterns suffer from three deficiencies: First, dark patterns lack …

The Complex Interplay Between Intellectual Property And The Right To Science, Peter K. Yu

Faculty Scholarship

In April 2020, the U.N. Committee on Economic, Social and Cultural Rights released General Comment No. 25, which provides an authoritative interpretation of the right to science—a right that has hitherto not received much attention. In light of this publication and the recent celebration of the 75th anniversary of the Universal Declaration of Human Rights, this article examines the complex interplay between intellectual property and the right to science, with a view toward the human rights challenges brought about by both the COVID-19 pandemic and the arrival of generative AI.

The article begins by documenting the historical evolution of the …

Ai For Good: Expanding Legal Services For Immigrants, Huyen Pham, Bryan Garcia

Faculty Scholarship

In this Essay, we explore the possibilities for putting AI technology in the hands of clients themselves, considering the advantages and disadvantages. Thinking about the specific context of immigration law, we could envision apps that help individuals to prepare for interviews for affirmative asylum, visas, or naturalization; to educate them about their rights in ways that are more specific, timely, and convenient than current know-your-rights formats; or, in a more attorney-adjacent interaction, using an app to conduct the initial intake interview and organize that information, making the usual time-consuming intake process more efficient and effective. We are not envisioning apps …

How Domestic Institutions Shape The Global Tech War, Anu Bradford, Eileen Li, Matthew C. Waxman

Faculty Scholarship

The United States (U.S.), China, and the European Union (EU) are engaged in a national security-driven economic competition over advanced technology. Many scholars and commentators focus on the external dimension of this geopolitical contest; that is, they describe the strategic choices by each actor in terms of geopolitical realities, threat perceptions, and relative power. However, this Article brings to the fore the internal dimension of the global tech war. We argue that each player’s strategy in the tech war is a function of its internal features, including basic constitutional powers, domestic legal institutions, and the relationships between the government and …