Artificial Intelligence and Robotics Commons^™

Regulating Algorithmic Harms, Sylvia Lu

Law & Economics Working Papers

In recent years, the rapid expansion of artificial intelligence (AI) innovations has led to a rise in algorithmic harms—harms emerging from AI operations that pose significant threats to civil rights and democratic values in today’s technological landscape. A facial recognition system for improving criminal detection wrongly collected sensitive personal data and flagged racial minorities as shoplifters. A risk-prediction algorithm adopted to identify patients denied medical treatment to Black individuals with poor health conditions. A social media algorithm intended to boost social engagement exacerbated addictive behavior and mental illness in teenagers. These harms are becoming increasingly ubiquitous yet often manifest in …

An Artificial Intelligence Report Card For Judicial Review, Zoe E. Niesel

Michigan Journal of Environmental & Administrative Law

The rapid advancement of technology, including artificial intelligence (AI), is creating new challenges for judicial review under the Administrative Procedure Act (APA). In late 2023, federal administrative agencies publicly disclosed over 700 use cases of AI that employ sophisticated techniques like machine learning and natural language processing. While the APA's flexible judicial review framework certainly allows agencies to utilize new technologies, the APA also requires explainability of agency decisions; thus, agencies must be able to articulate the reasoning and methodology behind AI-enabled decisions for the purpose of judicial review. This Article examines APA judicial review as it applies to agency …

Liability For Use Of Artificial Intelligence In Medicine, Nicholson W. Price Ii, Sara Gerke, I. Glenn Cohen

Book Chapters

While artificial intelligence (AI) has substantial potential to improve medical practice, errors will certainly occur, sometimes resulting in injury. Who will be liable? Questions of liability for AI-related injury raise not only immediate concerns for potentially liable parties but also broader systemic questions about how AI will be developed and adopted. The landscape of liability is complex, involving healthcare providers and institutions and the developers of AI systems. In this chapter, we consider these three principal loci of liability. At the outset, we note a few issues that shape our analysis.

Confronting Algorithms: Conscience Catching In The Criminal Trial And Beyond, Sherman J. Clark

University of Michigan Journal of Law Reform

Using the question of how to treat algorithmic evidence under the Confrontation Clause as an entry point, I argue that the use of AI in ethically salient situations presents a risk. It may cause us to avoid confronting our own responsibility. This matters because facing up to what we do, including what we delegate, can help us grow and thrive. Bearing responsibility can help us nurture vital capacities, including forms of empathy, honesty, and dignity. In the language of ethics, these are eudaimonist virtues—traits and capacities that can help us live well and fully. We should thus find ways of …

Shutting Out Noise And Understanding Artificial Intelligence, Lauren J. Yu

Michigan Law Review

A review of Noise: A Flaw in Human Judgment. By Daniel Kahneman, Olivier Sibony and Cass R. Sunstein, and You Look Like a Thing and I Love You: How Artificial Intelligence Works and Why It’s Making the World a Weirder Place. By Janelle Shane.

Can Informed Consent Solve Ai Bias?, W. Nicholson Price Ii

Reviews

Artificial intelligence (AI) is moving increasingly rapidly into health care (as indeed into everything else). But it has problems there (as indeed everywhere else!). What’s to be done, in particular, about the deeply embedded biases along racial and other lines that permeate the whole world of health and, as such, are likely to be encoded in AI?

Khiara Bridges gives an answer that seems mild but carries roots of revolution. In Race in the Machine: Racial Disparities in Health and Medical AI, she argues that informed consent is a key lever to pull in fighting these racial disparities. But not …

Impossibility Of Artificial Inventors, Matt Blaszczyk

Fellow, Adjunct, Lecturer, and Research Scholar Works

Recently, the United Kingdom Supreme Court decided that only natural persons can be considered inventors. A year before, the United States Court of Appeals for the Federal Circuit issued a similar decision. In fact, so have many the courts all over the world. This Article analyses these decisions, argues that the courts got it right, and finds that artificial inventorship is at odds with patent law doctrine, theory, and philosophy. The Article challenges the intellectual property (IP) post-humanists, exposing the analytical and normative perils of their argumentation, and recommends against getting rid of the nominally central place of humans in …

Generative Artificial Intelligence: Basic Terminology And Concepts, Kincaid Brown

Law Librarian Scholarship

Generative artificial intelligence (GenAI) has been a hard topic to avoid in the media for more than a year. But what do all of the terms mean and what are areas of concern with GenAI tools?

This column aims to provide a baseline explanation of terminology and concepts that are frequently in the media.

Comment On Chapters 1 And 4: Health Ai, System Performance, And Physicians In The Loop, W. Nicholson Price Ii

Book Chapters

Accounts of artificial intelligence (AI) in medicine must grapple, in one way or another, with the interaction between AI systems and the humans involved in delivering healthcare. Humans are, of course, involved throughout the process of developing , deploying, and evaluating AI systems, but a particular role stands out: the human in the loop of an algorithmic decision. In medicine, when an algorithm is involved in a decision , a typical view of the system envisions a human healthcare professional mediating that algorithm - deciding whether and how to implement or react to any recommendation, prediction, or other algorithmic output. …

Enhancing 21 U.S.C. §§ 355, 356, And 360 To Encompass Artificial Intelligence-Based Drug Design And Manufacturing Methods, Aj Tsang

Michigan Technology Law Review

Despite newfound attention to how artificial intelligence (AI) may accelerate pharmaceutical development, federal regulators may find that current statutes are ambiguous or silent about their applicability to AI-based drug design and manufacturing methods. This poses a serious problem in the era of Loper Bright and the Major Questions Doctrine. As federal agencies struggle to adjust to courts’ growing demand for Congress to craft clear, explicit, and express delegations of authority, this note develops a statutory framework in which the Food and Drug Administration (FDA) would have more flexibility to regulate the use of AI in advanced drug manufacturing. Guided by …

Locating Liability For Medical Ai, W. Nicholson Price Ii, I. Glenn Cohen

Articles

When medical AI systems fail, who should be responsible, and how? We argue that various features of medical AI complicate the application of existing tort doctrines and render them ineffective at creating incentives for the safe and effective use of medical AI. In addition to complexity and opacity, the problem of contextual bias, where medical AI systems vary substantially in performance from place to place, hampers traditional doctrines. We suggest instead the application of enterprise liability to hospitals—making them broadly liable for negligent injuries occurring within the hospital system—with an important caveat: hospitals must have access to the information needed …

Use Of Artificial Intelligence In Drug Development, Louise C. Druedahl, Nicholson Price, Timo Minssen, Dipl Jur, Ameet Sarpatwari

Articles

Considerable focus has been placed on the health care applications of artificial intelligence (AI). Already, machine learning, a subset of AI that involves “the use of data and algorithms to imitate the way that humans learn” has been used to predict diseases, while AI-powered smartphone apps have been developed to promote mental health and weight loss. Owing in part to such successes, the market for AI in health care has been forecasted to increase more than 1000% between 2022 and 2029, from $13.8 billion to $164.1 billion. One area of substantial promise is drug development, which is poised to benefit …

Feedback Loops: Feedback Machines, Patrick Barry

Articles

Yes, AI raises serious concerns about bias, privacy, copyright infringement, environmental sustainability, and a whole bunch of other important topics. But if you are looking for a positive use case - and a new way to approach professional development - try asking chatgpt or some other AI chatbot for feedback, especially on something you've written.

Synthetic Health Data: Real Ethical Promise And Peril, W. Nicholson Price Ii, Daniel Susser

Other Publications

Modern health research and development faces a dilemma. On the one hand, there is more data than ever — in electronic health records, in lab research, in public datasets, and on the internet — from which to extract potentially transformative scientific insights and to use as the basis for developing breakthrough health care technologies. On the other hand, using this data entails various risks: threats to patient privacy, skewed samples and approaches to analysis that can perpetuate demographic and other biases, and uneven access to data about rare conditions and small patient subgroups. Generating synthetic data has emerged as one …

An Intelligent Path For Improving Diversity At Law Firms (Un)Artificially, Rimsha Syeda

Michigan Technology Law Review

Most law firms are struggling when it comes to diversity and inclusion. There are fewer women in law firms compared to men. The majority of lawyers—81%—are White, despite White people making up only about 65% of the law school population. Lawyers of color remain underrepresented with the historic high being only 28.32%. By comparison, 13.4% of the United States population is Black and 5.9% is Asian. The biases that perpetuate this lack of diversity in law firms begin during the hiring process and extend to associate retainment. For example, an applicant’s resume reveals a lot, including the prestige of the …

Equitable Ecosystem: A Two-Pronged Approach To Equity In Artificial Intelligence, Rangita De Silva De Alwis, Amani Carter, Govind Nagubandi

Michigan Technology Law Review

Lawmakers, technologists, and thought leaders are facing a once-in-a-generation opportunity to build equity into the digital infrastructure that will power our lives; we argue for a two-pronged approach to seize that opportunity. Artificial Intelligence (AI) is poised to radically transform our world, but we are already seeing evidence that theoretical concerns about potential bias are now being borne out in the market. To change this trajectory and ensure that development teams are focused explicitly on creating equitable AI, we argue that we need to shift the flow of investment dollars. Venture Capital (VC) firms have an outsized impact in determining …

Humans In The Loop, Nicholson Price Ii, Rebecca Crootof, Margot Kaminski

Articles

From lethal drones to cancer diagnostics, humans are increasingly working with complex and artificially intelligent algorithms to make decisions which affect human lives, raising questions about how best to regulate these “human in the loop” systems. We make four contributions to the discourse.

First, contrary to the popular narrative, law is already profoundly and often problematically involved in governing human-in-the-loop systems: it regularly affects whether humans are retained in or removed from the loop. Second, we identify “the MABA-MABA trap,” which occurs when policymakers attempt to address concerns about algorithmic incapacities by inserting a human into decision making process. Regardless …

Open-Source Clinical Machine Learning Models: Critical Appraisal Of Feasibility, Advantages, And Challenges, Keerthi B. Harish, W. Nicholson Price Ii, Yindalon Aphinyanaphongs

Articles

Machine learning applications promise to augment clinical capabilities and at least 64 models have already been approved by the US Food and Drug Administration. These tools are developed, shared, and used in an environment in which regulations and market forces remain immature. An important consideration when evaluating this environment is the introduction of open-source solutions in which innovations are freely shared; such solutions have long been a facet of digital culture. We discuss the feasibility and implications of open-source machine learning in a health care infrastructure built upon proprietary information. The decreased cost of development as compared to drugs and …

Degrees Of Confidence As A Legal Tool To Assess Ai System Liability, Joshua Song

Michigan Technology Law Review

AI systems have become increasingly integrated into our everyday lives, and harms caused by these systems have graduated from raising hypothetical ethical concerns to questions of actual legal liability. Civil liability schemes are generally designed to address harms caused by humans; thus, it may be tempting to analogize new types of harms caused by AI systems to familiar harms caused by humans in order to justify commandeering existing human-centered legal tools to assess AI liability. However, the analogy is inappropriate and misrepresents salient legal differences in how harms are committed by humans and AI systems. Thus, “as is often the …

Ai Insurance: How Liability Insurance Can Drive The Responsible Adoption Of Artificial Intelligence In Health Care, Ariel Dora Stern, Avi Goldfarb, Timo Minssen, W. Nicholson Price Ii

Articles

Despite enthusiasm about the potential to apply artificial intelligence (AI) to medicine and health care delivery, adoption remains tepid, even for the most compelling technologies. In this article, the authors focus on one set of challenges to AI adoption: those related to liability. Well-designed AI liability insurance can mitigate predictable liability risks and uncertainties in a way that is aligned with the interests of health care’s main stakeholders, including patients, physicians, and health care organization leadership. A market for AI insurance will encourage the use of high-quality AI, because insurers will be most keen to underwrite those products that are …

Volume Introduction, I. Glenn Cohen, Timo Minssen, W. Nicholson Price Ii, Christopher Robertson, Carmel Shachar

Other Publications

Medical devices have historically been less regulated than their drug and biologic counterparts. A benefit of this less demanding regulatory regime is facilitating innovation by making new devices available to consumers in a timely fashion. Nevertheless, there is increasing concern that this approach raises serious public health and safety concerns. The Institute of Medicine in 2011 published a critique of the American pathway allowing moderate-risk devices to be brought to the market through the less-rigorous 501(k) pathway,1 flagging a need for increased postmarket review and surveillance. High-profile recalls of medical devices, such as vaginal mesh products, along with reports globally …

Liability For Use Of Artificial Intelligence In Medicine, W. Nicholson Price, Sara Gerke, I. Glenn Cohen

Law & Economics Working Papers

While artificial intelligence has substantial potential to improve medical practice, errors will certainly occur, sometimes resulting in injury. Who will be liable? Questions of liability for AI-related injury raise not only immediate concerns for potentially liable parties, but also broader systemic questions about how AI will be developed and adopted. The landscape of liability is complex, involving health-care providers and institutions and the developers of AI systems. In this chapter, we consider these three principal loci of liability: individual health-care providers, focused on physicians; institutions, focused on hospitals; and developers.

Exclusion Cycles: Reinforcing Disparities In Medicine, Ana Bracic, Shawneequa L. Callier, Nicholson Price

Articles

Minoritized populations face exclusion across contexts from politics to welfare to medicine. In medicine, exclusion manifests in substantial disparities in practice and in outcome. While these disparities arise from many sources, the interaction between institutions, dominant-group behaviors, and minoritized responses shape the overall pattern and are key to improving it. We apply the theory of exclusion cycles to medical practice, the collection of medical big data, and the development of artificial intelligence in medicine. These cycles are both self-reinforcing and other-reinforcing, leading to dismayingly persistent exclusion. The interactions between such cycles offer lessons and prescriptions for effective policy.

Part I - Ai And Data As Medical Devices, W. Nicholson Price Ii

Other Publications

It may seem counterintuitive to open a book on medical devices with chapters on software and data, but these are the frontiers of new medical device regulation and law. Physical devices are still crucial to medicine, but they – and medical practice as a whole – are embedded in and permeated by networks of software and caches of data. Those software systems are often mindbogglingly complex and largely inscrutable, involving artificial intelligence and machine learning. Ensuring that such software works effectively and safely remains a substantial challenge for regulators and policymakers. Each of the three chapters in this part examines …

How Much Can Potential Jurors Tell Us About Liability For Medical Artificial Intelligence?, W. Nicholson Price Ii, Sara Gerke, I. Glenn Cohen

Articles

Artificial intelligence (AI) is rapidly entering medical practice, whether for risk prediction, diagnosis, or treatment recommendation. But a persistent question keeps arising: What happens when things go wrong? When patients are injured, and AI was involved, who will be liable and how? Liability is likely to influence the behavior of physicians who decide whether to follow AI advice, hospitals that implement AI tools for physician use, and developers who create those tools in the first place. If physicians are shielded from liability (typically medical malpractice liability) when they use AI tools, even if patient injury results, they are more likely …

An Agent-Based Model Of Financial Benchmark Manipulation, Gabriel Virgil Rauterberg, Megan Shearer, Michael Wellman

Articles

Financial benchmarks estimate market values or reference rates used in a wide variety of contexts, but are often calculated from data generated by parties who have incentives to manipulate these benchmarks. Since the the London Interbank Offered Rate (LIBOR) scandal in 2011, market participants, scholars, and regulators have scrutinized financial benchmarks and the ability of traders to manipulate them. We study the impact on market quality and microstructure of manipulating transaction-based benchmarks in a simulated market environment. Our market consists of a single benchmark manipulator with external holdings dependent on the benchmark, and numerous background traders unaffected by the benchmark. …

Risks And Remedies For Artificial Intelligence In Healthcare, W. Nicholson Price Ii

Other Publications

Artificial intelligence (AI) is rapidly entering health care and serving major roles, from automating drudgery and routine tasks in medical practice to managing patients and medical resources. As developers create AI systems to take on these tasks, several risks and challenges emerge, including the risk of injuries to patients from AI system errors, the risk to patient privacy of data acquisition and AI inference, and more. Potential solutions are complex but involve investment in infrastructure for high-quality, representative data; collaborative oversight by both the Food and Drug Administration and other health-care actors; and changes to medical education that will prepare …