“AI Fairness: Designing Equal Opportunity Algorithms” with Professor Derek Leben

As artificial intelligence takes on a growing role in decisions about education, jobs, housing, loans, healthcare, and criminal justice, concerns about fairness have become urgent. Because AI systems are trained on data that reflect historical inequalities, they often reproduce or even amplify those disparities. In his book “AI Fairness: Designing Equal Opportunity Algorithms” Professor Derek Leben draws on classic philosophical theories of justice—especially John Rawls’s work—to propose a framework for evaluating the fairness of AI systems. This framework offers a way to think systematically about algorithmic justice: how automated decisions can align with ethical principles of equality and fairness. The book examines the trade-offs among competing fairness metrics and shows that it is often impossible to satisfy them all at once. As a result, organizations must decide which definitions of fairness to prioritize, and regulators must determine how existing laws should apply to AI. In this episode of Bridging the Gaps, I speak with Professor Derek Leben.

Derek Leben is Professor of Business Ethics at the Tepper School of Business at Carnegie Mellon University. As founder of the consulting group Ethical Algorithms, he has worked with governments and companies to develop policies on fairness and benefit for AI and autonomous systems.

I begin our discussion by asking Derek what “AI” means in the context of his work and how fairness fits into that picture. From there, we explore why fairness matters as AI systems increasingly influence critical decisions about employment, education, housing, loans, healthcare, and criminal justice.

We discuss how historical inequalities in training data lead to biased outcomes, giving listeners a deeper understanding of the problem. While some view AI fairness as a purely technical issue that engineers can fix, the book argues that it is also a moral and political challenge—one that requires insights from philosophy and ethics. We then examine the difficulty of balancing multiple fairness metrics, which often cannot all be satisfied simultaneously, and discuss how organizations might prioritize among them. Derek explains his theory of algorithmic justice, inspired by John Rawls’s philosophy, and we unpack its key ideas.

Later, we touch on questions of urgency versus long-term reform, exploring the idea of longtermism, and discuss the tension between fairness and accuracy. Finally, we consider how businesses can balance commercial goals with their broader social responsibilities.

Overall, it is an informative and thought-provoking conversation about how we can make AI systems more just.

Complement this discussion with “The Line: AI and the Future of Personhood” with Professor James Boyle and the listen to Reclaiming Human Intelligence and “How to Stay Smart in a Smart World” with Prof. Gerd Gigerenzer

“The Line: AI and the Future of Personhood” with Professor James Boyle

The Line James Boyle on Bridging the Gaps

Humans are no longer the only entities capable of generating language and ideas with fluency. But this advancement raises a profound question: are artificial intelligence systems truly conscious, or are they simply performing an elaborate imitation of human thought? And if, in the future, claims of AI consciousness become more credible, how will that shift our understanding of these technologies? Will we continue to see them as tools, or begin to recognize them as something closer to persons? In his book “The Line: AI and the Future of Personhood”, Professor James Boyle confronts these complex issues. He explores how questions that once belonged to the realm of science fiction have now become urgent and real. He examines how this technological shift might redefine our understanding of personhood and challenge the boundary—”the line”—that separates humans from everything else, as well as persons with legal rights from inanimate objects. In this episode of Bridging the Gaps, I speak with Professor James Boyle to explore these timely, thought provoking and transformative questions.

James Boyle is a professor of Law at Duke Law School, founder of the Center for the Study of the Public Domain, and former Chair of Creative Commons. He is the winner of the Electronic Frontier Foundation’s Pioneer Award for his work on digital civil liberties.

We begin by talking about the idea of personhood—what it means, how we define it, and what separates beings that have personhood from those that don’t. I ask whether it’s simply consciousness that makes the difference. We then explore why empathy is an important part of thinking about personhood.

Next, we discuss the challenge of using consciousness as a dividing line. If consciousness is what separates those with personhood from those without, how can we use such a complex and unclear concept to draw that line?

In his book, The Line: AI and the Future of Personhood, James Boyle uses many examples from science fiction to explore these tough questions. I found this approach fascinating, and I asked him why he chose science fiction as a way to talk about such deep and complicated ideas.

We also talk about similar issues that came up when thinking about the rights of corporations and other non-living things. Then we move on to what we can learn from how rights have been developed for non-human animals. Finally, we touch on recent court cases involving decisions made by artificial intelligence.

Overall, this was a very engaging and insightful conversation.

Complement this discussion with “Evolutionary Intelligence: How Technology Will Make Us Smarter” with Professor W. Russell Neuman and the listen to Reclaiming Human Intelligence and “How to Stay Smart in a Smart World” with Prof. Gerd Gigerenzer

“The Painful Truth about Hunger in America” with Professor Mariana Chilton

Hunger is far more than the immediate and tangible experience of not being able to find or buy food. While it is true that hunger is often depicted as the physical sensation of an empty stomach—a condition that can be temporarily alleviated by food—the issue runs much deeper. Hunger is more than the absence of food; it is a manifestation of deeper, societal and structural failings leading to individual and collective trauma. To genuinely combat hunger, we must engage with its underlying causes—economic inequality, systemic discrimination, and societal neglect—and strive to create a compassionate and just society where all people have the resources, respect, and opportunities they need to thrive. In her book “The Painful Truth about Hunger in America: Why We Must Unlearn Everything We Think We Know—and Start Again” professor Mariana Chilton presents a bold, transformative perspective on addressing hunger and poverty in the United States. The book emphasises that hunger in the United States is underpinned by profound societal and structural failures that perpetuate poverty and ensure that millions remain trapped in cycles of scarcity. In this episode of Bridging the Gaps I speak with professor Mariana Chilton.

Although the book focuses on the issues of hunger and poverty in the United States, the human experiences and the underlying structural and social root causes it explores are often universal. The insights and key points raised in the book resonate with similar challenges faced in other societies and regions, making its research and findings valuable for broader learning and application.

Mariana Chilton is a Professor of Health Management and Policy at Drexel University’s Dornsife School of Public Health. She is the founder of the Center for Hunger-Free Communities, where she initiated impactful programs such as “Witnesses to Hunger”, aimed at amplifying women’s voices in the national conversation on hunger and poverty, and the “Building Wealth and Health Network”, which focuses on fostering economic security and healing. Chilton has provided expert testimony on hunger solutions before both the US Senate and the House of Representatives.

Our discussion delves into the intricate connections between hunger and trauma, revealing the emotional and psychological toll on individuals and communities. We examine the persistent nature of poverty and its link to generational trauma and explore the complex relationship between poverty, violence, and systemic inequalities. Professor Chilton provides thoughtful explanations supported by real-world examples and personal stories, many of which are detailed in her book. We also discuss challenges involved in conducting research on such sensitive topics, particularly when working with vulnerable populations. The discussion covers both ethical considerations and the logistical obstacles researchers face when collecting data and sharing findings in a manner that respects and empowers participants. Professor Chilton’s insights shed light on the importance of compassionate, inclusive approaches to research and advocacy that prioritise the voices of those most affected by these issues.

Complement this discussion with “The Blind Spot: Why Science Cannot Ignore Human Experience” with Professor Adam Frank and then listen to “A Passion for Ignorance” and for Denials and Negations with Professor Renata Salecl.

By |November 17th, 2024|Podcasts, Research, Social Science, Sustainability|