IMPACT-SPEECH

Identifying, Measuring, Preventing, and Assessing
Consequences of Bias in Speech LLMs

Co-located with EMNLP 2026 • Full-Day Workshop • October 29, 2026

Welcome!

IMPACT-SPEECH is a full-day workshop focused on identifying, measuring, preventing, and assessing bias in speech-enabled large language models and multimodal speech systems.

Co-located with EMNLP 2026 • Full-Day Workshop • October 29, 2026

Workshop Objective

SpeechLLM has accelerated the shift in human–computer interaction from predominantly text-based systems to speech-enabled and multimodal interfaces. These technologies are increasingly embedded in everyday applications, enabling more natural and accessible forms of interaction. However, this rapid progress has outpaced our understanding of the limitations, biases, and broader societal consequences of such systems. These systems have been shown to exhibit and even amplify biases related to accent, speaker identity, gender, socioeconomic status, and other factors. Such biases can lead to unequal performance, exclusion of certain user groups, and unintended harms in real-world applications. Despite growing research efforts across natural language processing, speech processing, and machine learning, work on bias remains fragmented, with limited integration across modalities and disciplines.

The IMPACT-SPEECH workshop aims to bring together researchers, practitioners, developers, and end-users from diverse fields, including speech processing, natural language processing, machine learning, social sciences, fairness, and ethics, to address these challenges. The workshop seeks to foster collaboration and build a coherent research agenda around bias in Speech LLMs. Through interdisciplinary exchange, the workshop aims to advance methods for identifying, measuring, preventing, and assessing the consequences of bias, while examining the real-world consequences of these systems, particularly in terms of fairness, accessibility, ethical responsibility, and societal impacts.

Important Dates

The important dates are as follows:

All deadlines are Anywhere on Earth (AoE).

Tentative Program (Room G9-10)

09:00 – 09:15
Introduction and General Remarks
09:15 – 10:15
Keynote 1 — Marco Matassoni
Senior Researcher, Fondazione Bruno Kessler
Title: Every Voice Matters: Towards Inclusive Speech LLMs
Abstract

The increasing use of Speech Large Language Models raises fundamental questions about fairness, inclusiveness, and trustworthiness. This talk presents research conducted within the ELOQUENCE project, which aims to develop multilingual, context-aware, and bias-controlled conversational AI for applications ranging from customer service and smart homes to safety-critical scenarios. We will focus on inequalities in multilingual and low-resource speech processing, where differences in data availability, language coverage, accents, and speaker characteristics can lead to significant performance disparities. The talk will discuss approaches to identify and measure speech bias, as well as strategies to improve robustness and inclusiveness through cross-lingual adaptation, data-efficient learning, and privacy-preserving approaches.

10:15 – 11:00
Coffee Break ☕
11:00 – 12:30
Oral Session 1
Fairness, reliability and conversational speech
15 minutes per presentation (12 min presentation + 3 min Q&A)
11:00 – 11:15
Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models Maneesha Rani Saha; Catherine Bao; Neal Patwari
11:15 – 11:30
Pruning for Efficiency, Paying in Fairness: Demographic Disparities in Pruned Speech-LLMs Ganesh Pavan Kartikeya Bharadwaj Kolluri; Michael Kampouridis; Ravi Shekhar
11:30 – 11:45
Early Warning for Target-Speaker Extraction: Reliability under Distribution and Failure-Definition Shift Shubham Sharma; Manik Gupta
11:45 – 12:00
Detecting Mental Manipulation in Speech via Synthetic Multi-Speaker Dialogue Run Chen; Wen Liang; Ziwei Gong; Lin Ai; Julia Hirschberg
12:00 – 12:15
Temporal Taxation Compounds Under Post-Training Compression of Whisper Models Srishti Ginjala; Eric Fosler-Lussier; Christopher W. Myers; Srinivasan Parthasarathy
12:15 – 12:30
Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges Syeda Faiza Ahmed Sara; Zien Sheikh Ali; Hunzalah Hassan Bhatti; Firoj Alam; Shammur Absar Chowdhury
12:30 – 14:00
Lunch Break 🥪
14:00 – 15:00
Keynote 2 — Jesper Rindom Jensen
Associate Professor, Aalborg University
Title: Bias before the model: Reference noise as source of unfair speech systems
Abstract

Bias in speech systems is often attributed to the models themselves, but it can be introduced long before training begins. In this talk, I will use speech enhancement as a case study, focusing on one such example: the "clean" references used for training are, in practice, often noisy. Drawing on our recent research, we will see how this can bias models to let noise pass through while still scoring well on objective metrics. We will also examine current evaluation practices, showing that common metrics struggle to differentiate between state-of-the-art methods and often fail to reflect the preferences and perception of real users.

15:00 – 15:30
Oral Session 2
Fairness in speaker verification and speech representations
15 minutes per presentation (12 min presentation + 3 min Q&A)
15:00 – 15:15
TurkSV-Bench: Assessing Demographic Bias and Preprocessing Effects in Speaker Verification Ahmet Berkay Kantarcı; Abdulkadir Parlak; Ahmet Karazor
15:15 – 15:30
A Probe Shift Is Not a Fairness Fix: The Limits of Representation Steering in Speech Models Nicolas Bourrel; Abderrahmane Issam; Gerasimos Spanakis
Closing Remarks
15:30 – 16:00
Coffee Break ☕
16:00 – 17:30
Poster Session
13 posters — click to expand
Can Large Audio-Language Models Ignore Multilingual Distractors? An Evaluation of Their Selective Auditory Attention Capabilities Heejoon Koo
AIP-Speech: Auditing Speech LLM Robustness to Background Interference Aiden Dsouza; Shreyansh Mishra; Yashraj Suneja; Rohan Swain; Samyak Borkar; Arjun Jaishankar; Tanmay Urade
When How You Speak Changes What Models Refuse: Investigating Prosody-Conditioned Safety Divergence in Audio-Language Models Akash Das; Ishan Roy
What Drives Dialectal Jailbreaks? An Ablation of Surface Form, Cultural Framing, and Strategy Banks Qingyang Xu
KanAdapter: A Kolmogorov-Arnold Network-based Plug-and-Play Module for Efficient Fine-tuning of Foundation Speech Models Tuan Dat Phuong
Zero-Shot Spoken Language Understanding with SLAM-ASR: What Do Monolingual ASR-Trained Linear Projectors Enable? Edwin Arkel Rios; Sneh Sourabh; Jocelyn Zaruma; Girish Ewoorkar; Julian Mack; Bo-Cheng Lai
Auditing Spoken Correction Uptake and Retention in Speech LLMs Yoonhyuk Choi
Lost in Compression: Calibration Bias and the Accent-WER Gap in Speech LLMs Angad Ripudaman Singh Bajwa
Responsible Benchmarking of Fairness for Automatic Speech Recognition Felix Herron; Ange Richard; François Portet; Alexandre Allauzen; Solange Rossato
Dialect Gaps in Tamil Speech Recognition: A Paired Evaluation of Erode and Common Spoken Tamil Dharunish Yugeswardeenoo
Evaluating WhisperX Transcriptions of Korean Child-Directed Speech through Linguistic Analysis Ioana Buhnila; Jiho Lee; Sung Hyu Chon; Jae-Hun Jung; Eon-Suk Ko
Personalization Without Stereotyping: Do Speech LLMs Know When to Turn a Deaf Ear? Kshitij Ambilduke; Caroline Brun; Thibaut Thonet; Vassilina Nikoulina; Marcely Zanon Boito
Steering ASR systems towards domain adaptation and personalization Felix Herron; Alex Colagrande; Solange Rossato; François Portet; Alexandre Allauzen; Chuyan Li

Invited Speakers

Marco Matassoni

Marco Matassoni

Senior Researcher
Fondazione Bruno Kessler

Jesper Rindom Jensen

Jesper Rindom Jensen

Associate Professor
Aalborg University

Workshop Organizers

Ravi Shekhar

Ravi Shekhar

University of Essex, UK

Monorama Swain

Monorama Swain

JKU Linz, Austria

Jagabandhu Mishra

Jagabandhu Mishra

University of Eastern Finland, Finland

Sandipan Dhar

Sandipan Dhar

Fraunhofer IIS, Germany

Haralambos Mouratidis

Haralambos Mouratidis

University of Essex, UK

Matthew Purver

Matthew Purver

QMUL, UK & JSI, Slovenia

Program Committee

Mohd Mujtaba Akhtar – IIIT Delhi, India

Iqra Ali – Queen Mary University of London, UK

Sudhansu Bala Das – University of Galway, Ireland

Daniel Hershcovich – University of Copenhagen, Denmark

Senja Pollak – Jožef Stefan Institute, Slovenia

Orchid Chetia Phukan – IIIT Delhi, India

Subhankar Roy – University of Bergamo, Italy

Markus Schedl – Johannes Kepler University Linz, Austria

Divya Sharma – IIIT Delhi, India

Shah Nawaz – Johannes Kepler University Linz, Austria

Venktesh V – Stockholm, Sweden

Sarenne Wallbridge – UK AI Security Institute, UK

Tariq Yousef – University of Southern Denmark, Denmark

Eva Szekely – KTH Royal Institute of Technology, Sweden

Juntao Yu – Queen Mary University of London, UK

Reyhaneh Hashempour – QA Ltd, UK

Girish – IIIT Delhi, India

Tharindu Ranasinghe – Lancaster University, UK

Tariq Rahim – Kingston University London, UK

Abhirama Subramanyam – MBZUAI Abu Dhabi

Kalluri Shareef Babu – Manipal Institute of Technology Bengaluru

Giovanni Filomeno – JKU Linz, Austria

Shekhar Nayak – University of Groningen, Netherlands

Nina Hosseini-Kivanani – Radio Télévision Luxembourg (RTL), Luxembourg

Badr M. Abdullah – Saarland University, Germany

Shammur Absar Chowdhury – Qatar Computing Research Institute (QCRI), Qatar

Lorenzo Concina – Fondazione Bruno Kessler (FBK), Italy

Spyretta Leivaditi – University of Groningen, Netherlands

Ludovica Pannitto – University of Bologna, Italy

Esaú Villatoro Tello – Idiap Research Institute, Switzerland

Sergio Burdisso – Idiap Research Institute, Switzerland

Santosh Kesiraju – Brno University of Technology, Czechia

Fernando López – Telefónica Innovación Digital, Spain

Alessio Brutti – Fondazione Bruno Kessler (FBK), Italy

Bo Su – Indiana University Bloomington, USA