CN ZhejiangSchool of Artificial Intelligence Feb 28
Works on multimodal learning, including speech and singing-voice synthesis, audio generation and video-language understanding.
2026 A Survey of Direct Preference Optimization: Datasets, Theories, Variants, and Applications TPAMI 2026 AlignSep: Temporally-Aligned Video-Queried Sound Separation with Flow Matching ICLR 136 T1194 papersGroup size not listed CN SJTUSchool of Computer Science May 31
Xie Chen Tenured Track Associate Professor Works on speech recognition, speech synthesis and audio language models in the X-LANCE lab.
2026 AHAMask: Reliable Task Specification for Large Audio Language Models without Instructions AAAI 2026 Anonymization, Not Elimination: Utility-Preserved Speech Anonymization TASLP 90 T1123 papersGroup size not listed CN SJTUSchool of Computer Science May 31
Yanmin Qian Distinguished Professor Works on speech recognition, speaker recognition, speech separation and auditory AI.
2026 2025 URGENT Speech Enhancement Challenge Multilingual P.808 Listening Tests: Approach and Results ICASSP 2026 A Data-Centric Approach to Generalizable Speech Deepfake Detection ACL 85 T1139 papers11 members11 alumniDE TUMTUM School of Medicine and Health
Researches computer audition, affective computing and AI for digital health, including speech-based health monitoring.
2026 Discovering and Causally Validating Emotion-Sensitive Neurons in Large Audio-Language Models ACL 2026 Early Warning of Starter-Battery Failure from Remotely Sensed Engine-Start Signals in Heavy-Duty Fleets ICCAD 71 T1269 papers30 members174 alumniUS USCElectrical and Computer Engineering Dec 15
Shrikanth Narayanan Niki and Max Nikias Chair in Engineering and University Professor of Electrical and Computer Engineering, Computer Science, Linguistics, Psychology, Pediatrics, and Otolaryngology Leads SAIL on speech and multimodal signal processing, behavioral signal analysis and human-centered machine intelligence.
2026 A Long-Form Single-Speaker Real-Time MRI Speech Dataset and Benchmark ICASSP 2026 A Point Process Model of Skin Conductance Responses in a Stroop Task for Predicting Depression and Suicidal Ideation ICASSP 71 T1162 papers24 members88 alumniUS CMULanguage Technologies Institute Dec 9
Studies speech and audio processing, machine learning for audio and privacy-preserving speech technologies.
2026 VideoJudge: Bootstrapping Enables Scalable Supervision of MLLM-as-a-Judge for Video Understanding ICLR 2026 φ-DPO: Fairness Direct Preference Optimization Approach to Continual Learning in Large Multimodal Models CVPR 68 T190 papersGroup size not listed SG NTUCollege of Computing and Data Science
Works on speech recognition and enhancement, end-to-end ASR, spoken language processing and large language models.
2026 Evaluating the Expressive Appropriateness of Speech in Rich Contexts ACL 2026 KCAM-SENet: Speech enhancement network with KAN-based channel attention module Speech Communication 61 T1114 papers15 members43 alumniCN TsinghuaDepartment of Automation Feb 28
Works on speech processing, affective computing, and multimodal information fusion.
2026 AStar: Boosting Multimodal Reasoning with Automated Structured Thinking AAAI 2026 Beyond Examples: Towards Automated Thought-level In-Context Reasoning for Large Language Models ACL 59 T1151 papersGroup size not listed US UC BerkeleyElectrical Engineering and Computer Sciences Dec 1
Works on speech processing and neural speech decoding, including assistive spoken language technologies and speech disorder diagnosis.
2026 Benchmarking Single-Factor Physical Video-to-Audio Generation CVPR 2026 Evolutionary Strategies at Scale lead to Catastrophic Forgetting ACL 40 T160 papers10 members10 alumniUS UIUCElectrical and Computer Engineering Dec 1
Studies speech recognition and audio signal processing, including acoustic phonetics and speech technology for under-resourced languages.
2026 Decomposed On-Policy Distillation for Vision-Language Reasoning: Steering Gradients for Visual Grounding ICML 2026 In-Sync: Adaptation of Speech Aware Large Language Models for ASR with Word Level Timestamp Predictions ICASSP 38 T170 papers8 members79 alumniCN TsinghuaDepartment of Electronic Engineering Feb 28
Works on speech and audio technology, including speech recognition and speaker recognition, and leads the Speech and Audio Technology Lab.
2026 Acoustic and semantic feature fusion mapping for lyric intelligibility prediction Interspeech 2026 ALMA-Chor: Leveraging audio-lyric alignment with mamba for chorus detection ICASSP 35 T148 papersGroup size not listed CN SJTUSchool of Computer Science May 31
Works on speech and audio processing, including audio captioning and speech-based mental health assessment.
2026 A Human-Centric Pipeline for Aligning Large Language Models with Chinese Medical Ethics AAAI 2026 From Medical Records to Diagnostic Dialogues: A Clinical-Grounded Approach and Dataset for Psychiatric Comorbidity ICLR 27 T140 papers15 members3 alumniGB CambridgeEngineering - Information Engineering Division Dec 8
Mark Gales Professor of Information Engineering Works on automatic speech recognition and speech synthesis, including low-resource speech processing and spoken language learning and assessment.
2026 Detect, Attend and Extract: Keyword Guided Target Speaker Extraction IJCAI/ECAI 2026 Towards Self-Referential Analytic Assessment: A Profile-Based Approach to L2 Writing Evaluation with LLMs BEA 26 T155 papersGroup size not listed GB EdinburghSchool of Informatics
Researches automatic speech recognition, including adaptation and low-resource speech recognition.
2026 TTSDS2: Resources and Benchmark for Evaluating Human-Quality Text to Speech Systems ICLR 2026 "Walk a Mile in My Voice": Voice Conversion Shapes Trust, Attribution, and Empathy in Human-AI Speech Interactions IUI Companion 26 T148 papers9 members5 alumniCN TsinghuaDepartment of Automation Feb 28
Works on speech signal processing, personalized speech synthesis and deepfake audio detection, and continual learning.
2026 SpeechPalette: A Comprehensive Speech Editing Method for Text-Based Speech Editing, One-Shot TTS and Attributes Editing TPAMI 2026 MSSG: Multi-Scale Speaker Graph Network for Active Speaker Detection IEEE Trans. Multim. 25 T149 papersGroup size not listed US Georgia TechElectrical and Computer Engineering Dec 15
Researches speech recognition and deep learning for speech and audio signal processing.
2025 An Explicit Consistency-Preserving Loss Function for Phase Reconstruction and Speech Enhancement ICASSP 2025 The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition Interspeech 24 T140 papersGroup size not listed US CMULanguage Technologies Institute Dec 9
Studies speech translation and multimodal interfaces for human communication.
2026 Beyond Transcripts: A Renewed Perspective on Audio Chaptering ACL 2026 BOOM: Beyond Only One Modality KIT's Multimodal Multilingual Lecture Companion EACL 22 T151 papersGroup size not listed US UMDElectrical and Computer Engineering
Studies speech acoustics, speech recognition and speech-based detection of mental health conditions.
2026 Acoustic and Facial Markers of Perceived Conversational Success in Spontaneous Speech ICASSP 2026 Articulatory Entrainment and Coordination Complexity in Spontaneous Autistic and Non-autistic Dialogue Interspeech 22 T137 papers6 members76 alumniCN SJTUSchool of Computer Science May 31
Chenda Li Assistant Professor Works on speech enhancement and separation, multimodal speech processing and speech language models in the AudioCC lab.
2026 2025 Urgent Speech Enhancement Challenge Multilingual P.808 Listening Tests: Approach and Results ICASSP 2026 ESPnet3: Infrastructure for Scalable Speech and Audio Research in the Foundation Model Era Interspeech 21 T131 papersGroup size not listed US UT AustinComputer Science Dec 15
Works on automatic speech recognition, spoken language understanding and visually grounded speech learning from audio and video.
2024 Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos ECCV 2024 AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models ICASSP 21 T128 papers8 members10 alumni