Alexander Waibel
Professor (On Leave)
Studies speech translation and multimodal interfaces for human communication.
Alexander Waibel's lab at CMU works on speech recognition & spoken language, vision-language & multimodal and multimodal & grounded language. 51 papers since 2023, 22 at top venues, mostly ICASSP and Interspeech. Applications close .
At a glance
- papers, 2023–2026
- 13/ year
- at T1 venues
- 43%
- PhD students
- —
- MS students
- —
- alumni listed
- —
Papers by yearfrom DBLP, 2023–2026
- 8 papers2026 · T1 1 · collecting
- 17 papers2025 · T1 12
- 13 papers2024 · T1 4
- 13 papers2023 · T1 5
T1 venuesOtherVenues: ICASSP, Interspeech, EMNLP, ACL, EACL
Research focuspaper titles that use each topic's words
- Speech recognition & spoken language28 papers
- translation14 papers
- Vision-language & multimodal7 papers
- Multimodal & grounded language5 papers
- studies speech0 papers
Paper list
From DBLP.
20268 papers
- ACL (T1)Beyond Transcripts: A Renewed Perspective on Audio Chaptering (opens in a new tab)
- EACLBOOM: Beyond Only One Modality KIT's Multimodal Multilingual Lecture Companion (opens in a new tab)
- WACVCAPE: A CLIP-Aware Pointing Ensemble of Complementary Heatmap Cues for Embodied Reference Understanding (opens in a new tab)
- IWSLTKIT's Submission to Cross-Lingual Voice Cloning in IWSLT 2026 (opens in a new tab)
- IWSLTMultilingual Long-Form Speech Instruction Following: KIT's Submission to IWSLT 2026 (opens in a new tab)
- LRECMUSCAT: MUltilingual, SCientific ConversATion Benchmark (opens in a new tab)
- LRECParagraph Segmentation Revisited: Towards a Standard Task for Structuring Speech (opens in a new tab)
- IWSLTSpeech Translation and Metrics in 2026: Findings of the IWSLT Campaign (opens in a new tab)
202517 papers
- Interspeech (T1)Cocktail-Party Audio-Visual Speech Recognition (opens in a new tab)
- ICASSP (T1)Continuously Learning New Words in Automatic Speech Recognition (opens in a new tab)
- HumanoidsEpisodic Memory Verbalization Using Hierarchical Representations of Life-Long Robot Experience (opens in a new tab)
- ICASSP (T1)Factorized-VITS: Decoupling Prosody and Text in End-to-End Speech Synthesis without External or Secondary Aligner (opens in a new tab)
- EMNLP (T1)Few-Shot Learning Translation from New Languages (opens in a new tab)
- IWSLTFindings of the IWSLT 2025 Evaluation Campaign (opens in a new tab)
- Interspeech (T1)From Speech Science to Language Transparence (opens in a new tab)
- ICASSP (T1)Improving Pronunciation and Accent Conversion through Knowledge Distillation And Synthetic Ground-Truth from Native TTS (opens in a new tab)
- IWSLTKIT's Low-resource Speech Translation Systems for IWSLT2025: System Enhancement with Synthetic Data and Model Regularization (opens in a new tab)
- IWSLTKIT's Offline Speech Translation and Instruction Following Submission for IWSLT 2025 (opens in a new tab)
- ICASSP (T1)MSA-ASR: Efficient Multilingual Speaker Attribution with frozen ASR Models (opens in a new tab)
- ICASSP (T1)PIER: A Novel Metric for Evaluating What Matters in Code-Switching (opens in a new tab)
202413 papers
- ECCV (T1)Audio-Driven Talking Face Generation with Stabilized Synchronization Loss (opens in a new tab)
- CVPR WorkshopAudio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation (opens in a new tab)
- IWSLTBlending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024 (opens in a new tab)
- IWSLTCharles Locock, Lowcock or Lockhart? Offline Speech Translation: Test Suite for Named Entities (opens in a new tab)
- ICASSP WorkshopConVoiFilter: A Case Study of Doing Cocktail Party Speech Recognition (opens in a new tab)
- LREC/COLINGDECM: Evaluating Bilingual ASR Performance on a Code-switching/mixing Benchmark (opens in a new tab)
- ACL (T1)Decoupled Vocabulary Learning Enables Zero-Shot Translation from Unseen Languages (opens in a new tab)
- IWSLTFINDINGS OF THE IWSLT 2024 EVALUATION CAMPAIGN (opens in a new tab)
- EACLFrom Text Segmentation to Smart Chaptering: A Novel Benchmark for Structuring Video Transcriptions (opens in a new tab)
- Frontiers Robotics AIIncremental learning of humanoid robot behavior from natural interaction and large language models (opens in a new tab)
- EMNLP (T1)SciEx: Benchmarking Large Language Models on Scientific Exams with Human Expert Grading and Automatic Grading (opens in a new tab)
- ICASSP (T1)Synthetic Conversations Improve Multi-Talker ASR (opens in a new tab)
202313 papers
- Image Vis. Comput.A survey on computer vision based human analysis in the COVID-19 era (opens in a new tab)
- ICASSP (T1)AdapITN: A Fast, Reliable, and Dynamic Adaptive Inverse Text Normalization (opens in a new tab)
- EMNLP (T1)End-to-End Evaluation for Low-Latency Simultaneous Speech Translation (opens in a new tab)
- ICASSP WorkshopFace-Dubbing++: LIP-Synchronous, Voice Preserving Translation Of Videos (opens in a new tab)
- IWSLT@ACLFindings of the IWSLT 2023 Evaluation Campaign (opens in a new tab)
- Interspeech (T1)Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff (opens in a new tab)
- IWSLT@ACLKIT's Multilingual Speech Translation System for IWSLT 2023 (opens in a new tab)
- GHTCModular Design of a Front-End and Back-End Speech-to-Speech Translation Application for Psychiatric Treatment of Refugees (opens in a new tab)
- ICCV WorkshopMultimodal Error Correction with Natural Language and Pointing Gestures (opens in a new tab)
- ICASSP (T1)SYNTACC : Synthesizing Multi-Accent Speech By Weight Factorization (opens in a new tab)
- Interspeech (T1)Towards continually learning new languages (opens in a new tab)
- IWSLT@ACLTowards Efficient Simultaneous Speech Translation: CUNI-KIT System for Simultaneous Track at IWSLT 2023 (opens in a new tab)
Where alumni went
Alumni are not listed on the lab homepage.
Apply to CMUFall 2027
CMU SCS Computer Science PhD
- Round
- Single round
- Opens
- GRE
- See program page
- English
- TOEFL / IELTS / Duolingo (F-1/J-1 non-native speakers)
- Fee
- USD 100 (USD 80 by early deadline)
Confirmed on the program page.
Similar labsnearest by research summary
- GBCambridge
Bill Byrne
- Multimodal & grounded language
- CNSJTU
Zhuosheng Zhang
- Reasoning & agents
- GBCambridge
Phil Woodland
- Speech recognition & spoken language
- GBEdinburgh
Sharon Goldwater
- Multilingual, translation & linguistics
- GBCambridge
Simone Teufel
2 T1 - USUW
Yulia Tsvetkov
- Interpretability, evaluation & safety of LMs
Your notes
Save this lab to keep notes.
Data
Some numbers could not be verified:
- The member list could not be found on the lab site.
- The alumni list could not be found on the lab site.
- The lab site and the paper record do not agree.
- Collected
- Verified
- Papers
- DBLP
- Members
- Not collected
- Alumni
- Not collected
Tiers are venue classifications, not lab rankings.
CMUcloses