Mark Hasegawa-Johnson
Professor
Studies speech recognition and audio signal processing, including acoustic phonetics and speech technology for under-resourced languages.
Mark Hasegawa-Johnson's lab at UIUC works on speech recognition & spoken language, music, audio & sound and signal processing & information theory. 70 papers since 2023, 38 at top venues, mostly Interspeech and ICASSP. 79 alumni. Applications close .
At a glance
- papers, 2023–2026
- 18/ year
- at T1 venues
- 54%
- PhD students
- 0
- MS students
- 0
- alumni listed
- 79
Papers by yearfrom the lab homepage, 2023–2026
- 19 papers2026 · T1 12 · collecting
- 22 papers2025 · T1 14
- 20 papers2024 · T1 7
- 9 papers2023 · T1 5
T1 venuesOtherVenues: Interspeech, ICASSP, ICML, ICLR, LREC
Research focuspaper titles that use each topic's words
- Speech recognition & spoken language50 papers
- speech39 papers
- Music, audio & sound6 papers
- Signal processing & information theory2 papers
- studies speech0 papers
Paper list
From the lab homepage.
202619 papers
- Signal Processing MagazineAutomated Analysis of Naturalistic Recordings in Early Childhood: Applications, challenges, and opportunities
- Conference on Language ModelingAVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking (opens in a new tab)
- SLTCHILDES-Aligned: A Curated Children’s Speech Dataset via Multi-Model Timestamp Ensembling
- ICML (T1)Decomposed On-Policy Distillation for Vision-Language Reasoning: Steering Gradients for Visual Grounding
- Pronunciation in Second Language Learning and TeachingDesigning Audiovisual Pronunciation Feedback for Second Language Learners
- Learning to Listen: ICML Workshop on Machine Learning for AudioFew-Shot Synthetic Accented Speech for ASR Fine-Tuning: What Helps and When?
- ICASSP (T1)In-Sync: Adaptation of Speech Aware Large Language Models for ASR with Word Level Timestamp Predictions
- Interspeech (T1)Low-Burden Data Augmentation for Dysarthric ASR via Zero-Shot Voice Cloning
- Generative AI for the World: The First Workshop on Globalizing Tasks, Evaluations, and Systems at COLMMetaSICL: Adapting Auditory LLM via Meta Speech In-Context Learning (opens in a new tab)
- CVPR (T1)PDCR: Perception-Decomposed Confidence Reward for Vision-Language Reasoning (opens in a new tab)
- Interspeech (T1)Phoneme Error and Uncertainty Features for Interpretable Dysarthric Speech Assessment
- Interspeech (T1)Robust Multi-Tier Infant-Centered Audio Understanding with Whisper via Structured Speaker Conditioning
202522 papers
- Interspeech (T1)Aligning ASR Evaluation with Human and LLM Judgments: Intelligibility Metrics Using Phonetic, Semantic, and NLI Approaches (opens in a new tab)
- Interspeech (T1)Band-Split Self-supervised Mamba for Infant-centered Audio Analysis (opens in a new tab)
- ICLR (T1)Can Video LLMs Refuse to Answer? Alignment for Answerability in Video Large Language Models (opens in a new tab)
- ICASSP (T1)Cohort-Sensitive Labeling: An Effective Approach for Enhancing ASR Performance (opens in a new tab)
- ICML (T1)ConfPO: Exploiting Policy Model Confidence for Critical Token Selection in Preference Optimization (opens in a new tab)
- ICASSP (T1)Dysarthric Speech Conformer: Adaptation for Sequence-to-Sequence Dysarthric Speech Recognition (opens in a new tab)
- Interspeech (T1)FAI: A Benchmark Dataset for Fairness in Speech Technology (opens in a new tab)
- IEEE Journal on Selected Topics in Signal ProcessingGuest Editorial: Modeling and Processing Language and Speech in Neurodegenerative Disorders
- ICASSP (T1)Improved Recognition of the Speech of People with Parkinson’s who Stutter (opens in a new tab)
- International Congress of Parkinson's Disease and Movement DisordersImproving Automatic Speech Recognition (ASR) for People with Parkinson's Disease (opens in a new tab)
- Society for Research in Child Development (SRCD) Biennial MeetingInfant-directed speech prosody and real-time infant gaze at the mother’s face: A machine-learning approach
- J. Acoust. Soc. Am.Introduction to special issue on acoustic cue-based perception and production of speech by humans and machines (opens in a new tab)
202420 papers
- ICONIPA Comprehensive Performance Evaluation of Whisper Models in Dysarthric Speech Recognition (opens in a new tab)
- American Speech Language Hearing Association (ASHA) Annual ConventionAn Overview of Speech Data in the Speech Accessibility Project: Speech Variations for Inclusive Technology (opens in a new tab)
- ICLR (T1)C-TPT: Calibrated Test-Time Prompt Tuning for Vision-Language Models via Text Feature Dispersion (opens in a new tab)
- Journal of Speech Language and Hearing ResearchCommunity-supported shared infrastructure in support of speech accessibility (opens in a new tab)
- Interspeech (T1)Enhancing Child Vocalization Classification with Phonetically-Tuned Embeddings for Assisting Autism Diagnosis
- JMIR Human FactorsEvaluating Users’ Experiences of a Child Multimodal Wearable Device: A Mixed Methods Approach
- LRECFinding Spoken Identifications: Using GPT-4 Annotation For An Efficient And Fast Dataset Creation Pipeline (opens in a new tab)
- Interspeech (T1)Fine-Tuning Automatic Speech Recognition for People with Parkinson's: An Effective Strategy for Enhancing Speech Technology Accessibility
- ICASSP (T1)G2PU: Grapheme-to-Phoneme Transducer with Speech Units
- BSNInfantMotion2Vec: Unlabeled Data-Driven Infant Pose Estimation Using a Single Chest IMU (opens in a new tab)
- SLTJust ASR + LLM? A Study on Speech Large Language Models’ Ability to Identify and Understand Speaker in Spoken Dialogue (opens in a new tab)
- Interspeech (T1)LI-TTA: Language Informed Test-Time Adaptation for Automatic Speech Recognition
20239 papers
- Asia Pacific Signal and Information Processing Association Annual Summit and ConferenceClassification of infant sleep/wake states: cross-attention among large scale pretrained transformer networks using audio, ECG, and IMU data (opens in a new tab)
- ICASSP (T1)Dual-Path Cross-Modal Attention for better Audio-Visual Speech Extraction (opens in a new tab)
- Interspeech (T1)End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions
- Interspeech (T1)Mitigating the Exposure Bias in Sentence-Level Grapheme-to-Phoneme (G2P) Transduction
- Findings of ACLSpeak and Decipher and Sign: Toward Unsupervised Speech-to-Sign Language Recognition (opens in a new tab)
- Proceedings of the International Symposium on Human Factors and Ergonomics in Health CareThe Importance of Diverse User Goals When Designing an Automated COVID Risk Counselor (opens in a new tab)
- Human Factors in HealthcareThe Influence of Memory for and Affective Response to Health Messages on Self-care Behavioral Intentions
- Interspeech (T1)Towards Robust Family-Infant Audio Analysis Based on Unsupervised Pretraining of Wav2vec 2.0 on Large-Scale Unlabeled Family Audio (opens in a new tab)
- Interspeech (T1)Wav2ToBI: a new approach to automatic ToBI transcription
Where alumni went79 listed
Apply to UIUCFall 2027
UIUC Siebel Computer Science PhD
- Round
- Single round
- Opens
- —
- GRE
- optional
- English
- TOEFL iBT / IELTS
- Fee
- USD 90
Not yet confirmed for this intake.
Similar labsnearest by research summary
- USGeorgia Tech
Larry Heck
- Dialogue, generation & summarization
- USCMU
Bhiksha Raj
- Speech recognition & spoken language
- SGNTU
Andy W. H. Khong
- Speech enhancement & signal processing
- CNPeking
Jing Chen
- Speech recognition & spoken language
- GBEdinburgh
Catherine Lai
- Speech recognition & spoken language
- CNPeking
Yuexian Zou
- Data management & big data
Your notes
Save this lab to keep notes.
Data
Checked against the lab homepage.
- Collected
- Verified
- Papers
- The lab homepage
- Members
- Lab homepage
- Alumni
- Lab homepage
Tiers are venue classifications, not lab rankings.
UIUCcloses