Xie Chen
Tenured Track Associate Professor
Works on speech recognition, speech synthesis and audio language models in the X-LANCE lab.
Xie Chen's lab at SJTU works on speech recognition & spoken language, speech synthesis & voice and recognition, detection & segmentation. 123 papers since 2023, 90 at top venues, mostly Interspeech and ICASSP. Applications close .
At a glance
- papers, 2023–2026
- 32/ year
- at T1 venues
- 73%
- PhD students
- —
- MS students
- —
- alumni listed
- —
Papers by yearfrom the lab homepage, 2023–2026
- 40 papers2026 · T1 30 · collecting
- 37 papers2025 · T1 26
- 29 papers2024 · T1 20
- 17 papers2023 · T1 14
T1 venuesOtherVenues: Interspeech, ICASSP, ACL, ACM MM, TASLP
Research focuspaper titles that use each topic's words
- Speech recognition & spoken language90 papers
- Speech synthesis & voice72 papers
- speech64 papers
- Recognition, detection & segmentation16 papers
- x-lance0 papers
Paper list
From the lab homepage.
202640 papers
- AAAI (T1)AHAMask: Reliable Task Specification for Large Audio Language Models without Instructions
- TASLP (T1)Anonymization, Not Elimination: Utility-Preserved Speech Anonymization
- EMNLP (T1)AnyAudio-Judge: A Dynamic Rubric-Based Benchmark and Evaluator for Audio Instruction Following
- ICASSP (T1)AUV: Teaching Audio Universal Vector Quantization with Single Nested Codebook
- ICASSP (T1)Cross-Lingual F5-TTS: Towards Language-Agnostic Voice Cloning and Speech Synthesis
- ACM MMEfficient Chain-of-Modality Reasoning via Progressive Compression for Spoken Language Models
- ACL (T1)Evaluating the Expressive Appropriateness of Speech in Rich Contexts
- ACL (T1)FineLAP: Taming Heterogeneous Supervision for Fine-grained Language-Audio Pretraining
- IEEE Transactions on Industrial InformaticsFisher: A foundation model for multi-modal industrial signal comprehensive representation
- ACM MMIMTalker: Efficient Audio-driven Talking Face Generation with Implicit Motion Transfer
- ICASSP (T1)ISA-Bench: Benchmarking instruction sensitivity for large audio language models
- Interspeech (T1)Joint Learning Global-Local Speaker Classification to Enhance End-to-End Speaker Diarization and Recognition
202537 papers
- ICMEA Progressive Generation Framework with Speech Pre-trained Model for Expressive Voice Conversion
- Interspeech (T1)Accelerating Diffusion-based Text-to-Speech Model Training with Dual Modality Alignment
- Interspeech (T1)Accelerating Flow-Matching-Based Text-to-Speech via Empirically Pruned Step Sampling
- ASRUAudio-cot: Exploring chain-of-thought reasoning in large audio language model
- ICCV (T1)Bitrate-Controlled Diffusion for Disentangling Motion and Content in Video
- ICASSP (T1)DRCap: Decoding CLAP Latents with Retrieval-Augmented Generation for Zero-shot Audio Captioning
- AAAI (T1)ELLA-V: Stable Neural Codec Language Modeling with Alignment-Guided Sequence Reordering
- ACM MMEmovoice: Llm-based emotional text-to-speech model with freestyle text prompting
- Interspeech (T1)Empowering Large Language Models for End-to-End Speech Translation Leveraging Synthetic Data
- ICASSP (T1)Enhancing Low-Resource ASR through Versatile TTS: Bridging the Data Gap
- Findings of EMNLPEnhancing Speech-to-Speech Dialogue Modeling with End-to-End Retrieval-Augmented Generation
- Interspeech (T1)Exploring SSL Discrete Speech Features for Zipformer-based Contextual ASR
202429 papers
- Odyssey1st Place Solution to Odyssey Emotion Recognition Challenge Task1: Tackling Class Imbalance Problem
- ICASSP (T1)Acoustic BPE for speech generation with discrete tokens
- TASLP (T1)Advanced long-content speech recognition with factorized neural transducer
- ACM MMAniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding
- Interspeech (T1)AnoPatch: Towards Better Consistency in Machine Anomalous Sound Detection
- SLTAttention-Constrained Inference for Robust Decoder-Only Text-to-Speech
- ICML (T1)BAT: Learning to Reason about Spatial Sounds with Large Language Models
- SLTCTC-Assisted LLM-Based Contextual ASR
- TASLP (T1)E3 TTS: End-to-End Text-Based Speech Editing TTS System and Its Applications
- IJCAI (T1)EAT: Self-supervised pre-training with efficient audio transformer
- Interspeech (T1)EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark
- Findings of ACLemotion2vec: Self-supervised pre-training for speech emotion representation
202317 papers
- ICASSP (T1)An Adapter Based Multi-Label Pre-Training for Speech Separation and Enhancement
- Interspeech (T1)Blank-regularized CTC for Frame Skipping in Neural Transducer
- ACM MMDAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder
- Interspeech (T1)DSE-TTS: Dual Speaker Embedding for Cross-Lingual Text-to-Speech
- ICASSP (T1)Emodiff: Intensity Controllable Emotional Text-to-Speech with Soft-Label Guidance
- ASRUExploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition
- ICASSP (T1)Factorized AED: Factorized Attention-Based Encoder-Decoder for Text-Only Domain Adaptive ASR
- ASRUFast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning
- ICASSP (T1)Front-End Adapter: Adapting Front-End Input of Speech Based Self-Supervised Learning for Speech Recognition
- Interspeech (T1)Improving Code-Switching and Name Entity Recognition in ASR with Speech Editing based Data Augmentation
- ICASSP (T1)Improving Few-Shot Learning for Talking Face System with TTS Data Augmentation
- ICASSP (T1)LongFNT: Long-Form Speech Recognition with Factorized Neural Transducer
Where alumni went
Alumni are not listed on the lab homepage.
Apply to SJTUFall 2027
Computer Science PhD (international applicants)
- Round
- Self-funded
- Opens
- —
- GRE
- See program page
- English
- See program page
- Fee
- See program page
Not yet confirmed for this intake.
Similar labsnearest by research summary
- GBEdinburgh
Simon King
- Speech recognition & spoken language
- CNPeking
Xihong Wu
- Speech recognition & spoken language
- USCMU
Richard Stern
- Speech recognition & spoken language
- USGeorgia Tech
Biing Hwang Juang
- Speech recognition & spoken language
- CNSJTU
Yanmin Qian
- Speech recognition & spoken language
- USCMU
Shinji Watanabe
- Speech recognition & spoken language
Your notes
Save this lab to keep notes.
Data
Some numbers could not be verified:
- The member list could not be found on the lab site.
- The alumni list could not be found on the lab site.
- Collected
- Verified
- Papers
- The lab homepage
- Members
- Not collected
- Alumni
- Not collected
Tiers are venue classifications, not lab rankings.
SJTUcloses