Jianhua Tao
Professor
Works on speech processing, affective computing, and multimodal information fusion.
Jianhua Tao's lab at Tsinghua works on speech recognition & spoken language, affective & health speech and multimodal & grounded language. 151 papers since 2023, 59 at top venues, mostly Interspeech and ACM MM. Applications close .
At a glance
- papers, 2023–2026
- 39/ year
- at T1 venues
- 39%
- PhD students
- —
- MS students
- —
- alumni listed
- —
Papers by yearfrom DBLP, 2023–2026
- 24 papers2026 · T1 14 · collecting
- 34 papers2025 · T1 15
- 60 papers2024 · T1 19
- 33 papers2023 · T1 11
T1 venuesOtherVenues: Interspeech, ACM MM, TAFFC, ICASSP, AAAI
Research focuspaper titles that use each topic's words
- Speech recognition & spoken language49 papers
- Multimodal & grounded language46 papers
- Affective & health speech36 papers
- affective computing4 papers
- speech processing0 papers
Paper list
From DBLP.
202624 papers
- Eng. Appl. Artif. Intell.A dual-layer bilevel optimization model to complete algorithm evolution in agile satellite task scheduling problem using Large Language Models (opens in a new tab)
- AAAI (T1)AStar: Boosting Multimodal Reasoning with Automated Structured Thinking (opens in a new tab)
- Findings of ACLATLAS: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoning (opens in a new tab)
- ACL (T1)Beyond Examples: Towards Automated Thought-level In-Context Reasoning for Large Language Models (opens in a new tab)
- Findings of ACLCAIR: Causal Adaptive Information-based Reinforcement Learning for Multimodal Emotion Reasoning (opens in a new tab)
- Pattern RecognitionCMDPAD: A Chinese multimodal dynamic personality and affect dataset for affect prediction in conversations (opens in a new tab)
- TPAMI (T1)Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline (opens in a new tab)
- ICLR (T1)EmoPrefer: Can Large Language Models Understand Human Emotion Preferences? (opens in a new tab)
- ICLR (T1)Exploring Knowledge Purification in Multi-Teacher Knowledge Distillation for LLMs (opens in a new tab)
- IEEE J. Sel. Top. Signal Process.Exploring the Use of Large Language Models and Interpretable Features for Explainable Speech Emotion Recognition (opens in a new tab)
- TPAMI (T1)IRNet: Iterative Refinement Network for Noisy Partial Label Learning (opens in a new tab)
- TAFFCMA-DLE: Speech-Based Automatic Depression Level Estimation via Memory Augmentation (opens in a new tab)
202534 papers
- Mach. Intell. Res.A Comprehensive Survey of Few-shot Information Networks (opens in a new tab)
- TAFFCA Knowledge Distillation-Based Approach to Speech Emotion Recognition (opens in a new tab)
- TAFFCA Residual Multi-Scale Convolutional Neural Network With Transformers for Speech Emotion Recognition (opens in a new tab)
- ICASSP (T1)Adversarial Training and Gradient Optimization for Partially Deepfake Audio Localization (opens in a new tab)
- ICML (T1)AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Models (opens in a new tab)
- ACM MMALLM4ADD: Unlocking the Capabilities of Audio Large Language Models for Audio Deepfake Detection (opens in a new tab)
- AAAI (T1)BSDB-Net: Band-Split Dual-Branch Network with Selective State Spaces Mechanism for Monaural Speech Enhancement (opens in a new tab)
- AAAI (T1)Code-switching Mediated Sentence-level Semantic Learning (opens in a new tab)
- IEEE Trans. Neural Networks Learn. Syst.DashFusion: Dual-Stream Alignment With Hierarchical Bottleneck Fusion for Multimodal Sentiment Analysis (opens in a new tab)
- IEEE Trans. Circuits Syst. Video Technol.Depression Scale Dictionary Decomposition Framework for Multimodal Automatic Depression Level Prediction (opens in a new tab)
- ICASSP (T1)DPI-TTS: Directional Patch Interaction for Fast-Converging and Style Temporal Modeling in Text-to-Speech (opens in a new tab)
- ACM MMEnhancing Multimodal Personality Assessment with LLM-Augmented Hierarchical Fusion (opens in a new tab)
202460 papers
- ISCSLPA Noval Feature via Color Quantisation for Fake Audio Detection (opens in a new tab)
- Intell. Comput.A Two-Stage Stacked Transformer Framework for Multimodal Sentiment Analysis (opens in a new tab)
- IJCNNAPC: Predict Global Representation From Local Observation In Multi-Agent Reinforcement Learning (opens in a new tab)
- Neural NetworksBayesian hypernetwork collaborates with time-difference evolutional network for temporal knowledge prediction (opens in a new tab)
- Findings of NAACLBilateral Masking with prompt for Knowledge Graph Completion (opens in a new tab)
- Speech Communication (T1)CFAD: A Chinese dataset for fake audio detection (opens in a new tab)
- Interspeech (T1)Codecfake: An Initial Dataset for Detecting LLM-based Deepfake Audio (opens in a new tab)
- NeurIPS (T1)DARNet: Dual Attention Refinement Network with Spatiotemporal Construction for Auditory Attention Detection (opens in a new tab)
- IEEE Trans. Circuits Syst. Video Technol.DepressionMLP: A Multi-Layer Perceptron Architecture for Automatic Depression Level Prediction via Facial Keypoints and Action Units (opens in a new tab)
- Neural NetworksDGSD: Dynamical graph self-distillation for EEG-based auditory spatial attention detection (opens in a new tab)
- CCLDistinguishing Neural Speech Synthesis Models Through Fingerprints in Speech Waveforms (opens in a new tab)
- ISCSLPDoes Current Deepfake Audio Detection Model Effectively Detect ALM-Based Deepfake Audio? (opens in a new tab)
202333 papers
- DADA@IJCAIAdaptive Fake Audio Detection with Low-Rank Model Squeezing (opens in a new tab)
- Neural NetworksAdaptive pseudo-Siamese policy network for temporal knowledge prediction (opens in a new tab)
- DADA@IJCAIADD 2023: the Second Audio Deepfake Detection Challenge (opens in a new tab)
- IEEE ACM Trans. Audio Speech Lang. Process.Adversarial Multi-Task Learning for Mandarin Prosodic Boundary Prediction With Multi-Modal Embeddings (opens in a new tab)
- NeurIPS (T1)ALIM: Adjusting Label Importance Mechanism for Noisy Partial Label Learning (opens in a new tab)
- Proc. IEEEAn Overview of Affective Speech Synthesis and Conversion in the Deep Learning Era (opens in a new tab)
- Interspeech (T1)Detection of Cross-Dataset Fake Audio Based on Prosodic and Pronunciation Features (opens in a new tab)
- ICML (T1)Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio Detection (opens in a new tab)
- TAFFCDual Attention and Element Recalibration Networks for Automatic Depression Level Prediction (opens in a new tab)
- Interspeech (T1)EmotionNAS: Two-stream Neural Architecture Search for Speech Emotion Recognition (opens in a new tab)
- MuSe@ACM MultimediaExclusive Modeling for MuSe-Personalisation Challenge (opens in a new tab)
- MuSe@ACM MultimediaExploring the Power of Cross-Contextual Large Language Model in Mimic Emotion Prediction (opens in a new tab)
Where alumni went
Alumni are not listed on the lab homepage.
Apply to TsinghuaFall 2027
Computer Science PhD (international applicants)
- Round
- Main
- Opens
- GRE
- See program page
- English
- Per school catalog
- Fee
- RMB 800
Not yet confirmed for this intake.
Similar labsnearest by research summary
- USCMU
Carlos Busso
- Speech recognition & spoken language
- USCMU
Chris Donahue
- Music, audio & sound
- USUIUC
Minje Kim
- Music, audio & sound
- HKCUHK
Qiuqiang Kong
- Music, audio & sound
- GBImperial
Patrick Naylor
- Music, audio & sound
- USMichigan
Hao-Wen Dong
- Music, audio & sound
Your notes
Save this lab to keep notes.
Data
Some numbers could not be verified:
- The member list could not be found on the lab site.
- The alumni list could not be found on the lab site.
- Collected
- Verified
- Papers
- DBLP
- Members
- Not collected
- Alumni
- Not collected
Tiers are venue classifications, not lab rankings.
Tsinghuacloses