Zhou Zhao
教授
Works on multimodal learning, including speech and singing-voice synthesis, audio generation and video-language understanding.
Zhou Zhao's lab at Zhejiang works on speech synthesis & voice, speech recognition & spoken language and vision-language & multimodal. 194 papers since 2023, 136 at top venues, mostly ACL and Findings of ACL. Applications close .
At a glance
- papers, 2023–2026
- 51/ year
- at T1 venues
- 70%
- PhD students
- —
- MS students
- —
- alumni listed
- —
Papers by yearfrom DBLP, 2023–2026
- 31 papers2026 · T1 20 · collecting
- 63 papers2025 · T1 48
- 51 papers2024 · T1 35
- 49 papers2023 · T1 33
T1 venuesOtherVenues: ACL, Findings of ACL, NeurIPS, ACM MM, ICLR
Research focuspaper titles that use each topic's words
- Speech recognition & spoken language65 papers
- Speech synthesis & voice51 papers
- Vision-language & multimodal48 papers
- audio31 papers
- multimodal learning1 paper
Paper list
From DBLP.
202631 papers
- TPAMI (T1)A Survey of Direct Preference Optimization: Datasets, Theories, Variants, and Applications (opens in a new tab)
- ICLR (T1)AlignSep: Temporally-Aligned Video-Queried Sound Separation with Flow Matching (opens in a new tab)
- Findings of ACLBridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Search (opens in a new tab)
- TPAMI (T1)Chat-Scene++: Exploiting Context-Rich Object Identification for 3D LLM (opens in a new tab)
- ICLR (T1)CIAR: Interval-based Collaborative Decoding for Image Generation Acceleration (opens in a new tab)
- Findings of ACLComprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (opens in a new tab)
- ICLR (T1)Depth Anything with Any Prior (opens in a new tab)
- ECCV (T1)Diffusion Model as a Generalist Segmentation Learner (opens in a new tab)
- Findings of ACLDiTReducio: A Training-Free Acceleration for DiT-Based TTS via Progressive Calibration (opens in a new tab)
- KDD (T1)DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark (opens in a new tab)
- ACL (T1)Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models (opens in a new tab)
- ICLR (T1)Figma2Code: Automating Multimodal Design to Code in the Wild (opens in a new tab)
202563 papers
- ACM MMA Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference (opens in a new tab)
- NeurIPS (T1)AHa-Bench: Benchmarking Audio Hallucinations in Large Audio-Language Models (opens in a new tab)
- NeurIPS (T1)AnomalyCoT: A Multi-Scenario Chain-of-Thought Dataset for Multimodal Large Language Models (opens in a new tab)
- IJCNLP-AACLASAudio: A Survey of Advanced Spatial Audio Research (opens in a new tab)
- ICCV (T1)Bridging Domain Generalization to Multimodal Domain Generalization via Unified Representations (opens in a new tab)
- ACL (T1)CART: A Generative Cross-Modal Retrieval Framework With Coarse-To-Fine Semantic Modeling (opens in a new tab)
- ICML (T1)CodeSync: Synchronizing Large Language Models with Dynamic Code Evolution at Scale (opens in a new tab)
- ACL (T1)ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control (opens in a new tab)
- ICASSP (T1)Curriculum Learning aided Audio-Visual Speech Recognition with Arbitrary Speaker Number (opens in a new tab)
- Findings of NAACLData-Efficiently Learn Large Language Model for Universal 3D Scene Perception (opens in a new tab)
- ICML (T1)Dataflow-Guided Neuro-Symbolic Language Models for Type Inference (opens in a new tab)
- WWW (T1)EAGER-LLM: Enhancing Large Language Models as Recommenders through Exogenous Behavior-Semantic Integration (opens in a new tab)
202451 papers
- NeurIPS (T1)Action Imitation in Common Action Space for Customized Action Image Synthesis (opens in a new tab)
- ACL (T1)AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension (opens in a new tab)
- AAAI (T1)AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head (opens in a new tab)
- ACM MMAudioLCM: Efficient and High-Quality Text-to-Audio Generation with Minimal Inference Steps (opens in a new tab)
- ACM MMBoosting Speech Recognition Robustness to Modality-Distortion with Contrast-Augmented Prompts (opens in a new tab)
- ACM MMCalibrating Prompt from History for Continual Vision-Language Retrieval and Grounding (opens in a new tab)
- TKDE (T1)Causal Distillation for Alleviating Performance Heterogeneity in Recommender Systems (opens in a new tab)
- NeurIPS (T1)Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers (opens in a new tab)
- NeurIPS (T1)Classifier-guided Gradient Modulation for Enhanced Multimodal Learning (opens in a new tab)
- ACM MMCross-modal Observation Hypothesis Inference (opens in a new tab)
- NeurIPS (T1)E3: Exploring Embodied Emotion Through A Large-Scale Egocentric Video Dataset (opens in a new tab)
- KDD (T1)EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration (opens in a new tab)
202349 papers
- EMNLP (T1)3DRP-Net: 3D Relative Position-aware Network for 3D Visual Grounding (opens in a new tab)
- NeurIPS (T1)Achieving Cross Modal Generalization with Multimodal Unified Representation (opens in a new tab)
- Findings of ACLAlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignment (opens in a new tab)
- CVPR (T1)ANetQA: A Large-scale Benchmark for Fine-grained Compositional Reasoning over Untrimmed Videos (opens in a new tab)
- EMNLP (T1)ART: rule bAsed futuRe-inference deducTion (opens in a new tab)
- ACL (T1)AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation (opens in a new tab)
- SIGIR (T1)Beyond Two-Tower Matching: Learning Sparse Retrievable Cross-Interactions for Recommendation (opens in a new tab)
- ACL (T1)CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training (opens in a new tab)
- NeurIPS (T1)Connecting Multi-modal Contrastive Representations (opens in a new tab)
- Findings of ACLContrastive Token-Wise Meta-Learning for Unseen Performer Visual Temporal-Aligned Translation (opens in a new tab)
- NeurIPS (T1)Cross-modal Prompts: Adapting Large Pre-trained Models for Audio-Visual Downstream Tasks (opens in a new tab)
- CVPR (T1)DATE: Domain Adaptive Product Seeker for E-Commerce (opens in a new tab)
Where alumni went
Alumni are not listed on the lab homepage.
Apply to ZhejiangFall 2027
Computer Science PhD (international applicants)
- Round
- Self-funded
- Opens
- —
- GRE
- See program page
- English
- Per ZJU language requirements
- Fee
- RMB 800
Not yet confirmed for this intake.
Similar labsnearest by research summary
- GBCambridge
Weiwei Sun
- Multilingual, translation & linguistics
- GBEdinburgh
Adam Lopez
- Multilingual, translation & linguistics
- USStanford
Christopher Manning
- Multilingual, translation & linguistics
- USCMU
Mona Diab
- Multilingual, translation & linguistics
- SGNUS
Hwee Tou Ng
- Multilingual, translation & linguistics
- CNPeking
Zhihong Deng
16 T1
Your notes
Save this lab to keep notes.
Data
Some numbers could not be verified:
- The member list could not be found on the lab site.
- The alumni list could not be found on the lab site.
- The lab site and the paper record do not agree.
- Collected
- Verified
- Papers
- DBLP
- Members
- Not collected
- Alumni
- Not collected
Tiers are venue classifications, not lab rankings.
Zhejiangcloses