Ruohan Gao
Assistant Professor
Studies multisensory machine perception, learning from sight, sound and touch for embodied agents and audio-visual scene understanding.
Ruohan Gao's lab at UMD works on recognition, detection & segmentation, embodied & active vision and robot perception & SLAM. 29 papers since 2023, 26 at top venues, mostly CVPR and ICCV. 4 PhD students.
At a glance
- papers, 2023–2026
- 8/ year
- at T1 venues
- 90%
- PhD students
- 4
- MS students
- 0
- alumni listed
- —
Papers by yearfrom the lab homepage, 2023–2026
- 6 papers2026 · T1 6 · collecting
- 9 papers2025 · T1 7
- 5 papers2024 · T1 5
- 9 papers2023 · T1 8
T1 venuesOtherVenues: CVPR, ICCV, CoRL, ECCV, ICLR
Research focuspaper titles that use each topic's words
- multisensory4 papers
- Robot perception & SLAM3 papers
- Embodied & active vision2 papers
- Recognition, detection & segmentation0 papers
- machine perception0 papers
Paper list
From the lab homepage.
20266 papers
- CoRL (T1)ControlTac: Scaling Tactile Data with Physically Controlled Tactile Image Generation
- CVPR (T1)Do Audio-Visual Large Language Models Really See and Hear?
- ECCV (T1)Objects as Audio-Visual Modal Sound Fields
- CoRL (T1)OdorSpaces: Visual-Olfactory Embodied Navigation in 3D Environments
- CoRL (T1)OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies
- CVPR (T1)SonoWorld: From One Image to a 3D Audio-Visual Scene
20259 papers
- ICCV (T1)Aurelia: Test-time Reasoning Distillation in Audio-Visual LLMs
- ICCV (T1)AVTrustBench: Assessing and Enhancing Reliability and Robustness in Audio-Visual LLMs
- ICCV (T1)Differentiable Room Acoustic Rendering with Multi-View Vision Priors
- ICCV (T1)EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception
- ICCV (T1)GenFlowRL: Shaping Rewards with Generative Object-Centric Flow in Visual Reinforcement Learning
- CVPR (T1)Hearing Anywhere in Any Environment
- CVPR (T1)Learning to Highlight Audio by Watching Movies
- AI MagazineMultisensory Machine Intelligence
- WASPAATowards Perception-Informed Latent HRTF Representations
20245 papers
- SIGGRAPH (T1)DiffSound: Differentiable Modal Sound Rendering and Inverse Rendering for Diverse Inference Tasks
- CVPR (T1)Hearing Anything Anywhere
- ECCV (T1)Meerkat: Audio-Visual Large Language Model for Grounding in Space and Time
- ECCV (T1)Spherical World-Locking for Audio-Visual Localization in Egocentric Videos
- CVPR (T1)The Audio-Visual Conversational Graph: From an Egocentric-Exocentric Perspective
20239 papers
- ICLR (T1)An Extensible Multi-modal Multi-task Object Dataset with Materials
- RA-LDifferentiable Physics Simulation of Dynamics-Augmented Neural Objects
- TMLR (T1)Learning Object-Centric Neural Scattering Functions for Free-Viewpoint Relighting and Scene Composition
- CoRL (T1)NOIR: Neural Signal Operated Intelligent Robot for Everyday Activities
- CVPR (T1)RealImpact: A Dataset of Impact Sound Fields for Real Objects
- ICRA (T1)Sonicverse: A Multisensory Simulation Platform for Training Household Agents that See and Hear
- NeurIPS (T1)SoundCam: A Dataset for Tasks in Tracking and Identifying Humans from Real Room Acoustics
- CVPR (T1)The ObjectFolder Benchmark: Multisensory Object-Centric Learning with Neural and Real Objects
- IJCV (T1)Visually-Guided Audio Spatialization in Video with Geometry-Aware Multi-task Learning
Where alumni went
Alumni are not listed on the lab homepage.
Apply to UMDFall 2027
Not announced yet
UMD Computer Science PhD
- Round
- Single round
- Opens
- —
- GRE
- See program page
- English
- See program page
- Fee
- See program page
Not yet confirmed for this intake.
Similar labsnearest by research summary
- CNPeking
Shiliang Zhang
- Recognition, detection & segmentation
- USUT Austin
Kristen Grauman
- Recognition, detection & segmentation
- CHEPFL
Sabine Süsstrunk
- Computational imaging & photography
- SGNUS
Robby Tan
- Recognition, detection & segmentation
- CNZhejiang
Dongming Lu
- Recognition, detection & segmentation
- SGNTU
Xudong Jiang
- Recognition, detection & segmentation
Your notes
Save this lab to keep notes.
Data
Some numbers could not be verified:
- The alumni list could not be found on the lab site.
- Collected
- Verified
- Papers
- The lab homepage
- Members
- Lab homepage
- Alumni
- Not collected
Tiers are venue classifications, not lab rankings.