James M. Rehg
Professor
Studies computer vision and machine learning, including egocentric video understanding and behavioral imaging for health.
James M. Rehg's lab at UIUC works on video understanding, computational imaging & photography and data management & big data. 63 papers since 2023, 44 at top venues, mostly CVPR and ECCV. 13 PhD students and 3 master's students. 12 alumni, most often to Google and Amazon. Applications close .
At a glance
- papers, 2023–2026
- 16/ year
- at T1 venues
- 70%
- PhD students
- 13
- MS students
- 3
- alumni listed
- 12
Papers by yearfrom the lab homepage and DBLP, 2023–2026
- 24 papers2026 · T1 13 · collecting
- 13 papers2025 · T1 12
- 17 papers2024 · T1 13
- 9 papers2023 · T1 6
T1 venuesOtherVenues: CVPR, ECCV, NeurIPS, ICLR, IJCV
Research focuspaper titles that use each topic's words
- Video understanding16 papers
- egocentric7 papers
- Data management & big data3 papers
- egocentric video2 papers
- Computational imaging & photography0 papers
Paper list
From the lab homepage and DBLP.
202624 papers
- —CoherentHand: Temporally Consistent 3D Hand Trajectory Synthesis with Semantic Motion Priors (opens in a new tab)
- —ConvDeck: Conversational Paper-to-Slide Generation via Stage-Specific User Feedback (opens in a new tab)
- ECCV (T1)Decoding Children's Gait Behavior (opens in a new tab)
- ICLR (T1)DiffVax: Optimization-Free Image Immunization Against Diffusion-Based Editing (opens in a new tab)
- —Exact Posterior Score Estimation for Solving Linear Inverse Problems (opens in a new tab)
- CVPR (T1)Forecasting 3D Scanpaths in Egocentric Video (opens in a new tab)
- CVPR (T1)Gaze Target Estimation Anywhere with Concepts (opens in a new tab)
- —GRASP: Learning to Ground Social Reasoning in Multi-Person Non-Verbal Interactions (opens in a new tab)
- CVPR (T1)How Much 3D Do Video Foundation Models Encode? (opens in a new tab)
- ECCV (T1)Kirin: Animal Motion Generation from In-the-Wild Video (opens in a new tab)
- ECCV (T1)Layer-Aware Video Composition via Split-then-Merge (opens in a new tab)
- —Learning Predictive Visuomotor Coordination (opens in a new tab)
202513 papers
- NeurIPS (T1)Cue3D: Quantifying the Role of Image Cues in Single-Image 3D Generation (opens in a new tab)
- NeurIPS (T1)DiffEye: Diffusion-Based Continuous Eye-Tracking Data Generation Conditioned on Natural Images (opens in a new tab)
- TPAMI (T1)Ego4D: Around the World in 3,600 Hours of Egocentric Video (opens in a new tab)
- NeurIPS (T1)Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMs (opens in a new tab)
- CVPR (T1)Gaze-LLE: Gaze Target Estimation via Large-scale Learned Encoders (opens in a new tab)
- CVPR (T1)Improving Personalized Search with Regularized Low-Rank Parameter Updates (opens in a new tab)
- Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.Pulse-PPG: An Open-Source Field-Trained PPG Foundation Model for Wearable Applications across Lab and Field Settings (opens in a new tab)
- CVPR (T1)ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Models (opens in a new tab)
- CVPR (T1)SocialGesture: Delving into Multi-person Gesture Understanding (opens in a new tab)
- CVPR (T1)SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images (opens in a new tab)
- CVPR (T1)Symmetry Strikes Back: From Single-Image Symmetry Detection to 3D Generation (opens in a new tab)
- NeurIPS (T1)Toward Human Deictic Gesture Target Estimation (opens in a new tab)
202417 papers
- ECCV (T1)3˟ 2: 3D Object Part Segmentation by 2D Semantic Correspondences (opens in a new tab)
- —3x2: 3D Object Part Segmentation by 2D Semantic Correspondences (opens in a new tab)
- IJCV (T1)Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives (opens in a new tab)
- CVPR (T1)LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs (opens in a new tab)
- ECCV (T1)LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuning (opens in a new tab)
- ECCV WorkshopLeveraging Object Priors for Point Tracking (opens in a new tab)
- ECCV (T1)Listen to Look into the Future: Audio-Visual Egocentric Gaze Anticipation (opens in a new tab)
- CVPR (T1)MAPLM: A Real-World Large-Scale Vision-Language Benchmark for Map and Traffic Scene Understanding (opens in a new tab)
- —MAPLM: A Real-World Large-Scale Vision-Language Dataset for Map and Traffic Scene Understanding (opens in a new tab)
- CVPR (T1)Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations (opens in a new tab)
- CVPR (T1)PointInfinity: Resolution-Invariant Point Diffusion Models (opens in a new tab)
- CVPR (T1)RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models (opens in a new tab)
20239 papers
- CVPR (T1)Egocentric Auditory Attention Localization in Conversations (opens in a new tab)
- CHILExplaining a machine learning decision to physicians via counterfactuals (opens in a new tab)
- TPAMI (T1)In the Eye of the Beholder: Gaze and Actions in First Person Video (opens in a new tab)
- IJCV (T1)In the Eye of Transformer: Global–Local Correlation for Egocentric Gaze Estimation and Beyond (opens in a new tab)
- NeurIPS (T1)Low-shot Object Learning with Mutual Exclusivity Bias (opens in a new tab)
- CVPR (T1)ShapeClipper: Scalable 3D Shape Learning from Single-View Images via Geometric and CLIP-based Consistency (opens in a new tab)
- —Werewolf Among Us: A Multimodal Dataset for Modeling Persuasion Behaviors in Social Deduction Games (opens in a new tab)
- Findings of ACLWerewolf Among Us: Multimodal Resources for Modeling Persuasion Behaviors in Social Deduction Games (opens in a new tab)
- AAMAS (T1)Which way is ‘right’?: Uncovering limitations of Vision-and-Language Navigation models (opens in a new tab)
Where alumni went12 listed, 75% to industry
Industry 6Academia 2
Most often to
- Amazon
- World Labs
Also to
- Tsinghua University
- UC Berkeley
Apply to UIUCFall 2027
UIUC Siebel Computer Science PhD
- Round
- Single round
- Opens
- —
- GRE
- optional
- English
- TOEFL iBT / IELTS
- Fee
- USD 90
Not yet confirmed for this intake.
Similar labsnearest by research summary
- CNPeking
Yang Liu
2 T1 - USNYU
Eero Simoncelli
- Recognition, detection & segmentation
- CNTsinghua
Qionghai Dai
- Computational imaging & photography
- USNYU
Yann LeCun
- Generative & foundation models
- CHEPFL
Jean-Philippe Thiran
- Image & video generation
- CHEPFL
Michael Unser
- Computational imaging & photography
Your notes
Save this lab to keep notes.
Data
Checked against the lab homepage.
- Collected
- Verified
- Papers
- The lab homepage and DBLP
- Members
- Lab homepage
- Alumni
- Lab homepage
Tiers are venue classifications, not lab rankings.
UIUCcloses