Xiaolong Wang

Assistant Professor, UC San Diego [GitHub] [Google Scholar] [CV]
Home Publication Group Contact
Select All Publication by Year Self-Supervised Learning Video Understanding Common Sense Reasoning RL and Robotics 3D Interaction Dexterous Hand

Mazeyu Ji*, Ri-Zhao Qiu*, Xueyan Zou, Xiaolong Wang.
GraspSplats: Efficient Manipulation with 3D Feature Splatting.
Conference on Robot Learning (CoRL), 2024.

[arXiv] [project page] [code]

Xialin He*, Chengjing Yuan*, Wenxuan Zhou, Ruihan Yang, David Held, Xiaolong Wang.
Visual Manipulation with Legs.
Conference on Robot Learning (CoRL), 2024.

[arXiv] [project page]

Shiqi Yang, Minghuan Liu, Yuzhe Qin, Runyu Ding, Jialong Li, Xuxin Cheng, Ruihan Yang, Sha Yi, Xiaolong Wang.
ACE: A Cross-Platform Visual-Exoskeletons System for Low-Cost Dexterous Teleoperation.
Conference on Robot Learning (CoRL), 2024.

[arXiv] [project page] [code] [hardware design]

Jun Wang*, Ying Yuan*, Haichuan Che*, Haozhi Qi*, Yi Ma, Jitendra Malik, Xiaolong Wang.
Lessons from Learning to Spin “Pens”.
Conference on Robot Learning (CoRL), 2024.

[arXiv] [project page] [code]

Xuxin Cheng*, Jialong Li*, Shiqi Yang, Ge Yang, Xiaolong Wang.
Open-TeleVision: Teleoperation with Immersive Active Visual Feedback.
Conference on Robot Learning (CoRL), 2024.

[arXiv] [project page] [code] [hardware] [dataset]

Minghuan Liu*, Zixuan Chen*, Xuxin Cheng, Yandong Ji, Ruihan Yang, Xiaolong Wang.
Visual Whole-Body Control for Legged Loco-Manipulation.
Conference on Robot Learning (CoRL), 2024.
Oral Presentation

[arXiv] [project page] [code]

Ruihan Yang*, Zhuoqun Chen*, Jianhan Ma*, Chongyi Zheng*, Yiyu Chen, Quan Nguyen, Xiaolong Wang.
Generalized Animal Imitator: Agile Locomotion with Versatile Motion Prior.
Conference on Robot Learning (CoRL), 2024.
Workshop on Towards Reliable and Deployable Learning-Based Robotic Systems, CoRL 2023
Workshop Best Paper Award

[arXiv] [project page]

Adrian Remonda, Nicklas Hansen, Ayoub Raji, Nicola Musiu, Marko Bertogna, Eduardo E. Veas, Xiaolong Wang.
A Simulation Benchmark for Autonomous Racing with Large-Scale Human Data.
Conference on Neural Information Processing Systems (NeurIPS), 2024.

[arXiv] [project page] [code] [dataset]

Runyu Ding*, Yuzhe Qin*, Jiyue Zhu*, Chengzhe Jia, Shiqi Yang, Ruihan Yang, Xiaojuan Qi, Xiaolong Wang.
Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learning.
arXiv, 2024.

[arXiv] [project page] [code] [Hand URDFs]

Nicklas Hansen, Jyothir S V, Vlad Sobal, Yann LeCun, Xiaolong Wang†, Hao Su†.
Hierarchical World Models as Visual Whole-Body Humanoid Controllers.
arXiv, 2024.

[arXiv] [project page] [code]

Ri-Zhao Qiu, Yafei Hu, Ge Yang, Yuchen Song, Yang Fu, Jianglong Ye, Jiteng Mu, Ruihan Yang, Nikolay Atanasov, Sebastian Scherer, Xiaolong Wang.
Learning Generalizable Feature Fields for Mobile Manipulation.
arXiv, 2024.

[arXiv] [project page]

Xuxin Cheng*, Yandong Ji*, Junming Chen, Ruihan Yang, Ge Yang, Xiaolong Wang.
Expressive Whole-Body Control for Humanoid Robots.
Robotics: Science and Systems (RSS), 2024.

[arXiv] [project page] [code]

Ruihan Yang, Yejin Kim, Aniruddha Kembhavi, Xiaolong Wang, Kiana Ehsani.
Harmonic Mobile Manipulation.
International Conference on Intelligent Robots and Systems (IROS), 2024.
Oral Presentation
Best Paper Award on Mobile Manipulation

[arXiv] [project page]

Kang-Won Lee, Yuzhe Qin, Xiaolong Wang, Soo-Chul Lim.
DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity.
Robotics and Automation Letters (RA-L), 2024.

[arXiv] [project page]

Jun Wang*, Yuzhe Qin*, Kaiming Kuang, Yigit Korkmaz, Akhilan Gurumoorthy, Hao Su, Xiaolong Wang.
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation.
Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

[arXiv] [project page]

Ying Yuan*, Haichuan Che*, Yuzhe Qin*, Binghao Huang, Zhao-Heng Yin, Kang-Won Lee, Yi Wu, Soo-Chul Lim, Xiaolong Wang.
Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing.
International Conference on Robotics and Automation (ICRA), 2024.

[arXiv] [project page] [code]

Entong Su, Chengzhe Jia, Yuzhe Qin, Wenxuan Zhou, Annabella Macaluso, Binghao Huang, Xiaolong Wang.
Sim2Real Manipulation on Unknown Objects with Tactile-based Reinforcement Learning.
International Conference on Robotics and Automation (ICRA), 2024.

[arXiv] [project page]

Nicklas Hansen, Hao Su*, Xiaolong Wang*.
TD-MPC2: Scalable, Robust World Models for Continuous Control.
International Conference on Learning Representations (ICLR), 2024.
Spotlight

[arXiv] [project page] [code] [models] [dataset]

Lirui Wang, Yiyang Ling*, Zhecheng Yuan*, Mohit Shridhar, Chen Bao, Yuzhe Qin, Bailin Wang, Huazhe Xu, Xiaolong Wang.
GenSim: Generating Robotic Simulation Tasks via Large Language Models.
International Conference on Learning Representations (ICLR), 2024.
Spotlight
Workshop on Language Grounding and Robot Learning, CoRL 2023
Workshop Best Paper Award

[arXiv] [project page] [code] [demo]

Binghao Huang, Yuanpei Chen, Tianyu Wang, Yuzhe Qin, Yaodong Yang, Nikolay Atanasov, Xiaolong Wang.
Dynamic Handover: Throw and Catch with Bimanual Hands .
Conference on Robot Learning (CoRL), 2023.

[arXiv] [project page] [code]

Yanjie Ze*, Ge Yan*, Yueh-Hua Wu*, Annabella Macaluso, Yuying Ge, Jianglong Ye, Nicklas Hansen, Li Erran Li, Xiaolong Wang.
GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fields.
Conference on Robot Learning (CoRL), 2023.
Oral Presentation

[arXiv] [project page] [code]

Yunhai Feng*, Nicklas Hansen*, Ziyan Xiong*, Chandramouli Rajagopalan, Xiaolong Wang.
Finetuning Offline World Models in the Real World.
Conference on Robot Learning (CoRL), 2023.
Oral Presentation

[arXiv] [project page] [code]

Yueh-Hua Wu, Xiaolong Wang*, Masashi Hamaya*.
Elastic Decision Transformer.
Conference on Neural Information Processing Systems (NeurIPS), 2023.

[arXiv] [project page] [code]

Nicklas Hansen*, Zhecheng Yuan*, Yanjie Ze*, Tongzhou Mu*, Aravind Rajeswaran+, Hao Su+, Huazhe Xu+, Xiaolong Wang+.
On Pre-Training for Visuo-Motor Control: Revisiting a Learning-from-Scratch Baseline.
International Conference on Machine Learning (ICML), 2023.

[arXiv] [code]

Zhao-Heng Yin*, Binghao Huang*, Yuzhe Qin, Qifeng Chen, Xiaolong Wang.
Rotating without Seeing: Towards In-hand Dexterity through Touch.
Robotics: Science and Systems (RSS), 2023.

[arXiv] [project page] [video] [code]

Ruihan Yang, Ge Yang, Xiaolong Wang.
Neural Volumetric Memory for Visual Locomotion Control.
Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Highlight

[arXiv] [project page] [video]

Yuying Ge, Annabella Macaluso, Li Erran Li, Ping Luo, Xiaolong Wang.
Policy Adaptation from Foundation Model Feedback.
Conference on Computer Vision and Pattern Recognition (CVPR), 2023.

[arXiv] [project page]

Jianglong Ye*, Jiashun Wang*, Binghao Huang, Yuzhe Qin, Xiaolong Wang.
Learning Continuous Grasping Function with a Dexterous Hand from Human Demonstrations.
Robotics and Automation Letters (RA-L), 2023.
International Conference on Intelligent Robots and Systems (IROS), 2023.

[arXiv] [project page] [video] [code]

Yanjie Ze*, Nicklas Hansen*, Yinbo Chen, Mohit Jain, Xiaolong Wang.
Visual Reinforcement Learning with Self-Supervised 3D Representations.
Robotics and Automation Letters (RA-L), 2023.
International Conference on Intelligent Robots and Systems (IROS), 2023.

[arXiv] [project page] [code]

Nicklas Hansen, Yixin Lin, Hao Su, Xiaolong Wang, Vikash Kumar, Aravind Rajeswaran.
MoDem: Accelerating Visual Model-Based Reinforcement Learning with Demonstrations.
International Conference on Learning Representations (ICLR), 2023.

[arXiv] [project page] [code]

Yuzhe Qin*, Binghao Huang*, Zhao-Heng Yin, Hao Su, Xiaolong Wang.
DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulation.
Conference on Robot Learning (CoRL), 2022.

[arXiv] [project page] [video] [code]

Sateesh Kumar, Jonathan Zamora*, Nicklas Hansen*, Rishabh Jangir, Xiaolong Wang.
Graph Inverse Reinforcement Learning from Diverse Videos.
Conference on Robot Learning (CoRL), 2022 (Oral Presentation).

[arXiv] [project page] [video] [code]

Yueh-Hua Wu*, Jiashun Wang*, Xiaolong Wang.
Learning Generalizable Dexterous Manipulation from Human Grasp Affordance.
Conference on Robot Learning (CoRL), 2022.

[arXiv] [project page] [code]

Yuzhe Qin*, Yueh-Hua Wu*, Shaowei Liu, Hanwen Jiang, Ruihan Yang, Yang Fu, Xiaolong Wang.
DexMV: Imitation Learning for Dexterous Manipulation from Human Videos.
European Conference on Computer Vision (ECCV), 2022.

[arXiv] [project page] [video] [code]

Yuzhe Qin, Hao Su*, Xiaolong Wang*.
From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperation.
Robotics and Automation Letters (RA-L), 2022.
International Conference on Intelligent Robots and Systems (IROS), 2022.

[arXiv] [project page] [video] [code]

Chieko Sarah Imai*, Minghao Zhang*, Yuchen Zhang*, Marcin Kierebiński, Ruihan Yang, Yuzhe Qin, Xiaolong Wang.
Vision-Guided Quadrupedal Locomotion in the Wild with Multi-Modal Delay Randomization.
International Conference on Intelligent Robots and Systems (IROS), 2022.

[arXiv] [project page] [video] [code]

Nicklas Hansen, Xiaolong Wang*, Hao Su*.
Temporal Difference Learning for Model Predictive Control.
International Conference on Machine Learning (ICML), 2022.

[arXiv] [project page] [video] [code]

Rishabh Jangir*, Nicklas Hansen*, Sambaran Ghosal, Mohit Jain, Xiaolong Wang.
Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation.
Robotics and Automation Letters (RA-L), 2022.
International Conference on Robotics and Automation (ICRA), 2022.

[arXiv] [project page] [video] [code]

Ruihan Yang*, Minghao Zhang*, Nicklas Hansen, Huazhe Xu, Xiaolong Wang.
Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers.
International Conference on Learning Representations (ICLR), 2022 (Spotlight Presentation).

[arXiv] [project page] [video] [code]

Nicklas Hansen, Hao Su, Xiaolong Wang.
Stabilizing Deep Q-Learning with ConvNets and Vision Transformers under Data Augmentation.
Conference on Neural Information Processing Systems (NeurIPS), 2021.

[arXiv] [project page] [code]

Tianjun Zhang, Huazhe Xu, Xiaolong Wang, Yi Wu, Kurt Keutzer, Joseph E. Gonzalez, Yuandong Tian.
NovelD: A Simple yet Effective Exploration Criterion.
Conference on Neural Information Processing Systems (NeurIPS), 2021.

[pdf] [Talk] [code]

Minghao Zhang*, Pingcheng Jian*, Yi Wu, Huazhe Xu, Xiaolong Wang.
DAIR: Disentangled Attention Intrinsic Regularization for Safe and Efficient Bimanual Manipulation.
arXiv, 2021.

[arXiv] [project page]

Ilija Radosavovic, Xiaolong Wang, Lerrel Pinto, Jitendra Malik.
State-Only Imitation Learning for Dexterous Manipulation.
International Conference on Intelligent Robots and Systems (IROS), 2021.

[arXiv] [project page] [Talk]

Nicklas Hansen, Xiaolong Wang.
Generalization in Reinforcement Learning by Soft Data Augmentation.
International Conference on Robotics and Automation (ICRA), 2021.

[arXiv] [code] [project page]

Qiang Zhang, Tete Xiao, Alexei A. Efros, Lerrel Pinto, Xiaolong Wang.
Learning Cross-domain Correspondence for Control with Dynamics Cycle-consistency.
International Conference on Learning Representations (ICLR), 2021 (Oral Presentation).

[arXiv] [code] [project page]

Nicklas Hansen, Rishabh Jangir, Yu Sun, Guillem Alenyà, Pieter Abbeel, Alexei A. Efros, Lerrel Pinto, Xiaolong Wang.
Self-Supervised Policy Adaptation during Deployment.
International Conference on Learning Representations (ICLR), 2021 (Spotlight Presentation).

[arXiv] [code] [project page] [bair blog post]

Yunfei Li, Huazhe Xu, Yilin Wu, Xiaolong Wang, Yi Wu.
Solving Compositional Reinforcement Learning Problems via Task Reduction.
International Conference on Learning Representations (ICLR), 2021.

[arXiv] [code] [project page]

Zhenggang Tang, Chao Yu, Boyuan Chen, Huazhe Xu, Xiaolong Wang, Fei Fang, Simon Shaolei Du, Yu Wang, Yi Wu.
Discovering Diverse Multi-Agent Strategic Behavior via Reward Randomization.
International Conference on Learning Representations (ICLR), 2021.

[arXiv] [code] [project page]

Tianjun Zhang, Huazhe Xu, Xiaolong Wang, Yi Wu, Kurt Keutzer, Joseph E. Gonzalez, Yuandong Tian.
Multi-Agent Collaboration via Reward Attribution Decomposition.
arXiv, 2020.

[arXiv] [code] [project page] [Talk]

Ruihan Yang, Huazhe Xu, Yi Wu, Xiaolong Wang.
Multi-Task Reinforcement Learning with Soft Modularization.
Conference on Neural Information Processing Systems (NeurIPS), 2020.

[pdf] [code] [project page] [Talk]

Qian Long*, Zihan Zhou*, Abhinav Gupta, Fei Fang, Yi Wu†, Xiaolong Wang†.
Evolutionary Population Curriculum for Scaling Multi-Agent Reinforcement Learning.
International Conference on Learning Representations (ICLR), 2020.

[arXiv] [project page] [BibTeX] [code]

Wei Yang, Xiaolong Wang, Ali Farhadi, Abhinav Gupta and Roozbeh Mottaghi.
Visual Semantic Navigation using Scene Priors.
International Conference on Learning Representations (ICLR), 2019.

[arXiv] [video] [BibTeX]