Xiaolong Wang

Assistant Professor, UC San Diego [GitHub] [Google Scholar] [CV]
Home Publication Group Contact

Ying Yuan*, Haichuan Che*, Yuzhe Qin*, Binghao Huang, Zhao-Heng Yin, Kang-Won Lee, Yi Wu, Soo-Chul Lim, Xiaolong Wang.
Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing.
arXiv, 2023.

[arXiv] [project page]

Nicklas Hansen, Hao Su*, Xiaolong Wang*.
TD-MPC2: Scalable, Robust World Models for Continuous Control.
arXiv, 2023.

[arXiv] [project page] [code] [models] [dataset]

Lirui Wang, Yiyang Ling*, Zhecheng Yuan*, Mohit Shridhar, Chen Bao, Yuzhe Qin, Bailin Wang, Huazhe Xu, Xiaolong Wang.
GenSim: Generating Robotic Simulation Tasks via Large Language Models.
arXiv, 2023.
Workshop on Language Grounding and Robot Learning, CoRL 2023
Workshop Best Paper Award

[arXiv] [project page] [code] [demo]

Ruihan Yang*, Zhuoqun Chen*, Jianhan Ma*, Chongyi Zheng*, Yiyu Chen, Quan Nguyen, Xiaolong Wang.
Generalized Animal Imitator: Agile Locomotion with Versatile Motion Prior.
arXiv, 2023.
Workshop on Towards Reliable and Deployable Learning-Based Robotic Systems, CoRL 2023
Workshop Best Paper Award

[arXiv] [project page]

Binghao Huang, Yuanpei Chen, Tianyu Wang, Yuzhe Qin, Yaodong Yang, Nikolay Atanasov, Xiaolong Wang.
Dynamic Handover: Throw and Catch with Bimanual Hands .
Conference on Robot Learning (CoRL), 2023.

[arXiv] [project page]

Yanjie Ze*, Ge Yan*, Yueh-Hua Wu*, Annabella Macaluso, Yuying Ge, Jianglong Ye, Nicklas Hansen, Li Erran Li, Xiaolong Wang.
GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fields.
Conference on Robot Learning (CoRL), 2023.
Oral Presentation

[arXiv] [project page] [code]

Yunhai Feng*, Nicklas Hansen*, Ziyan Xiong*, Chandramouli Rajagopalan, Xiaolong Wang.
Finetuning Offline World Models in the Real World.
Conference on Robot Learning (CoRL), 2023.
Oral Presentation

[arXiv] [project page] [code]

Yueh-Hua Wu, Xiaolong Wang*, Masashi Hamaya*.
Elastic Decision Transformer.
Conference on Neural Information Processing Systems (NeurIPS), 2023.

[arXiv] [project page] [code]

Nicklas Hansen*, Zhecheng Yuan*, Yanjie Ze*, Tongzhou Mu*, Aravind Rajeswaran+, Hao Su+, Huazhe Xu+, Xiaolong Wang+.
On Pre-Training for Visuo-Motor Control: Revisiting a Learning-from-Scratch Baseline.
International Conference on Machine Learning (ICML), 2023.

[arXiv]

Zhao-Heng Yin*, Binghao Huang*, Yuzhe Qin, Qifeng Chen, Xiaolong Wang.
Rotating without Seeing: Towards In-hand Dexterity through Touch.
Robotics: Science and Systems (RSS), 2023.

[arXiv] [project page] [video]

Ruihan Yang, Ge Yang, Xiaolong Wang.
Neural Volumetric Memory for Visual Locomotion Control.
Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Highlight

[arXiv] [project page] [video]

Yuying Ge, Annabella Macaluso, Li Erran Li, Ping Luo, Xiaolong Wang.
Policy Adaptation from Foundation Model Feedback.
Conference on Computer Vision and Pattern Recognition (CVPR), 2023.

[arXiv] [project page]

Jianglong Ye*, Jiashun Wang*, Binghao Huang, Yuzhe Qin, Xiaolong Wang.
Learning Continuous Grasping Function with a Dexterous Hand from Human Demonstrations.
Robotics and Automation Letters (RA-L), 2023.
International Conference on Intelligent Robots and Systems (IROS), 2023.

[arXiv] [project page] [video]

Yanjie Ze*, Nicklas Hansen*, Yinbo Chen, Mohit Jain, Xiaolong Wang.
Visual Reinforcement Learning with Self-Supervised 3D Representations.
Robotics and Automation Letters (RA-L), 2023.
International Conference on Intelligent Robots and Systems (IROS), 2023.

[arXiv] [project page] [code]

Nicklas Hansen, Yixin Lin, Hao Su, Xiaolong Wang, Vikash Kumar, Aravind Rajeswaran.
MoDem: Accelerating Visual Model-Based Reinforcement Learning with Demonstrations.
International Conference on Learning Representations (ICLR), 2023.

[arXiv] [project page] [code]

Yuzhe Qin*, Binghao Huang*, Zhao-Heng Yin, Hao Su, Xiaolong Wang.
DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulation.
Conference on Robot Learning (CoRL), 2022.

[arXiv] [project page] [video]

Sateesh Kumar, Jonathan Zamora*, Nicklas Hansen*, Rishabh Jangir, Xiaolong Wang.
Graph Inverse Reinforcement Learning from Diverse Videos.
Conference on Robot Learning (CoRL), 2022 (Oral Presentation).

[arXiv] [project page] [video] [code]

Yueh-Hua Wu*, Jiashun Wang*, Xiaolong Wang.
Learning Generalizable Dexterous Manipulation from Human Grasp Affordance.
Conference on Robot Learning (CoRL), 2022.

[arXiv] [project page] [code]

Yuzhe Qin*, Yueh-Hua Wu*, Shaowei Liu, Hanwen Jiang, Ruihan Yang, Yang Fu, Xiaolong Wang.
DexMV: Imitation Learning for Dexterous Manipulation from Human Videos.
European Conference on Computer Vision (ECCV), 2022.

[arXiv] [project page] [video] [code]

Yuzhe Qin, Hao Su*, Xiaolong Wang*.
From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperation.
Robotics and Automation Letters (RA-L), 2022.
International Conference on Intelligent Robots and Systems (IROS), 2022.

[arXiv] [project page] [video]

Chieko Sarah Imai*, Minghao Zhang*, Yuchen Zhang*, Marcin Kierebiński, Ruihan Yang, Yuzhe Qin, Xiaolong Wang.
Vision-Guided Quadrupedal Locomotion in the Wild with Multi-Modal Delay Randomization.
International Conference on Intelligent Robots and Systems (IROS), 2022.

[arXiv] [project page] [video] [code]

Nicklas Hansen, Xiaolong Wang*, Hao Su*.
Temporal Difference Learning for Model Predictive Control.
International Conference on Machine Learning (ICML), 2022.

[arXiv] [project page] [video] [code]

Rishabh Jangir*, Nicklas Hansen*, Sambaran Ghosal, Mohit Jain, Xiaolong Wang.
Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation.
Robotics and Automation Letters (RA-L), 2022.
International Conference on Robotics and Automation (ICRA), 2022.

[arXiv] [project page] [video] [code]

Ruihan Yang*, Minghao Zhang*, Nicklas Hansen, Huazhe Xu, Xiaolong Wang.
Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers.
International Conference on Learning Representations (ICLR), 2022 (Spotlight Presentation).

[arXiv] [project page] [video] [code]

Nicklas Hansen, Hao Su, Xiaolong Wang.
Stabilizing Deep Q-Learning with ConvNets and Vision Transformers under Data Augmentation.
Conference on Neural Information Processing Systems (NeurIPS), 2021.

[arXiv] [project page] [code]

Tianjun Zhang, Huazhe Xu, Xiaolong Wang, Yi Wu, Kurt Keutzer, Joseph E. Gonzalez, Yuandong Tian.
NovelD: A Simple yet Effective Exploration Criterion.
Conference on Neural Information Processing Systems (NeurIPS), 2021.

[pdf] [Talk] [code]

Minghao Zhang*, Pingcheng Jian*, Yi Wu, Huazhe Xu, Xiaolong Wang.
DAIR: Disentangled Attention Intrinsic Regularization for Safe and Efficient Bimanual Manipulation.
arXiv, 2021.

[arXiv] [project page]

Ilija Radosavovic, Xiaolong Wang, Lerrel Pinto, Jitendra Malik.
State-Only Imitation Learning for Dexterous Manipulation.
International Conference on Intelligent Robots and Systems (IROS), 2021.

[arXiv] [project page] [Talk]

Nicklas Hansen, Xiaolong Wang.
Generalization in Reinforcement Learning by Soft Data Augmentation.
International Conference on Robotics and Automation (ICRA), 2021.

[arXiv] [code] [project page]

Qiang Zhang, Tete Xiao, Alexei A. Efros, Lerrel Pinto, Xiaolong Wang.
Learning Cross-domain Correspondence for Control with Dynamics Cycle-consistency.
International Conference on Learning Representations (ICLR), 2021 (Oral Presentation).

[arXiv] [code] [project page]

Nicklas Hansen, Rishabh Jangir, Yu Sun, Guillem Alenyà, Pieter Abbeel, Alexei A. Efros, Lerrel Pinto, Xiaolong Wang.
Self-Supervised Policy Adaptation during Deployment.
International Conference on Learning Representations (ICLR), 2021 (Spotlight Presentation).

[arXiv] [code] [project page] [bair blog post]

Yunfei Li, Huazhe Xu, Yilin Wu, Xiaolong Wang, Yi Wu.
Solving Compositional Reinforcement Learning Problems via Task Reduction.
International Conference on Learning Representations (ICLR), 2021.

[arXiv] [code] [project page]

Zhenggang Tang, Chao Yu, Boyuan Chen, Huazhe Xu, Xiaolong Wang, Fei Fang, Simon Shaolei Du, Yu Wang, Yi Wu.
Discovering Diverse Multi-Agent Strategic Behavior via Reward Randomization.
International Conference on Learning Representations (ICLR), 2021.

[arXiv] [code] [project page]

Tianjun Zhang, Huazhe Xu, Xiaolong Wang, Yi Wu, Kurt Keutzer, Joseph E. Gonzalez, Yuandong Tian.
Multi-Agent Collaboration via Reward Attribution Decomposition.
arXiv, 2020.

[arXiv] [code] [project page] [Talk]

Ruihan Yang, Huazhe Xu, Yi Wu, Xiaolong Wang.
Multi-Task Reinforcement Learning with Soft Modularization.
Conference on Neural Information Processing Systems (NeurIPS), 2020.

[pdf] [code] [project page] [Talk]

Qian Long*, Zihan Zhou*, Abhinav Gupta, Fei Fang, Yi Wu†, Xiaolong Wang†.
Evolutionary Population Curriculum for Scaling Multi-Agent Reinforcement Learning.
International Conference on Learning Representations (ICLR), 2020.

[arXiv] [project page] [BibTeX] [code]

Wei Yang, Xiaolong Wang, Ali Farhadi, Abhinav Gupta and Roozbeh Mottaghi.
Visual Semantic Navigation using Scene Priors.
International Conference on Learning Representations (ICLR), 2019.

[arXiv] [video] [BibTeX]