Jayjun Lee

Welcome! I'm a PhD student in Robotics at the University of Michigan and a Robotics research intern at the Dexterity team at NVIDIA. I'm fortunate to be advised by Professor Nima Fazeli and to be a member of the Manipulation and Machine Intelligence (MMINT) Lab. My research focuses on robot learning and dexterity to develop robots that can perceive and interact with the physical world.

I graduated from Imperial College London where I received my BEng in Electronic and Information Engineering. Previously, I worked with Professor Ad Spiers in the Manipulation and Touch Lab. I also worked with Professor Joyce Chai in the Situated Language and Embodied Dialogue (SLED) Lab and Professor Cindy Chestek in the Cortical Neural Prosthetics Lab.

Github     Google Scholar     Twitter

Email: [unscramble]

News

Jan. 2026

VA2Contact is accepted to ICRA 2026 in Vienna, Austria!

Jan. 2026

I joined the Dexterity team at NVIDIA as a Robotics research Intern!

Sep. 2025

I'm co-organizing Human-to-Robot workshop at CoRL 2025!

Aug. 2025

AimBot is accepted to CoRL 2025 in Seoul, Korea!

Apr. 2025

ViTaSCOPE is accepted to RSS 2025 in Los Angeles!

Some recent highlights from our research:
* indicates equal contribution
https://hydroshear.github.io/

HydroShear: Hydroelastic Shear Simulation for Tactile Sim-to-Real Reinforcement Learning

*, *, , , , , and
Webpage  •   Paper

Visual-auditory Extrinsic Contact Estimation

*, *, and
International Conference on Robotics and Automation (ICRA) 2026
Webpage  •   Paper

https://aimbot-reticle.github.io/

AimBot: A Simple Auxiliary Visual Cue to Enhance Spatial Awareness of Visuomotor Policies

*, *, Yichi Zhang, Ziqiao Ma, Jianing Yang, Amir Zadeh, Chuan Li, , and
Conference on Robot Learning (CoRL) 2025
Webpage   •   Paper   •   Code

RACER: Rich Language-guided Failure Recovery Policies for Imitation Learning

*, *, , and
★ Best Overall Award @ UM AI Symposium 2024 ★
The 3rd Workshop on Language and Robot Learning (LangRob) @ CoRL 2024
International Conference on Robotics and Automation (ICRA) 2025
Webpage  •   Paper  •   Code

Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguities

*, *, *, , , , and
The 1st Pluralistic Alignment Workshop @ NeurIPS 2024
International Conference on Learning Representations (ICLR) 2025 (Oral, 1.8% acceptance rate)
Webpage  •   Paper  •   Code

Neural Inverse Source Problems

, , , and
Conference on Robot Learning (CoRL) 2024
Webpage  •   Paper  •   Code

Naturalistic Robot Arm Trajectory Generation via Representation Learning

and Adam Spiers
UK-RAS Towards Autonomous Robotic Systems (TAROS) 2023
PDF