Jayjun Lee

Welcome! I'm a PhD student in Robotics at the University of Michigan and a Robotics Research intern at NVIDIA. I'm fortunate to be advised by Professor Nima Fazeli and to be a member of the Manipulation and Machine Intelligence (MMINT) Lab. My research focuses on Robot Learning – developing algorithms for robots to perceive and interact with the physical world. These days I'm interested in multi-modal (i.e. vision, tactile, F/T, language, audio) perception and learning representations to acquire contact- and force-rich manipulation skills.


Formal Bio     Github     Google Scholar     Twitter

Email: jayjun [at] umich [dot] edu

News

Jan. 2026

VA2Contact is accepted to ICRA 2026 in Vienna, Austria!

Jan. 2026

I joined NVIDIA as a Robotics Research Intern!

Sep. 2025

I'm co-organizing Human-to-Robot workshop at CoRL 2025!

Aug. 2025

AimBot is accepted to CoRL 2025 in Seoul, Korea!

Apr. 2025

ViTaSCOPE is accepted to RSS 2025 in Los Angeles!

Some recent highlights from our research:
* indicates equal contribution

Visual-auditory Extrinsic Contact Estimation

*, *, and
International Conference on Robotics and Automation (ICRA) 2026
Webpage  •   Paper

https://aimbot-reticle.github.io/

AimBot: A Simple Auxiliary Visual Cue to Enhance Spatial Awareness of Visuomotor Policies

*, *, Yichi Zhang, Ziqiao Ma, Jianing Yang, Amir Zadeh, Chuan Li, , and
Conference on Robot Learning (CoRL) 2025
Webpage   •   Paper   •   Code

RACER: Rich Language-guided Failure Recovery Policies for Imitation Learning

*, *, , and
★ Best Overall Award @ UM AI Symposium 2024 ★
The 3rd Workshop on Language and Robot Learning (LangRob) @ CoRL 2024
International Conference on Robotics and Automation (ICRA) 2025
Webpage  •   Paper  •   Code

Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguities

*, *, *, , , , and
The 1st Pluralistic Alignment Workshop @ NeurIPS 2024
International Conference on Learning Representations (ICLR) 2025 (Oral, 1.8% acceptance rate)
Webpage  •   Paper  •   Code

Neural Inverse Source Problems

, , , and
Conference on Robot Learning (CoRL) 2024
Webpage  •   Paper  •   Code

Naturalistic Robot Arm Trajectory Generation via Representation Learning

and Adam Spiers
UK-RAS Towards Autonomous Robotic Systems (TAROS) 2023
PDF