Jayjun Lee

Welcome! I'm an MS Robotics student at the University of Michigan, where I'm advised by Prof. Nima Fazeli and Prof. Joyce Chai. My research focuses on Robot Learning – developing algorithms for robots to perceive and interact with the physical world. These days I'm interested in multi-modal (i.e. vision, tactile, F/T, language, audio) perception and learning representations to acquire contact- and force-rich manipulation skills.


Formal Bio     Github     Google Scholar     Twitter

Email: jayjun [at] umich [dot] edu

Some recent highlights from our research:
* indicates equal contribution

Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguities

*, *, *, , , ,
The 1st Pluralistic Alignment Workshop @ NeurIPS 2024
Webpage  •   arxiv  •   PDF

RACER: Rich Language-guided Failure Recovery Policies for Imitation Learning

*, *, ,
★ Best Overall Award @ UM AI Symposium 2024 ★
The 3rd Workshop on Language and Robot Learning (LangRob) @ CoRL 2024
Webpage  •   arxiv  •   PDF

Visual-auditory Extrinsic Contact Estimation

*, *,
In Submission
Webpage  •   arxiv  •   PDF

Neural Inverse Source Problems

, , ,
Conference on Robot Learning (CoRL) 2024
Webpage  •   PDF

Naturalistic Robot Arm Trajectory Generation via Representation Learning

, Adam Spiers
Poster @ UK-RAS Towards Autonomous Robotic Systems (TAROS) 2023
PDF