Work

Built, measured and bounded.

Four flagships on real hardware, the research around them, and an index of everything else with the state it is genuinely in, including the work that was archived or came back null.

Flagship projects

Assistive autonomy · Unitree GO2

Come Here

Say “come here” and a physical GO2 turns toward the voice, finds the caller, walks over and sits, all onboard its Jetson Orin NX with no internet at runtime.

Live on the physical GO2

Explore project

Sim-to-real locomotion · Isaac Lab

Phoenix

Learned GO2 locomotion carried from Isaac Lab to the physical robot through a gated pipeline. The first deploy exposed a failure simulation missed; in October 2026 a newer walking policy held the real GO2 through every stand gate after a scripted stand-up, then walked forward and made a partial turn on a free floor. It walks short of the command because of joint friction the simulator did not model.

4.77e-06 max ONNX vs PyTorch drift on the stand-v3-h25 export, against a 1e-4 gate

Holds a stand and walks on the physical GO2; friction-aware retrains in first hardware tests

Explore project

Runtime reliability · ROS 2

HELIX

Runtime monitoring, diagnosis and audited recovery commands inside a live ROS 2 graph on the GO2, with BlackBoxRS replaying the evidence offline afterwards.

1.16 ms mean detection latency through the ROS 2 callback path, in a single-process benchmark

Decision path ran on the live GO2; physical actuation is the next hardware gate

Explore project

Bare-metal C · Arm Cortex-M4F

Kestrel-RT

A real-time runtime in C written from the reset vector up, with the board's ESP32-S3 network chip isolated behind a budgeted link.

11 → 0 forced network-chip crashes, controller resets, in one 10,003,440-period Phase 2 soak

v1.0, validated on hardware

Explore project

Selected research & systems

The work around the flagships.

C++20 · CUDA · TensorRT

C++ perception runtime

A Python person-perception pipeline rebuilt in C++20, CUDA and TensorRT for the GO2's Jetson Orin NX: hardware decode, pose, re-identification and tracking.

135 → 33.5 ms p95 latency under matched replay of recorded camera frames on the robot's Jetson Orin NX; it keeps the 30 fps rate on 12% of one CPU core instead of 108%

Explore project Private repository

Conversational GO2 · local LLM + VLM

FETCH

A GO2 you talk to: on “Fetch, describe the room” it scans three views and describes each through its own speaker, and it holds a conversation on local models with no API key, while a safety envelope alone moves the robot.

22.4 to 31.2 s voice-triggered three-view room scans in armed runs on the physical GO2, none with a degraded subsystem

Explore project Demo Private repository

Autonomous driving · pre-registered study

av2-city-shift

In a log-replay planning harness, a trajectory predictor made the planner brake for parked cars. A pre-registered stopped-agent fix cut those brakes on fresh scenes; a dose-matched sham did not.

44.9% fewer unnecessary hard brakes on 8,140 fresh scenes (95% CI 37.7 to 51.4%)

Explore project

Production model teardown

supercombo-blindspot

A parity-controlled teardown of openpilot's shipped driving model: on simulator-rendered input it goes blind while its exported uncertainty stays flat.

Explore project

Flight recorder for ROS 2

BlackBoxRS

An incident recorder that builds a reproducible evidence bundle and replays recorded robot data through the same detectors offline.

Repository

Demos

See it move.

Validate before you trust

Localize and detect failures

Deploy and perceive on the GO2

The platform

Simulation is where a policy is allowed to be right; the robot is where it has to be. The hardware work on this page runs on one physical GO2.

The robot's onboard camera feed, relayed, with YOLOv8 detections.
Spoken command to motion, on the physical robot.
Platform
Unitree GO2: 12 actuated joints, onboard camera, four-microphone array
Compute
NVIDIA Jetson Orin NX, carried on the robot; every policy has to fit and run here
Middleware
ROS 2: nodes, lifecycle, QoS, and the topic timing HELIX watches
Navigation
Nav2 and SLAM Toolbox, exercised in Gazebo with CHAMP
Simulation
NVIDIA Isaac Lab, where locomotion policies are trained before they are trusted
Perception
YOLO person detection on the robot's front camera, on the Jetson for Come Here

What ties these together

I build autonomous robots, make them run efficiently on real compute, and instrument them so failures can be understood and contained. The research page makes that argument in full.

Research statement Technical reports