William Sharpless

Hello,

I am a Mechanical and Aerospace PhD candidate in Sylvia Herbert's Safety and Autonomous Systems group at UC San Diego.

My work involves differential games (HJB-PDE's), control and learning, and my thesis concentrates on feasible methods for safe, high-dimensional autonomy. I am an HHMI/NIH Interfaces fellow, and I am also supported by the ONR and the Society of Hellman.

Before, I did my undergraduate degree in applied mathematics at UC Berkeley where I worked with Claire Tomlin, Adam Arkin and Jay Keasling.

willsharpless [at] ucsd [dot] edu  /  CV  /  Google Scholar  /  Github  /  Linkedin

profile photo
Publications
Dual Objective Reinforcement Learning with Novel HJB Forms
William Sharpless*, Dylan Hirsch*, Sander Tonkens, Nikhil Shinde, Sylvia Herbert.
Recently Submitted - May, 2025

Here, we derive novel HJB forms for dual-objective problems (multi-reward or reward & cost) and solve the corresponding Bellman eqns. We use these to design a novel on-policy algorithm (DO-HJ-PPO) which outerperforms STL-RL and CMDP (C-PPO) algorithms for a variety of safe-arrival and multi-achievment tasks.

[RSS workshop paper] (full paper coming soon)

Reachability Barrier Networks: Learning HJ for Smooth and Flexible CBFs
Matthew Kim, William Sharpless, Hyun Joe Jeong, Sander Tonkens, Somil Bansal, Sylvia Herbert.
Recently Submitted - April, 2025

In this work, we explore learning smooth, tunable CBF's via the HJB PINN approach, dubbed Reachability Barrier Networks (RBNs). Due to the structure of the problem and uniqueness of the solution, we found RBNs to be more readily learned than neural CBFs, yielding safer appxs. with 5.5x less collisions in multi-agent scenario.

[paper]

Linear Supervision for Nonlinear, High-Dimensional Neural Control and Differential Games
William Sharpless, Zeyuan Feng, Somil Bansal, Sylvia Herbert.
Learning for Dynamics & Control (Best Paper Nom.) - December, 2024

Here, we show that to learn a nonlinear HJ-PDE for autonomy, one may introduce the linear solution for ~25x increase in accuracy and ~20x acceleration in training for problems up to 50-dimensions.

[paper]

State-Augmented Linear Games with Antagonistic Error for High-Dimensional, Nonlinear Hamilton-Jacobi Reachability
William Sharpless, Yat Tin Chow, Sylvia Herbert.
Conference on Decision and Control - March, 2024

Here, we propose a novel, lifted differential game that is guaranteed to be conservative, is solved rapidly, and allows the use of lifting functions such as neural nets, polynomials and radial basis functions to reduce linear error.

[paper]

Conservative Linear Envelopes for High-Dimensional, Hamilton-Jacobi Reachability for Nonlinear Systems via the Hopf Formula
William Sharpless, Yat Tin Chow, Sylvia Herbert.
Transactions on Automatic Control - April, 2024

Here, we demonstrate how the error between a nonlinear system of interest and a linearization of it may transformed into an antagonistic player, yielding a conservative linear game that may be solved rapidly in high-dimensions.

[paper]

Koopman-Hopf Hamilton-Jacobi Reachability and Control
William Sharpless, Nikhil Shinde, Matthew Kim, Yat Tin Chow, Sylvia Herbert.
Arxiv (In Review) - November, 2023

In this work, we propose and demonstrate the use of Koopman linearizations to allow the use of the Hopf formula for linear differential games to yield a performant algorithm for high-dimensional, nonlinear autonomy.

[paper]

Invited Talks
American Math Society (AMS) - Session on Applied Partial Differential Equations, October 2024 [slides]
Lifted Differential Games with Antagonistic Error for Fast, Accurate and Conservative HJB Approximations.
Scientific AI Research Seminar @ Oden Institute - UT Austin, October 2024 [slides]
Lifted Differential Games with Antagonistic Error for Fast, Accurate and Conservative HJB Approximations.
Society of Industrial and Applied Mathematics (SIAM) - High Dimensional Control and HJE Session, September 2024 [slides]
Lifted Differential Games with Antagonistic Error for Fast, Accurate and Conservative HJB Approximations.
Safe and Intelligent Autonomy Seminar @ USC, August 2023 [slides]
Conservative Envelopes with Linear Hopf Solutions for Fast & Safe High-Dimensional Control and Reachability
Level Set Seminar @ UCLA, April 2023 [slides]
Koopman-Hopf Hamilton-Jacobi-Reachability for Fast and Accurate Autonomy
Software
HopfReachability.jl

Julia software for accelerated non-smooth, convex optimization of the Hopf objective for solving high-dimensional differential games.

Margo

A fast, interactive level set solver for HJB flows made in GLSL.


Website template by Jon Barron (source code).
How the mighty have fallen.