My work involves differential games (HJB-PDE's), control and learning, and my thesis concentrates on feasible methods for safe, high-dimensional autonomy. I am an HHMI/NIH Interfaces fellow, and I am also supported by the ONR and the Society of Hellman.
Before, I did my undergraduate degree in applied mathematics at UC Berkeley where I worked with Claire Tomlin, Adam Arkin and Jay Keasling.
Dual Objective Reinforcement Learning with Novel HJB Forms William Sharpless*, Dylan Hirsch*, Sander Tonkens, Nikhil Shinde, Sylvia Herbert.
Recently Submitted - May, 2025
Here, we derive novel HJB forms for dual-objective problems (multi-reward or reward & cost) and solve the corresponding Bellman eqns. We use these to design a novel on-policy algorithm (DO-HJ-PPO) which outerperforms STL-RL and CMDP (C-PPO) algorithms for a variety of safe-arrival and multi-achievment tasks.
Reachability Barrier Networks: Learning HJ for Smooth and Flexible CBFs Matthew Kim, William Sharpless, Hyun Joe Jeong, Sander Tonkens, Somil Bansal, Sylvia Herbert.
Recently Submitted - April, 2025
In this work, we explore learning smooth, tunable CBF's via the HJB PINN approach, dubbed Reachability Barrier Networks (RBNs). Due to the structure of the problem and uniqueness of the solution, we found RBNs to be more readily learned than neural CBFs, yielding safer appxs. with 5.5x less collisions in a multi-agent experiment.
Linear Supervision for Nonlinear, High-Dimensional Neural Control and Differential Games William Sharpless, Zeyuan Feng, Somil Bansal, Sylvia Herbert.
Learning for Dynamics & Control (Best Paper Nom.) - December, 2024
Here, we show that to learn a nonlinear HJ-PDE for autonomy, one may introduce the linear solution for ~25x increase in accuracy and ~20x acceleration in training for problems up to 50-dimensions.
State-Augmented Linear Games with Antagonistic Error for High-Dimensional, Nonlinear Hamilton-Jacobi Reachability William Sharpless, Yat Tin Chow, Sylvia Herbert.
Conference on Decision and Control - March, 2024
Here, we propose a novel, lifted differential game that is guaranteed to be conservative, is solved rapidly, and allows the use of lifting functions such as neural nets, polynomials and radial basis functions to reduce linear error.
Conservative Linear Envelopes for High-Dimensional, Hamilton-Jacobi Reachability for Nonlinear Systems via the Hopf Formula William Sharpless, Yat Tin Chow, Sylvia Herbert.
Transactions on Automatic Control - April, 2024
Here, we demonstrate how the error between a nonlinear system of interest and a linearization of it may transformed into an antagonistic player, yielding a conservative linear game that may be solved rapidly in high-dimensions.
Koopman-Hopf Hamilton-Jacobi Reachability and Control William Sharpless, Nikhil Shinde, Matthew Kim, Yat Tin Chow, Sylvia Herbert.
Arxiv (In Review) - November, 2023
In this work, we propose and demonstrate the use of Koopman linearizations to allow the use of the Hopf formula for linear differential games to yield a performant algorithm for high-dimensional, nonlinear autonomy.
Semi-autonomous Seminar - UC Berkeley, May 2025 [slides]
Hopf Methods for High-Dimensional HJR
American Math Society (AMS) - Session on Applied Partial Differential Equations, October 2024 [slides]
Lifted Differential Games with Antagonistic Error for Fast, Accurate and Conservative HJB Approximations.
Scientific AI Research Seminar @ Oden Institute - UT Austin, October 2024 [slides]
Lifted Differential Games with Antagonistic Error for Fast, Accurate and Conservative HJB Approximations.
Society of Industrial and Applied Mathematics (SIAM) - High Dimensional Control and HJE Session, September 2024 [slides]
Lifted Differential Games with Antagonistic Error for Fast, Accurate and Conservative HJB Approximations.
Safe and Intelligent Autonomy Seminar @ USC, August 2023 [slides]
Conservative Envelopes with Linear Hopf Solutions for Fast & Safe High-Dimensional Control and Reachability
Level Set Seminar @ UCLA, April 2023 [slides]
Koopman-Hopf Hamilton-Jacobi-Reachability for Fast and Accurate Autonomy