Software Engineer for the Controls, Autonomy, Estimation, and Learning for Uncertain Systems (CAELUS) Lab.
Year
2023-2024
A major focus of my work was developing a reinforcement learning sensor tasking framework for space object detection. I constructed a Deep Q-Network (DQN) algorithm with convolutional architectures, experience replay, and reward shaping to train an agent to prioritize high value targets within stochastic environments (modeled via Gaussian Mixture distributions to resemble the random space domain). To stabilize training under sparse and delayed rewards, I implemented replay buffer management, target network synchronization, and exploration decay to mitigate divergence in these large environments. This system was designed to reduce uncertainty in the detection and tracking of space objects.
To enable quick experimentation, I implemented parallel processing (CUDA) for environment generation. I trained the model on terabytes of synthetic datasets using Git LFS and TensorBoard workflows to manage reproducibility and performance tracking.
In parallel, I contributed to porting a legacy Draper Semi-Analytic Satellite Theory (DSST) orbit propagator from Fortran to Python, enabling propagation using equinoctial elements and perturbation modeling (J2 effects). We validated orbital evolution over decades against reference Molniya trajectories to quantify divergence and numerical sensitivity.
This experience shaped my approach to engineering: combining physics, probabilistic estimation, and decision systems to build robust agents that operate under uncertainty.
Disciplines
Reinforcement Learning
Space Domain Awareness
Orbital Mechanics
Parallel Processing
Data Simulation
Statistics
Navigation & Controls
Technical Documentation