The CAELUS Lab

Space

Situational Awareness

Software Engineer for the Controls, Autonomy, Estimation, and Learning for Uncertain Systems (CAELUS) Lab. 

Year

2023-2024

A major focus of my work was developing a reinforcement learning sensor tasking framework for space object detection. I constructed a Deep Q-Network (DQN) algorithm with convolutional architectures, experience replay, and reward shaping to train an agent to prioritize high value targets within stochastic environments (modeled via Gaussian Mixture distributions to resemble the random space domain). To stabilize training under sparse and delayed rewards, I implemented replay buffer management, target network synchronization, and exploration decay to mitigate divergence in these large environments. This system was designed to reduce uncertainty in the detection and tracking of space objects.

To enable quick experimentation, I implemented parallel processing (CUDA) for environment generation. I trained the model on terabytes of synthetic datasets using Git LFS and TensorBoard workflows to manage reproducibility and performance tracking. 

In parallel, I contributed to porting a legacy Draper Semi-Analytic Satellite Theory (DSST) orbit propagator from Fortran to Python, enabling propagation using equinoctial elements and perturbation modeling (J2 effects). We validated orbital evolution over decades against reference Molniya trajectories to quantify divergence and numerical sensitivity.

This experience shaped my approach to engineering: combining physics, probabilistic estimation, and decision systems to build robust agents that operate under uncertainty.

Disciplines

Reinforcement Learning

Space Domain Awareness

Orbital Mechanics

Parallel Processing

Data Simulation

Statistics

Navigation & Controls

Technical Documentation