Experience

Working on Nimbus, a hybrid LLM inference system that meets TTFT SLOs under bursty workloads by combining local GPU deployments with serverless APIs. Built full-stack inference gateway integrating vLLM/SGLang backends with multiple external providers.

Co-leading OpenManus-RL, an agentic reinforcement learning framework for fine-tuning LLM agents on environments such as ALFWorld, WebShop, and GAIA. Co-developed AgentDebug, a framework that analyzes LLM agent trajectories with a modular error taxonomy to localize root-cause failures.

Developed AutoForge, a framework that formulates automatic agentic system generation and optimization as a searching problem using Monte Carlo Tree Search (MCTS) to explore agent architectures. The framework incorporates cost-aware optimization by intelligently assigning heterogeneous LLMs based on task-specific capabilities, maintaining strong performance while significantly reducing inference costs.

Developed BEDEO, a multi-agent ontology-based LLM recommendation framework that enhanced interpretability and recommendation quality for Canada Ontario residents. Integrated ontological knowledge structures with LLM reasoning to improve recommendation transparency.

Led the creation of OasisSimp, a multilingual text simplification dataset for English, Sinhala, Tamil, and Thai. Implemented and fine-tuned mT5 using the MUSS framework for unsupervised text simplification.

Selected as a Google Summer of Code 2025 contributor to enhance ChromiumOS's farfetchd service with kernel tracing and replay capabilities.

Designed and implemented an internal front-end component library for Microsoft Edge team.

Led the group's first on-device learning project.