Member of Technical Staff Intern

Tensormesh

March 2026 - Present

Foster City, CA

• Contributed upstream to LMCache, adding a coordinator endpoint for listing pinned cache entries and per-key access tracking in the key directory.
• Shipped 35 PRs and 100+ commits across 9 company repos spanning various services.
• Integrated Arize Phoenix into Tensormesh's observability stack, emitting OpenInference LLM traces from the router for all requests, and shipped SDK and CLI tooling for inspecting traces and spans.
• Reworked the Prometheus metrics for TTFT, throughput, and other rollups that power the serverless observability dashboards.
• Built an orchestrator microservice that pins prompts in LMCache asynchronously during inference, and exposed pin management through the API, SDK, and CLI.
• Built a KV cache discovery interface on top of the LMCache Coordinator API to browse cached keys, tokens, and utilization across engines.
• Led an internal research effort on key weighting for long-context inference, from evals to writeups.

Software Engineer Intern

Quantum Rings

June 2025 - August 2025

Chicago, IL

• Delivered 19 PRs, 43 contributions, and 15 completed GitHub issues across the internship, adding ~15K LOC and removing ~3.6K LOC while reviewing code and driving schema refactors.
• Migrated execution data from the user entity to a dedicated relational table with FKs, modularizing schema and ensuring test suite stability with no performance regression.
• Implemented a telemetry aggregation background worker (AWS SQS + TypeORM) to asynchronously roll up user execution activity, improving scalability and simplifying downstream analytics queries.
• Designed and deployed queue-driven execution processing to decouple heavy telemetry operations from the API, reducing request latency and enabling horizontal scaling.
• Built full-stack admin analytics dashboards with NestJS, Next.js, and Recharts, integrating SQL time-bucket aggregation and timezone-safe filtering to track user growth, active usage, and execution volume.

LMCache

LMCache/LMCache

Python

• Added a coordinator endpoint for listing pinned cache entries.
• Added per-key access tracking to the coordinator key directory.

Brev CLI

brevdev/brev-cli

Go

• Authored the core rsync-first file-transfer implementation with automatic SCP fallback and unit coverage

Pyrefly

facebook/pyrefly

Rust · Python

• Submitted an upstream Rust cleanup standardizing the error-summary module and imports from 'summarise' to 'summarize'.

vLLM Production Stack

vllm-project/production-stack

Kubernetes · Helm

• Landed router volume and mount support for read-only root filesystems and corrected the default NVIDIA runtime class with regenerated CRD manifests.