DistIE: Distributed Inference Engine Permalink
Published:
Go gateway + C++ KV-cache/memory pool + Python continuous batching. A production-style LLM inference stack, not a notebook demo.
Published:
Go gateway + C++ KV-cache/memory pool + Python continuous batching. A production-style LLM inference stack, not a notebook demo.
Published:
+18% cross-task VLA success on InternVL-1B; 35% lower I/O latency across 100+ dual-arm episodes (8×A100, SJTU).
Published:
Terabyte-scale calcium-imaging pipelines and an honors thesis on neural tuning dynamics (Van Hooser Lab). Manuscript in preparation.
Published:
82% Spider execution accuracy with QLoRA fine-tuning and a FAISS schema-aware RAG serving path.
Published:
Schema-validated LLM agents for dietary logs, PostgreSQL/Prisma, and 90%+ test coverage (Vitest, GitHub Actions).