mohith
Mohith
ENGINEER · OPEN SOURCE BUILDER

Hey, I’m Mohith.

Building the things behind the screen.

I build infrastructure for AI systems: schedulers, guardrails, and developer tools that decide what actually runs.

GSoC ’26 contributor at RUXAILAB , previously a product developer intern at Koncepts. Currently building Kestrel, a GPU compute control plane.

Experience

A few places I’ve built, learned, and taken responsibility.

THE FOUNDATION

Chinmaya Vishwavidyapeeth

B.Tech, Computer Science

Sep 2023 to May 2027CGPA 9.85 / 10.0

Work

04 PROJECTS

AI infrastructure, developer tools, and a few things I wished existed.

Latest writing

All posts →
10 min read

LLM Inference at Scale: Why Serving One User Is Easy and Serving a Hundred Is Not

A ground-up walk through LLM inference: the KV cache, prefill vs decode, a capacity equation for Mistral 7B on an A100, and the model and serving optimizations (GQA, MLA, FlashAttention, PagedAttention, continuous batching, prefix caching, speculative decoding) that make LLMs servable.

LLMInferencevLLMSGLangKV CacheSystems

Activity

0
Contributions
0
Merged PRs
0
Stars earned
0
Public repos

0 day streak·longest 0 days

Stack

Every day

What I open without thinking about it

PythonTypeScriptFastAPINext.jsPostgreSQLDockerGitClaude Code

Often

Reached for whenever the problem calls for it

ReactKubernetesRedisTailwindSupabaseVuePrometheusVercel

When it fits

Used in anger at least once, happy to again

JavaDjangoSpring BootLangChainOllamaFirebaseMySQL

Learning

  • Kubernetes & Kueuescheduling, quota, and operators from the inside
  • Distributed systemsmetering, admission control, backpressure
  • GPU infrastructureallocation, autoscaling, cost modelling
  • Model evaluationfaithfulness, hallucination, and PII scoring
A line that stays with me