Available for freelance projects

Ayush Kumar
Freelance ML engineer.

See the work
01 · Selected work

Systems built from first principles

Each project has its own design doc: architecture, the decisions that mattered, benchmarks, and what I'd do next.

Lead projectLLM inferenceDistributed serving

nanoserve

A from-scratch LLM inference engine and distributed serving layer.

Benchmarks coming soon
Read the design docGitHub
requestsschedulerkv cacheworker 0worker 1worker nDetailed diagram coming soon
02

clarix

Answers questions over a codebase with hybrid retrieval. MCP server in progress.

Design doc03

Sluice

A Kafka-compatible streaming log with no broker disks: object storage is the only durable layer.

Design doc
02 · Research

Tool-calling agents

Work in progress, listed as it is.

Paper

Tool-calling agents on VAKRA

A paper on how LLM agents call tools, evaluated on the VAKRA benchmark.

In progress
Shared task

SemEval-2027 Task 11

Participating in VAKRA-Advanced.

In progress
Earlier work

CNNs for brain CT

ResNet, AlexNet and DenseNet compared for intracranial hemorrhage detection.

03 · Experience

AI Trainer (Contract)

DataAnnotation
August 2026 - Present
Design agentic coding tasks for evaluating AI coding agents: realistic engineering problems in real codebases, with hidden tests, reference solutions and containerized environments, plus analysis of frontier-model attempts.
04 · Other work

CNN comparison for intracranial hemorrhage detection

ResNet, AlexNet and DenseNet on brain CT
Project

CUDA coursework

GPU programming
Coursework

NVIDIA Deep Learning Institute

Certification
Certificate
05 · Education

B.Tech, Computer Science and Engineering

Bennett University
2023-2027
06 · Contact

Open to AI engineer roles, research internships, and freelance AI work.

hello@ayushkr.dev
GitHubLinkedInResume