Architecting small local AI models, deterministic agent systems, and resilient production web applications.
Based in Chandigarh, India · Open-weights creator on Hugging Face · Building developer tools that respect context and privacy.
I specialize in Applied AI Engineering and Full-Stack Systems. My recent focus is solving the context window crisis for AI coding agents and building deterministic AI engines powered by compact, open-weights language models that run 100% locally on user hardware.
- 🧠 Model Creator: Published 7 specialized open-weights models on Hugging Face (Hydra Nano family & VIC-2B) with 3,000+ downloads.
- 🛠️ Agent Context Optimization: Creator of Hydra, shaving 76% of noise tokens out of coding agent context windows using local GGUF models.
- 📊 Deterministic Query Planning: Developed VIC-2B and the vasuki engine, achieving 83.0% accuracy on Spider and matching 120B parameter models at 1.55 GB footprint.
- 💻 Production Full-Stack: Scalable, reliable architectures across TypeScript, React, Next.js, Node.js, Python, PHP, and Docker.
🐉 Hydra
Small Local Models That Take the Noisy Work Off Coding Agents
|
Deterministic Tabular Query Engine & 1.55 GB Planner Model
|
|
Specialized Compact Models Fine-Tuned for Autonomous Workflows
|
🛡️ Dhruv CLI
Local-First AI Command Center for Terminal Developers
|
I contribute fixes, reviews, and QA upstream to the projects I build on — not just my own.
- Merged PRs — 17 across 12 public repos, including openai/openai-cookbook, LibreTranslate, spatie/twitter-labs, mobile-next/mobile-mcp, and guillaumemeyer/watermarks-remover (3).
- PRs in active maintainer review: pytorch/pytorch, NVIDIA/cutlass, codeigniter4/CodeIgniter4, langchain-ai/openwiki, browser-use/jev-ultrafast, GoogleCloudPlatform/microservices-demo.
- Code review at depth: 100+ verified code reviews on open-source pull requests. Recent catches: a 366-day duplicate-month calendar bug, a regex regression that silently broke no-space time formats, and a hot-path O(n) rewrite flagged before merge.
- QA that ships: 50+ reproducible bug reports filed; fixes already merged by maintainers in caronc/apprise, shaongitbd/doory, KKKKhazix/AIHOT and others.
| Domain | Core Competencies & Tools |
|---|---|
| Applied AI & Local LLMs | Fine-tuning compact SLMs (0.8B–2B), Qwen3.5, Llama, Ollama, llama.cpp, MLX, GGUF quantization, OpenCV |
| Agentic Frameworks & Context | Model Context Protocol (MCP), tool output sandboxing, context token compression, deterministic planning |
| Frontend & Interfaces | Next.js, React, TypeScript, JavaScript, Tailwind CSS, Bootstrap, Responsive UI/UX |
| Backend & APIs | Node.js, Express, Python, PHP, Laravel, RESTful APIs, WebSockets, CLI development |
| Databases & DevOps | MySQL, MongoDB, Docker, Git/GitHub Actions, Linux/macOS runtime environments |
Whether you're exploring compact AI model deployments, building agentic workflows that don't burn tokens, or need a dependable full-stack application built from zero to production, let's talk.
Direct Mobile / WhatsApp / Arattai: +91 7004541481 · Email: rahul05ranjan@gmail.com




