Skip to content

About

VT-Transformer — a 1x1x1 LLM inference engine built on AI-generated kernels.

Resources

Stars

130 stars

Watchers

4 watching

Forks

Latest commit

 

History

9 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

VT-Transformer

AI-native infrastructure for building highly specialized LLM inference systems.

VT-Transformer takes a 1 × 1 × 1 approach:

1 Model × 1 Hardware × 1 Deployment

Instead of building a general-purpose inference engine, VT-Transformer uses AI to generate, verify, benchmark, and optimize a compact inference implementation tailored to a specific target.

Components

  • vt-lang — A Python-based DSL for describing and verifying LLM model computation.
  • vt-harness — An execution and optimization harness for AI-generated inference implementations.
Model Specification
       │
    vt-lang
       │
       ▼
  vt-harness
       │
       ▼
AI-generated
Inference System

The goal is simple:

Let AI build the inference engine for the target, rather than forcing every target into the same engine.

🚧 Early-stage project — under active development.

About

VT-Transformer — a 1x1x1 LLM inference engine built on AI-generated kernels.

Resources

Stars

130 stars

Watchers

4 watching

Forks

Releases

Packages

Used by

Contributors

Languages