Skip to content

Eamon2009/minillm.cpp

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

53 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

minillm 
=======
minillm is a language model pipeline in C++. It provides training, inference, and terminal chat in a single lightweight binary with no external dependencies.
The repo is simple structure of [Quadtrix.cpp](https://github.com/Eamon2009/Quadtrix.cpp) . The entire transformer (including tensor operations, attention, backpropagation, and AdamW optimizer) is here without any external libraries.

Quick Start
-----------
Build
git clone https://github.com/Eamon2009/minillm.git
cd minillm
g++ -std=c++17 -O3 -march=native -I. -Iinclude -o minillm main.cpp

Run
---
./minillm data/input.txt
./minillm data/input.txt --generate
./minillm data/input.txt --chat

License
======
MIT

About

Character-level language model training pipeline in C++.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors