Skip to content

TandemLLM: your private AI environment

TandemLLM

Your private AI environment. Fast local inference on your own hardware, and one dashboard in front of every model you run.

Buy me a coffee on Ko-fi Sponsor on GitHub TandemLLM on X 0xBakeer on X

Website · Engine docs · App docs · Weights on Hugging Face · StairCut paper

The projects

TandemEngine
docs
The inference engine for one NVIDIA DGX Spark. Small drafters guess the next tokens and the big model checks every guess in one pass, so a right guess is a free token. On Qwen3.8-27B NVFP4 it writes about 50 tokens a second for one request, and the text is the model's own greedy text. OpenAI-compatible API.
TandemApp
docs
One address and one dashboard in front of TandemEngine and any OpenAI-compatible server or cloud API. It runs Chat and the fleet of machines, counts every token, and gives each client an API key that names the backends and models it may run.

Support

TandemLLM is free and open source. If it saves you time or money, you can help keep it going:

Enterprise

Want TandemLLM running for your team on your own hardware, with support and a commercial license for use outside the AGPL? Write to mail@0xbakeer.com.

Popular repositories Loading

  1. TandemEngine TandemEngine Public

    TandemEngine: local inference that drafts and verifies its own tokens, behind an OpenAI-compatible API.

    Python 82 17

  2. TandemApp TandemApp Public

    The TandemLLM app: chat, models and fleet control in one place, on any OpenAI-compatible backend.

    Python 4 1

  3. .github .github Public

    The TandemLLM organization profile

Repositories

Showing 3 of 3 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…