Search results

multiple regressions in llama.cpp backend: max_tokens loops in streaming mode, first token duplicated

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#9716 In mudler/LocalAI;

· lowne-inf opened on May 8, 2026

Gemma 4-31b from Model Gallery Broken.

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#9711 In mudler/LocalAI;

· JohnGalt1717 opened on May 7, 2026

LocalAI使用llama.cpp时无法像LM Studio一样实现并发任务。

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#9704 In mudler/LocalAI;

· kelei999999 opened on May 7, 2026

Jetson AGX Xavier unsupported?

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#9696 In mudler/LocalAI;

· mithrandir42 opened on May 6, 2026

reasoning extraction only happens at end of stream

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#9658 In mudler/LocalAI;

· tv42 opened on May 4, 2026

📝 Integration Proposal: CAJAL — Scientific Paper Model for LocalAI

Status: Open.

#9656 In mudler/LocalAI;

· Agnuxo1 opened on May 4, 2026

RFC: Add pkg/tokens — in-process token counter helper (tiktoken-go wrapper)

Status: Open.

#9537 In mudler/LocalAI;

· walcz-de opened on Apr 24, 2026

RFC: Optional per-model PII replacement middleware (regex-based, bijective)

Status: Open.

#9535 In mudler/LocalAI;

· walcz-de opened on Apr 24, 2026

RFC: Optional server-side context-compression middleware for /v1/chat/completions

Status: Open.

#9534 In mudler/LocalAI;

· walcz-de opened on Apr 24, 2026

tool_choice parsing: wrong setter used in 4 sites; /v1/chat/completions silently drops string mode

Status: Open.

#9508 In mudler/LocalAI;

· walcz-de opened on Apr 23, 2026

feat: persist Chat History server-side

enhancementNew feature or requestNew feature or request

Status: Open.

#9432 In mudler/LocalAI;

· okcodemaybe opened on Apr 19, 2026

Agent always ever answers {"{"

bugSomething isn't workingSomething isn't working

unconfirmed

Status: Open.

#9419 In mudler/LocalAI;

· Haukinger opened on Apr 18, 2026