Skip to content

Commit df8374d

Browse files
authored
Merge pull request #29 from trailofbits/local-model-fix
fix local model setup readme
2 parents a6e1bc7 + 78d4c02 commit df8374d

1 file changed

Lines changed: 8 additions & 3 deletions

File tree

README.md

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -121,7 +121,7 @@ claude-local() {
121121
ANTHROPIC_BASE_URL=http://localhost:1234 \
122122
ANTHROPIC_AUTH_TOKEN=lmstudio \
123123
CLAUDE_CODE_DISABLE_NONESSENTIAL_TRAFFIC=1 \
124-
claude "$@"
124+
claude --model qwen/qwen3-coder-next "$@"
125125
}
126126
```
127127

@@ -381,8 +381,8 @@ Local models move fast. When this recommendation is stale, check the [LM Studio
381381
Download, load, and serve -- all from the CLI:
382382

383383
```bash
384-
lms get lmstudio-community/Qwen3-Coder-Next-MLX-4bit -y
385-
lms load lmstudio-community/Qwen3-Coder-Next-MLX-4bit --context-length 32768 --gpu max -y
384+
lms get Qwen3-Coder-Next@MLX-4bit -y
385+
lms load qwen/qwen3-coder-next --context-length 32768 --gpu max -y
386386
lms server start
387387
```
388388

@@ -400,8 +400,13 @@ claude
400400

401401
Or use the `claude-local` shell function from [Shell Setup](#shell-setup) to avoid typing the env vars every time.
402402

403+
If `claude-local` fails with `The number of tokens to keep from the initial prompt is greater than the context length.` message, then try disabling auto-loaded tools (`--strict-mcp-config` first, then try also `--disable-slash-commands` and `--system-prompt "You are a helpful coding assistant."`).
404+
405+
If `claude-local` fails with `request.thinking.type: Invalid discriminator value. Expected 'enabled' | 'disabled'"` then add `--settings '{"alwaysThinkingEnabled": false}'` flag.
406+
403407
For the full list of environment variables (model overrides, subagent models, traffic controls, etc.), see the [model configuration docs](https://code.claude.com/docs/en/model-config).
404408

409+
405410
### Personalization
406411

407412
You can customize the spinner verbs that appear while Claude is working. Ask Claude: "In my settings, make my spinner verbs Hackers themed" — or Doom, or Star Trek, or anything else.

0 commit comments

Comments
 (0)