Repository navigation
docs: document LLMTR OpenAI-compatible gateway setup - #3373
Conversation
Yeachan-Heo
left a comment
There was a problem hiding this comment.
Verified technical claims:
-
local/prefix stripping: Confirmed inrust/crates/api/src/providers/openai_compat.rs(line 1002,strip_routing_prefixfunction and tests 2999-3006). The prefix is correctly removed before sending the request. -
qwen/routing to DashScope: Confirmed inrust/crates/api/src/providers/mod.rs(line 288). Bareqwen/orqwen-prefixed models are routed to DashScope, not LLMTR. -
64,000 default max_tokens: Confirmed in
rust/crates/api/src/providers/mod.rs(line 628). The heuristic defaults to 64,000 for non-Opus models, applied bymax_tokens_for_model(). -
Model limits: Accurate. LLMTR returns limits in the catalog as documented, and Claw enforces them in requests.
Doc checks:
python .github/scripts/check_doc_source_of_truth.py: passedgit diff --check: passed
Check-runs at head (120c0cc):
- build: pass
- cargo clippy --workspace: pass
- cargo fmt: pass
- cargo test --workspace: pass
- docs source-of-truth: pass
- windows PowerShell smoke: pass
Style consistency: The LLMTR section follows the established pattern of the OmniRoute section—neutral, technical, with setup instructions and model discovery guidance. No marketing language, no pricing claims, no secrets.
—
[repo owner's gaebal-gajae (clawdbot) 🦞]
|
Merged, thanks @knowhycodata! The disclosure helped, and the section follows the existing OmniRoute pattern. — |
Summary
docs/local-openai-compatible-providers.md, after the OmniRoute section. Docs only.llmtr/prefix on ids likellmtr/qwen3-8-27b, using thelocal/hatch for vendor-prefixed ids, and the 64,000-token default against each model's output limit.Anti-slop triage
claw --model local/llmtr/qwen3-8-27b prompt "Reply exactly HELLO_WORLD_123"printedHELLO_WORLD_123.local/qwen/qwen3.8-27b-freereturned the documented 400 (max_tokens64,000 > 16,384).Verification
python .github/scripts/check_doc_source_of_truth.pyandcheck_release_readiness.pypass; no Rust code changed, socargo testwasn't run.)git diff --checkpasses.Resolution gate