| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| basert-engine-macos-arm64-0.1.7.tar.gz | 2026-07-21 | 9.6 MB | |
| basert-engine-macos-arm64-0.1.7.tar.gz.sha256 | 2026-07-21 | 105 Bytes | |
| BaseRT engine 0.1.7 source code.tar.gz | 2026-07-18 | 356.4 kB | |
| BaseRT engine 0.1.7 source code.zip | 2026-07-18 | 442.1 kB | |
| README.md | 2026-07-18 | 2.1 kB | |
| Totals: 5 Items | 10.4 MB | 14 | |
Maintenance release focused on the three most-reported serve/CLI issues, plus converter and chat quality-of-life fixes.
Fixed
- Tool calls for Qwen 3.5 / 3.6 (#21) —
basert servenow emits structuredtool_callsfor the Qwen XML tool-call dialect, in both streaming and non-streaming modes. Truncated generations never execute partial arguments, and logprobs stay aligned across tool-call segments. - Deterministic HTTP 500 on some short CJK prompts (#22) — fixed a byte-alphabet hole (soft hyphen
0xAD) in GPT-2-style byte tokenization; tokenization is now HF-exact for the affected models. Server errors are structured and logged instead of opaque 500s. --no-thinkand chat-template handling (#23) —--no-thinknow works across all thinking-capable architectures; the CLI renders model-embedded chat templates; fixed a Gemma 4 channel-marker leak and KV-reuse correctness on divergent history.- MLX 3/5/6-bit conversion — MLX quantized checkpoints at 3/5/6-bit widths now unpack correctly (little-endian bitstream); previously these converted to wrong weights.
basert pullHF-cache duplication — pulled models are no longer duplicated in the global Hugging Face cache (staged download with resume preserved; setBASERT_KEEP_HF_SOURCES=1to keep sources).
Added
- Chat line editing — cursor movement, kill ops, and word delete (
Ctrl+W/Alt+Backspace/Ctrl+Backspace) inbasert chat, with UTF-8/CJK support. - q6 MoE kernels — Q6 expert GEMM (plus q8/q6 scale-dtype siblings) and a bundled
default-q6conversion profile (--target base-q6). baseRT_decode_token_raw()— length-preserving raw-byte token decode in the C API (byte-level BPE tokens can legally contain NUL; the C-string variants truncate there). No struct-layout changes.
Changed
- Chat / complete / bench banners show the model id (
org/repo · variant) instead ofmodel.base. baserthelp output regrouped runtime-first.
Performance is unchanged vs 0.1.6 (validated dense + MoE on M4 Pro and M5 Pro, within noise).