| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2026-07-09 | 436 Bytes | |
| Sonic core v0.1.3 source code.tar.gz | 2026-07-09 | 287.7 kB | |
| Sonic core v0.1.3 source code.zip | 2026-07-09 | 396.5 kB | |
| Totals: 3 Items | 684.6 kB | 0 | |
Changes
Dependency updates:
- Bump
jieba-rsfrom0.9to0.10(in5d4a432) - Disable unnecessary
rocksdbfeatures (in421d13d) - Disable default features for all dependencies (in
cd7f328)
New Features
- feat: Improve the tokenizer to avoid splitting special tokens (in
f290006) - feat: Make tokenizer pattern matching opt-in (in
ddd6848) - feat: Make tokenizer pattern matching non-breaking (in
e744fd0)