Download Latest Version llama-b9738-bin-ubuntu-openvino-2026.2-x64.tar.gz (14.1 MB)
Email in envelope

Get an email when there's a new version of llama.cpp

Home / b9735
Name Modified Size InfoDownloads / Week
Parent folder
llama-b9735-xcframework.zip < 18 hours ago 206.3 MB
0
llama-b9735-ui.tar.gz < 18 hours ago 2.7 MB
0
llama-b9735-bin-win-vulkan-x64.zip < 18 hours ago 38.9 MB
0
llama-b9735-bin-win-sycl-x64.zip < 18 hours ago 114.3 MB
0
llama-b9735-bin-win-openvino-2026.2-x64.zip < 18 hours ago 10.5 MB
0
llama-b9735-bin-win-opencl-adreno-arm64.zip < 18 hours ago 11.7 MB
0
llama-b9735-bin-win-hip-radeon-x64.zip < 18 hours ago 321.4 MB
0
llama-b9735-bin-win-cuda-13.3-x64.zip < 18 hours ago 159.5 MB
0
llama-b9735-bin-win-cuda-12.4-x64.zip < 18 hours ago 261.6 MB
0
llama-b9735-bin-win-cpu-x64.zip < 18 hours ago 17.3 MB
0
llama-b9735-bin-win-cpu-arm64.zip < 18 hours ago 11.2 MB
0
llama-b9735-bin-ubuntu-x64.tar.gz < 18 hours ago 15.6 MB
0
llama-b9735-bin-ubuntu-vulkan-x64.tar.gz < 18 hours ago 38.5 MB
0
llama-b9735-bin-ubuntu-vulkan-arm64.tar.gz < 18 hours ago 31.9 MB
0
llama-b9735-bin-ubuntu-sycl-fp32-x64.tar.gz < 18 hours ago 47.5 MB
0
llama-b9735-bin-ubuntu-sycl-fp16-x64.tar.gz < 18 hours ago 47.7 MB
0
llama-b9735-bin-ubuntu-s390x.tar.gz < 18 hours ago 14.7 MB
0
llama-b9735-bin-ubuntu-rocm-7.2-x64.tar.gz < 18 hours ago 131.3 MB
0
llama-b9735-bin-ubuntu-openvino-2026.2-x64.tar.gz < 18 hours ago 14.1 MB
0
llama-b9735-bin-macos-x64.tar.gz < 18 hours ago 11.2 MB
0
llama-b9735-bin-ubuntu-arm64.tar.gz < 18 hours ago 12.6 MB
0
llama-b9735-bin-macos-arm64.tar.gz < 18 hours ago 10.9 MB
0
llama-b9735-bin-android-arm64.tar.gz < 18 hours ago 76.8 MB
0
cudart-llama-bin-win-cuda-13.3-x64.zip < 18 hours ago 391.0 MB
0
cudart-llama-bin-win-cuda-12.4-x64.zip < 18 hours ago 391.4 MB
0
b9735 source code.tar.gz < 19 hours ago 35.0 MB
0
b9735 source code.zip < 19 hours ago 36.5 MB
0
README.md < 19 hours ago 5.2 kB
0
Totals: 28 Items   2.5 GB 0
ggml : optimize AMX (#24806) Flatten the partition over n_batch * M so every thread participates in the quantization | CPU | Model | Test | t/s OLD | t/s NEW | Speedup | |:--------------------------------|:------------------------------|:-------|----------:|----------:|----------:| | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B IQ4_NL - 4.5 bpw | pp512 | 730.71 | 779.86 | 1.07 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B IQ4_NL - 4.5 bpw | tg128 | 87.88 | 86.79 | 0.99 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B IQ4_XS - 4.25 bpw | pp512 | 725.09 | 1023.31 | 1.41 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B IQ4_XS - 4.25 bpw | tg128 | 83.64 | 83.62 | 1.00 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B Q4_0 | pp512 | 820.51 | 924.05 | 1.13 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B Q4_0 | tg128 | 90.59 | 92.46 | 1.02 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B Q4_1 | pp512 | 776.88 | 872.79 | 1.12 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B Q4_1 | tg128 | 89.39 | 90.94 | 1.02 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B Q4_K_M | pp512 | 719.28 | 1009.27 | 1.40 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B Q4_K_M | tg128 | 80.62 | 80.86 | 1.00 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B Q4_K_S | pp512 | 732.29 | 1077.29 | 1.47 | | Intel(R) Xeon(R) Platinum 8488C | qwen35 0.8B Q4_K_S | tg128 | 86.42 | 83.53 | 0.97 | Signed-off-by: Adrien Gallouët <angt@huggingface.co>

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Source: README.md, updated 2026-06-20