openTPU
An open-source AI accelerator, developed by AI
openTPU is an open-source AI accelerator project that exposes an entire inference hardware stack in one readable repository. It includes SystemVerilog RTL, a custom instruction set, a bit-exact simulator, a kernel language, compiler tooling, host software, and profiling utilities. The hardware design runs on a Xilinx Kintex-7 PCIe FPGA card and has been demonstrated with modern language models including Qwen, LFM, Gemma, SmolLM, and Phi variants. Both int8 and compact 4-bit weight formats...