TokenSpeed Files

TokenSpeed is a speed-of-light LLM inference engine

This is an exact mirror of the TokenSpeed project, hosted at https://github.com/lightseekorg/tokenspeed. SourceForge is not affiliated with TokenSpeed.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size
tokenspeed source code.tar.gz	< 14 hours ago	2.5 MB
tokenspeed source code.zip	< 14 hours ago	3.3 MB
Totals: 2 Items		5.8 MB

Other Useful Business Software

$300 in Free Credit Towards Top Cloud Services

Build VMs, containers, AI, databases, storage—all in one place.

Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.

Get Started

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

$300 in Free Credit Towards Top Cloud Services

Build VMs, containers, AI, databases, storage—all in one place.

Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.

Get Started

Recommended Projects

AutoGen
An Open-Source Programming Framework for Agentic AI
tiny-llm
A course of learning LLM inference serving on Apple Silicon
vLLM
A high-throughput and memory-efficient inference and serving engine
TensorRT
C++ library for high performance inference on NVIDIA GPUs
RTP-LLM
Alibaba's high-performance LLM inference engine for diverse apps

TokenSpeed Files

TokenSpeed is a speed-of-light LLM inference engine

Get an email when there's a new version of TokenSpeed