API-for-Open-LLM Files

Openai style api for open large language models

This is an exact mirror of the API-for-Open-LLM project, hosted at https://github.com/xusenlinzy/api-for-open-llm. SourceForge is not affiliated with API-for-Open-LLM.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
api-for-open-llm-vllm0.4.3	2024-06-07	1
api-for-open-llm-v1.0.4	2024-01-19	0
api-for-open-llm-v1.0.3	2023-12-27	0
api-for-open-llm-v1.0.2	2023-12-01	0
api-for-open-llm-v1.0.0	2023-11-15	0
Totals: 5 Items		1

Other Useful Business Software

Fully Managed MySQL, PostgreSQL, and SQL Server

Automatic backups, patching, replication, and failover. Focus on your app, not your database.

Cloud SQL handles your database ops end to end, so you can focus on your app.

Try Free

$300 in Free Credit Towards Top Cloud Services

Build VMs, containers, AI, databases, storage—all in one place.

Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.

Get Started

$300 in Free Credit Towards Top Cloud Services

Build VMs, containers, AI, databases, storage—all in one place.

Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.

Get Started

Recommended Projects

AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis
Text Generation Inference
Large Language Model Text Generation Inference
LLMFlows
LLMFlows - Simple, Explicit and Transparent LLM Apps
LMDeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
OpenLLM
Operating LLMs in production

API-for-Open-LLM Files

Openai style api for open large language models

Get an email when there's a new version of API-for-Open-LLM