Related Products
|
||||||
About
Axolotl is an open source tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures. It enables users to train models, supporting methods like full fine-tuning, LoRA, QLoRA, ReLoRA, and GPTQ. Users can customize configurations using simple YAML files or command-line interface overrides, and load different dataset formats, including custom or pre-tokenized datasets. Axolotl integrates with technologies like xFormers, Flash Attention, Liger kernel, RoPE scaling, and multipacking, and works with single or multiple GPUs via Fully Sharded Data Parallel (FSDP) or DeepSpeed. It can be run locally or on the cloud using Docker and supports logging results and checkpoints to several platforms. It is designed to make fine-tuning AI models friendly, fast, and fun, without sacrificing functionality or scale.
|
About
RunInfra turns plain English into production AI inference endpoints. Describe your use case, and the AI agent builds, optimizes, deploys, and scales it for you; no YAML, no DevOps, no GPU configuration, just chat. It is built for shipping open source AI models as production APIs, selecting compatible models, benchmarking real GPUs, applying kernel optimizations, and deploying OpenAI-compatible HTTP endpoints. RunInfra can build LLM, speech-to-text, text-to-speech, embedding, vision-language, image-generation, RAG search, document AI, transcription, AI assistant, and multi-model reasoning pipelines when the selected model and runtime support the route. Its workflow moves from description to optimization to deployment to integration; tell RunInfra what you need, let it profile real GPUs from L4 to B200, search model variants such as AWQ, GPTQ, and FP8, tune kernels with Forge, and ship an endpoint that works with OpenAI Python and JavaScript SDKs.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
Data scientists seeking a solution to fine-tune large language models across various architectures
|
Audience
AI developers and infrastructure teams that need to benchmark, optimize, and deploy open models on the most suitable inference engines and GPU configurations
|
|||||
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
|||||
API
Offers API
Not Supported
|
API
Offers API
Supported
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
Free
Free Version
Supported
Free Trial
Not Supported
|
Pricing
$100 per month
Free Version
Not Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Supported
In Person
Not Supported
|
|||||
Company InformationAxolotl
United States
axolotl.ai/
|
Company InformationRunInfra
Founded: 2026
Jordan
runinfra.ai/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
Hugging Face
Supported
Cerebras
Supported
Comet
Supported
Docker
Supported
Falcon
Supported
GPT-J
Supported
Gemma
Supported
Llama
Supported
MLflow
Supported
MPT-7B
Supported
|
Integrations
Hugging Face
Supported
Cerebras
Not Supported
Comet
Not Supported
Docker
Not Supported
Falcon
Not Supported
GPT-J
Not Supported
Gemma
Not Supported
Llama
Not Supported
MLflow
Not Supported
MPT-7B
Not Supported
|
|||||
|
|
|