StableVicunaStability AI
|
TinkerThinking Machines Lab
|
|||||
Related Products
|
||||||
About
StableVicuna is the first large-scale open source chatbot trained via reinforced learning from human feedback (RHLF). StableVicuna is a further instruction fine tuned and RLHF trained version of Vicuna v0 13b, which is an instruction fine tuned LLaMA 13b model.
In order to achieve StableVicuna’s strong performance, we utilize Vicuna as the base model and follow the typical three-stage RLHF pipeline outlined by Steinnon et al. and Ouyang et al. Concretely, we further train the base Vicuna model with supervised finetuning (SFT) using a mixture of three datasets:
OpenAssistant Conversations Dataset (OASST1), a human-generated, human-annotated assistant-style conversation corpus comprising 161,443 messages distributed across 66,497 conversation trees, in 35 different languages;
GPT4All Prompt Generations, a dataset of 437,605 prompts and responses generated by GPT-3.5 Turbo;
And Alpaca, a dataset of 52,000 instructions and demonstrations generated by OpenAI's text-davinci-003.
|
About
Tinker is a training API designed for researchers and developers that allows full control over model fine-tuning while abstracting away the infrastructure complexity. It supports primitives and enables users to build custom training loops, supervision logic, and reinforcement learning flows. It currently supports LoRA fine-tuning on open-weight models across both LLama and Qwen families, ranging from small models to large mixture-of-experts architectures. Users write Python code to handle data, loss functions, and algorithmic logic; Tinker handles scheduling, resource allocation, distributed training, and failure recovery behind the scenes. The service lets users download model weights at different checkpoints and doesn’t force them to manage the compute environment. Tinker is delivered as a managed offering; training jobs run on Thinking Machines’ internal GPU infrastructure, freeing users from cluster orchestration.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Anyone interested in an open source AI chatbot
|
Audience
AI researchers and ML engineers requiring a solution to experiment with fine-tuning open source language models while outsourcing infrastructure complexity
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
Free
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationStability AI
Founded: 2019
United Kingdom
stability.ai/
|
Company InformationThinking Machines Lab
United States
thinkingmachines.ai/tinker/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
||||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
Inkling
Inkling-Small
Llama 3
Llama 3.1
Llama 3.2
Llama 3.3
Python
Qwen
Qwen3
|
Integrations
Inkling
Inkling-Small
Llama 3
Llama 3.1
Llama 3.2
Llama 3.3
Python
Qwen
Qwen3
|
|||||
|
|
|