Alpaca

Alpaca

Stanford Center for Research on Foundation Models (CRFM)
Solar Mini

Solar Mini

Upstage AI
+
+

Related Products

  • Google AI Studio
    40 Ratings
    Visit Website
  • Evertune
    1 Rating
    Visit Website
  • Gemini Enterprise Agent Platform
    999 Ratings
    Visit Website
  • VKS
    26 Ratings
    Visit Website
  • 6Storage
    129 Ratings
    Visit Website
  • Partful
    20 Ratings
    Visit Website
  • Admin By Request Endpoint Privilege Management
    100 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • ClickLearn
    67 Ratings
    Visit Website
  • CoachIQ
    41 Ratings
    Visit Website

About

Instruction-following models such as GPT-3.5 (text-DaVinci-003), ChatGPT, Claude, and Bing Chat have become increasingly powerful. Many users now interact with these models regularly and even use them for work. However, despite their widespread deployment, instruction-following models still have many deficiencies: they can generate false information, propagate social stereotypes, and produce toxic language. To make maximum progress on addressing these pressing problems, it is important for the academic community to engage. Unfortunately, doing research on instruction-following models in academia has been difficult, as there is no easily accessible model that comes close in capabilities to closed-source models such as OpenAI’s text-DaVinci-003. We are releasing our findings about an instruction-following language model, dubbed Alpaca, which is fine-tuned from Meta’s LLaMA 7B model.

About

Solar Mini is a pre‑trained large language model that delivers GPT‑3.5‑comparable responses with 2.5× faster inference while staying under 30 billion parameters. It achieved first place on the Hugging Face Open LLM Leaderboard in December 2023 by combining a 32‑layer Llama 2 architecture, initialized with high‑quality Mistral 7B weights, with an innovative “depth up‑scaling” (DUS) approach that deepens the model efficiently without adding complex modules. After DUS, continued pretraining restores and enhances performance, and instruction tuning in a QA format, especially for Korean, refines its ability to follow user prompts, while alignment tuning ensures its outputs meet human or advanced AI preferences. Solar Mini outperforms competitors such as Llama 2, Mistral 7B, Ko‑Alpaca, and KULLM across a variety of benchmarks, proving that compact size need not sacrifice capability.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Organizations and researchers interested in a powerful Large Language Model

Audience

Developers and AI teams in need of a solution with robust instruction following and RAG‑enabled document processing for real‑time applications

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

$0.1 per 1M tokens
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Stanford Center for Research on Foundation Models (CRFM)
United States
crfm.stanford.edu/2023/03/13/alpaca.html

Company Information

Upstage AI
Founded: 2020
United States
www.upstage.ai/blog/en/introducing-solar-mini-compact-yet-powerful

Alternatives

Falcon-40B

Falcon-40B

Technology Innovation Institute (TII)

Alternatives

Llama 2

Llama 2

Meta
LTM-1

LTM-1

Magic AI
Mistral 7B

Mistral 7B

Mistral AI
MPT-7B

MPT-7B

MosaicML
Dolly

Dolly

Databricks
Mistral NeMo

Mistral NeMo

Mistral AI
Phi-4-reasoning

Phi-4-reasoning

Microsoft

Categories

Categories

Integrations

BERT
ChatGPT
Dolly
GPT-4
Hugging Face
Llama
Llama 2
Ludwig
Mistral 7B
Stable LM
Syn
Upstage AI

Integrations

BERT
ChatGPT
Dolly
GPT-4
Hugging Face
Llama
Llama 2
Ludwig
Mistral 7B
Stable LM
Syn
Upstage AI
Claim Alpaca and update features and information
Claim Alpaca and update features and information
Claim Solar Mini and update features and information
Claim Solar Mini and update features and information