StarCoder

StarCoder

BigCode
+
+

Related Products

  • Windsurf Editor
    161 Ratings
    Visit Website
  • Google AI Studio
    11 Ratings
    Visit Website
  • Vertex AI
    944 Ratings
    Visit Website
  • JetBrains Junie
    12 Ratings
    Visit Website
  • Retool
    567 Ratings
    Visit Website
  • ArboStar
    563 Ratings
    Visit Website
  • Notifyre
    47 Ratings
    Visit Website
  • LALAL.AI
    4,805 Ratings
    Visit Website
  • LM-Kit.NET
    25 Ratings
    Visit Website
  • Google Cloud BigQuery
    1,983 Ratings
    Visit Website

About

StarCoder and StarCoderBase are Large Language Models for Code (Code LLMs) trained on permissively licensed data from GitHub, including from 80+ programming languages, Git commits, GitHub issues, and Jupyter notebooks. Similar to LLaMA, we trained a ~15B parameter model for 1 trillion tokens. We fine-tuned StarCoderBase model for 35B Python tokens, resulting in a new model that we call StarCoder. We found that StarCoderBase outperforms existing open Code LLMs on popular programming benchmarks and matches or surpasses closed models such as code-cushman-001 from OpenAI (the original Codex model that powered early versions of GitHub Copilot). With a context length of over 8,000 tokens, the StarCoder models can process more input than any other open LLM, enabling a wide range of interesting applications. For example, by prompting the StarCoder models with a series of dialogues, we enabled them to act as a technical assistant.

About

Tülu 3 is an advanced instruction-following language model developed by the Allen Institute for AI (Ai2), designed to enhance capabilities in areas such as knowledge, reasoning, mathematics, coding, and safety. Built upon the Llama 3 Base, Tülu 3 employs a comprehensive four-stage post-training process: meticulous prompt curation and synthesis, supervised fine-tuning on a diverse set of prompts and completions, preference tuning using both off- and on-policy data, and a novel reinforcement learning approach to bolster specific skills with verifiable rewards. This open-source model distinguishes itself by providing full transparency, including access to training data, code, and evaluation tools, thereby closing the performance gap between open and proprietary fine-tuning methods. Evaluations indicate that Tülu 3 outperforms other open-weight models of similar size, such as Llama 3.1-Instruct and Qwen2.5-Instruct, across various benchmarks.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Developers interested in an LLM for code generation

Audience

Tülu 3 is designed for AI researchers, developers, and organizations seeking a high-performance, open-source language model for advanced reasoning, coding, and instruction-following tasks

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

BigCode
Founded: 2023
huggingface.co/blog/starcoder

Company Information

Ai2
Founded: 2014
United States
allenai.org/tulu

Alternatives

CodeGemma

CodeGemma

Google

Alternatives

Molmo

Molmo

Ai2
CodeQwen

CodeQwen

Alibaba
Olmo 3

Olmo 3

Ai2
DeepSeek Coder

DeepSeek Coder

DeepSeek
Llama 2

Llama 2

Meta
Olmo 2

Olmo 2

Ai2
Mercury Coder

Mercury Coder

Inception Labs

Categories

Categories

Integrations

Python
BuildThatIdea
C#
CSS
CodeQwen
Elixir
F#
GitHub
HTML
Java
Kotlin
R
Ruby
Rust
SQL
Tabby
Taylor AI
TypeScript
Visual Basic
Visual Studio Code

Integrations

Python
BuildThatIdea
C#
CSS
CodeQwen
Elixir
F#
GitHub
HTML
Java
Kotlin
R
Ruby
Rust
SQL
Tabby
Taylor AI
TypeScript
Visual Basic
Visual Studio Code
Claim StarCoder and update features and information
Claim StarCoder and update features and information
Claim Tülu 3 and update features and information
Claim Tülu 3 and update features and information