Qwen2.5-1M

Qwen2.5-1M

Alibaba
StarCoder

StarCoder

BigCode
+
+

Related Products

  • Vertex AI
    944 Ratings
    Visit Website
  • LM-Kit.NET
    25 Ratings
    Visit Website
  • Google AI Studio
    11 Ratings
    Visit Website
  • AI Video Cut
    1 Rating
    Visit Website
  • Juspay
    15 Ratings
    Visit Website
  • imgproxy
    15 Ratings
    Visit Website
  • Source Defense
    7 Ratings
    Visit Website
  • Teradata VantageCloud
    1,105 Ratings
    Visit Website
  • Odoo
    1,638 Ratings
    Visit Website
  • Proton Pass
    31,996 Ratings
    Visit Website

About

Qwen2.5-1M is an open-source language model developed by the Qwen team, designed to handle context lengths of up to one million tokens. This release includes two model variants, Qwen2.5-7B-Instruct-1M and Qwen2.5-14B-Instruct-1M, marking the first time Qwen models have been upgraded to support such extensive context lengths. To facilitate efficient deployment, the team has also open-sourced an inference framework based on vLLM, integrated with sparse attention methods, enabling processing of 1M-token inputs with a 3x to 7x speed improvement. Comprehensive technical details, including design insights and ablation experiments, are available in the accompanying technical report.

About

StarCoder and StarCoderBase are Large Language Models for Code (Code LLMs) trained on permissively licensed data from GitHub, including from 80+ programming languages, Git commits, GitHub issues, and Jupyter notebooks. Similar to LLaMA, we trained a ~15B parameter model for 1 trillion tokens. We fine-tuned StarCoderBase model for 35B Python tokens, resulting in a new model that we call StarCoder. We found that StarCoderBase outperforms existing open Code LLMs on popular programming benchmarks and matches or surpasses closed models such as code-cushman-001 from OpenAI (the original Codex model that powered early versions of GitHub Copilot). With a context length of over 8,000 tokens, the StarCoder models can process more input than any other open LLM, enabling a wide range of interesting applications. For example, by prompting the StarCoder models with a series of dialogues, we enabled them to act as a technical assistant.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

AI researchers, developers, and organizations seeking an open-source large language model with extended context capabilities for advanced natural language processing tasks

Audience

Developers interested in an LLM for code generation

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Alibaba
Founded: 1999
China
qwenlm.github.io/blog/qwen2.5-1m/

Company Information

BigCode
Founded: 2023
huggingface.co/blog/starcoder

Alternatives

Qwen2.5-Max

Qwen2.5-Max

Alibaba

Alternatives

CodeGemma

CodeGemma

Google
CodeQwen

CodeQwen

Alibaba
CodeQwen

CodeQwen

Alibaba
DeepSeek Coder

DeepSeek Coder

DeepSeek
Qwen3.5-Plus

Qwen3.5-Plus

Alibaba

Categories

Categories

Integrations

Python
Alibaba Cloud
C++
ChatGPT
Clojure
Elixir
Git
GitHub
HTML
JavaScript
Kotlin
LM-Kit.NET
ModelScope
OpenAI
R
Ruby
Rust
Tabby
Taylor AI
Visual Basic

Integrations

Python
Alibaba Cloud
C++
ChatGPT
Clojure
Elixir
Git
GitHub
HTML
JavaScript
Kotlin
LM-Kit.NET
ModelScope
OpenAI
R
Ruby
Rust
Tabby
Taylor AI
Visual Basic
Claim Qwen2.5-1M and update features and information
Claim Qwen2.5-1M and update features and information
Claim StarCoder and update features and information
Claim StarCoder and update features and information