Devstral

Devstral

Mistral AI
+
+

Related Products

  • Gemini Enterprise Agent Platform
    1,161 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Creatio
    589 Ratings
    Visit Website
  • Sendbird
    166 Ratings
    Visit Website
  • Pipefy
    594 Ratings
    Visit Website
  • Dialpad Support
    1,607 Ratings
    Visit Website
  • Checksum.ai
    2 Ratings
    Visit Website
  • Pensero
    3 Ratings
    Visit Website
  • BAND
    3 Ratings
    Visit Website
  • Ethena
    131 Ratings
    Visit Website

About

AgentBench is an evaluation framework specifically designed to assess the capabilities and performance of autonomous AI agents. It provides a standardized set of benchmarks that test various aspects of an agent's behavior, such as task-solving ability, decision-making, adaptability, and interaction with simulated environments. By evaluating agents on tasks across different domains, AgentBench helps developers identify strengths and weaknesses in the agents’ performance, such as their ability to plan, reason, and learn from feedback. The framework offers insights into how well an agent can handle complex, real-world-like scenarios, making it useful for both research and practical development. Overall, AgentBench supports the iterative improvement of autonomous agents, ensuring they meet reliability and efficiency standards before wider application.

About

Devstral is an open source, agentic large language model (LLM) developed by Mistral AI in collaboration with All Hands AI, specifically designed for software engineering tasks. It excels at navigating complex codebases, editing multiple files, and resolving real-world issues, outperforming all open source models on the SWE-Bench Verified benchmark with a score of 46.8%. Devstral is fine-tuned from Mistral-Small-3.1 and features a long context window of up to 128,000 tokens. It is optimized for local deployment on high-end hardware, such as a Mac with 32GB RAM or an Nvidia RTX 4090 GPU, and is compatible with inference frameworks like vLLM, Transformers, and Ollama. Released under the Apache 2.0 license, Devstral is available for free and can be accessed via Hugging Face, Ollama, Kaggle, Unsloth, and LM Studio.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Supported
iPad Supported
Android Supported
Chromebook Not Supported

Audience

AI developers wanting a tool to manage and evaluate their LLMs

Audience

Software developers and engineering teams seeking a tool to assist with code exploration, debugging, and multi-file editing tasks

Support

Phone Support Supported
24/7 Live Support Not Supported
Online Supported

Support

Phone Support Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Not Supported

API

Offers API Supported

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Pricing

$0.1 per million input tokens
Free Version Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Supported
In Person Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Supported

Company Information

AgentBench
China
llmbench.ai/agent

Company Information

Mistral AI
Founded: 2023
France
mistral.ai/news/devstral

Alternatives

Alternatives

DeepCoder

DeepCoder

Agentica Project
GLM-4.7

GLM-4.7

Z.ai
DeepSWE

DeepSWE

Agentica Project
Mistral Vibe

Mistral Vibe

Mistral AI
Devstral Small 2

Devstral Small 2

Mistral AI
Devstral 2

Devstral 2

Mistral AI

Categories

LLM Evaluation Supported

Categories

AI Coding Models Supported
AI Models Supported

Integrations

Hugging Face Not Supported
Kaggle Not Supported
LM Studio Not Supported
Mistral AI Not Supported
Mistral Code Not Supported
Ollama Not Supported
Unsloth Not Supported

Integrations

Hugging Face Supported
Kaggle Supported
LM Studio Supported
Mistral AI Supported
Mistral Code Supported
Ollama Supported
Unsloth Supported
Claim AgentBench and update features and information
Claim AgentBench and update features and information
Claim Devstral and update features and information
Claim Devstral and update features and information