Open and portable generative AI for devs and businesses. We release open-weight models for everyone to customize and deploy where they want it. Our super-efficient model Mistral Nemo is available under Apache 2.0, while Mistral Large 2 is available through both a free non-commercial license, and a commercial license.

Features

  • Create a local folder to store models
  • To test that a model works in your setup, you can run the mistral-demo command
  • Chat with Codestral
  • Chat with Codestral-Mamba
  • Fill-in-the-middle (FIM)
  • One-file-ref
  • Run logits equivalence

Project Samples

Mistral Inference Screenshot 1 Mistral Inference Screenshot 2

Project Activity

See All Activity >

Categories

Libraries, LLM Inference

License

Apache License V2.0

Follow Mistral Inference

Mistral Inference Web Site

Other Useful Business Software
AI-powered service management for IT and enterprise teams Icon
AI-powered service management for IT and enterprise teams

Enterprise-grade ITSM, for every business

Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity. Maximize operational efficiency with refreshingly simple, AI-powered Freshservice.
Try it Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Mistral Inference!

Additional Project Details

Programming Language

Python

Related Categories

Python Libraries, Python LLM Inference Tool

Registered

2024-09-20
Report inappropriate content