Audience
AI researchers and developers in search of a solution providing an embedding model for code retrieval
About voyage-code-3
Voyage AI introduces voyage-code-3, a next-generation embedding model optimized for code retrieval. It outperforms OpenAI-v3-large and CodeSage-large by an average of 13.80% and 16.81% on a suite of 32 code retrieval datasets, respectively. It supports embeddings of 2048, 1024, 512, and 256 dimensions and offers multiple embedding quantization options, including float (32-bit), int8 (8-bit signed integer), uint8 (8-bit unsigned integer), binary (bit-packed int8), and ubinary (bit-packed uint8). With a 32 K-token context length, it surpasses OpenAI's 8K and CodeSage Large's 1K context lengths. Voyage-code-3 employs Matryoshka learning to create embeddings with a nested family of various lengths within a single vector. This allows users to vectorize documents into a 2048-dimensional vector and later use shorter versions (e.g., 256, 512, or 1024 dimensions) without re-invoking the embedding model.
Other Popular Alternatives & Related Software
Cohere Embed
Cohere's Embed is a leading multimodal embedding platform designed to transform text, images, or a combination of both into high-quality vector representations. These embeddings are optimized for semantic search, retrieval-augmented generation, classification, clustering, and agentic AI applications. The latest model, embed-v4.0, supports mixed-modality inputs, allowing users to combine text and images into a single embedding. It offers Matryoshka embeddings with configurable dimensions of 256, 512, 1024, or 1536, enabling flexibility in balancing performance and resource usage. With a context length of up to 128,000 tokens, embed-v4.0 is well-suited for processing large documents and complex data structures. It also supports compressed embedding types, including float, int8, uint8, binary, and ubinary, facilitating efficient storage and faster retrieval in vector databases. Multilingual support spans over 100 languages, making it a versatile tool for global applications.
Learn more
Codestral Embed
Codestral Embed is Mistral AI's first embedding model, specialized for code, optimized for high-performance code retrieval and semantic understanding. It significantly outperforms leading code embedders in the market today, such as Voyage Code 3, Cohere Embed v4.0, and OpenAI’s large embedding model. Codestral Embed can output embeddings with different dimensions and precisions; for instance, with a dimension of 256 and int8 precision, it still performs better than any model from competitors. The dimensions of the embeddings are ordered by relevance, allowing users to choose the first n dimensions for a smooth trade-off between quality and cost. It excels in retrieval use cases on real-world code data, particularly in benchmarks like SWE-Bench, which is based on real-world GitHub issues and corresponding fixes, and Text2Code (GitHub), relevant for providing context for code completion or editing.
Learn more
Voyage AI
Voyage AI provides best-in-class embedding models and rerankers designed to supercharge search and retrieval for unstructured data. Its technology powers high-quality Retrieval-Augmented Generation (RAG) by improving how relevant context is retrieved before responses are generated. Voyage AI offers general-purpose, domain-specific, and company-specific models to support a wide range of use cases. The models are optimized for accuracy, low latency, and reduced costs through shorter vector dimensions. With long-context support of up to 32K tokens, Voyage AI enables deeper understanding of complex documents. The platform is modular and integrates easily with any vector database or large language model. Voyage AI is trusted by industry leaders to deliver reliable, factual AI outputs at scale.
Learn more
voyage-3-large
Voyage AI has unveiled voyage-3-large, a cutting-edge general-purpose and multilingual embedding model that leads across eight evaluated domains, including law, finance, and code, outperforming OpenAI-v3-large and Cohere-v3-English by averages of 9.74% and 20.71%, respectively. Enabled by Matryoshka learning and quantization-aware training, it supports embeddings of 2048, 1024, 512, and 256 dimensions, along with multiple quantization options such as 32-bit floating point, signed and unsigned 8-bit integer, and binary precision, significantly reducing vector database costs with minimal impact on retrieval quality. Notably, voyage-3-large offers a 32K-token context length, surpassing OpenAI's 8K and Cohere's 512 tokens. Evaluations across 100 datasets in diverse domains demonstrate its superior performance, with flexible precision and dimensionality options enabling substantial storage savings without compromising quality.
Learn more
Integrations
Company Information
MongoDB
Founded: 2007
United States
blog.voyageai.com/2024/12/04/voyage-code-3/
Videos and Screen Captures
Other Useful Business Software
Our Free Plans just got better! | Auth0
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Product Details
Platforms Supported
Cloud
Training
Documentation
Live Online
Support
Online
