Universal Sentence Encoder

The Voyage 4 model family from Voyage AI is a new generation of text embedding models designed to produce high-quality semantic vectors with an industry-first shared embedding space that lets different models in the series generate compatible embeddings so developers can mix and match models for document and query embedding to optimize accuracy, latency, and cost trade-offs. It includes voyage-4-large (a flagship model using a mixture-of-experts architecture delivering state-of-the-art retrieval accuracy at about 40% lower serving cost than comparable dense models), voyage-4 (balancing quality and efficiency), voyage-4-lite (high-quality embeddings with fewer parameters and lower compute cost), and the open-weight voyage-4-nano (ideal for local development and prototyping with an Apache 2.0 license). All four models in the series operate in a single shared embedding space, so embeddings generated by different variants are interchangeable, enabling asymmetric retrieval strategies.

Word2Vec is a neural network-based technique for learning word embeddings, developed by researchers at Google. It transforms words into continuous vector representations in a multi-dimensional space, capturing semantic relationships based on context. Word2Vec uses two main architectures: Skip-gram, which predicts surrounding words given a target word, and Continuous Bag-of-Words (CBOW), which predicts a target word based on surrounding words. By training on large text corpora, Word2Vec generates word embeddings where similar words are positioned closely, enabling tasks like semantic similarity, analogy solving, and text clustering. The model was influential in advancing NLP by introducing efficient training techniques such as hierarchical softmax and negative sampling. Though newer embedding models like BERT and Transformer-based methods have surpassed it in complexity and performance, Word2Vec remains a foundational method in natural language processing and machine learning research.