RankGPT

Cohere Rerank is a powerful semantic search tool that refines enterprise search and retrieval by precisely ranking results. It processes a query and a list of documents, ordering them from most to least semantically relevant, and assigns a relevance score between 0 and 1 to each document. This ensures that only the most pertinent documents are passed into your RAG pipeline and agentic workflows, reducing token use, minimizing latency, and boosting accuracy. The latest model, Rerank v3.5, supports English and multilingual documents, as well as semi-structured data like JSON, with a context length of 4096 tokens. Long documents are automatically chunked, and the highest relevance score among chunks is used for ranking. Rerank can be integrated into existing keyword or semantic search systems with minimal code changes, enhancing the relevance of search results. It is accessible via Cohere's API and is compatible with various platforms, including Amazon Bedrock and SageMaker.

ColBERT is a fast and accurate retrieval model, enabling scalable BERT-based search over large text collections in tens of milliseconds. It relies on fine-grained contextual late interaction: it encodes each passage into a matrix of token-level embeddings. At search time, it embeds every query into another matrix and efficiently finds passages that contextually match the query using scalable vector-similarity (MaxSim) operators. These rich interactions allow ColBERT to surpass the quality of single-vector representation models while scaling efficiently to large corpora. The toolkit includes components for retrieval, reranking, evaluation, and response analysis, facilitating end-to-end workflows. ColBERT integrates with Pyserini for retrieval and provides integrated evaluation for multi-stage pipelines. It also includes a module for detailed analysis of input prompts and LLM responses, addressing reliability concerns with LLM APIs and non-deterministic behavior in Mixture-of-Experts.