AI-Q NVIDIA BlueprintNVIDIA
|
RankLLMCastorini
|
|||||
Related Products
|
||||||
About
Create AI agents that reason, plan, reflect, and refine to produce high-quality reports based on source materials of your choice. An AI research agent, informed by many data sources, can synthesize hours of research in minutes. The AI-Q NVIDIA Blueprint enables developers to build AI agents that use reasoning and connect to many data sources and tools to distill in-depth source materials with efficiency and precision. Using AI-Q, agents summarize large data sets, generating tokens 5x faster and ingesting petabyte-scale data 15x faster with better semantic accuracy. Multimodal PDF data extraction and retrieval with NVIDIA NeMo Retriever, 15x faster ingestion of enterprise data, 3x lower retrieval latency, multilingual and cross-lingual, reranking to further improve accuracy, and GPU-accelerated index creation and search.
|
About
RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking. It offers a suite of rerankers, pointwise models like MonoT5, pairwise models like DuoT5, and listwise models compatible with vLLM, SGLang, or TensorRT-LLM. Additionally, it supports RankGPT and RankGemini variants, which are proprietary listwise rerankers. It includes modules for retrieval, reranking, evaluation, and response analysis, facilitating end-to-end workflows. RankLLM integrates with Pyserini for retrieval and provides integrated evaluation for multi-stage pipelines. It also includes a module for detailed analysis of input prompts and LLM responses, addressing reliability concerns with LLM APIs and non-deterministic behavior in Mixture-of-Experts (MoE) models. The toolkit supports various backends, including SGLang and TensorRT-LLM, and is compatible with a wide range of LLMs.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Research institutions seeking a tool to develop sophisticated AI agents that can autonomously analyze vast datasets
|
Audience
Academic researchers and developers seeking a solution offering tools for implementing and evaluating listwise reranking with large language models
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
Free
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationNVIDIA
Founded: 1993
United States
build.nvidia.com/nvidia/aiq
|
Company InformationCastorini
Canada
github.com/castorini/rank_llm/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
Gemini
Gemini Enterprise
LangChain
Llama
Milvus
Mistral AI
NVIDIA AI Data Platform
NVIDIA AI Enterprise
NVIDIA NeMo
NVIDIA TensorRT
|
Integrations
Gemini
Gemini Enterprise
LangChain
Llama
Milvus
Mistral AI
NVIDIA AI Data Platform
NVIDIA AI Enterprise
NVIDIA NeMo
NVIDIA TensorRT
|
|||||
|
|
|