RankLLM

RankLLM

Castorini
+
+

Related Products

  • Runpod
    220 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    984 Ratings
    Visit Website
  • Google AI Studio
    30 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • StackAI
    53 Ratings
    Visit Website
  • Evertune
    1 Rating
    Visit Website
  • Teradata VantageCloud
    1,122 Ratings
    Visit Website
  • Cloudflare
    2,026 Ratings
    Visit Website
  • Passwork
    117 Ratings
    Visit Website
  • Retool
    584 Ratings
    Visit Website

About

Oumi is a fully open source platform that streamlines the entire lifecycle of foundation models, from data preparation and training to evaluation and deployment. It supports training and fine-tuning models ranging from 10 million to 405 billion parameters using state-of-the-art techniques such as SFT, LoRA, QLoRA, and DPO. The platform accommodates both text and multimodal models, including architectures like Llama, DeepSeek, Qwen, and Phi. Oumi offers tools for data synthesis and curation, enabling users to generate and manage training datasets effectively. For deployment, it integrates with popular inference engines like vLLM and SGLang, ensuring efficient model serving. The platform also provides comprehensive evaluation capabilities across standard benchmarks to assess model performance. Designed for flexibility, Oumi can run on various environments, from local laptops to cloud infrastructures such as AWS, Azure, GCP, and Lambda.

About

RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking. It offers a suite of rerankers, pointwise models like MonoT5, pairwise models like DuoT5, and listwise models compatible with vLLM, SGLang, or TensorRT-LLM. Additionally, it supports RankGPT and RankGemini variants, which are proprietary listwise rerankers. It includes modules for retrieval, reranking, evaluation, and response analysis, facilitating end-to-end workflows. RankLLM integrates with Pyserini for retrieval and provides integrated evaluation for multi-stage pipelines. It also includes a module for detailed analysis of input prompts and LLM responses, addressing reliability concerns with LLM APIs and non-deterministic behavior in Mixture-of-Experts (MoE) models. The toolkit supports various backends, including SGLang and TensorRT-LLM, and is compatible with a wide range of LLMs.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Machine learning researchers and developers in need of a platform to build, evaluate, and deploy state-of-the-art AI models

Audience

Academic researchers and developers seeking a solution offering tools for implementing and evaluating listwise reranking with large language models

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Oumi
Founded: 2024
United States
oumi.ai/

Company Information

Castorini
Canada
github.com/castorini/rank_llm/

Alternatives

Alternatives

RankGPT

RankGPT

Weiwei Sun
LLaMA-Factory

LLaMA-Factory

hoshi-hiyouga
ColBERT

ColBERT

Future Data Systems

Categories

Categories

Integrations

Llama
Qwen
AWS Lambda
Amazon Web Services (AWS)
DeepSeek
Gemini
Gemini Enterprise
Google Cloud Platform
Microsoft Azure
Mistral AI
NVIDIA TensorRT
OpenAI
Phi-2
Python
RankGPT

Integrations

Llama
Qwen
AWS Lambda
Amazon Web Services (AWS)
DeepSeek
Gemini
Gemini Enterprise
Google Cloud Platform
Microsoft Azure
Mistral AI
NVIDIA TensorRT
OpenAI
Phi-2
Python
RankGPT
Claim Oumi and update features and information
Claim Oumi and update features and information
Claim RankLLM and update features and information
Claim RankLLM and update features and information