Search Results for "parallel language"
Sort By:
Showing 4 open source projects for "parallel language"
View related business solutions-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
Safetica Data Loss Prevention Software for BusinessesSafetica is a cost-effective, easy-to-use Data Loss Prevention (DLP) solution. It performs security audits, prevents sensitive data from leaving your company, and sheds light on what is going on in your organization.
-
1
vLLM
A high-throughput and memory-efficient inference and serving engine
vLLM is a fast and easy-to-use library for LLM inference and serving. High-throughput serving with various decoding algorithms, including parallel sampling, beam search, and more. -
2
Petals
Run 100B+ language models at home, BitTorrent-style
Parallel inference reaches hundreds of tokens/sec. Beyond classic language model APIs — you can employ any fine-tuning and sampling methods, execute custom paths through the model, or see its hidden states. You get the comforts of an API with the flexibility of PyTorch. You can also host BLOOMZ, a version of BLOOM fine-tuned to follow human instructions in the zero-shot regime — just replace bloom-petals with bloomz-petals. -
3
Medusa
Framework for Accelerating LLM Generation with Multiple Decoding Heads
Medusa is a framework aimed at accelerating the generation capabilities of Large Language Models (LLMs) by employing multiple decoding heads. This approach allows for parallel processing during text generation, significantly enhancing throughput and reducing response times. Medusa is designed to be simple to implement and integrates with existing LLM infrastructures, making it a practical solution for scaling LLM applications. -
4
GPT-NeoX
Implementation of model parallel autoregressive transformers on GPUs
This repository records EleutherAI's library for training large-scale language models on GPUs. Our current framework is based on NVIDIA's Megatron Language Model and has been augmented with techniques from DeepSpeed as well as some novel optimizations. We aim to make this repo a centralized and accessible place to gather techniques for training large-scale autoregressive language models, and accelerate research into large-scale training. For those looking for a TPU-centric codebase, we... -
Try the cloud dialer that managers trust and employees love to use.Boost your agents’ productivity and enhance customer engagement like never before with CallTools’ powerful suite of call center features, including predictive dialing, call recording, and multi-touch campaigns with email and SMS capabilities. Get a complete 360-degree view of your agents’ performance and take advantage of real-time reporting. With seamless integration options, advanced queue management, and flexible IVR settings, CallTools ensures a streamlined workflow. Effortlessly manage data targeting and caller ID strategies to optimize connection rates and improve outcomes. Empower your team with a user-friendly interface designed to simplify complex tasks while delivering consistent results.
- Previous
- You're on page 1
- Next
