Search Results for "llama.cpp python"

Backtrack Sampler is a framework designed for experimenting with custom sampling strategies for language models (LLMs), enabling the ability to rewind and revise generated tokens. It allows developers to create and test their own token generation strategies by providing a base structure for manipulating logits and probabilities, making it a flexible tool for those interested in fine-tuning the behavior of LLMs.

OpenAI Sublime Text is a full-featured AI assistant plugin designed to bring advanced language model capabilities into the Sublime Text editor with a deeply integrated user experience. It supports a wide range of providers, including OpenAI, Anthropic, Google Gemini, and local backends like Ollama or llama.cpp, making it highly flexible for different deployment scenarios. The plugin offers both chat-based interaction and inline assistance through “phantoms,” which display non-intrusive...