Search Results for "llama.cpp"

Backtrack Sampler is a framework designed for experimenting with custom sampling strategies for language models (LLMs), enabling the ability to rewind and revise generated tokens. It allows developers to create and test their own token generation strategies by providing a base structure for manipulating logits and probabilities, making it a flexible tool for those interested in fine-tuning the behavior of LLMs.

...It provides intelligent code completion, inline refactoring, and conversational chat interfaces that can appear as popups, side panels, or embedded views within the IDE. The plugin supports both local and cloud-based language model providers, including Ollama, llama.cpp, OpenAI, Claude, and others, allowing developers to choose between privacy-focused local setups or more powerful remote models. It includes advanced context handling features such as file attachments, project-specific rules, and automatic synchronization with open files, which improves the relevance of AI responses. The system also enables AI tool calling, allowing the assistant to inspect project files, run searches, and access diagnostics to provide deeper assistance.

OpenAI Sublime Text is a full-featured AI assistant plugin designed to bring advanced language model capabilities into the Sublime Text editor with a deeply integrated user experience. It supports a wide range of providers, including OpenAI, Anthropic, Google Gemini, and local backends like Ollama or llama.cpp, making it highly flexible for different deployment scenarios. The plugin offers both chat-based interaction and inline assistance through “phantoms,” which display non-intrusive responses directly within the editor view. It allows users to send selected code, entire files, or diagnostic outputs as context, enabling more precise and relevant responses. ...