Search Results for "benchmarking tool"

Apache Maka is an incubating local-first AI agent workspace designed for practical software and knowledge work. It can inspect projects, execute tools, create artifacts, and preserve agent activity as recoverable execution records. Sessions, settings, and run data stay on the user’s machine by default, while model connections can use cloud APIs, local models, or compatible gateways. Its Runtime Event Log records model messages, tool calls, tool results, permission decisions, and termination...

Ollama Grid Search is a desktop application designed to automate the evaluation and comparison of large language models, prompts, and inference parameters in a structured and repeatable way. Instead of manually testing combinations, the tool performs grid search experiments by iterating across different models, prompt variations, and parameter configurations, allowing users to quickly identify optimal setups for specific tasks. It provides a visual interface where experiment results can be inspected, compared, and refined, making it especially useful for prompt engineering and benchmarking workflows. ...