BenchGen

Gemini 3.5 Flash Cyber is a specialized cyber-focused model built on Gemini 3.5 Flash and fine-tuned to find, validate, and fix cybersecurity vulnerabilities efficiently at scale. It is designed for defensive security workflows where organizations need to identify critical weaknesses faster and generate reliable patches before those issues can be exploited. Flash’s combination of performance and efficiency makes it a strong foundation for scanning code, reasoning about security flaws, validating whether findings are real, and proposing targeted remediations across large software environments. Within CodeMender, multiple Gemini 3.5 Flash Cyber agents work together and combine their findings into a single report, helping the system investigate vulnerabilities from different angles and improve the quality of the final result. This coordinated agent setup delivers competitive frontier performance on CyberGym, a benchmark for evaluating cybersecurity capabilities.

OpenPipe provides fine-tuning for developers. Keep your datasets, models, and evaluations all in one place. Train new models with the click of a button. Automatically record LLM requests and responses. Create datasets from your captured data. Train multiple base models on the same dataset. We serve your model on our managed endpoints that scale to millions of requests. Write evaluations and compare model outputs side by side. Change a couple of lines of code, and you're good to go. Simply replace your Python or Javascript OpenAI SDK and add an OpenPipe API key. Make your data searchable with custom tags. Small specialized models cost much less to run than large multipurpose LLMs. Replace prompts with models in minutes, not weeks. Fine-tuned Mistral and Llama 2 models consistently outperform GPT-4-1106-Turbo, at a fraction of the cost. We're open-source, and so are many of the base models we use. Own your own weights when you fine-tune Mistral and Llama 2, and download them at any time.