Audience
Developers and anyone seeking an LLM solution to scan for vulnerabilities
About garak
garak checks if an LLM can be made to fail in a way we don't want. garak probes for hallucination, data leakage, prompt injection, misinformation, toxicity generation, jailbreaks, and many other weaknesses. garak's a free tool, we love developing it and are always interested in adding functionality to support applications. garak is a command-line tool, it's developed in Linux and OSX. Just grab it from PyPI and you should be good to go. The standard pip version of garak is updated periodically. garak has its own dependencies, you can to install garak in its own Conda environment. garak needs to know what model to scan, and by default, it'll try all the probes it knows on that model, using the vulnerability detectors recommended by each probe. For each probe loaded, garak will print a progress bar as it generates. Once the generation is complete, a row evaluating that probe's results on each detector is given.
Other Popular Alternatives & Related Software
Probely
Probely is a web vulnerability scanner for agile teams. It provides continuous scanning of web applications and lets you efficiently manage the lifecycle of the vulnerabilities found, in a sleek and intuitive web interface.
It also provides simple instructions on how to fix the vulnerabilities (including snippets of code), and by using its full-featured API, it can be integrated into development processes (SDLC) and continuous integration pipelines (CI/CD), to automate security testing.
Probely empowers developers to be more independent, solving the security teams' scaling problem, that is usually undersized when compared to development teams, by providing developers with a tool that makes them more independent when it comes to security testing, allowing security teams to focus on more important and critical activities.
Probely covers OWASP TOP10 and thousands more and can be used to check specific PCI-DSS, ISO27001, HIPAA, and GDPR requirements.
Learn more
SplxAI
SplxAI offers an automated platform specifically designed for conversational AI applications. Their flagship product, Probe, proactively identifies and mitigates vulnerabilities in AI systems by simulating domain-specific attack scenarios. Key features of Probe include detailed risk analysis, framework and compliance checks, domain-specific penetration testing, continuous and automated testing, and multi-language precision, supporting over 20 languages. The platform integrates seamlessly into development cycles, ensuring AI applications remain secure throughout their lifecycle. SplxAI's mission is to secure and safeguard generative AI-powered conversational apps by providing advanced security and penetration testing solutions, enabling organizations to unlock AI's full potential without compromising security. Evaluate and refine your app’s boundaries for optimal security and user experience without being overly restrictive.
Learn more
MobiProbe
World's most advance AI algorithm is as good as the underlying DATA. MobiProbe empowers your business to solve its DATA QUALITY problem. MobiProbe is a real time system performance and engagement measurement workbench for connected devices, systems and applications. MobiProbe provides best in class, powerful and lightweight SDKs and APIs that can seamlessly be integrated into your software system with a single line of code. Thereupon you can track and log any {key:value} defined event and add any number of attributes to your data points. MobiProbe comes with a highly customisable dashboard and reporting system that can be customised specific to your business use case. You can use MobiProbe's built in visualisations, ask us to build a custom one for you or have your analyst connect their preferred data visualisation tool on top of MobiProbe data store.
Learn more
myEPITIRO
Epitiro remote network monitoring probes keep you informed of your Ethernet, Wi-Fi, and/or LTE service performance and user experience. Deploy Epitiro hardware probes at key locations and continuously test network performance and bandwidth for multiple broadband networks. Easily configure test networks and schedules from our cloud interface. Test on demand or on schedule. Set-up performance alerts for you and your team. Assure captive portal and splash page operation and performance. Invite your team and customer stakeholders to securely view performance from their desktop or mobile app. Enterprise class administrative features and scalability. Comprehensive end-to-end performance tests include Ookla Speedtest, Latency, Jitter, Packet Loss, application performance for Browsing, Dropbox, Youtube as well as iPerf and traceroute support. QoS. QoE.
Learn more
Pricing
Starting Price:
Free
Free Version:
Free Version available.
Integrations
Company Information
garak
github.com/leondz/garak/
Videos and Screen Captures
Other Useful Business Software
Ship Agents Faster
Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
Product Details
Platforms Supported
Mac
Linux
Training
Documentation
Support
Online
