+
+

Related Products

  • ZeroPath
    2 Ratings
    Visit Website
  • Astra Pentest
    219 Ratings
    Visit Website
  • Aikido Security
    123 Ratings
    Visit Website
  • Wiz
    1,088 Ratings
    Visit Website
  • Orca Security
    492 Ratings
    Visit Website
  • Synap
    32 Ratings
    Visit Website
  • LTX
    141 Ratings
    Visit Website
  • Vertex AI
    783 Ratings
    Visit Website
  • ManageEngine Endpoint Central
    2,457 Ratings
    Visit Website
  • Boozang
    15 Ratings
    Visit Website

About

garak checks if an LLM can be made to fail in a way we don't want. garak probes for hallucination, data leakage, prompt injection, misinformation, toxicity generation, jailbreaks, and many other weaknesses. garak's a free tool, we love developing it and are always interested in adding functionality to support applications. garak is a command-line tool, it's developed in Linux and OSX. Just grab it from PyPI and you should be good to go. The standard pip version of garak is updated periodically. garak has its own dependencies, you can to install garak in its own Conda environment. garak needs to know what model to scan, and by default, it'll try all the probes it knows on that model, using the vulnerability detectors recommended by each probe. For each probe loaded, garak will print a progress bar as it generates. Once the generation is complete, a row evaluating that probe's results on each detector is given.

About

Promptfoo discovers and eliminates major LLM risks before they are shipped to production. Its founders have experience launching and scaling AI to over 100 million users using automated red-teaming and testing to overcome security, legal, and compliance issues. Promptfoo's open source, developer-first approach has made it the most widely adopted tool in this space, with over 20,000 users. Custom probes for your application that identify failures you actually care about, not just generic jailbreaks and prompt injections. Move quickly with a command-line interface, live reloads, and caching. No SDKs, cloud dependencies, or logins. Used by teams serving millions of users and supported by an active open source community. Build reliable prompts, models, and RAGs with benchmarks specific to your use case. Secure your apps with automated red teaming and pentesting. Speed up evaluations with caching, concurrency, and live reloading.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Developers and anyone seeking an LLM solution to scan for vulnerabilities

Audience

Developers in need of a solution to test and secure their LLM apps

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

Free
Free Version
Free Trial

Pricing

Free
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

garak
github.com/leondz/garak/

Company Information

promptfoo
United States
www.promptfoo.dev/

Alternatives

Alternatives

Vega

Vega

Subgraph
EnProbe

EnProbe

Entersoft Security

Categories

Categories

Integrations

OpenAI
Cake AI
Claude
Cohere
Conda
Hugging Face
Netguru Omega
Replicate

Integrations

OpenAI
Cake AI
Claude
Cohere
Conda
Hugging Face
Netguru Omega
Replicate
Claim garak and update features and information
Claim garak and update features and information
Claim promptfoo and update features and information
Claim promptfoo and update features and information