What is Promptfoo?
Promptfoo is an LLM evaluation and security testing tool for developers and security teams working on AI applications, agents, and workflows. Promptfoo supports prompt evaluation as well as security tests that account for how an application uses business logic, retrieval-augmented generation, agents, and integrations. That application focus lets teams test the systems they build rather than assessing only the underlying model.
What Promptfoo can do
Promptfoo combines prompt evaluation, vulnerability scanning, and remediation tracking. Developers can compare prompt iterations and inspect results locally, while security teams can test for vulnerabilities such as prompt injection and jailbreaks. Enterprise reporting brings security results from multiple projects into a centralized view, with automated evaluations and real-time alerts for continuous monitoring.
- Promptfoo lets developers configure prompt tests in YAML.
- Promptfoo scans AI applications for vulnerabilities.
- Promptfoo integrates continuous testing into CI/CD pipelines.
- Promptfoo can surface security findings in pull requests.
- Promptfoo offers guided remediation and issue tracking on Enterprise.
How Promptfoo works in a development workflow
Promptfoo connects to AI applications, agents, and workflows through integrations that include GitHub, GitLab, Jenkins, and MCP and agent frameworks. For prompt evaluation, developers can configure tests in YAML and view the results locally. In CI/CD, teams can run security tests continuously rather than treating testing as a separate review. Promptfoo also supports surfacing findings in pull requests so developers can review them alongside code changes.
Who Promptfoo is for
Promptfoo serves individual developers and small teams that need local testing, as well as security directors and CISOs responsible for risk across multiple AI applications. Developers can use Promptfoo to evaluate prompt changes and review security findings in their existing workflows. Larger teams can use Enterprise features to share scan configurations, manage access, and follow remediation progress across projects.
- Evaluate prompt changes before releasing them.
- Check applications for security issues during CI/CD.
- Share scan configurations across security and development teams.
- Track remediation progress across projects.
Promptfoo pricing and plans
Promptfoo offers a free, open-source Community plan with all LLM evaluation features, basic vulnerability scanning, and up to 10k red teaming probes per month. A probe is a single request to the system being tested. Community users can run Promptfoo locally or self-host it on their own infrastructure and receive community support.
Promptfoo prices Enterprise and On-Premise plans by custom quote. Enterprise adds custom red teaming limits, continuous monitoring, team collaboration, SSO, API access, and managed cloud deployment. The On-Premise plan includes Enterprise features and adds deployment on the organization's own infrastructure, complete data isolation, a dedicated runner, and an assigned deployment engineer.
Strengths and limitations of Promptfoo
Promptfoo's main strength is that teams can use the same tool to evaluate prompts locally and bring security checks into their CI/CD workflow. Free local or self-hosted Community use is distinct from the On-Premise plan, which includes Enterprise controls and dedicated deployment support. Teams comparing plans should consider not just where Promptfoo runs, but also whether they need centralized monitoring, access controls, or guided remediation.
- Community red teaming is limited to 10k probes per month.
- Community support is provided through the community rather than with an SLA.
- Advanced vulnerability detection and remediation recommendations are not included in Community.
- Enterprise and On-Premise pricing is not listed as a fixed amount.
Promptfoo FAQ
What is Promptfoo?
Promptfoo is an LLM evaluation and security testing tool for AI applications, agents, and workflows. Developers can configure prompt tests in YAML and review results locally, while security teams can scan application behavior for vulnerabilities such as prompt injection and jailbreaks.
Is Promptfoo free?
Promptfoo offers a free, open-source Community plan with all LLM evaluation features, basic vulnerability scanning, and up to 10k red teaming probes per month. Promptfoo also offers custom-priced Enterprise and On-Premise plans with additional monitoring, collaboration, and deployment options.
Who is Promptfoo for?
Promptfoo is for developers and security teams that build or oversee AI applications, agents, and workflows. The Community plan is intended for individual developers and small teams, while Enterprise serves larger teams that need to monitor risk in development and production.
Can Promptfoo run locally or be self-hosted?
Promptfoo can run locally or be self-hosted on the Community plan. Promptfoo also offers a custom-priced On-Premise plan for organizations that want Enterprise features on their own infrastructure, with complete data isolation, a dedicated runner, and an assigned deployment engineer.
Does Promptfoo integrate with CI/CD or offer an API?
Promptfoo integrates with CI/CD pipelines such as GitHub, GitLab, and Jenkins, and API access is included in the Enterprise plan. Promptfoo also connects to MCP and agent frameworks, so teams can bring testing into workflows that include agents.
From the community
No reviews yet
Be the first to review this tool. What you write helps the next person choose.




