Unverified50% confidenceFactExact time
Promptfoo is an open-source LLM evaluation framework that describes test cases using YAML configuration files and executes evaluations via CLI; it is similar in style to PyTest and supports multiple assertion types including exact match, regex, semantic similarity, and calling an external LLM as a judge.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/22/2026
First Seen
Valid until: 12/21/2026
Sources
Related Entities
Related Claims
UnverifiedPromptfoo is a framework for automated prompt evaluation.74% similarUnverifiedPromptfoo can cover all three evaluation layers—large models, knowledge bases, and agents—making it suitable for testing teams whose purpose is to determine whether software can go live.69% similarUnverifiedrunn通过YAML文件定义多步骤测试场景68% similarUnverifiedCurrent mainstream automated verification methods include running existing test suites, generating and executing new test cases, and performing semantic review of outputs via LLM (LLM-as-Judge pattern)65% similarUnverifiedThe basic structure of Promptfoo consists of three parts: providers (the model or interface under test), prompts (prompt templates), and tests (test cases and assertion rules), and it can be integrated into CI/CD pipelines to enable automated regression evaluation.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/941449API
curl https://kongchang.com/api/v1/knowledge/claims/941449MCP
get_claim(id=941449)