promptfoo-config

📁 vanman2024/ai-dev-marketplace 📅 2 days ago
3
总安装量
1
周安装量
#56395
全站排名
安装命令
npx skills add https://github.com/vanman2024/ai-dev-marketplace --skill promptfoo-config

Agent 安装分布

amp 1
opencode 1
kimi-cli 1
codex 1
github-copilot 1
claude-code 1

Skill 文档

promptfoo Configuration

Skill for configuring promptfoo prompt evaluation and testing.

Overview

promptfoo enables:

  • Prompt regression testing
  • Multi-provider comparison
  • Assertion-based validation
  • HTML report generation

Use When

This skill is automatically invoked when:

  • Setting up prompt testing
  • Comparing LLM providers
  • Creating evaluation pipelines
  • Defining test assertions

Available Scripts

Script Description
scripts/init-promptfoo.sh Initialize promptfoo project
scripts/run-eval.sh Run evaluation with output

Available Templates

Template Description
templates/promptfooconfig.yaml Basic configuration
templates/multi-provider.yaml Provider comparison
templates/assertions.yaml Assertion examples

Best Practices

  1. Use YAML anchors for repeated config
  2. Store prompts in separate files
  3. Use variables for dynamic tests
  4. Set appropriate thresholds