Files
antigravity-skills-reference/docs/contributors/quality-bar.md
2026-03-16 16:12:51 +01:00

3.6 KiB

🏆 Quality Bar & Validation Standards

To transform Antigravity Awesome Skills from a collection of scripts into a trusted platform, every skill must meet a specific standard of quality and safety.

The "Validated" Badge

A skill earns the "Validated" badge only if it meets these 6 quality checks. Some are enforced automatically today, while others still require reviewer judgment:

1. Metadata Integrity

The SKILL.md frontmatter must be valid YAML and contain:

  • name: Kebab-case, matches folder name.
  • description: Under 200 chars, clear value prop.
  • risk: One of [none, safe, critical, offensive, unknown]. Use unknown only for legacy or unclassified skills; prefer a concrete level for new skills.
  • source: URL to original source (or "self" if original).

2. Clear Triggers ("When to use")

The skill MUST have a section explicitly stating when to trigger it.

  • Good: "Use when the user asks to debug a React component."
  • Bad: "This skill helps you with code." Accepted headings: ## When to Use, ## Use this skill when, ## When to Use This Skill.

3. Safety & Risk Classification

Every skill must declare its risk level:

  • 🟢 none: Pure text/reasoning (e.g., Brainstorming).
  • 🔵 safe: Reads files, runs safe commands (e.g., Linter).
  • 🟠 critical: Modifies state, deletes files, pushes to prod (e.g., Git Push).
  • 🔴 offensive: Pentesting/Red Team tools. MUST have "Authorized Use Only" warning.

4. Copy-Pasteable Examples

At least one code block or interaction example that a user (or agent) can immediately use.

5. Explicit Limitations

A list of known edge cases or things the skill cannot do.

  • Example: "Does not work on Windows without WSL."

6. Instruction Safety Review

If a skill includes command examples, remote fetch steps, secrets, or mutation guidance, the PR must document the risk and pass npm run security:docs in addition to normal validation.

For pull requests that add or modify SKILL.md, GitHub also runs the automated skill-review workflow. Treat that review as part of the normal PR quality gate and address any actionable findings before merge.

npm run security:docs enforces a repo-wide scan for:

  • command pipelines like curl ... | bash, wget ... | sh, irm ... | iex,
  • inline token/secret-style command examples,
  • deliberate allowlisted high-risk documentation commands via <!-- security-allowlist: ... -->.

Support Levels

We also categorize skills by who maintains them:

Level Badge Meaning
Official 🟣 Maintained by the core team. High reliability.
Community Contributed by the ecosystem. Best effort support.
Verified Community skill that has passed deep manual review.

How to Validate Your Skill

The canonical validator is tools/scripts/validate_skills.py, but the recommended entrypoint is npm run validate before submitting a PR:

npm run validate
npm run validate:references
npm test
npm run security:docs

Notes:

  • npm run validate is the operational contributor gate.
  • npm run security:docs is required for command-heavy or risky skill content.
  • PRs that touch SKILL.md also get an automated skill-review GitHub Actions check.
  • npm run validate:strict is a useful hardening pass, but the repository still contains legacy skills that do not yet satisfy strict validation.
  • Examples and limitations remain part of the quality bar even when they are not fully auto-enforced by the current validator.