Index of every page on this site: llms.txt
All skills
bitwarden avatar

/creating-test-runs

@a11c77b official
by bitwardenbitwarden/ai-plugins165 stars
27
Run it yourself

Create test runs in Bitwarden's Testmo instance from reviewable JSON filter specs. Use when asked to create one or more Testmo runs, link runs to a Testmo milestone, select cases for a run, or write or debug a run filter spec built from folder/tag/test-type/team/automation filters. Accepts several specs in one pass. Dry-run first; writes mutate the live instance. For a release's QA manual regression suite, use bitwarden-testing-tools' setting-up-regression-runs instead — it owns the release profiles and specs and delegates here.

Use this Skill: https://skilld.dev/gh/bitwarden/ai-plugins/creating-test-runs

Nothing lands on disk. Nothing to clean up.

Fork this Skill

Edit a local copy. It keeps the author and licence.

referencesapi-reference.md

≈603 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Testmo API and project 1 field reference

API reference

  • Base: https://bitwarden.testmo.net/api/v1, auth header Authorization: Bearer $TESTMO_API_KEY.
  • Projects: 1 = Bitwarden (live: ~13.7k cases), 2 = Pretend (sandbox), 11 = Automation - Test, 14 = Archive. Project 2 is safe for exercising the script's write path, but it does not mirror project 1's folders, tags, or configurations, so a spec cannot be validated there — a dry-run against it proves nothing about the case set the spec will select.
  • Pagination quirk: per_page only accepts specific values (100 works; 5/10 return HTTP 422). Omit per_page and page with page=N; responses carry next_page/last_page.
  • Read endpoints (GET): /projects/{id}/cases, /projects/{id}/folders, /projects/{id}/milestones, /projects/{id}/runs, /projects/{id}/automation/runs, and single-run detail at /runs/{id} (top-level — /projects/{id}/runs/{id} 404s).
  • Create run (POST /projects/{id}/runs): body {name, state_id, include_all:false, cases:[ids], milestone_id?, config_id?, tags?, note?}. Run state_ids (from /projects/{id}/states): 6=New, 7=In progress, 8=Under review, 9=Rejected, 10=Done. Active runs use 7.

Project 1 field reference (captured 2026-07-22 — re-verify via /projects/1/fields)

  • Test Type (custom_test_type, multiselect): 18=Functional, 19=Regression, 20=Smoke, 21=Accessibility, 22=Compatibility.
  • Automation Type (custom_automation_type, single): 8=Not Automating, 11=Ready to Automate, 9=In Progress, 10=Automated, 23=Automated-Android, 24=Automated-iOS, 12=Blocked. "Manual only" = exclude {10, 23, 24}.
  • Case state_id: 4=Active (~94% of cases), 5=(inactive/deprecated), plus legacy strays. Regression runs filter to [4].
  • Team (custom_team, multiselect): 25=Admin Console, 26=Auth, 27=Autofill, 28=Billing, 38=Desktop Native, 29=DIRT, 30=Key Management, 31=Mobile, 37=Passwordless, 32=Platform, 33=Secrets Manager, 34=Tools, 35=UI Foundation, 36=Vault.
  • Top-level folders (partial list — GET /projects/1/folders is authoritative): Web=3136, Extension=2779, Mobile=3010, Desktop=2923, CLI=2858, API=3390, Passwordless=3103, and "Directory Connector (BWDC)" (id not captured; resolve it by path). (Excluded as junk: "Retired Test Cases"=81330, "Need to be deleted"=371518.)

Source: SKILL.md on GitHub

skilld matched fixed text patterns in SKILL.md and file names. Patterns miss obfuscated code.

skilld run checks every file with the same patterns. It asks for approval before it loads a Skill with a behavior marked Needs approval.

1 warning21d3 checks · Risk SAFE
  • Gen Agent Trust Hub21d

    This skill provides a secure way to create test runs in Bitwarden's Testmo instance using JSON filter specifications. It demonstrates high security maturity by implementing protections against credential exposure in process lists, validating project IDs to prevent path traversal, and enforcing a mandatory human-in-the-loop review process before performing any API write operations.

  • Socket21d

    No alerts

  • Snyk21d

    Risk: MEDIUM · 1 issue

Signed by skilld at a11c77b. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub yesterday.

Activeupdated 3 weeks ago

README badge

README badge for bitwarden/ai-plugins/creating-test-runs