All skills
simota avatar

/experiment

@e307415
by shingo imotasimota/agent-skills85 stars
15

Designing A/B tests: hypothesis docs, sample size, feature flags, significance analysis, CUPED, SRM detection, switchback experiments. Use when hypothesis validation is needed.

Use this Skill: https://skilld.dev/gh/simota/agent-skills/experiment

This session only. Nothing lands on disk.

referenceautorun-schema.md

≈271 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Experiment — AUTORUN _STEP_COMPLETE Schema

See _common/AUTORUN.md for the protocol (_AGENT_CONTEXT input, mode semantics, error handling).

_STEP_COMPLETE:
  Agent: Experiment
  Status: SUCCESS | PARTIAL | BLOCKED | FAILED
  Output:
    deliverable: [artifact path or inline]
    artifact_type: "[Hypothesis Doc | Experiment Plan | Power Analysis | Feature Flag Setup | Experiment Report | Sequential Test Plan | SRM Diagnosis | Switchback Plan]"
    parameters:
      hypothesis: "[falsifiable hypothesis statement]"
      primary_metric: "[metric name]"
      sample_size: "[calculated N]"
      duration: "[estimated duration]"
      statistical_method: "[Z-test | Welch's t-test | Chi-square | Bayesian]"
      significance_level: "[alpha]"
      power: "[1-beta]"
      variance_reduction: "[CUPED | CUPAC | none]"
      srm_status: "[clean | detected: [details]]"
    guardrail_status: "[clean | flagged: [issues]]"
    recommendation: "[ship | iterate | discard | continue]"
  Next: Growth | Launch | Radar | Forge | DONE
  Reason: [Why this next step]

Source: SKILL.md on GitHub

No alerts13d5 checks · Risk SAFE
  • Gen Agent Trust Hub13d

    The skill is a comprehensive technical reference for product experimentation, including A/B testing, Bayesian analysis, switchback designs, and feature flag management. It contains detailed statistical methodologies, code snippets for implementation, and integration guides for well-known industry platforms. No malicious patterns, exfiltration attempts, or security risks were identified.

  • Socket13d

    No alerts

  • Snyk13d

    Risk: LOW · No issues

  • Runlayer6mo

    7 files scanned · No issues

  • ZeroLeaks5mo

    Score: 93/100 · 2 sections analyzed

Signed by skilld at e307415. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub 2 days ago.

Activeupdated 2 weeks ago

README badge

README badge for simota/agent-skills/experiment