All skills
jwynia avatar

/scraper-builder

@dbeae09
by J Wyniajwynia/agent-skills160 stars
20

Guide AI agents to generate complete PageObject pattern web scraper projects using Playwright and TypeScript with Docker deployment. Supports agent-browser site analysis for automated selector discovery. Keywords: scraper, playwright, pageobject, web scraping, docker, typescript, data extraction, automation.

Use this Skill: https://skilld.dev/gh/jwynia/agent-skills/scraper-builder

This session only. Nothing lands on disk.

assetsconfigspackage.json.md

≈399 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Package.json Template

Package configuration with Playwright, Zod, and tsx as core dependencies.

Template

{
  "name": "{{project-name}}",
  "version": "0.1.0",
  "private": true,
  "type": "module",
  "scripts": {
    "start": "tsx src/index.ts",
    "build": "tsc",
    "dev": "tsx watch src/index.ts",
    "scrape": "tsx src/index.ts",
    "typecheck": "tsc --noEmit"
  },
  "dependencies": {
    "playwright": "^1.48.0",
    "zod": "^3.23.0",
    "dotenv": "^16.4.0"
  },
  "devDependencies": {
    "typescript": "^5.6.0",
    "tsx": "^4.19.0",
    "@types/node": "^22.0.0"
  }
}

Customization Notes

  • playwright not @playwright/test: Scrapers use the library package, not the test runner. The library package is smaller and doesn't include test runner overhead.
  • tsx: TypeScript execute — runs .ts files directly without a build step. Used for development and can be used in production for simpler setups.
  • zod: Remove from dependencies if --no-validation was used during scaffolding.
  • dotenv: Loads .env files for local development. Not needed in Docker (environment variables set via compose).
  • type: "module": Enables ESM imports. Required for top-level await and modern module syntax.
  • Scripts:
    • start / scrape: Run the scraper
    • dev: Run with file watching (re-runs on source changes)
    • build: Compile TypeScript to JavaScript
    • typecheck: Verify types without emitting

See Also

  • tsconfig.json.md — TypeScript configuration
  • ../../references/docker-setup.md — Docker deployment

Source: SKILL.md on GitHub

2 warnings14d5 checks · Risk SAFE
  • Gen Agent Trust Hub14d

    This skill is a generator for web scraper projects using Playwright, TypeScript, and Docker. It follows security best practices by implementing data validation via Zod schemas, using non-root users in Docker containers, and referencing official images and tools from trusted organizations.

  • Socket14d

    No alerts

  • Snyk14d

    Risk: MEDIUM · 1 issue

  • Runlayer7mo

    22/22 files flagged

  • ZeroLeaks5mo

    Score: 93/100 · 2 sections analyzed

Signed by skilld at dbeae09. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub 2 months ago.

Dormantupdated 8 months ago
Other metadata
compatibility
Requires Deno for generator scripts. Generated projects use Node.js with Playwright.
metadata
{
  "author": "agent-skills",
  "version": "1.0",
  "domain": "development",
  "type": "generator",
  "mode": "generative"
}

README badge

README badge for jwynia/agent-skills/scraper-builder