All skills
firecrawl avatar

/firecrawl-map

@509dd9c official
by firecrawlfirecrawl/cli643 stars
110

Discover and list a site's URLs, with search filtering. Use for "map the site" or "find the URL for" requests — when the user knows the site but not the exact page, or wants site structure.

Use this Skill: https://skilld.dev/gh/firecrawl/cli/firecrawl-map

This session only. Nothing lands on disk.

SKILL.md

≈52 tokens always: the name and description. ≈339 when used: this file.

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

Prerequisite: map requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login.

Quick start

# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Run firecrawl map --help for the full option list (sitemap handling, subdomains, etc.).

Done when: the URL list is saved under .firecrawl/ and you have selected the URLs to scrape or crawl next.

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" → found /docs/api/authentication → scrape that URL.

See also

Source: SKILL.md on GitHub

1 warning16d5 checks · Risk SAFE
  • Gen Agent Trust Hub16d

    This skill provides instructions and examples for using the Firecrawl CLI tool to discover and map website URLs. It is safe for use and adheres to standard practices for utilizing vendor-provided utilities.

  • Socket16d

    No alerts

  • Snyk16d

    Risk: MEDIUM · 1 issue

  • Runlayer6mo

    1 file scanned · No issues

  • ZeroLeaks5mo

    Score: 93/100 · 2 sections analyzed

Signed by skilld at 509dd9c. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub 13 hours ago.

Activeupdated last month
What it can do
Runs commands
All 2 allowed tools
Bash(firecrawl *)Bash(npx firecrawl-cli *)
  • CLI
  • firecrawl
  • web-scraping
  • url-discovery
  • sitemap
  • bash

README badge

README badge for firecrawl/cli/firecrawl-map

Lists all URLs on a website using Firecrawl's map command, with optional search filtering to find specific pages within large sites. Use this when you need to discover a particular page before scraping or understand the site structure, especially as the second step in the Firecrawl workflow before crawling or scraping.

Generated from the current SKILL.md.

Does this work with sites behind authentication?
No. The skill maps publicly accessible URLs. For authenticated content, you would need to scrape individual pages after logging in separately.
Can I use this to find URLs across multiple domains?
The `--include-subdomains` option lets you include subdomains of the target site, but the skill maps a single domain, not arbitrary cross-domain searches.
What's the difference between map and crawl?
Map lists all URLs on a site (useful for discovery and filtering). Crawl extracts content from multiple pages in bulk. Map is typically paired with scrape for targeted extraction.
Does the --search option do substring matching or regex?
The SKILL.md does not specify the matching behavior of --search, so exact matching rules are unclear.

Generated from the current SKILL.md. These answers refresh after source changes.