Index of every page on this site: llms.txt
All skills
tavily-ai avatar

/tavily-extract

@778122e official
by Tavily AItavily-ai/skills488 stars
42
Run it yourself

Extract clean markdown or text content from specific URLs via the Tavily CLI. Use this skill when the user has one or more URLs and wants their content, says "extract", "grab the content from", "pull the text from", "get the page at", "read this webpage", or needs clean text from web pages. Handles JavaScript-rendered pages, returns LLM-optimized markdown, and supports query-focused chunking for targeted extraction. Can process up to 20 URLs in a single call.

Use this Skill: https://skilld.dev/gh/tavily-ai/skills/tavily-extract

Nothing lands on disk. Nothing to clean up.

Fork this Skill

Edit a local copy. It keeps the author and licence.

SKILL.md

≈120 tokens for metadata: the name and description. ≈734 when used: this file.

Description uses 6.0% of example budget

Before choosing a Skill, your Agent reads its name and description. All available Skills share that space.

  • A shorter description leaves more room for other Skills. This entry exceeds our 1% size suggestion.

In our Claude Code example, all Skill names and descriptions share 8,000 characters. This Skill uses ≈480 characters, or 6.0%.

The 1% threshold is a size suggestion. Longer descriptions can still fit.

Your model, settings, and other Skills decide how much text your Agent can read.

Example settings and source

The example uses a 200k-token context and default Claude Code settings. The count includes the name, description, separators, and when_to_use when present. Codex also counts local file paths.

Skit's source and limits: Codex 0.160.1, Claude Code 2.1.292.

tavily extract

Extract clean markdown or text content from one or more URLs.

Before running

Run extract directly when tvly is available. Extract supports capped keyless access, so do not look for an API key or authenticate before the first request.

If tvly is missing, follow the tavily-cli setup before retrying. If the keyless cap is reached in an interactive session, run tvly login to open browser OAuth, then retry the original extraction once. In an unattended environment, report the cap and authentication options instead of starting an interactive flow. Do not start a second login immediately after guided setup has completed.

When to use

  • You have a specific URL and want its content
  • You need text from JavaScript-rendered pages
  • Step 2 in the workflow: search → extract → map → crawl → research

Quick start

# Single URL
tvly extract "https://example.com/article" --json

# Multiple URLs
tvly extract "https://example.com/page1" "https://example.com/page2" --json

# Query-focused extraction (returns relevant chunks only)
tvly extract "https://example.com/docs" --query "authentication API" --chunks-per-source 3 --json

# JS-heavy pages
tvly extract "https://app.example.com" --extract-depth advanced --json

# Save to file
tvly extract "https://example.com/article" -o article.json

Options

Option Description
--query Rerank chunks by relevance to this query
--chunks-per-source Chunks per URL (1-5, requires --query)
--extract-depth basic (default) or advanced (for JS pages)
--format markdown (default) or text
--include-images Include image URLs
--timeout Max wait time (1-60 seconds)
-o, --output Save the JSON response to a file
--json Structured JSON output

Extract depth

Depth When to use
basic Simple pages, fast — try this first
advanced JS-rendered SPAs, dynamic content, tables

Tips

  • Max 20 URLs per request — batch larger lists into multiple calls.
  • Use --query + --chunks-per-source to get only relevant content instead of full pages.
  • Try basic first, fall back to advanced if content is missing.
  • Set --timeout for slow pages (up to 60s).
  • Inspect failed_results even after exit code 0. A successful request can still return no extracted pages. Retry the affected URL with advanced when appropriate, otherwise report the per-URL failure instead of treating the request as complete.
  • If search results already contain the content you need (via --include-raw-content), skip the extract step.

See also

Source: SKILL.md on GitHub

Skill behaviors

skilld matched fixed text patterns in SKILL.md and file names. Patterns miss obfuscated code.

skilld run checks every file with the same patterns. It asks for approval before it loads a Skill with a behavior marked Needs approval.

Third-party checks

1 warning1mo4 checks · Risk SAFE
  • Gen Agent Trust Hub1mo

    This skill provides safe utility for extracting web content using the Tavily CLI. It operates within a restricted execution environment and follows security best practices for handling authentication and unattended environments. While it processes external web content, which inherently carries a minor risk of indirect prompt injection, this is a standard characteristic of web extraction tools.

  • Socket1mo

    No alerts

  • Snyk1mo

    Risk: MEDIUM · 1 issue

  • ZeroLeaks6mo

    1 finding · Score: 82/100

Provenance

Signed by skilld at 778122e. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub last week.

Steadyupdated last month

Capability

What it can do
Runs commands
All 1 allowed tools
Bash(tvly *)

Topics

  • CLI
  • tavily
  • web-extraction
  • markdown
  • url
  • content-extraction
  • javascript-rendering
  • bash

README badge

README badge for tavily-ai/skills/tavily-extract

What it does

Extracts clean markdown or text from specific URLs via the Tavily CLI, handling JavaScript-rendered pages and returning LLM-optimized content. Supports query-focused chunking to extract only relevant sections and can process up to 20 URLs in a single call.

Generated from the current SKILL.md.

Frequently asked

Does this skill handle JavaScript-rendered pages?
Yes. Use `--extract-depth advanced` for pages that require JavaScript execution; `basic` is faster and works for static content.
Can I extract content from multiple URLs at once?
Yes, up to 20 URLs per call. Pass them as separate arguments: `tvly extract "url1" "url2" "url3" --json`.
How do I get only relevant content from a page instead of everything?
Use `--query` with `--chunks-per-source` to return only chunks ranked by relevance to your query, e.g. `tvly extract "https://example.com/docs" --query "authentication API" --chunks-per-source 3 --json`.
What output formats are supported?
Markdown (default) or plain text via `--format text`. Use `--json` for structured JSON output, and `-o` to save to a file.
What do I do if the tvly CLI is not installed?
Run `curl -fsSL https://cli.tavily.com/install.sh | bash && tvly login` before executing extract commands.

Generated from the current SKILL.md. These answers refresh after source changes.