All skills
apify avatar

/apify-ultimate-scraper

@97047d3 official
by apifyapify/agent-skills2.4k stars
259

Universal AI-powered web scraper for any platform. Scrape data from Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Google Search, Google Trends, Reddit, Airbnb, Yelp, and 15+ more platforms. Use for lead generation, brand monitoring, competitor analysis, influencer discovery, trend research, content analytics, audience analysis, review analysis, SEO intelligence, recruitment, or any data extraction task.

Use this Skill: https://skilld.dev/gh/apify/agent-skills/apify-ultimate-scraper

This session only. Nothing lands on disk.

referencesworkflowsinfluencer-vetting.md

≈989 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Influencer vetting workflows

Instagram creator vetting

When: User wants to evaluate an influencer's profile, audience, and engagement quality.

Pipeline

  1. Get profile data -> apify/instagram-profile-scraper
    • Key input: usernames (list of handles)
  2. Analyze engagement -> apify/instagram-comment-scraper
    • Pipe: results[].latestPosts[].url -> directUrls (pick 3-5 recent posts)
    • Key input: directUrls, resultsLimit

Output fields

Step 1: username, fullName, followersCount, followsCount, postsCount, biography, isVerified, latestPosts[] Step 2: text, ownerUsername, timestamp (scan for bot patterns: generic praise, emoji-only, irrelevant content)

Gotcha

High follower count with low comment quality suggests fake followers. Compare comment sentiment to post content.


Cross-platform influencer discovery

When: User wants to find an influencer's presence across multiple platforms.

Pipeline

  1. Search across platforms -> tri_angle/social-media-finder
    • Key input: query (influencer name or handle), platforms

Output fields

Step 1: platform, profileUrl, username, followers, isVerified


TikTok creator vetting

When: User wants to vet TikTok creators by niche or handle for partnership fit based on engagement rate and content quality.

Pipeline

  1. Get profile metrics -> clockworks/tiktok-profile-scraper
    • Key input: profiles (username array), resultsPerPage
  2. Pull recent videos -> clockworks/tiktok-video-scraper
    • Pipe: results[].authorMeta.name -> profiles
    • Key input: profiles, maxItems

Output fields

Step 1: authorMeta.name, authorMeta.fans, authorMeta.heart, authorMeta.video Step 2: diggCount, playCount, commentCount, shareCount, createTimeISO, hashtags, text

Gotcha

TikTok engagement rate must be calculated manually: (diggCount + commentCount + shareCount) / playCount. The Actor does not return a pre-calculated ER field.


YouTube channel audit

When: User wants to audit YouTube channels for subscriber growth, average views, and topic consistency before sponsorship.

Pipeline

  1. Get channel overview -> streamers/youtube-channel-scraper
    • Key input: startUrls (channel URLs), maxResults
  2. Pull video metrics -> streamers/youtube-scraper
    • Pipe: results[].channelUrl -> startUrls
    • Key input: startUrls, maxResults
  3. Analyze content themes -> curious_coder/youtube-transcript-scraper
    • Pipe: results[].url -> video URLs (pick 5-10 recent videos)
    • Key input: video URLs

Output fields

Step 1: channelName, numberOfSubscribers, channelTotalViews, channelUrl Step 2: videos[].viewCount, videos[].likeCount, videos[].title, videos[].publishedAt Step 3: transcript (raw text for AI topic classification)


Cross-platform hashtag discovery

When: User wants to discover new influencer candidates across Instagram, TikTok, and YouTube using niche hashtags for a unified shortlist.

Pipeline

  1. Instagram hashtag scrape -> apify/instagram-hashtag-scraper
    • Key input: hashtags (array), resultsLimit
  2. TikTok hashtag scrape -> clockworks/tiktok-hashtag-scraper
    • Key input: hashtags (same array), maxItems
  3. YouTube hashtag scrape -> streamers/youtube-video-scraper-by-hashtag
    • Key input: hashtags (same array), resultsLimit

Output fields

Step 1: ownerUsername, followersCount, profileUrl, likesCount, commentsCount Step 2: authorMeta.name, authorMeta.fans, playCount, diggCount, shareCount Step 3: channelName, numberOfSubscribers, viewCount, channelUrl

Gotcha

Each platform returns platform-specific field names. Normalize to a common schema (username, platform, followersCount, avgEngagement, profileUrl) in a downstream merge step before scoring.

Source: SKILL.md on GitHub

1 alert16d5 checks · Risk SAFE
  • Gen Agent Trust Hub16d

    The skill provides comprehensive instructions for orchestrating and interacting with web scrapers (Actors) via the Apify CLI. It provides structured playbooks for different data extraction workflows (B2B lead generation, brand monitoring, social media analytics, etc.) and contains standard guidelines on configuration, parameter passing, and error handling. No malicious behaviors, obfuscation techniques, or hidden actions were detected.

  • Socket16d

    No alerts

  • Snyk16d

    Risk: MEDIUM · 1 issue

  • Runlayer7mo

    2/2 files flagged

  • ZeroLeaks5mo

    Score: 93/100 · 2 sections analyzed

Signed by skilld at 97047d3. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub yesterday.

Activeupdated 3 months ago
  • SEO
  • apify
  • scraping
  • web-scraping
  • instagram
  • facebook
  • tiktok
  • youtube
  • linkedin
  • twitter
  • google-maps
  • reddit
  • lead-generation
  • competitor-analysis
  • brand-monitoring

README badge

README badge for apify/agent-skills/apify-ultimate-scraper

Scrapes data from 100+ Apify Actors covering Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Reddit, Airbnb, Yelp, and 15+ other platforms via the Apify CLI. Use for lead generation, competitor analysis, brand monitoring, influencer discovery, review analysis, or SEO intelligence on any public web platform.

Generated from the current SKILL.md.

Does this skill work with all platforms?
It covers ~100 Actors across 15+ platforms including Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Reddit, Airbnb, Yelp, and more. Not all platforms are equally supported; check the actor-index.md reference for your target platform.
What authentication is required?
You need an Apify account and CLI token. Authenticate via `apify login` (OAuth), set `APIFY_TOKEN` as an environment variable, or source from a .env file.
Do I need to install anything locally?
Yes, Apify CLI v1.5.0 or later must be installed via npm (`npm install -g apify-cli`).
Can I export results in different formats?
Yes. Results can be fetched as JSON or CSV using `apify datasets get-items` with the `--format` flag.
What should I read before running a scraper for the first time?
Check `references/actor-index.md` to find the right Actor for your platform, then read `references/gotchas.md` for common pitfalls specific to that Actor before running.

Generated from the current SKILL.md. These answers refresh after source changes.