All skills
apify avatar

/apify-ultimate-scraper

@97047d3 official
by apifyapify/agent-skills2.4k stars
259

Universal AI-powered web scraper for any platform. Scrape data from Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Google Search, Google Trends, Reddit, Airbnb, Yelp, and 15+ more platforms. Use for lead generation, brand monitoring, competitor analysis, influencer discovery, trend research, content analytics, audience analysis, review analysis, SEO intelligence, recruitment, or any data extraction task.

Use this Skill: https://skilld.dev/gh/apify/agent-skills/apify-ultimate-scraper

This session only. Nothing lands on disk.

referencesworkflowsreview-analysis.md

≈1k tokens on demand. Your agent reads this file only when SKILL.md points to it.

Review analysis workflows

Google Maps review extraction

When: User wants to collect and analyze business reviews from Google Maps.

Pipeline

  1. Find businesses -> compass/crawler-google-places
    • Key input: searchStringsArray, locationQuery, maxCrawledPlaces
  2. Extract reviews -> compass/Google-Maps-Reviews-Scraper
    • Pipe: results[].url -> startUrls
    • Key input: startUrls, maxReviews

Output fields

Step 1: title, totalScore, reviewsCount, url, categoryName Step 2: text, stars, publishedAtDate, reviewerName, ownerResponse

Competitor review intelligence

When: User wants to extract competitor reviews to surface customer pain points and compare against own product strengths for positioning.

Pipeline

  1. Scrape competitor reviews -> compass/Google-Maps-Reviews-Scraper
    • Key input: startUrls (competitor Google Maps URLs), maxReviews, sort (newest or most relevant)
  2. Yelp competitor reviews -> tri_angle/yelp-review-scraper
    • Key input: startUrls (competitor Yelp URLs), maxReviews

Output fields

Step 1: stars, text, name, publishedAtDate, reviewId Step 2: text, rating, date, userName

Gotcha

Run steps 1 and 2 in parallel for the same competitor, then merge by date. AI analysis works best when you label each review with the competitor name before passing to LLM for theme extraction.

Google Play app review monitoring

When: User wants daily low-rating alerts from Google Play to route urgent negative feedback to the support team.

Pipeline

  1. Scrape app reviews -> apify/playwright-scraper
    • Key input: startUrls (Google Play app URL), maxRequestsPerCrawl
  2. Filter and alert (n8n native - IF node)
    • Pipe: results[].stars -> filter where stars < 4

Output fields

Step 1: stars, text, date, appVersion, thumbsUpCount

Gotcha

Google Play uses heavy client-side rendering. Use apify/playwright-scraper rather than cheerio. If results are thin, search Apify Store for a dedicated Google Play reviews Actor - the ecosystem updates frequently.

Cross-platform hotel/restaurant reviews

When: User wants reviews aggregated from multiple platforms for the same business.

Pipeline (hotels)

  1. Aggregate reviews -> tri_angle/hotel-review-aggregator
    • Key input: urls (hotel URLs from TripAdvisor, Yelp, Google Maps, Booking.com, etc.)

Pipeline (restaurants)

  1. Aggregate reviews -> tri_angle/restaurant-review-aggregator
    • Key input: urls (restaurant URLs from Yelp, Google Maps, DoorDash, UberEats, etc.)

Output fields

Both: text, rating, date, platform, reviewerName, title

Multi-platform review aggregation for hospitality

When: User wants a weekly sentiment digest across TripAdvisor, Booking.com, Google, and Yelp for a property - including theme extraction by category (service, rooms, location, price).

Pipeline

  1. Aggregate all platforms -> tri_angle/hotel-review-aggregator
    • Key input: startUrls (property page URLs per platform), maxReviews, includeReviews
  2. Airbnb reviews (if applicable) -> tri_angle/airbnb-reviews-scraper
    • Key input: startUrls (Airbnb listing URLs), maxReviews

Output fields

Step 1: stars, text, title, reviewDate, source, userProfile.name Step 2: stars, text, reviewDate, reviewerName

Gotcha

Review aggregators pull from multiple platforms in one run - cheaper than running separate scrapers per platform. Use the aggregators when covering 3+ platforms. For Airbnb specifically, run the dedicated tri_angle/airbnb-reviews-scraper separately and merge by date.

Yelp review pipeline

When: User wants Yelp reviews for businesses in a specific area.

Pipeline

  1. Find businesses -> tri_angle/get-yelp-urls
    • Key input: location, category
  2. Extract reviews -> tri_angle/yelp-review-scraper
    • Pipe: results[].url -> startUrls
    • Key input: startUrls, maxReviews

Output fields

Step 1: name, url, rating, reviewCount, address Step 2: text, rating, date, userName

Source: SKILL.md on GitHub

1 alert16d5 checks · Risk SAFE
  • Gen Agent Trust Hub16d

    The skill provides comprehensive instructions for orchestrating and interacting with web scrapers (Actors) via the Apify CLI. It provides structured playbooks for different data extraction workflows (B2B lead generation, brand monitoring, social media analytics, etc.) and contains standard guidelines on configuration, parameter passing, and error handling. No malicious behaviors, obfuscation techniques, or hidden actions were detected.

  • Socket16d

    No alerts

  • Snyk16d

    Risk: MEDIUM · 1 issue

  • Runlayer7mo

    2/2 files flagged

  • ZeroLeaks5mo

    Score: 93/100 · 2 sections analyzed

Signed by skilld at 97047d3. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub yesterday.

Activeupdated 3 months ago
  • SEO
  • apify
  • scraping
  • web-scraping
  • instagram
  • facebook
  • tiktok
  • youtube
  • linkedin
  • twitter
  • google-maps
  • reddit
  • lead-generation
  • competitor-analysis
  • brand-monitoring

README badge

README badge for apify/agent-skills/apify-ultimate-scraper

Scrapes data from 100+ Apify Actors covering Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Reddit, Airbnb, Yelp, and 15+ other platforms via the Apify CLI. Use for lead generation, competitor analysis, brand monitoring, influencer discovery, review analysis, or SEO intelligence on any public web platform.

Generated from the current SKILL.md.

Does this skill work with all platforms?
It covers ~100 Actors across 15+ platforms including Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Reddit, Airbnb, Yelp, and more. Not all platforms are equally supported; check the actor-index.md reference for your target platform.
What authentication is required?
You need an Apify account and CLI token. Authenticate via `apify login` (OAuth), set `APIFY_TOKEN` as an environment variable, or source from a .env file.
Do I need to install anything locally?
Yes, Apify CLI v1.5.0 or later must be installed via npm (`npm install -g apify-cli`).
Can I export results in different formats?
Yes. Results can be fetched as JSON or CSV using `apify datasets get-items` with the `--format` flag.
What should I read before running a scraper for the first time?
Check `references/actor-index.md` to find the right Actor for your platform, then read `references/gotchas.md` for common pitfalls specific to that Actor before running.

Generated from the current SKILL.md. These answers refresh after source changes.