Index of every page on this site: llms.txt
All skills
jeremylongshore avatar

/apify-performance-tuning

@820dfc8
Run it yourself

Optimize Apify Actor performance: crawl speed, memory usage, concurrency, and proxy rotation. Use when Actors are slow, consuming too much memory, or being blocked by target sites, or when a crawl is too expensive per run. Trigger with "apify performance", "optimize apify actor", "apify slow", "crawlee concurrency", "apify memory tuning", "scraper performance".

Use this Skill: https://skilld.dev/gh/jeremylongshore/tons-of-skills-marketplace/apify-performance-tuning

Nothing lands on disk. Nothing to clean up.

Fork this Skill

Edit a local copy. It keeps the author and licence.

referencesmonitoring.md

≈331 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Performance Monitoring & Before/After Impact

Instrument the crawl so you can see throughput in the logs, then use the comparison table to judge whether an optimization was worth it.

Performance Monitoring in Actors

import { Actor } from 'apify';
import { log } from 'crawlee';

// Log performance metrics during the crawl
let processedCount = 0;
const startTime = Date.now();

const crawler = new CheerioCrawler({
  requestHandler: async ({ request, $ }) => {
    processedCount++;

    if (processedCount % 100 === 0) {
      const elapsed = (Date.now() - startTime) / 1000;
      const rate = processedCount / (elapsed / 60);
      log.info(`Progress: ${processedCount} pages | ${rate.toFixed(1)} pages/min`);
    }

    await Actor.pushData({
      url: request.url,
      title: $('title').text().trim(),
    });
  },
});

Performance Comparison

Optimization Before After Impact
Cheerio instead of Playwright 3 pages/min 30 pages/min 10x speed
Block images/CSS 5 pages/min 12 pages/min 2.4x speed
Increase concurrency 5 pages/min 25 pages/min 5x speed
Reduce memory 4GB to 512MB $0.04/run $0.005/run 8x cost savings
Batch dataset pushes 1000 API calls 1 API call Eliminates rate limits

Source: SKILL.md on GitHub

No rule matched.

skilld matched fixed text patterns in SKILL.md and file names. Patterns miss obfuscated code.

skilld run checks every file with the same patterns. It asks for approval before it loads a Skill with a behavior marked Needs approval.

No alerts2mo3 checks · Risk SAFE
  • Gen Agent Trust Hub2mo

    The skill provides legitimate optimization techniques for Apify Actors, including crawler selection and resource management. It correctly uses environment variables for sensitive tokens. A low-severity risk of indirect prompt injection exists because the skill processes data from external websites, which is inherent to web scraping tools.

  • Socket2mo

    No alerts

  • Snyk2mo

    Risk: LOW · No issues

Signed by skilld at 820dfc8. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub yesterday.

Activeupdated 4 months ago
What it can do
Reads files Edits files
version
1.5.0
author
Jeremy Longshore <jeremy@intentsolutions.io>
tags
[
  "saas",
  "scraping",
  "automation",
  "apify"
]
All 3 allowed tools
ReadWriteEdit
Other metadata
compatibility
Designed for Claude Code

README badge

README badge for jeremylongshore/tons-of-skills-marketplace/apify-performance-tuning