Index of every page on this site: llms.txt
All skills
proyecto26 avatar

/distributed-logging

@228d57d
Run it yourself

This skill should be used when the user designs "distributed logging", "log aggregation", "centralized logs", an "ELK" or "EFK" stack, "log shipping", "structured logging", a "correlation ID" or "trace ID" in logs, "log retention", or "high-volume log ingest". It gives the collect → buffer → ship → index → store → retain pipeline, sampling, ordering, and cold-storage tiering. Use it whenever many services emit logs that must be searched in one place under load, even if the user doesn't say "logging pipeline".

Use this Skill: https://skilld.dev/gh/proyecto26/system-design-skills/distributed-logging

Nothing lands on disk. Nothing to clean up.

Fork this Skill

Edit a local copy. It keeps the author and licence.

referencesprovidersaws.md

≈657 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Distributed logging — AWS

Service mapping (generic stage → AWS)

  • Collect: CloudWatch agent / Fluent Bit (the aws-for-fluent-bit image is the standard ECS/EKS sidecar/daemon). Lambda and many services log to CloudWatch Logs natively.
  • Buffer / transport: Kinesis Data Streams as the durable log bus, or Kinesis Data Firehose for buffered, no-ops delivery straight to a sink. (Kafka via MSK if you already run Kafka — owned by messaging-streaming.)
  • Index / search: OpenSearch Service (managed Elasticsearch/OpenSearch) for full-text search; CloudWatch Logs Insights for query-in-place without a separate cluster.
  • Cold archive: S3 via Firehose, with lifecycle to Glacier classes; query in place with Athena (→ blob-store).

A very common AWS recipe: agents/services → CloudWatch Logs → subscription filter → Firehose → S3 (cold) and/or OpenSearch (hot search). Firehose does the buffering, batching, compression, and retry so you don't run agents for that hop.

Limits / things that bite (verify against current docs)

  • CloudWatch Logs PutLogEvents has per-request batch size and per-stream throughput limits; bursts get throttled — batch and back off.
  • Firehose buffers by size or time interval, whichever first — there is an inherent delivery delay (seconds–minutes); not for interactive tailing.
  • Kinesis Data Streams throughput is per-shard (fixed MB/s in, records/s); ordering is per-shard only; you must scale shards for peak ingest.
  • OpenSearch Service is the same shard/heap pressure as self-hosted ES; instance type caps RAM and the index queue.
  • CloudWatch Logs retention is per-log-group; default can be "never expire" → silent cost growth. Set it explicitly.

Provider trade-offs

  • CloudWatch Logs is the path of least resistance (most services emit there for free) but ingestion + storage + Insights scans are billed separately and add up fast.
  • Firehose → S3 is the cheap durable archive; OpenSearch is the expensive hot search — send everything to S3, a sampled/filtered subset to OpenSearch.
  • Lock-in: subscription filters, Firehose transforms, and Insights queries don't port to other clouds.

Pitfalls

  • Leaving log groups on infinite retention (cost) — or expecting Firehose to be real-time (it isn't).
  • Sending full-volume logs to OpenSearch when most queries are label filters that S3 + Athena would answer for far less.
  • Forgetting Kinesis shard limits during an incident spike → throttled, dropped logs exactly when you need them.

Source: SKILL.md on GitHub

No rule matched.

skilld matched fixed text patterns in SKILL.md and file names. Patterns miss obfuscated code.

skilld run checks every file with the same patterns. It asks for approval before it loads a Skill with a behavior marked Needs approval.

No alerts24d3 checks · Risk SAFE
  • Gen Agent Trust Hub24d

    The skill provides architectural guidance for designing distributed logging systems. No security issues were detected.

  • Socket24d

    No alerts

  • Snyk24d

    Risk: LOW · No issues

Signed by skilld at 228d57d. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub 3 weeks ago.

Activeupdated 4 weeks ago

README badge

README badge for proyecto26/system-design-skills/distributed-logging