---
title: "vercel-labs/agent-desktop skills · skilld"
description: "Computer use CLI for AI agents"
canonical_url: "https://skilld.dev/gh/vercel-labs/agent-desktop"
meta:
  "og:description": "Computer use CLI for AI agents"
  "og:image": "https://skilld.dev/_og/d/a_~c2tpbGxkLCBhZ2VudCBza2lsbHMgd3JpdHRlbiBieSByZWFsIG1haW50YWluZXJz%2Cc_Page.takumi%2Cdescription_~Q3VyYXRlZCBhZ2VudCBza2lsbHMgYnkgaHVtYW5zLCB3cml0dGVuIGJ5IHJlYWwgbWFpbnRhaW5lcnMgaW4gdGhlaXIgb3duIEdpdEh1YiByZXBvcw%2Cp_Ii9naC92ZXJjZWwtbGFicy9hZ2VudC1kZXNrdG9wIg%2Cs_TUuGqv5mFkdc2kPT.png"
  "og:image:alt": "skilld, agent skills written by real maintainers"
  "og:image:height": "600"
  "og:image:type": image/png
  "og:image:width": "1200"
  "og:title": "vercel-labs/agent-desktop skills"
  "twitter:description": "Computer use CLI for AI agents"
  "twitter:image": "https://skilld.dev/_og/d/a_~c2tpbGxkLCBhZ2VudCBza2lsbHMgd3JpdHRlbiBieSByZWFsIG1haW50YWluZXJz%2Cc_Page.takumi%2Cdescription_~Q3VyYXRlZCBhZ2VudCBza2lsbHMgYnkgaHVtYW5zLCB3cml0dGVuIGJ5IHJlYWwgbWFpbnRhaW5lcnMgaW4gdGhlaXIgb3duIEdpdEh1YiByZXBvcw%2Cp_Ii9naC92ZXJjZWwtbGFicy9hZ2VudC1kZXNrdG9wIg%2Cs_TUuGqv5mFkdc2kPT.png"
  "twitter:image:alt": "skilld, agent skills written by real maintainers"
  "twitter:title": "vercel-labs/agent-desktop skills"
---

> Index of every page on this site: [llms.txt](https://skilld.dev/llms.txt)

[All skills](https://skilld.dev/skills)

[![vercel-labs avatar](https://skilld.dev/_img/avatar?url=https%3A%2F%2Fgithub.com%2Fvercel-labs.png)](https://skilld.dev/gh/vercel-labs)

# **vercel-labs/agent-desktop**

Computer use CLI for AI agents

main Updated 2 hours ago [GitHub](https://github.com/vercel-labs/agent-desktop)

![README badge for vercel-labs/agent-desktop](https://skilld.dev/b/vercel-labs/agent-desktop?theme=light&label=0)

## Repository statistics

- Indexed skills

  **8**
- Skill groups

  **1**
- GitHub stars

  **25,826**
- Forks

  **1,934**

## Skills

8 total

Sort skills

[/agent-desktop-macos](https://skilld.dev/gh/vercel-labs/agent-desktop/agent-desktop-macos)

macOS platform guide for the agent-desktop CLI. Use for desktop automation on macOS: granting Accessibility and Screen Recording permission (TCC), what headed mode does on macOS (physical-first click, type and scroll), surfaces (menu, menubar, sheet, popover, alert, dock, menu-bar-extras), menu bar apps and system panels with no window, Notification Center, Chromium and Electron apps including launch --cdp, and fixing PERM\_DENIED, empty accessibility trees, ACTION\_FAILED and APP\_UNRESPONSIVE.

Updated3 days ago

[/agent-desktop](https://skilld.dev/gh/vercel-labs/agent-desktop/agent-desktop)

Operate desktop applications on macOS, Windows and Linux through native accessibility trees, using the agent-desktop CLI. Use when an AI agent must see or act on a desktop GUI: click buttons, fill forms, read UI state, navigate menus, toggle checkboxes, scroll, drag, type text, press shortcuts, take screenshots, manage windows, use the clipboard, launch or close apps, read notifications. Triggers on: "click button", "fill form", "open app", "read UI", "computer use", "operate desktop", "accessibility tree", "snapshot app", "type into field", "navigate menu", "toggle checkbox", "take screenshot", "desktop automation", "agent-desktop", or any desktop GUI task on macOS, Windows or Linux.

Updated7 days ago

[/agent-desktop-linux](https://skilld.dev/gh/vercel-labs/agent-desktop/agent-desktop-linux)

Linux platform guide for the agent-desktop CLI. Lists per command group what works on X11 and on Wayland, how to check the AT-SPI accessibility bus, the first-contact gotchas (app names, Chromium and Electron flags, headed focus, blocked key combos), and where to find lifecycle, screenshot, clipboard, tray, notification and troubleshooting details. Triggers on: "linux desktop automation", "AT-SPI tree", "automate GNOME app", "agent-desktop on Linux", "accessibility bus not available", "empty supported\_surfaces", "wayland screenshot consent", or any Linux GUI interaction task.

Updated10 days ago

[/agent-desktop-windows](https://skilld.dev/gh/vercel-labs/agent-desktop/agent-desktop-windows)

Windows platform guide for the agent-desktop CLI. Lists per command group what works on Windows and what refuses, the first-contact gotchas (PowerShell ref quoting, minimized windows, headed-only input), and where to find shell surfaces, notifications, the cursor overlay, UIPI elevation, Chromium/Electron settle behavior and troubleshooting. Triggers on: "windows desktop automation", "UIA tree", "automate Windows app", "agent-desktop on Windows", "elevated window input blocked", "E\_ACCESSDENIED", or any Windows GUI interaction task.

Updated10 days ago

[/agent-desktop-ffi](https://skilld.dev/gh/vercel-labs/agent-desktop/agent-desktop-ffi)

C-ABI bindings over agent-desktop's PlatformAdapter. Consumers (Python ctypes, Swift, Node ffi-napi, Go cgo, C++, Ruby fiddle) link libagent\_desktop\_ffi.{dylib,so,dll} and call \`ad\_\*\` functions directly instead of spawning the CLI binary per call. The canonical observe-act workflow is: ad\_init → ad\_adapter\_create\[\_with\_session] → ad\_snapshot → read qualified refs (@s8f3k2p9:e5) → ad\_execute\_by\_ref → ad\_free\_string → ad\_adapter\_destroy.

Updated16 days ago

[/architecture-diagram](https://skilld.dev/gh/vercel-labs/agent-desktop/architecture-diagram)

Create or update architecture and flow diagrams for agent-desktop's docs site in apps/docs. Use when a docs page needs a diagram of components, data flow, or a command pipeline, or when an existing diagram in apps/docs/public/desktop/diagrams changes.

Updated22 days ago

[/technical-writer](https://skilld.dev/gh/vercel-labs/agent-desktop/technical-writer)

Write, review, and edit agent-desktop documentation, including the docs site in apps/docs served at agent-browser.dev/desktop, READMEs, the agent skills in skills/, changelog entries, commit messages, PR descriptions, and issues. Use for getting-started guides, command references, conceptual explanations, integration guides, troubleshooting, and code examples.

Updated22 days ago

[/jev-desktop](https://skilld.dev/gh/vercel-labs/agent-desktop/jev-desktop)

Drive a desktop application from one plain-language goal, or resolve one intent at a time, without ever reading the accessibility tree. Use when automating a desktop app and you want to keep a 150-element JSON tree out of your context. Hand \`run.mjs\` a whole goal and it observes, decides and acts until the goal is met; hand \`act.mjs\` a single step when you want to keep the plan yourself. Covers which element, which operation, when to look deeper, and when to stop. Needs a clone of the agent-desktop repository and a TYPESAFE\_API\_KEY.

Updated27 days ago

## Add to your README

The badge links readers to this page. It shows the skilld mark and no counts, and it follows the reader's light or dark GitHub theme.

`<a href="https://skilld.dev/gh/vercel-labs/agent-desktop"> <picture> <source media="(prefers-color-scheme: dark)" srcset="https://skilld.dev/b/vercel-labs/agent-desktop?theme=dark"> <source media="(prefers-color-scheme: light)" srcset="https://skilld.dev/b/vercel-labs/agent-desktop?theme=light"> <img alt="Skill repository on skilld.dev" src="https://skilld.dev/b/vercel-labs/agent-desktop?theme=light"> </picture> </a>`

```json
{"@context":"https://schema.org","@graph":[{"@id":"https://skilld.dev/#website","@type":"WebSite","description":"Curated agent skills by humans, written by real maintainers in their own GitHub repos","name":"skilld","url":"https://skilld.dev/"},{"@id":"https://skilld.dev/gh/vercel-labs/agent-desktop#webpage","@type":"WebPage","description":"Computer use CLI for AI agents","name":"vercel-labs/agent-desktop skills","url":"https://skilld.dev/gh/vercel-labs/agent-desktop","isPartOf":{"@id":"https://skilld.dev/#website"},"potentialAction":[{"@type":"ReadAction","target":["https://skilld.dev/gh/vercel-labs/agent-desktop"]}]}]}
```