skilld
All skills
am-will avatar

/gemini-computer-use

@6cd5afa
by am.willam-will/codex-skills1k stars
60

Build and run Gemini 2.5 Computer Use browser-control agents with Playwright. Use when a user wants to automate web browser tasks via the Gemini Computer Use model, needs an agent loop (screenshot → function_call → action → function_response), or asks to integrate safety confirmation for risky UI actions.

Ask your Agent

Use this Skill: https://skilld.dev/gh/am-will/codex-skills/gemini-computer-use

This session only. Nothing lands on disk.

referencesgoogle-computer-use.md

≈159 tokens on demand. Your agent reads this file only when SKILL.md points to it.

Gemini Computer Use Notes

  • Model: gemini-2.5-computer-use-preview-10-2025 (required when using the Computer Use tool).
  • The model emits function_call actions that must be executed client-side.
  • After each action, return a function_response with the latest screenshot + URL.
  • If a response includes safety_decision: require_confirmation, you must ask the user to confirm before executing the action.

Supported actions (browser environment):

  • open_web_browser
  • wait_5_seconds
  • go_back
  • go_forward
  • search
  • navigate
  • click_at
  • hover_at
  • type_text_at
  • key_combination
  • scroll_document
  • scroll_at
  • drag_and_drop

Source: SKILL.md on GitHub

Third-party checks

2 warnings13d5 checks · Risk SAFE
  • Gen Agent Trust Hub13d

    This skill implements a browser automation agent using Gemini Computer Use. It is vulnerable to indirect prompt injection from malicious content on websites visited by the agent.

  • Socket13d

    No alerts

  • Snyk13d

    Risk: MEDIUM · 1 issue

  • Runlayer7mo

    4/4 files flagged

  • ZeroLeaks5mo

    Score: 93/100 · 2 sections analyzed

Provenance

Signed by skilld at 6cd5afa. This ties the file your Agent reads to that commit on GitHub. It does not review the instructions.

Last checked against GitHub 2 months ago.

Steadyupdated 9 months ago

Topics

  • Python
  • gemini
  • computer-use
  • playwright
  • browser-automation
  • agent-loop
  • web-automation
  • google-genai

README badge

README badge for am-will/codex-skills/gemini-computer-use

What it does

Builds and runs agentic loops for Gemini 2.5 Computer Use, which controls a browser via Playwright to complete web automation tasks. The agent captures screenshots, sends them to the model, executes returned actions (click, type, scroll), and loops until the task completes or a turn limit is reached. Includes safety confirmation prompts for risky UI actions.

Generated from the current SKILL.md.

Frequently asked

What model does this skill use?
Gemini 2.5 with Computer Use capabilities. The skill sends screenshots and receives function calls to control the browser.
Does this work with browsers other than Chromium?
The default is Playwright's bundled Chromium, but you can specify Chrome or Edge via COMPUTER_USE_BROWSER_CHANNEL, or any Chromium-based executable (e.g. Brave) via COMPUTER_USE_BROWSER_EXECUTABLE.
How do I prevent the agent from taking risky actions?
Use the --exclude flag to block specific actions you don't want the model to execute, and run the browser in a sandboxed profile or container for isolation.
What happens when the agent encounters a risky action?
If the model marks an action with safety_decision as require_confirmation, the skill prompts you to approve it before executing.
How many turns can the agent run?
You control the turn limit via the --turn-limit flag (default appears to be 6). Each turn is one screenshot, model response, and action execution cycle.

Generated from the current SKILL.md. These answers refresh after source changes.