Topics / #computer-use

Computer-use projects on GitHub

AI agents operating computers through GUI automation

As of , the most-starred Computer-use projects on GitHub are browser-use (118.4K stars), orca (96.3K stars) and openinterpreter (68.6K stars). GitHub.Locker tracks 63 Computer-use repositories with 983.7K stars combined. The fastest-growing on October 18 was orca, with +1.5K stars in a day.

63Projects
983.7KStars in total
+3.2KStars in a day
Browse in the catalog →github.com/topics/computer-use ↗

Hot right now

Most stars gained in a day · Oct 18

+1.5K

orca

stablyai/orca · ★ 96.3K

Orca is an AI Orchestrator (ADE) for running a fleet of parallel coding agents like Claude Code, Codex, OpenCode or Pi, each in its own git worktree, all tracked from one place.

+232

claude-quickstarts

anthropics/claude-quickstarts · ★ 18.6K

Claude Quickstarts is a collection of separate example projects that show developers how to quickly build and deploy applications using the Claude API, covering use cases like customer support, financial analysis, computer use, and browser automation.

+150

esp32-iphone-agent

onehumanbeing/esp32-iphone-agent · ★ 3.1K

This project lets an AI vision model control a real iPhone, using AirPlay screen mirroring as its 'eyes' and a $7 ESP32-S3 board acting as a USB mouse and keyboard as its 'hands', with no Mac, Apple developer account, or jailbreak required.

+149

ai-agent-book

bojieli/ai-agent-book · ★ 54.8K

An open-source book by Li Bojie taking AI agents from design principles to engineering practice, built on the formula Agent = LLM + context + tools; text, figures and labs all live in this repo.

The all-time top

63 projects · by stars

  1. #1 · browser-use/browser-use

    browser-use

    Browser Use is an open-source browser agent that lets AI models control a real web browser - navigating sites, filling forms, handling CAPTCHAs, and completing tasks like booking appointments.

    118.4K
  2. #2 · stablyai/orca

    orca

    Orca is an AI Orchestrator (ADE) for running a fleet of parallel coding agents like Claude Code, Codex, OpenCode or Pi, each in its own git worktree, all tracked from one place.

    96.3K
  3. #3 · openinterpreter/openinterpreter

    openinterpreter

    Open Interpreter is a Rust-based coding agent forked from OpenAI's Codex, built to get the best performance out of low-cost open models like Kimi K3, DeepSeek, GLM, and Qwen.

    68.6K
  1. 4

    anything-llm

    67.3KMintplex-Labs/anything-llm · JavaScript

    AnythingLLM is an all-in-one, self-hosted AI application that lets you chat with your documents, run AI agents, and build a private ChatGPT-like experience using local or cloud LLMs.

  2. 5

    ai-agent-book

    54.8Kbojieli/ai-agent-book · Python

    An open-source book by Li Bojie taking AI agents from design principles to engineering practice, built on the formula Agent = LLM + context + tools; text, figures and labs all live in this repo.

  3. 6

    UI-TARS-desktop

    39.3Kbytedance/UI-TARS-desktop · TypeScript

    TARS is an open-source multimodal AI agent stack from ByteDance that ships two projects: Agent TARS, a CLI/Web UI agent for terminal, browser and tool-use tasks, and UI-TARS Desktop, a native app that lets a vision-language model see your screen and control mouse/keyboard.

  4. 7

    oh-my-pi

    35.9Kcan1357/oh-my-pi · TypeScript

    omp (oh-my-pi) is a terminal coding agent — a fork of Mario Zetchner's Pi with the IDE wired in, built by Stencil Labs: 60+ model providers, 31 built-in tools, 14 LSP and 28 debugger ops, around 80k lines of Rust core.

  5. 8

    invisible_dots

    32.2Kfeder-cr/invisible_dots · TypeScript

    AIHawk is an open-source AI browser agent that browses the web undetected: it drives a stealth Firefox that anti-bot systems see as a normal person, so no captchas and no blocks. You say what you want in plain language, and it browses, clicks, types and reads the actual web to get it done.

  6. 9

    cua

    30.1Ktrycua/cua · Rust

    An open-source stack for computer-use AI agents: desktop automation drivers, isolated cloud desktops, local macOS VMs, small specialist decision models, and benchmarks for training, evaluation, and data generation.

  7. 10

    page-agent

    29.5Kalibaba/page-agent · TypeScript

    Page Agent is a JavaScript GUI agent that lives inside a web page: one script gives the page its own AI assistant you control with natural language.

  8. 11

    qwen-code

    28.6KQwenLM/qwen-code · TypeScript

    An open-source AI coding agent that lives in your terminal — it edits code and runs commands in your project, powered by Qwen, OpenAI, Anthropic, or Gemini APIs, or local models via Ollama and vLLM.

  9. 12

    Open-AutoGLM

    26.4Kzai-org/Open-AutoGLM · Python

    Open-AutoGLM (Phone Agent) is an open phone-use agent framework built on the AutoGLM model that understands your phone screen visually and automates tasks via natural-language commands like 'open Xiaohongshu and search for food'.

  10. 13

    OmniParser

    25.5Kmicrosoft/OmniParser · Jupyter Notebook

    OmniParser parses GUI screenshots into structured, labeled elements (icons, text, interactable regions) so a vision model like GPT-4V can accurately decide what to click or type on a screen.

  11. 14

    skyvern

    23.2KSkyvern-AI/skyvern · Python

    Skyvern is an open-source AI agent that automates browser-based workflows using LLMs and computer vision — filling out forms, logging in, extracting data and downloading files on websites it has never seen before.

  12. 15

    claude-code

    22.9Kclaude-code-best/claude-code · TypeScript

    Claude Code Best (CCB) is a full open-source engineering reconstruction of Anthropic's official Claude Code CLI agent — buildable, runnable and debuggable — extended with extra features like goal-driven workflows, multi-agent orchestration, voice input and computer/browser control, while keeping full compatibility with the original Claude Code configuration.

  13. 16

    agent-zero

    19.5Kagent0ai/agent-zero · Python

    Agent Zero is an open-source agent framework that gives your AI agent a full Dockerized Linux computer — a real desktop, browser, documents and plugins — instead of just a chat window.

  14. 17

    claude-quickstarts

    18.6Kanthropics/claude-quickstarts · TypeScript

    Claude Quickstarts is a collection of separate example projects that show developers how to quickly build and deploy applications using the Claude API, covering use cases like customer support, financial analysis, computer use, and browser automation.

  15. 18

    leon

    17.6Kleon-ai/leon · TypeScript

    Leon is an open-source personal AI assistant that runs locally and is built around tools, context, memory, and agentic execution — it understands a goal, uses real tools, and completes tasks end to end.

  16. 19

    midscene

    15.3Kweb-infra-dev/midscene · TypeScript

    Midscene is a vision-driven GUI Agent combined with an E2E testing kit: it looks at screenshots to act on and verify UI across web, mobile, and desktop apps through one set of Agent APIs.

  17. 20

    cc-haha

    15.1KNanmiCoder/cc-haha · TypeScript

    Claude Code Haha is a local-first desktop workbench for Claude Code and other coding agents, bundling multi-session chat, git worktree launches, diff review, an in-app browser, model switching, MCP management, Computer Use, a skill marketplace, and remote access via chat apps into one macOS/Windows/Linux app.

  18. 21

    E2B

    14.4Ke2b-dev/E2B · Python

    E2B is open-source infrastructure that lets you run AI-generated code in secure, isolated cloud sandboxes, so agents can execute untrusted code safely.

  19. 22

    GenericAgent

    14.3Klsdefine/GenericAgent · Python

    GenericAgent (GA) is a minimal, self-evolving autonomous agent framework that gives any LLM system-level control over a local computer - browser, terminal, filesystem, keyboard/mouse, screen vision, and mobile via ADB. Instead of preloading skills, it crystallizes every solved task into a reusable 'Skill', growing a personal skill tree from a ~3K-line seed.

  20. 23

    Agent-S

    12.6Ksimular-ai/Agent-S · Python

    Agent S is an open-source agent framework that controls a real desktop GUI - clicking, typing, and scrolling - to complete natural-language tasks the way a human would, without per-app API integrations.

  21. 24

    awesome-chatgpt-zh

    11.8KEmbraceAGI/awesome-chatgpt-zh · Python

    A Chinese-language guide to ChatGPT and frontier AI: a curated, continuously updated GitHub collection of free and paid ChatGPT resources, prompt-engineering advice, app-development guides and AI productivity tools (11.7k stars).

  22. 25

    UI-TARS

    11.6Kbytedance/UI-TARS · Python

    UI-TARS is an open-source multimodal agent model built on a vision-language model that can operate GUIs directly — clicking, typing, scrolling, dragging — across desktop apps, mobile screens, browsers, and even video games like Minecraft, reasoning about its actions before taking them.

  23. 26

    hive

    11.1Kaden-hive/hive · Python

    OpenHive is an open-source multi-agent harness for production AI — a runtime that adds state management, failure recovery, observability, cost control, and human oversight so colonies of agents reliably run real business processes instead of demos.

  24. 27

    bytebot

    11.1Kbytebot-ai/bytebot · TypeScript

    Bytebot is a self-hosted AI agent that gets its own full Linux desktop (apps, file system, browser) inside a container and completes tasks by actually using that desktop like a human would.

  25. 28

    robotgo

    10.9Kgo-vgo/robotgo · Go

    A Go library for native cross-platform desktop automation: it drives the mouse and keyboard, reads the screen, manages windows and processes, and listens to global events — aimed at RPA, auto-testing and AI computer use.

  26. 29

    self-operating-computer

    10.3KOthersideAI/self-operating-computer · Python

    A framework that lets a multimodal AI model operate your computer: it views the screen and issues mouse and keyboard actions to reach the objective you give it. One of the first full computer-use projects (Nov 2023).

  27. 30

    magentic-ui

    10.1Kmicrosoft/magentic-ui · Python

    MagenticLite is a free, open-source agent application from Microsoft AI Frontiers that automates real work — web research, form filling, file management — across the browser and your local file system, built to run on small models.

  28. 31

    Windows-MCP

    9.4KCursorTouch/Windows-MCP · Python

    Windows-MCP is a lightweight, open-source MCP server that bridges LLMs and AI agents with the Windows operating system, letting agents control apps, navigate files, interact with the UI, and run QA tests.

  29. 32

    clicky

    7.7Kfarzaa/clicky · Swift

    Clicky is an AI teacher that lives next to your cursor: it sees your screen, talks to you, and can even point at things on screen, like having a real teacher sitting beside you.

  30. 33

    Kun

    6.3KKunAgent/Kun · TypeScript

    Kun is a local-first AI agent workspace that takes AI from answering questions to completing real work — coding, writing, design and automation — planning, editing files, running checks and leaving evidence beside each task.

  31. 34

    fara

    6.2Kmicrosoft/fara · Python

    A family of open computer-use agent models — Fara1.5-4B, 9B and 27B, built on Qwen3.5 — that perform multi-step web tasks for you by controlling the mouse and keyboard like a human would.

  32. 35

    open-dots

    5.9KAnil-matcha/open-dots · Python

    An open-source, self-hosted AI agent workspace and alternative to paid products like OpenAI Dots, Claude Cowork, Grok Bot and ChatGPT agent. The prototype focuses on coding-agent workflows: running Claude Code tasks from Telegram or a browser, reviewing risky actions, and scheduling recurring prompts.

  33. 36

    OpenDots

    5.6KCopilotKit/OpenDots · TypeScript

    OpenDots is an open-source template for always-on AI coworkers ('Dots') that move between text chat, voice calls, and Slack, each with its own persistent computer.

  34. 37

    openmuse

    5.2KCopilotKit/openmuse · TypeScript

    OpenMuse is a personal-agent application: an AI agent with its own browser, terminal, files, and background work that keeps going. You ask for an outcome, follow the plan, review its actions, and come back to the result.

  35. 38

    OpenMausBot

    5.1Kmilind-soni/OpenMausBot · TypeScript

    OpenMausBot is an open-source, local-first alternative to Grok Bot: a chat app where every bot in the sidebar is a real AI agent (Claude, Codex, or Grok) running on your own machine, each with its own personality, model, memory, and a 'computer' it can use to do work.

  36. 39

    arcbox

    4.2Karcboxlabs/arcbox · Rust

    ArcBox is a fast, open-source container and VM runtime for macOS, built from scratch in Rust, that acts as a drop-in Docker replacement while also offering disposable sandboxes for AI agents, native Kubernetes, and full Linux and macOS VMs.

  37. 40

    codex-desktop-linux

    3.9Kilysenko/codex-desktop-linux · JavaScript

    codex-desktop is an unofficial, community-maintained distribution of OpenAI's official Linux ChatGPT desktop app. It repackages the signed upstream payload into native deb, RPM, pacman, AppImage, and Nix outputs, adds optional Linux-only features, and installs as a separate 'ChatGPT Community' app alongside the official one.

  38. 41

    esp32-iphone-agent

    3.1Konehumanbeing/esp32-iphone-agent · C

    This project lets an AI vision model control a real iPhone, using AirPlay screen mirroring as its 'eyes' and a $7 ESP32-S3 board acting as a USB mouse and keyboard as its 'hands', with no Mac, Apple developer account, or jailbreak required.

  39. 42

    invisible_playwright_mcp

    2.8Kfeder-cr/invisible_playwright_mcp · Python

    This is dots, a Playwright MCP server that gives AI agents a real, patched Firefox browser so they can browse the web without being flagged by anti-bot systems or captchas.

  40. 43

    agent-desktop

    1.8Klahfir/agent-desktop · Rust

    Agent Desktop is a Rust-built tool that gives AI agents reliable control over desktop apps by reading the OS accessibility tree instead of screenshots, so actions target real UI elements with stable, retry-safe references instead of guessed pixel coordinates.

  41. 44

    nanoMuse

    1.5Knano-muse/nanoMuse · Swift

    nanoMuse is an open-source personal AI agent that runs across every device you own. It does things rather than just answering questions, keeps working while the app is closed, remembers you, and stops to ask before doing anything irreversible.

  42. 45

    jev-browser-use

    1.3Kwy-coliney/jev-browser-use · JavaScript

    Jev Browser Use is a Skill for Codex (and soon Claude Code) that splits browser automation into two roles: a fast, cheap model called Jev handles clicks, navigation, toggles and scrolling, while Codex handles typing, visual judgment and the final verification. The split claims roughly 5-10x faster browser operations versus letting one model do everything.

  43. 46

    typesafe-computer-use

    1.2Kawlevin/typesafe-computer-use · Python

    A Python agent that drives your Mac toward a goal you type in plain English: it OCRs the screen, a cheap classifier picks each action, and it clicks — about $0.0002 per step.

  44. 47

    lcu

    1.2Kamontlabs/lcu · JavaScript

    LCU extracts Codex's built-in computer-use runtime out of the ChatGPT desktop app and exposes it to any AI coding harness (Claude Code, Codex CLI, Pi), so an agent can click, type, read windows, and take screenshots on your machine without needing Codex authentication.

  45. 48

    hermes-jev-skills

    1.1Kkerpopule/hermes-jev-skills · Python

    Hermes Jev Skills gives an AI agent a cheap, fast 'second brain' for small routine decisions (model routing, memory filtering, skill selection, turn compaction, computer/browser use) so the expensive frontier model only does the writing. The decisions are handled by Jev, TypeSafe's calibrated decision model.

  46. 49

    awesome-jev

    976heyjunpenn/awesome-jev · Astro

    A verified, community-maintained catalog of open-source projects built with Jev — TypeSafe AI's System One model for typed decisions inside software. The README snapshot covers 832 unique public GitHub repositories.

  47. 50

    macos-harness

    960browser-use/macos-harness · Python

    macos-harness is a thin Python harness that gives an LLM agent direct control of a Mac through a handful of raw primitives instead of prebuilt app-specific tools.

  48. 51

    StartLux-Decision

    727StartLuxLabs/StartLux-Decision · Python

    StartLux-Decision is a family of typed decision models (five dense sizes from 0.8B to 27B plus a 35B-A3B mixture-of-experts) that answer a question with a probability for each option instead of generating text.

  49. 52

    open-dot

    659composio-community/open-dot · TypeScript

    Open Dot is an open-source version of OpenAI's 'Dots' personal agents, which normally require ChatGPT Pro or Business Premium. It runs on your own Mac with your own OpenAI key, or with open models like Kimi, DeepSeek and Qwen through OpenRouter, keeping agents working in the background on your computer.

  50. 53

    collab-agent

    479Iwtbs27/collab-agent · Python

    OmniAct (repo name collab-agent) is a lightweight multi-agent system that helps you finish real digital tasks across browsers, desktop apps, and the command line.

  51. 54

    bluey-by-riley

    436rbrown101010/bluey-by-riley · Swift

    Googly Eyes is a blueberry character that lives on your iPhone screen and points at things on your Mac with his own cursor. It pairs a Mac menu bar app with an iPhone app so he can see your screen, talk through OpenAI's Realtime API, and even control your computer when asked.

  52. 55

    Rungic

    414kevinzhow/Rungic · Python

    Rungic turns a compatible Android phone into a real computer, giving you a full Linux (KDE Plasma) desktop plus an AI assistant, powered by Codex, that can see, speak and act on your behalf.

  53. 56

    useagent

    366useagenthq/useagent · TypeScript

    useAgent is an open-source alternative to Devin: it gives coding agents like Claude Code, Codex, OpenCode, and Pi a shared cloud workspace with a terminal, a browser, and your team's tools, so they can do real work like research, code changes, or documents.

  54. 57

    huashu-mac-use

    311alchaincyf/huashu-mac-use · Swift

    An Agent Skill that lets coding agents like Claude Code, Codex and Cursor drive macOS apps that have no API — reading screens, clicking and typing — and leaves reproducible evidence of every step.

  55. 58

    quicksand

    292microsoft/quicksand · Python

    Quicksand is an async Python API for launching, controlling, and snapshotting QEMU virtual machines, built specifically for sandboxing AI agents.

  56. 59

    awesome-jev

    239Amal-David/awesome-jev · Python

    A curated awesome-list of demos, projects, SDKs and skills built with Jev — 44 reviewed picks with source links, plus a curated gallery of demos from X and YouTube.

  57. 60

    Dodaios

    238Dodaios/Dodaios · Python

    Personal Jarvis is an open-source, local-first desktop AI assistant that runs on your own machine. It orchestrates multiple coding agents, controls your desktop and browser, listens and talks through a voice assistant, and manages a team of persistent AI agents.

  58. 61

    solari-cookbook

    191solari-sdk/solari-cookbook · Python

    A cookbook of small, runnable example programs for Solari, a service that gives you cloud browsers, sandboxes, and desktop VMs behind a single API key.

  59. 62

    xiryn

    189SouravBeraAkaSpeed/xiryn · TypeScript

    Xiryn is an open-source personal agent you run on your own computer: it does the same job as Meta's Muse, xAI's Grok Bot and OpenAI's Dots, but each agent works inside a Docker-based Linux desktop that you own, with your own model keys, and it's controlled from Telegram.

  60. 63

    Codex-Minecraft-Gameplay

    182wz1119/Codex-Minecraft-Gameplay · Python

    A Windows toolkit that lets Codex or other computer-use agents play Minecraft by reading the screen and sending keyboard and mouse input to move, gather, craft, explore, and build.

Often tagged together