Topics / #desktop-automation

Desktop-automation projects on GitHub

Agents and bots that control desktops via mouse and keyboard.

As of , the most-starred Desktop-automation projects on GitHub are cua (30K stars), hammerspoon (16.3K stars) and midscene (15.3K stars). GitHub.Locker tracks 21 Desktop-automation repositories with 185.6K stars combined. The fastest-growing on October 17 was cua, with +79 stars in a day.

21Projects
185.6KStars in total
+203Stars in a day
Browse in the catalog →github.com/topics/desktop-automation ↗

Hot right now

Most stars gained in a day · Oct 17

+79

cua

trycua/cua · ★ 30K

An open-source stack for computer-use AI agents: desktop automation drivers, isolated cloud desktops, local macOS VMs, small specialist decision models, and benchmarks for training, evaluation, and data generation.

+32

mobile-mcp

mobile-next/mobile-mcp · ★ 9.7K

Mobile MCP is a Model Context Protocol server that lets AI agents automate and scrape native iOS and Android apps - on simulators, emulators, or real devices - through a single platform-agnostic set of tools.

+19

lcu

amontlabs/lcu · ★ 1.2K

LCU extracts Codex's built-in computer-use runtime out of the ChatGPT desktop app and exposes it to any AI coding harness (Claude Code, Codex CLI, Pi), so an agent can click, type, read windows, and take screenshots on your machine without needing Codex authentication.

+15

MaaEnd

MaaEnd/MaaEnd · ★ 4.1K

MaaEnd is a vision-AI-based automation assistant for the game 'Arknights: Endfield' (明日方舟:终末地), built on MaaFramework, MXU and MaaFwApp.

The all-time top

21 projects · by stars

  1. #1 · trycua/cua

    cua

    An open-source stack for computer-use AI agents: desktop automation drivers, isolated cloud desktops, local macOS VMs, small specialist decision models, and benchmarks for training, evaluation, and data generation.

    30K
  2. #2 · Hammerspoon/hammerspoon

    hammerspoon

    Hammerspoon is a bridge between macOS and a Lua scripting engine, letting you automate and control your Mac through extensions that expose system functionality to Lua scripts.

    16.3K
  3. #3 · web-infra-dev/midscene

    midscene

    Midscene is a vision-driven GUI Agent combined with an E2E testing kit: it looks at screenshots to act on and verify UI across web, mobile, and desktop apps through one set of Agent APIs.

    15.3K
  1. 4

    GenericAgent

    14.3Klsdefine/GenericAgent · Python

    GenericAgent (GA) is a minimal, self-evolving autonomous agent framework that gives any LLM system-level control over a local computer - browser, terminal, filesystem, keyboard/mouse, screen vision, and mobile via ADB. Instead of preloading skills, it crystallizes every solved task into a reusable 'Skill', growing a personal skill tree from a ~3K-line seed.

  2. 5

    robotjs

    12.8Koctalmage/robotjs · C

    RobotJS is a Node.js library for desktop automation: it controls the mouse and keyboard, and reads pixels from the screen.

  3. 6

    pyautogui

    12.7Kasweigart/pyautogui · Python

    PyAutoGUI is a cross-platform Python module that lets you programmatically control the mouse and keyboard to automate GUI interactions.

  4. 7

    March7thAssistant

    11.7Kmoesnow/March7thAssistant · Python

    March7thAssistant is a full-automation bot for the game Honkai: Star Rail. It handles daily chores like clearing stamina, daily training, claiming rewards, and commissions, plus weekly content such as Memory of Chaos, Pure Fiction, and Apocalyptic Shadow.

  5. 8

    bytebot

    11.1Kbytebot-ai/bytebot · TypeScript

    Bytebot is a self-hosted AI agent that gets its own full Linux desktop (apps, file system, browser) inside a container and completes tasks by actually using that desktop like a human would.

  6. 9

    robotgo

    10.9Kgo-vgo/robotgo · Go

    A Go library for native cross-platform desktop automation: it drives the mouse and keyboard, reads the screen, manages windows and processes, and listens to global events — aimed at RPA, auto-testing and AI computer use.

  7. 10

    KeymouseGo

    10.6Ktaojy123/KeymouseGo · Python

    KeymouseGo is a free, open-source tool for Windows, macOS and Linux that records your mouse clicks and keyboard input and replays them automatically, as many times as you set. It is made for simple, repetitive work: you do the task once, then the computer repeats it.

  8. 11

    self-operating-computer

    10.3KOthersideAI/self-operating-computer · Python

    A framework that lets a multimodal AI model operate your computer: it views the screen and issues mouse and keyboard actions to reach the objective you give it. One of the first full computer-use projects (Nov 2023).

  9. 12

    easytrader

    10.2Kshidenggui/easytrader · Python

    easytrader is a Python library for automating Chinese stock quant trading - it can drive the 同花顺 (THS) desktop client, use the official miniqmt quant API, rebalance or track 雪球 (Xueqiu) portfolios, and mirror joinquant/ricequant paper trading.

  10. 13

    mobile-mcp

    9.7Kmobile-next/mobile-mcp · TypeScript

    Mobile MCP is a Model Context Protocol server that lets AI agents automate and scrape native iOS and Android apps - on simulators, emulators, or real devices - through a single platform-agnostic set of tools.

  11. 14

    MaaEnd

    4.1KMaaEnd/MaaEnd · C++

    MaaEnd is a vision-AI-based automation assistant for the game 'Arknights: Endfield' (明日方舟:终末地), built on MaaFramework, MXU and MaaFwApp.

  12. 15

    agent-desktop

    1.8Klahfir/agent-desktop · Rust

    Agent Desktop is a Rust-built tool that gives AI agents reliable control over desktop apps by reading the OS accessibility tree instead of screenshots, so actions target real UI elements with stable, retry-safe references instead of guessed pixel coordinates.

  13. 16

    typesafe-computer-use

    1.2Kawlevin/typesafe-computer-use · Python

    A Python agent that drives your Mac toward a goal you type in plain English: it OCRs the screen, a cheap classifier picks each action, and it clicks — about $0.0002 per step.

  14. 17

    lcu

    1.2Kamontlabs/lcu · JavaScript

    LCU extracts Codex's built-in computer-use runtime out of the ChatGPT desktop app and exposes it to any AI coding harness (Claude Code, Codex CLI, Pi), so an agent can click, type, read windows, and take screenshots on your machine without needing Codex authentication.

  15. 18

    collab-agent

    479Iwtbs27/collab-agent · Python

    OmniAct (repo name collab-agent) is a lightweight multi-agent system that helps you finish real digital tasks across browsers, desktop apps, and the command line.

  16. 19

    bluey-by-riley

    424rbrown101010/bluey-by-riley · Swift

    Googly Eyes is a blueberry character that lives on your iPhone screen and points at things on your Mac with his own cursor. It pairs a Mac menu bar app with an iPhone app so he can see your screen, talk through OpenAI's Realtime API, and even control your computer when asked.

  17. 20

    huashu-mac-use

    309alchaincyf/huashu-mac-use · Swift

    An Agent Skill that lets coding agents like Claude Code, Codex and Cursor drive macOS apps that have no API — reading screens, clicking and typing — and leaves reproducible evidence of every step.

  18. 21

    Codex-Minecraft-Gameplay

    182wz1119/Codex-Minecraft-Gameplay · Python

    A Windows toolkit that lets Codex or other computer-use agents play Minecraft by reading the screen and sending keyboard and mouse input to move, gather, craft, explore, and build.

Often tagged together