Global

gui-automation
24 projects tagged “gui-automation” that gained the most stars yesterday
#244 · +157 · 1d ·GitHub

让 Codex 通过 USB 操作你的真实 iPhone。用自然语言描述任务,Codex 就能打开 App、读取页面、点击、滚动、输入文字、整理列表,并在侧边栏展示手机屏幕。

Creator
zhongerxin
Size
44.3 MB
Stars
4.2K
Age
13d
Commits · 90 Days
#788 · +42 · 1d ·GitHub

Model Context Protocol Server for Mobile Automation and Scraping (iOS, Android, Emulators, Simulators and Real Devices)

Size
3.9 MB
Stars
9.8K
Age
1y
Commits · 90 Days
#801 · +41 · 1d ·GitHub

The agent asks which phone is your default and walks you through the parts that need your hands: pairing iPhone Mirroring and granting Accessibility and Screen Recording, or turning on Android developer options and approving adb.

Creator
ShawnPana
Size
0.7 MB
Stars
3.8K
Age
2mo
Commits · 90 Days
#983 · +32 · 1d ·GitHub

This repository is Operit's Android edition. Operit 2 is a separate second-generation implementation centered on a shared Rust runtime, Flutter clients, and the operit2 CLI/TUI.

Creator
AAswordman
Size
577.4 MB
Stars
8.8K
Age
1y
Commits · 90 Days
#1380 · +21 · 1d ·GitHub

0(API 24)及以上 - 系统操作能力需配合 Shizuku(免 Root 授权)或有 root;都不授予也能正常使用(文件操作只需「所有文件访问」权限) - API Key 在 App 内页面填写,只存本机,绝不打包进 APK

Creator
woaiys3
Size
13.3 MB
Stars
513
Age
2mo
Commits · 90 Days
#1757 · +15 · 1d ·GitHub

Open-source, secure environment with real-world tools for enterprise-grade agents.

Creator
e2b-dev
Size
127.1 MB
Stars
14.4K
Age
3y
Commits · 90 Days
#1932 · +13 · 1d ·GitHub

Agent Zero is an open agent framework for work that needs more than chat: a Dockerized Linux desktop, a browser with DOM annotation, live document cowork, projects, skills, plugins, and a bridge back to your host machine.

Creator
agent0ai
Size
62.7 MB
Stars
19.5K
Age
2y
Commits · 90 Days
#1963 · +13 · 1d ·GitHub

MaaEnd 终末地小助手:基于视觉 AI 的「明日方舟:终末地」自动化工具

Creator
MaaEnd
Size
249.5 MB
Stars
4.1K
Age
4y
Commits · 90 Days
#2811 · +7 · 1d ·GitHub

Midscene combines a vision-driven GUI Agent with a testing kit for writing, verifying, and debugging UI tests across web, mobile, and desktop apps through the same Agent APIs.

Size
764.5 MB
Stars
15.3K
Age
2y
Commits · 90 Days
#3482 · +5 · 1d ·GitHub

🏆 This project is the first comprehensive vision-tool plugin in the DeepSeek Harness ecosystem: it was initiated before internal beta and built during the beta with reference to agent-vision-toolkit.

Creator
Anionex
Size
10.8 MB
Stars
899
Age
2mo
Commits · 90 Days
#4382 · +3 · 1d ·GitHub

> Beta. This is under heavy development. x releases.

Creator
awlevin
Size
0.9 MB
Stars
1.2K
Updated
CommitSep 29
Age
1mo
Commits · 90 Days
#4387 · +3 · 1d ·GitHub

txt file is included in the project root and can be modified by the user to contain seed words for the LLM to complete 20 searches. The wordlist should be separated by newline.

Creator
User0332
Size
0.8 MB
Stars
1K
Updated
CommitOct 15
Age
2mo
Commits · 90 Days
#4441 · +3 · 1d ·GitHub

让任何 agent 操控 Mac 上没有 API 的原生 app,读后台、写不打扰、每步留取证 · Agent Skill for macOS computer use

Creator
alchaincyf
Size
20.5 MB
Stars
311
Updated
CommitOct 13
Age
1mo
Commits · 90 Days
#4889 · +2 · 1d ·GitHub

This is a work in progress so the exported functions could change at any time before the first stable release (1.0.0). Ideas?

Creator
octalmage
Size
1.2 MB
Stars
12.8K
Age
12y
Commits · 90 Days
#4996 · +2 · 1d ·GitHub

RobotGo, Go Native cross-platform RPA, GUI automation, Auto test and Computer use @vcaesar

Creator
go-vgo
Size
6.9 MB
Stars
10.9K
Age
10y
Commits · 90 Days
#5036 · +2 · 1d ·GitHub

提供同花顺客户端/miniqmt/雪球的股票量化交易,支持跟踪 joinquant /ricequant 模拟交易 和 实盘雪球组合

Creator
shidenggui
Size
0.9 MB
Stars
10.3K
Updated
CommitOct 16
Age
10y
Commits · 90 Days
#5930 · +1 · 1d ·GitHub

A cross-platform GUI automation Python module for human beings. Used to programmatically control the mouse & keyboard.

Creator
asweigart
Size
2.3 MB
Stars
12.7K
Updated
CommitJun 07
Age
12y
Commits · 90 Days
#6319 · +1 · 1d ·GitHub

Agent Desktop gives any agent reliable computer use on the desktop. Built with Rust, it sees any app's real UI structure through OS accessibility trees and operates it — refs stay stable and actions stay safe to retry, instead of guessing from pixels.

Creator
lahfir
Size
56.3 MB
Stars
1.8K
Age
7mo
Commits · 90 Days
#7279 · +0 · 1d ·GitHub
archived

Automation&Workflow JavaScript IDE on Android(安卓平台上的JavaScript编程IDE)

Creator
clearw5
Size
<0.1 MB
Stars
12.9K
Updated
CommitFeb 11
Age
9y
Commits · 90 Days
#7731 · +0 · 1d ·GitHub

A framework to enable a multimodal model to operate a computer.

Size
12.6 MB
Stars
10.3K
Age
2y
Commits · 90 Days
#7841 · +0 · 1d ·GitHub

Agent-ready RPA suite with out-of-the-box automation tools. Built for individuals and enterprises.

Creator
iflytek
Size
200.6 MB
Stars
5.3K
Age
1y
Commits · 90 Days
#8101 · +0 · 1d ·GitHub

Be warned the program is highly unfinished and could use a lot of testing. Any feedback is welcome.

Creator
dingusdev
Size
6.1 MB
Stars
410
Updated
CommitOct 17
Age
7y
Commits · 90 Days
#8385 · +0 · 1d ·GitHub

Every example in this repo is a complete program you can run in under a minute. They are deliberately small: one idea each, no framework, no scaffolding to read past. Copy one into your project and change the parts you care about.

Creator
solari-sdk
Size
0.5 MB
Stars
191
Updated
CommitSep 28
Age
2mo
Commits · 90 Days
#8413 · +0 · 1d ·GitHub

A Windows keyboard, mouse, and screenshot toolkit for Codex and other computer-use agents. The agent observes the game, chooses actions, and verifies the result; the Python runtime provides controls and optional visual checks.

Creator
wz1119
Size
0.1 MB
Stars
182
Updated
CommitSep 07
Age
1mo
Commits · 90 Days