UI-TARS-desktop README

The project's README from github.com/bytedance/UI-TARS-desktop. As one markdown file: README.md.

Agent TARS Banner

Introduction

English | 简体中文

TARS* is a Multimodal AI Agent stack, currently shipping two projects: Agent TARS and UI-TARS-desktop:

Agent TARS UI-TARS-desktop
Agent TARS is a general multimodal AI Agent stack, it brings the power of GUI Agent and Vision into your terminal, computer, browser and product.

It primarily ships with a CLI and Web UI for usage. It aims to provide a workflow that is closer to human-like task completion through cutting-edge multimodal LLMs and seamless integration with various real-world MCP tools.
UI-TARS Desktop is a desktop application that provides a native GUI Agent based on the UI-TARS model.

It primarily ships a local and remote computer as well as browser operators.

Table of Contents

News


Agent TARS

npm version downloads node version Discord Community Official Twitter 飞书交流群 Ask DeepWiki

Agent TARS is a general multimodal AI Agent stack, it brings the power of GUI Agent and Vision into your terminal, computer, browser and product.

It primarily ships with a CLI and Web UI for usage. It aims to provide a workflow that is closer to human-like task completion through cutting-edge multimodal LLMs and seamless integration with various real-world MCP tools.

Showcase

Please help me book the earliest flight from San Jose to New York on September 1st and the last return flight on September 6th on Priceline

https://github.com/user-attachments/assets/772b0eef-aef7-4ab9-8cb0-9611820539d8


Booking Hotel Generate Chart with extra MCP Servers
Instruction: I am in Los Angeles from September 1st to September 6th, with a budget of $5,000. Please help me book a Ritz-Carlton hotel closest to the airport on booking.com and compile a transportation guide for me Instruction: Draw me a chart of Hangzhou's weather for one month

For more use cases, please check out #842.

Core Features

Quick Start

Agent TARS CLI
# Launch with `npx`.
npx @agent-tars/cli@latest

# Install globally, required Node.js >= 22
npm install @agent-tars/cli@latest -g

# Run with your preferred model provider
agent-tars --provider volcengine --model doubao-1-5-thinking-vision-pro-250428 --apiKey your-api-key
agent-tars --provider anthropic --model claude-3-7-sonnet-latest --apiKey your-api-key

Visit the comprehensive Quick Start guide for detailed setup instructions.

Documentation

🌟 Explore Agent TARS Universe 🌟

Category Resource Link Description
🏠 Central Hub Website Your gateway to Agent TARS ecosystem
📚 Quick Start Quick Start Zero to hero in 5 minutes
🚀 What's New Blog Discover cutting-edge features & vision
🛠️ Developer Zone Docs Master every command & features
🎯 Showcase Examples View use cases built by the official and community
🔧 Reference API Complete technical reference



UI-TARS Desktop

UI-TARS

UI-TARS Desktop is a native GUI agent for your local computer, driven by UI-TARS and Seed-1.5-VL/1.6 series models.

   📑 Paper    | 🤗 Hugging Face Models   |   🫨 Discord   |   🤖 ModelScope  
🖥️ Desktop Application    |    👓 Midscene (use in browser)   

Showcase

Instruction Local Operator Remote Operator
Please help me open the autosave feature of VS Code and delay AutoSave operations for 500 milliseconds in the VS Code setting.
Could you help me check the latest open issue of the UI-TARS-Desktop project on GitHub?

Features

Quick Start

See Quick Start

Contributing

See CONTRIBUTING.md.

License

This project is licensed under the Apache License 2.0.

Citation

If you find our paper and code useful in your research, please consider giving a star :star: and citation :pencil:

@article{qin2025ui,
  title={UI-TARS: Pioneering Automated GUI Interaction with Native Agents},
  author={Qin, Yujia and Ye, Yining and Fang, Junjie and Wang, Haoming and Liang, Shihao and Tian, Shizuo and Zhang, Junda and Li, Jiahao and Li, Yunxin and Huang, Shijue and others},
  journal={arXiv preprint arXiv:2501.12326},
  year={2025}
}

UI-TARS-desktop (bytedance/UI-TARS-desktop)

Searching Database…

这是什么?TARS 是字节跳动推出的开源多模态 AI 智能体体系,包含两个项目:Agent TARS,一个用于终端、浏览器和工具调用任务的命令行与 Web 界面智能体;以及 UI-TARS Desktop,一个原生应用,可让视觉语言模型看到你的屏幕,并控制鼠标和键盘。
Agent TARS 和 UI-TARS Desktop 是同一个东西吗?不是,它们是同一体系中的两个独立产品:Agent TARS 是一个命令行加 Web 界面的工具,用于协调多模态大语言模型和 MCP 工具;而 UI-TARS Desktop 是一个独立的桌面应用,可以在你的电脑或浏览器上驱动原生图形界面智能体。
怎样才能运行 Agent TARS 或 UI-TARS Desktop?使用 Agent TARS 时,请按照 CLI 快速入门指南操作,该指南被称为“5 分钟从零到精通”;使用 UI-TARS Desktop 时,请安装桌面应用,并将其指向本地或远程的电脑/浏览器操作端。
我需要自己提供 AI 模型吗?需要。图形界面智能体由 UI-TARS 模型或字节跳动的 Seed-1.5-VL/1.6 系列视觉语言模型驱动,因此你需要能够使用其中之一;从源码构建还需要 Node.js 20 或更高版本。
使用远程控制功能需要做什么配置吗?不需要额外设置。v0.2.0 引入的远程电脑和远程浏览器操作端无需额外配置,只需点击即可开始控制远程机器或浏览器,而且这些远程操作端可以免费使用。
UI-TARS Desktop 支持哪些平台?UI-TARS Desktop 宣称支持跨平台,包括 Windows、macOS 以及基于浏览器的控制。
我的屏幕数据会离开我的电脑吗?使用本地操作端运行时,UI-TARS Desktop 宣称是完全本地化的,截图和控制操作都保留在设备上,不会发送到第三方服务。
Agent TARS 开箱即用能做什么?README 展示了一些演示,例如在预算范围内通过 booking.com 预订洛杉矶机场附近的 Ritz-Carlton 酒店,以及使用已连接的 MCP 服务器生成杭州一个月的天气图表。
图形界面智能体究竟如何控制我的电脑?UI-TARS Desktop 先通过截图进行视觉识别,然后在视觉语言模型基于自然语言推理的指引下,发出精确的鼠标和键盘操作。
MCP 集成有什么用?Agent TARS 的内核基于模型上下文协议(MCP)构建,可以挂载 MCP 服务器,使智能体除了图形界面和浏览器控制之外,还能调用真实世界的各种工具。
如果我不想使用完整的桌面应用,有没有更轻量的 SDK?有。该项目还发布了 UI TARS SDK,它被描述为一个跨平台工具包,用于构建你自己的图形界面自动化智能体。
What are similar projects?midscene, UI-TARS, nanoMuse, qwen-code, claude-code, OmniParser, cua, fara
Creator
bytedance
Size
188.5 MB
Stars
39.3K
Age
1y
Commits · 90 Days