UI-TARS-desktop README

The project's README from github.com/bytedance/UI-TARS-desktop. As one markdown file: README.md.

Agent TARS Banner

Introduction

English | 简体中文

TARS* is a Multimodal AI Agent stack, currently shipping two projects: Agent TARS and UI-TARS-desktop:

Agent TARS UI-TARS-desktop
Agent TARS is a general multimodal AI Agent stack, it brings the power of GUI Agent and Vision into your terminal, computer, browser and product.

It primarily ships with a CLI and Web UI for usage. It aims to provide a workflow that is closer to human-like task completion through cutting-edge multimodal LLMs and seamless integration with various real-world MCP tools. 		UI-TARS Desktop is a desktop application that provides a native GUI Agent based on the UI-TARS model.

It primarily ships a local and remote computer as well as browser operators.

Table of Contents

News


Agent TARS

npm version downloads node version Discord Community Official Twitter 飞书交流群 Ask DeepWiki

Agent TARS is a general multimodal AI Agent stack, it brings the power of GUI Agent and Vision into your terminal, computer, browser and product.

It primarily ships with a CLI and Web UI for usage. It aims to provide a workflow that is closer to human-like task completion through cutting-edge multimodal LLMs and seamless integration with various real-world MCP tools.

Showcase

Please help me book the earliest flight from San Jose to New York on September 1st and the last return flight on September 6th on Priceline

https://github.com/user-attachments/assets/772b0eef-aef7-4ab9-8cb0-9611820539d8


Booking Hotel Generate Chart with extra MCP Servers
Instruction: I am in Los Angeles from September 1st to September 6th, with a budget of $5,000. Please help me book a Ritz-Carlton hotel closest to the airport on booking.com and compile a transportation guide for me Instruction: Draw me a chart of Hangzhou's weather for one month

For more use cases, please check out #842.

Core Features

Quick Start

Agent TARS CLI 
# Launch with `npx`.
npx @agent-tars/cli@latest

# Install globally, required Node.js >= 22
npm install @agent-tars/cli@latest -g

# Run with your preferred model provider
agent-tars --provider volcengine --model doubao-1-5-thinking-vision-pro-250428 --apiKey your-api-key
agent-tars --provider anthropic --model claude-3-7-sonnet-latest --apiKey your-api-key

Visit the comprehensive Quick Start guide for detailed setup instructions.

Documentation

🌟 Explore Agent TARS Universe 🌟

Category Resource Link Description
🏠 Central Hub Website Your gateway to Agent TARS ecosystem
📚 Quick Start Quick Start Zero to hero in 5 minutes
🚀 What's New Blog Discover cutting-edge features & vision
🛠️ Developer Zone Docs Master every command & features
🎯 Showcase Examples View use cases built by the official and community
🔧 Reference API Complete technical reference



UI-TARS Desktop

UI-TARS

UI-TARS Desktop is a native GUI agent for your local computer, driven by UI-TARS and Seed-1.5-VL/1.6 series models.

   📑 Paper    | 🤗 Hugging Face Models   |   🫨 Discord   |   🤖 ModelScope  
🖥️ Desktop Application    |    👓 Midscene (use in browser)   

Showcase

Instruction Local Operator Remote Operator
Please help me open the autosave feature of VS Code and delay AutoSave operations for 500 milliseconds in the VS Code setting.
Could you help me check the latest open issue of the UI-TARS-Desktop project on GitHub?

Features

Quick Start

See Quick Start

Contributing

See CONTRIBUTING.md.

License

This project is licensed under the Apache License 2.0.

Citation

If you find our paper and code useful in your research, please consider giving a star :star: and citation :pencil:

@article{qin2025ui,
  title={UI-TARS: Pioneering Automated GUI Interaction with Native Agents},
  author={Qin, Yujia and Ye, Yining and Fang, Junjie and Wang, Haoming and Liang, Shihao and Tian, Shizuo and Zhang, Junda and Li, Jiahao and Li, Yunxin and Huang, Shijue and others},
  journal={arXiv preprint arXiv:2501.12326},
  year={2025}
}

UI-TARS-desktop (bytedance/UI-TARS-desktop)

browser-use
Searching Database…

39.3K ·GitHub
UI-TARS-desktop
What is this?TARS is an open-source multimodal AI agent stack from ByteDance that ships two projects: Agent TARS, a CLI/Web UI agent for terminal, browser and tool-use tasks, and UI-TARS Desktop, a native app that lets a vision-language model see your screen and control mouse/keyboard.
Is Agent TARS the same thing as UI-TARS Desktop?No, they are two separate products in the same stack: Agent TARS is a CLI plus Web UI that orchestrates multimodal LLMs and MCP tools, while UI-TARS Desktop is a standalone desktop application that drives a native GUI agent on your computer or a browser.
How do I get Agent TARS or UI-TARS Desktop running?For Agent TARS you follow the CLI Quick Start guide described as 'zero to hero in 5 minutes'; for UI-TARS Desktop you install the desktop application and point it at a local or remote computer/browser operator.
Do I need to supply my own AI model?Yes, the GUI agent is driven by the UI-TARS model or ByteDance's Seed-1.5-VL/1.6 series vision-language models, so you need access to one of those; building from source also requires Node.js 20 or newer.
Do I need to configure anything to use remote control?No extra setup is needed for the Remote Computer and Remote Browser operators introduced in v0.2.0 - you just click to start controlling a remote machine or browser, and these remote operators are free to use.
Which platforms does UI-TARS Desktop run on?UI-TARS Desktop advertises cross-platform support for Windows, macOS, and browser-based control.
Does my screen data leave my machine?UI-TARS Desktop markets itself as fully local when run with the local operator, keeping screenshots and control actions on-device rather than sending them to a third-party service.
What can Agent TARS actually do out of the box?The README shows demos like booking a Ritz-Carlton hotel near LAX via booking.com with a travel budget, and generating a month-long weather chart for Hangzhou using connected MCP servers.
How does the GUI agent actually control my computer?UI-TARS Desktop takes screenshots for visual recognition and then issues precise mouse and keyboard actions guided by the vision-language model's natural-language reasoning.
What is MCP integration used for?Agent TARS's kernel is built on the Model Context Protocol (MCP) and can mount MCP servers so the agent can call real-world tools beyond just GUI/browser control.
Is there a lighter-weight SDK if I don't want the full desktop app?Yes, the project also publishes a UI TARS SDK, described as a cross-platform toolkit for building your own GUI automation agents.
What are similar projects?midscene, UI-TARS, nanoMuse, qwen-code, claude-code, OmniParser, cua, fara
Which topics is it in?gui-agent, browser-use, vision, vlm, computer-use, browser-automation, multimodal, sdk, mcp-server, desktop, ai-agent, agent
Creator
bytedance
Size
188.5 MB
Stars
39.3K
Updated
CommitOct 09Releasev0.3.1Oct 08
Age
1y
Commits · 90 Days