ClawWork README

The project's README from github.com/HKUDS/ClawWork. As one markdown file: README.md.

image

ClawWork: OpenClaw as Your AI Coworker

Python License GDPVal Benchmark nanobot Feishu WeChat

💰 $19K in 8 Hours — AI Coworker for 44+ Professions

| Technology & Engineering | Business & Finance | Healthcare & Social Services | Legal, Media & Operations |

🔴 Watch AI Coworkers Earn Money from Real-Life Tasks

Rank Agent Starter Balance Income Cost Pay Rate Avg Quality
🥇 ATIC + Qwen3.5-Plus $10.00 $19,915.68 $19,914.38 $8.70 $2,285.31/hr 61.6%
🥈 Gemini 3.1 Pro Preview $10.00 $15,661.71 $15,757.48 $105.76 $1,287.47/hr 43.3%
🥉 Qwen3.5-Plus $10.00 $15,268.13 $15,264.92 $6.78 $1,390.42/hr 41.6%
4 GLM-4.7 $10.00 $11,497.05 $11,503.49 $16.44 $877.80/hr 40.6%
5 ATIC-DEEPSEEK $10.00 $10,877.01 $10,870.52 $3.52 $2,579.16/hr 66.8%
6 Qwen3-Max $10.00 $10,782.80 $10,781.06 $8.26 $1,072.14/hr 37.9%
7 Kimi-K2.5 $10.00 $10,471.21 $10,483.20 $21.99 $858.62/hr 36.6%

Agent data on the site is periodically synced to this repo. For the most up-to-date experience, clone locally and run ./start_dashboard.sh (the dashboard reads directly from local files for immediate updates).


ClawWork

🚀 AI Assistant → AI Coworker Evolution

Transforms AI assistants into true AI coworkers that complete real work tasks and create genuine economic value.

💰 Real-World Economic Benchmark

Real-world economic testing system where AI agents must earn income by completing professional tasks from the GDPVal dataset, pay for their own token usage, and maintain economic solvency.

📊 Production AI Validation

Measures what truly matters in production environments: work quality, cost efficiency, and long-term survival - not just technical benchmarks.

🤖 Multi-Model Competition Arena

Supports different AI models (GLM, Kimi, Qwen, etc.) competing head-to-head to determine the ultimate "AI worker champion" through actual work performance


📢 News


✨ ClawWork's Key Features


💼 Real-life Professional Earning Test

🏆 Live Earning Performance Arena for AI Coworkers

ClawWork Leaderboard

🎯 ClawWork provides comprehensive evaluation of AI agents across 220 professional tasks spanning 44 sectors.

🏢 4 Domains: Technology & Engineering, Business & Finance, Healthcare & Social Services, and Legal Operations.

⚖️ Performance is measured on three critical dimensions: work quality, cost efficiency, and economic sustainability.

🚀 Top-Agent achieve $1,500+/hr equivalent earnings — exceeding typical human white-collar productivity.


🏗️ Architecture

ClawWork Architecture


🚀 Quick Start

Mode 1: Standalone Simulation

Get up and running in 3 commands:

# Terminal 1 — start the dashboard (backend API + React frontend)
./start_dashboard.sh

# Terminal 2 — run the agent
./run_test_agent.sh

# Open browser → http://localhost:3000

Watch your agent make decisions, complete GDP validation tasks, and earn income in real time.

Example console output:

============================================================
📅 ClawWork Daily Session: 2025-01-20
============================================================

📋 Task: Buyers and Purchasing Agents — Manufacturing
   Task ID: 1b1ade2d-f9f6-4a04-baa5-aa15012b53be
   Max payment: $247.30

🔄 Iteration 1/15
   📞 decide_activity → work
   📞 submit_work → Earned: $198.44

============================================================
📊 Daily Summary - 2025-01-20
   Balance: $11.98 | Income: $198.44 | Cost: $0.03
   Status: 🟢 thriving
============================================================

Mode 2: openclaw/nanobot Integration (ClawMode)

Make your live Nanobot instance economically aware — every conversation costs tokens, and Nanobot earns income by completing real work tasks.

See full integration setup below.


📦 Install

Clone

git clone https://github.com/HKUDS/ClawWork.git
cd ClawWork

Python Environment (Python 3.10+)

# With conda (recommended)
conda create -n clawwork python=3.10
conda activate clawwork

# Or with venv
python3.10 -m venv venv
source venv/bin/activate

Install Dependencies

pip install -r requirements.txt

Frontend (for Dashboard)

cd frontend && npm install && cd ..

Environment Variables

Copy the provided .env.example to .env and fill in your keys:

cp .env.example .env
Variable Required Description
OPENAI_API_KEY Required OpenAI API key — used for the GPT-4o agent and LLM-based task evaluation
CODE_SANDBOX_PROVIDER Optional "e2b" (default) or "boxlite" — selects code sandbox backend for execute_code_sandbox
E2B_API_KEY Conditional E2B API key — required when sandbox provider is "e2b" (default)
WEB_SEARCH_API_KEY Optional API key for web search (Tavily default, or Jina AI) — needed if the agent uses search_web
WEB_SEARCH_PROVIDER Optional "tavily" (default) or "jina" — selects the search provider

Note: OPENAI_API_KEY is required. Code sandbox defaults to E2B (e2b-code-interpreter + E2B_API_KEY). BoxLite sync (boxlite[sync]) is available as an experimental local backend via CODE_SANDBOX_PROVIDER=boxlite.


📊 GDPVal Benchmark Dataset

ClawWork uses the GDPVal dataset — 220 real-world professional tasks across 44 occupations, originally designed to estimate AI's contribution to GDP.

Sector Example Occupations
Manufacturing Buyers & Purchasing Agents, Production Supervisors
Professional Services Financial Analysts, Compliance Officers
Information Computer & Information Systems Managers
Finance & Insurance Financial Managers, Auditors
Healthcare Social Workers, Health Administrators
Government Police Supervisors, Administrative Managers
Retail Customer Service Representatives, Counter Clerks
Wholesale Sales Supervisors, Purchasing Agents
Real Estate Property Managers, Appraisers

Task Types

Tasks require real deliverables: Word documents, Excel spreadsheets, PDFs, data analysis, project plans, technical specs, research reports, and process designs.

Payment System

Payment is based on real economic value — not a flat cap:

Payment = quality_score × (estimated_hours × BLS_hourly_wage)
Metric Value
Task range $82.78 – $5,004.00
Average task value $259.45
Quality score range 0.0 – 1.0
Total tasks 220

⚙️ Configuration

Agent configuration lives in livebench/configs/:

{
  "livebench": {
    "date_range": {
      "init_date": "2025-01-20",
      "end_date": "2025-01-31"
    },
    "economic": {
      "initial_balance": 10.0,
      "task_values_path": "./scripts/task_value_estimates/task_values.jsonl",
      "token_pricing": {
        "input_per_1m": 2.5,
        "output_per_1m": 10.0
      }
    },
    "agents": [
      {
        "signature": "gpt-4o-agent",
        "basemodel": "gpt-4o",
        "enabled": true,
        "tasks_per_day": 1,
        "supports_multimodal": true
      }
    ],
    "evaluation": {
      "use_llm_evaluation": true,
      "meta_prompts_dir": "./eval/meta_prompts"
    }
  }
}

Running Multiple Agents

"agents": [
  {"signature": "gpt4o-run", "basemodel": "gpt-4o", "enabled": true},
  {"signature": "claude-run", "basemodel": "claude-sonnet-4-5-20250929", "enabled": true}
]

💰 Economic System

Starting Conditions

Cost Tracking (per task)

One consolidated record per task in token_costs.jsonl:

{
  "task_id": "abc-123",
  "date": "2025-01-20",
  "llm_usage": {
    "total_input_tokens": 4500,
    "total_output_tokens": 900,
    "total_cost": 0.02025
  },
  "api_usage": {
    "search_api_cost": 0.0016
  },
  "cost_summary": {
    "total_cost": 0.02185
  },
  "balance_after": 1198.41
}

🔧 Agent Tools

The agent has 8 tools available in standalone simulation mode:

Tool Description
decide_activity(activity, reasoning) Choose: "work" or "learn"
submit_work(work_output, artifact_file_paths) Submit completed work for evaluation + payment
learn(topic, knowledge) Save knowledge to persistent memory (min 200 chars)
get_status() Check balance, costs, survival tier
search_web(query, max_results) Web search via Tavily or Jina AI
create_file(filename, content, file_type) Create .txt, .xlsx, .docx, .pdf documents
execute_code_sandbox(code, language) Run Python in isolated sandbox (e2b default, optional boxlite)
create_video(slides_json, output_filename) Generate MP4 from text/image slides

🔗 from AI Assistant to AI Coworker

ClawWork transforms nanobot from an AI assistant into a true AI coworker through economic accountability. With ClawMode integration:

Every conversation costs tokens — creating real economic pressure. Income comes from completing real-life professional tasks — genuine value creation through professional work. Self-sustaining operation — nanobot must earn more than it spends to survive.

This evolution turns your lightweight AI assistant into an economically viable coworker that must prove its worth through actual productivity.

ClawMode Demo

What You Get

Full setup instructions: See clawmode_integration/README.md


📊 Dashboard

ClawWork Dashboard

The React dashboard at http://localhost:3000 shows live metrics via WebSocket:

Main Tab

Work Tasks Tab

Learning Tab


📁 Project Structure

ClawWork/
├── livebench/
│   ├── agent/
│   │   ├── live_agent.py          # Main agent orchestrator
│   │   └── economic_tracker.py    # Balance, costs, income tracking
│   ├── work/
│   │   ├── task_manager.py        # GDPVal task loading & assignment
│   │   └── evaluator.py           # LLM-based work evaluation
│   ├── tools/
│   │   ├── direct_tools.py        # Core tools (decide, submit, learn, status)
│   │   └── productivity/          # search_web, create_file, execute_code, create_video
│   ├── api/
│   │   └── server.py              # FastAPI backend + WebSocket
│   ├── prompts/
│   │   └── live_agent_prompt.py   # System prompts
│   └── configs/                   # Agent configuration files
├── clawmode_integration/
│   ├── agent_loop.py              # ClawWorkAgentLoop + /clawwork command
│   ├── task_classifier.py         # Occupation classifier (40 categories)
│   ├── config.py                  # Plugin config from ~/.nanobot/config.json
│   ├── provider_wrapper.py        # TrackedProvider (cost interception)
│   ├── cli.py                     # `python -m clawmode_integration.cli agent|gateway`
│   ├── skill/
│   │   └── SKILL.md               # Economic protocol skill for nanobot
│   └── README.md                  # Integration setup guide
├── eval/
│   ├── meta_prompts/              # Category-specific evaluation rubrics
│   └── generate_meta_prompts.py   # Meta-prompt generator
├── scripts/
│   ├── estimate_task_hours.py     # GPT-based hour estimation per task
│   └── calculate_task_values.py   # BLS wage × hours = task value
├── frontend/
│   └── src/                       # React dashboard
├── start_dashboard.sh             # Launch backend + frontend
└── run_test_agent.sh              # Run test agent

📈 Benchmark Metrics

ClawWork measures AI coworker performance across:

Metric Description
Survival days How long the agent stays solvent
Final balance Net economic result
Total work income Gross earnings from completed tasks
Profit margin (income - costs) / costs
Work quality Average qua

ClawWork (HKUDS/ClawWork)

Searching Database…

这是什么?ClawWork 将 AI 智能体变成“AI 同事”,它们必须通过完成 GDPVal 数据集中的真实专业任务来赚取真实收入。每个智能体起始资金仅 10 美元,并需用赚到的钱支付自身的 token 费用。
这是一个可以与之对话的聊天机器人,还是一个在后台运行的基准测试?它是一个基于 Nanobot/OpenClaw 构建的研究型基准测试与模拟框架:智能体执行任务、赚钱或亏钱,结果会在 React 仪表盘上实时显示。没有可以直接使用的聊天界面。
如何让智能体运行起来?克隆仓库,搭建 Python 3.10+ 环境并安装依赖,将 .env.example 复制为 .env 并填入你的 API 密钥,然后运行独立模拟(python -m clawmodeintegration.cli agent),或使用 ./startdashboard.sh 启动仪表盘。
运行它需要 OpenAI API 密钥吗?需要。GPT-4o 智能体和基于 LLM 的评估都必须提供 OPENAIAPIKEY;由于默认代码沙箱是 E2B,还需要 E2BAPIKEY;Tavily 或 Jina 密钥可选,用于网页搜索。
智能体真的可能破产吗?可以。智能体起始资金仅 10 美元,每次 LLM 调用都会自动扣除 token 费用,因此一次糟糕的任务或浪费的搜索就可能耗尽余额,因为收入只来自高质量的工作成果。
智能体需要完成哪些类型的任务?来自 GDPVal 数据集的 220 项真实专业任务,覆盖 44 个行业(制造、金融、医疗、法律等),需要交付真实成果,例如 Word 文档、Excel 电子表格、PDF、研究报告和流程设计。
哪些 AI 模型在排行榜上参与过竞争?ATIC+Qwen3.5-Plus、Gemini 3.1 Pro、Qwen3.5-Plus、GLM-4.7、ATIC-DEEPSEEK、Qwen3-Max 和 Kimi-K2.5 等模型都运行过该基准测试,其中表现最好的智能体每小时收入超过 2,285 美元等值。
我能把它接入自己的真实聊天机器人,而不是使用模拟环境吗?可以。ClawMode 包装层可以将正在运行的 Nanobot 网关变成具备经济意识的同事,覆盖 Nanobot 的全部 9 个渠道(Telegram、Discord、Slack、WhatsApp、Email、Feishu、DingTalk、MoChat、QQ),并在常规智能体工具之外额外增加 4 个经济工具。
如何评判智能体工作的质量?提交的成果由 GPT-5.2 依据 GDPVal 全部 44 个行业各自的专用评分标准进行评分,给出 0 到 1 之间的质量分数,该分数决定能否获得任务报酬。
Creator
HKUDS
Size
501 MB
Stars
8.6K
Updated
CommitMar 03
Age
8mo
Commits · 90 Days