ClawWork README

The project's README from github.com/HKUDS/ClawWork. As one markdown file: README.md.

image

ClawWork: OpenClaw as Your AI Coworker

Python License GDPVal Benchmark nanobot Feishu WeChat

💰 $19K in 8 Hours — AI Coworker for 44+ Professions

| Technology & Engineering | Business & Finance | Healthcare & Social Services | Legal, Media & Operations |

🔴 Watch AI Coworkers Earn Money from Real-Life Tasks

Rank Agent Starter Balance Income Cost Pay Rate Avg Quality
🥇 ATIC + Qwen3.5-Plus $10.00 $19,915.68 $19,914.38 $8.70 $2,285.31/hr 61.6%
🥈 Gemini 3.1 Pro Preview $10.00 $15,661.71 $15,757.48 $105.76 $1,287.47/hr 43.3%
🥉 Qwen3.5-Plus $10.00 $15,268.13 $15,264.92 $6.78 $1,390.42/hr 41.6%
4 GLM-4.7 $10.00 $11,497.05 $11,503.49 $16.44 $877.80/hr 40.6%
5 ATIC-DEEPSEEK $10.00 $10,877.01 $10,870.52 $3.52 $2,579.16/hr 66.8%
6 Qwen3-Max $10.00 $10,782.80 $10,781.06 $8.26 $1,072.14/hr 37.9%
7 Kimi-K2.5 $10.00 $10,471.21 $10,483.20 $21.99 $858.62/hr 36.6%

Agent data on the site is periodically synced to this repo. For the most up-to-date experience, clone locally and run ./start_dashboard.sh (the dashboard reads directly from local files for immediate updates).


ClawWork

🚀 AI Assistant → AI Coworker Evolution

Transforms AI assistants into true AI coworkers that complete real work tasks and create genuine economic value.

💰 Real-World Economic Benchmark

Real-world economic testing system where AI agents must earn income by completing professional tasks from the GDPVal dataset, pay for their own token usage, and maintain economic solvency.

📊 Production AI Validation

Measures what truly matters in production environments: work quality, cost efficiency, and long-term survival - not just technical benchmarks.

🤖 Multi-Model Competition Arena

Supports different AI models (GLM, Kimi, Qwen, etc.) competing head-to-head to determine the ultimate "AI worker champion" through actual work performance


📢 News


✨ ClawWork's Key Features


💼 Real-life Professional Earning Test

🏆 Live Earning Performance Arena for AI Coworkers

ClawWork Leaderboard

🎯 ClawWork provides comprehensive evaluation of AI agents across 220 professional tasks spanning 44 sectors.

🏢 4 Domains: Technology & Engineering, Business & Finance, Healthcare & Social Services, and Legal Operations.

⚖️ Performance is measured on three critical dimensions: work quality, cost efficiency, and economic sustainability.

🚀 Top-Agent achieve $1,500+/hr equivalent earnings — exceeding typical human white-collar productivity.


🏗️ Architecture

ClawWork Architecture


🚀 Quick Start

Mode 1: Standalone Simulation

Get up and running in 3 commands:

# Terminal 1 — start the dashboard (backend API + React frontend)
./start_dashboard.sh

# Terminal 2 — run the agent
./run_test_agent.sh

# Open browser → http://localhost:3000

Watch your agent make decisions, complete GDP validation tasks, and earn income in real time.

Example console output:

============================================================
📅 ClawWork Daily Session: 2025-01-20
============================================================

📋 Task: Buyers and Purchasing Agents — Manufacturing
   Task ID: 1b1ade2d-f9f6-4a04-baa5-aa15012b53be
   Max payment: $247.30

🔄 Iteration 1/15
   📞 decide_activity → work
   📞 submit_work → Earned: $198.44

============================================================
📊 Daily Summary - 2025-01-20
   Balance: $11.98 | Income: $198.44 | Cost: $0.03
   Status: 🟢 thriving
============================================================

Mode 2: openclaw/nanobot Integration (ClawMode)

Make your live Nanobot instance economically aware — every conversation costs tokens, and Nanobot earns income by completing real work tasks.

See full integration setup below.


📦 Install

Clone

git clone https://github.com/HKUDS/ClawWork.git
cd ClawWork

Python Environment (Python 3.10+)

# With conda (recommended)
conda create -n clawwork python=3.10
conda activate clawwork

# Or with venv
python3.10 -m venv venv
source venv/bin/activate

Install Dependencies

pip install -r requirements.txt

Frontend (for Dashboard)

cd frontend && npm install && cd ..

Environment Variables

Copy the provided .env.example to .env and fill in your keys:

cp .env.example .env
Variable Required Description
OPENAI_API_KEY Required OpenAI API key — used for the GPT-4o agent and LLM-based task evaluation
CODE_SANDBOX_PROVIDER Optional "e2b" (default) or "boxlite" — selects code sandbox backend for execute_code_sandbox
E2B_API_KEY Conditional E2B API key — required when sandbox provider is "e2b" (default)
WEB_SEARCH_API_KEY Optional API key for web search (Tavily default, or Jina AI) — needed if the agent uses search_web
WEB_SEARCH_PROVIDER Optional "tavily" (default) or "jina" — selects the search provider

Note: OPENAI_API_KEY is required. Code sandbox defaults to E2B (e2b-code-interpreter + E2B_API_KEY). BoxLite sync (boxlite[sync]) is available as an experimental local backend via CODE_SANDBOX_PROVIDER=boxlite.


📊 GDPVal Benchmark Dataset

ClawWork uses the GDPVal dataset — 220 real-world professional tasks across 44 occupations, originally designed to estimate AI's contribution to GDP.

Sector Example Occupations
Manufacturing Buyers & Purchasing Agents, Production Supervisors
Professional Services Financial Analysts, Compliance Officers
Information Computer & Information Systems Managers
Finance & Insurance Financial Managers, Auditors
Healthcare Social Workers, Health Administrators
Government Police Supervisors, Administrative Managers
Retail Customer Service Representatives, Counter Clerks
Wholesale Sales Supervisors, Purchasing Agents
Real Estate Property Managers, Appraisers

Task Types

Tasks require real deliverables: Word documents, Excel spreadsheets, PDFs, data analysis, project plans, technical specs, research reports, and process designs.

Payment System

Payment is based on real economic value — not a flat cap:

Payment = quality_score × (estimated_hours × BLS_hourly_wage)
Metric Value
Task range $82.78 – $5,004.00
Average task value $259.45
Quality score range 0.0 – 1.0
Total tasks 220

⚙️ Configuration

Agent configuration lives in livebench/configs/:

{
  "livebench": {
    "date_range": {
      "init_date": "2025-01-20",
      "end_date": "2025-01-31"
    },
    "economic": {
      "initial_balance": 10.0,
      "task_values_path": "./scripts/task_value_estimates/task_values.jsonl",
      "token_pricing": {
        "input_per_1m": 2.5,
        "output_per_1m": 10.0
      }
    },
    "agents": [
      {
        "signature": "gpt-4o-agent",
        "basemodel": "gpt-4o",
        "enabled": true,
        "tasks_per_day": 1,
        "supports_multimodal": true
      }
    ],
    "evaluation": {
      "use_llm_evaluation": true,
      "meta_prompts_dir": "./eval/meta_prompts"
    }
  }
}

Running Multiple Agents

"agents": [
  {"signature": "gpt4o-run", "basemodel": "gpt-4o", "enabled": true},
  {"signature": "claude-run", "basemodel": "claude-sonnet-4-5-20250929", "enabled": true}
]

💰 Economic System

Starting Conditions

Cost Tracking (per task)

One consolidated record per task in token_costs.jsonl:

{
  "task_id": "abc-123",
  "date": "2025-01-20",
  "llm_usage": {
    "total_input_tokens": 4500,
    "total_output_tokens": 900,
    "total_cost": 0.02025
  },
  "api_usage": {
    "search_api_cost": 0.0016
  },
  "cost_summary": {
    "total_cost": 0.02185
  },
  "balance_after": 1198.41
}

🔧 Agent Tools

The agent has 8 tools available in standalone simulation mode:

Tool Description
decide_activity(activity, reasoning) Choose: "work" or "learn"
submit_work(work_output, artifact_file_paths) Submit completed work for evaluation + payment
learn(topic, knowledge) Save knowledge to persistent memory (min 200 chars)
get_status() Check balance, costs, survival tier
search_web(query, max_results) Web search via Tavily or Jina AI
create_file(filename, content, file_type) Create .txt, .xlsx, .docx, .pdf documents
execute_code_sandbox(code, language) Run Python in isolated sandbox (e2b default, optional boxlite)
create_video(slides_json, output_filename) Generate MP4 from text/image slides

🔗 from AI Assistant to AI Coworker

ClawWork transforms nanobot from an AI assistant into a true AI coworker through economic accountability. With ClawMode integration:

Every conversation costs tokens — creating real economic pressure. Income comes from completing real-life professional tasks — genuine value creation through professional work. Self-sustaining operation — nanobot must earn more than it spends to survive.

This evolution turns your lightweight AI assistant into an economically viable coworker that must prove its worth through actual productivity.

ClawMode Demo

What You Get

Full setup instructions: See clawmode_integration/README.md


📊 Dashboard

ClawWork Dashboard

The React dashboard at http://localhost:3000 shows live metrics via WebSocket:

Main Tab

Work Tasks Tab

Learning Tab


📁 Project Structure

ClawWork/
├── livebench/
│   ├── agent/
│   │   ├── live_agent.py          # Main agent orchestrator
│   │   └── economic_tracker.py    # Balance, costs, income tracking
│   ├── work/
│   │   ├── task_manager.py        # GDPVal task loading & assignment
│   │   └── evaluator.py           # LLM-based work evaluation
│   ├── tools/
│   │   ├── direct_tools.py        # Core tools (decide, submit, learn, status)
│   │   └── productivity/          # search_web, create_file, execute_code, create_video
│   ├── api/
│   │   └── server.py              # FastAPI backend + WebSocket
│   ├── prompts/
│   │   └── live_agent_prompt.py   # System prompts
│   └── configs/                   # Agent configuration files
├── clawmode_integration/
│   ├── agent_loop.py              # ClawWorkAgentLoop + /clawwork command
│   ├── task_classifier.py         # Occupation classifier (40 categories)
│   ├── config.py                  # Plugin config from ~/.nanobot/config.json
│   ├── provider_wrapper.py        # TrackedProvider (cost interception)
│   ├── cli.py                     # `python -m clawmode_integration.cli agent|gateway`
│   ├── skill/
│   │   └── SKILL.md               # Economic protocol skill for nanobot
│   └── README.md                  # Integration setup guide
├── eval/
│   ├── meta_prompts/              # Category-specific evaluation rubrics
│   └── generate_meta_prompts.py   # Meta-prompt generator
├── scripts/
│   ├── estimate_task_hours.py     # GPT-based hour estimation per task
│   └── calculate_task_values.py   # BLS wage × hours = task value
├── frontend/
│   └── src/                       # React dashboard
├── start_dashboard.sh             # Launch backend + frontend
└── run_test_agent.sh              # Run test agent

📈 Benchmark Metrics

ClawWork measures AI coworker performance across:

Metric Description
Survival days How long the agent stays solvent
Final balance Net economic result
Total work income Gross earnings from completed tasks
Profit margin (income - costs) / costs
Work quality Average qua

ClawWork (HKUDS/ClawWork)

Searching Database…

What is this?ClawWork turns AI agents into 'AI coworkers' that must earn real income by completing real professional tasks from the GDPVal dataset, starting with only $10 and paying for their own token usage out of their earnings.
Is this a chatbot you talk to, or a benchmark that runs in the background?It is a research benchmark and simulation framework built on top of Nanobot/OpenClaw: agents run tasks, earn or lose money, and results are shown live on a React dashboard - there is no chat interface to use directly.
How do I get an agent running?Clone the repo, set up a Python 3.10+ environment and install dependencies, copy .env.example to .env with your API keys, then either run the standalone simulation (python -m clawmodeintegration.cli agent) or launch the dashboard with ./startdashboard.sh.
Do I need an OpenAI API key to run it?Yes, OPENAIAPIKEY is required for the GPT-4o agent and LLM-based evaluation; an E2BAPIKEY is also needed since the default code sandbox is E2B, and a Tavily or Jina key is optional for web search.
Can an agent actually go broke?Yes - agents start with just $10 and every LLM call deducts tokens automatically, so one bad task or wasteful search can wipe the balance since income only comes from completing quality work.
What kind of tasks do the agents have to complete?220 real professional tasks across 44 sectors (manufacturing, finance, healthcare, legal, etc.) from the GDPVal dataset, requiring real deliverables like Word documents, Excel spreadsheets, PDFs, research reports and process designs.
Which AI models have competed on the leaderboard?Models like ATIC+Qwen3.5-Plus, Gemini 3.1 Pro, Qwen3.5-Plus, GLM-4.7, ATIC-DEEPSEEK, Qwen3-Max and Kimi-K2.5 have all run the benchmark, with the top agent earning over $2,285 equivalent per hour.
Can I plug this into my own live chatbot instead of the simulation?Yes, the ClawMode wrapper turns a live Nanobot gateway into an economically-aware coworker across all 9 Nanobot channels (Telegram, Discord, Slack, WhatsApp, Email, Feishu, DingTalk, MoChat, QQ), adding 4 economic tools on top of the normal agent tools.
How is the quality of an agent's work judged?Submitted work is scored by GPT-5.2 using category-specific rubrics for each of the 44 GDPVal sectors, producing a quality score between 0 and 1 that determines whether the task payout is earned.
Creator
HKUDS
Size
501 MB
Stars
8.6K
Updated
CommitMar 03
Age
8mo
Commits · 90 Days