Embodied-AI-Start README

The project's README from github.com/ppsdk/Embodied-AI-Start. As one markdown file: README.md.

Embodied AI Starter Map | 具身智能入门

在线文档站:Github Pages

具身智能学习地图,面向想从机器人基础走到 VLA、World Model、RL/MBRL 和 WAM 的读者。

内容从坐标系、运动学、动力学、ROS 2、仿真和控制流程开始,逐步连接到视觉语言动作策略、动作生成、世界模型、模型辅助强化学习和世界动作模型。每条路线都配有论文、开源代码、benchmark 与实践入口,并把 observation、action、时间对齐、闭环评测和真机部署放在同一条链路里。

可以把它当作阅读索引,也可以按教程从 MuJoCo、Isaac Sim 或 ROS 2 Humble 开始动手。

具身智能学习框架图

先从你的目标开始

主路线 适合你如果… 起点
🤖 Robotics 想先搞懂坐标、控制和真机 机器人学基础
👁️ VLA 想研究视觉、语言和动作策略 VLA 专题
🌍 World Model 想做未来预测、生成或 WAM WM 专题
🔗 WAM 想研究未来世界与动作联合建模 WAM 专题
🎮 RL / MBRL 想做强化学习、规划和策略后训练 强化学习基础

更多目标 → MuJoCo · Isaac Sim · XPolicyLab · 真机实践 · Benchmark

按具体任务查入口

你想做什么 先看什么 后面接什么
先看懂全貌 知识图谱 学习路线
跑一个 RL 示例 强化学习基础 MuJoCo 教程
学机器人坐标、TF 和规划 机器人学基础 RViz 2、MoveIt 2、ros2_control
跑 GPU 并行仿真 Isaac Sim 教程 Isaac Lab、ManiSkill
从仿真走到真实机械臂 机器人学基础 手眼标定、ros2_control、rosbag2 和 Piper 实践
研究 VLA 或动作策略 VLA 专题 论文清单 和 OpenVLA/OpenPI
研究 World Model WM 专题 pixel、latent、对象中心、3D/4D 和闭环验证
研究 WAM WAM 专题 论文清单
做机器人策略后训练 RL / MBRL 专题 PPO、GRPO、SAPO、RLinf
适配 RoboDojo/XPolicyLab XPolicyLab 教程 debug 评测、策略服务和环境接入

如果你还没有明确方向,按这个顺序读即可:

flowchart LR
    K["知识图谱"] --> R["机器人学基础"]
    R --> M["模型基础"]
    M --> CHOOSE{"选择研究路线"}
    CHOOSE --> VLA["VLA"]
    CHOOSE --> WM["WM"]
    CHOOSE --> RL["RL"]
    CHOOSE --> WAM["WAM"]
    VLA --> REAL["真机学习"]
    WM --> REAL
    RL --> REAL
    WAM --> REAL

一张图看懂几条路线

flowchart LR
    O["观测与状态"] --> P["表征与预测"]
    P --> A["动作生成"]
    A --> C["控制执行"]
    C --> E["评测与恢复"]

    P --> VLM["VLM / VLA 表征"]
    P --> WM["WM:预测未来世界"]
    P --> DYN["动力学模型"]
    DYN --> MBRL["MBRL:用模型规划"]
    WM --> WAM["WAM:未来与动作联合"]
    VLM --> VLA["VLA:视觉语言到动作"]
    VLA --> A
    WAM --> A
    MBRL --> A
    E -->|"反馈"| O

文档地图

🧭 基础

🌍 研究方向

🧪 仿真与实践

ROS 2、OpenCV 和机器人依赖安装可参考鱼香 ROS 社区论坛。机器人章节统一以 Ubuntu 22.04 + ROS 2 Humble 为基线。

🤖 从仿真到真机

仓库结构

.
├── README.md
├── docs/
│   ├── knowledge-map.md
│   ├── robotics.md
│   ├── model-basics.md
│   ├── reinforcement-learning.md
│   ├── vla.md
│   ├── wam.md
│   ├── mbrl.md
│   ├── world-model-directions.md
│   ├── mujoco-tutorial.md
│   ├── isaac-sim-tutorial.md
│   ├── xpolicylab-tutorial.md
│   ├── papers.md
│   ├── codebases.md
│   ├── benchmarks.md
│   ├── roadmap.md
│   └── glossary.md
├── examples/hand_eye_calibration/
├── CONTRIBUTING.md
└── LICENSE

Embodied-AI-Start Star 趋势图

致谢

感谢所有公开论文、代码、数据集、仿真器和教程的作者与维护者。本仓库的学习路径和资源索引参考了以下项目:

本仓库链接的代码、论文、数据和许可证归原作者及维护者所有。链接只用于学习导航和交叉引用,不代表与相关项目存在官方合作或背书关系。使用代码或数据时,请以原项目的许可证、引用要求和当前文档为准。

Embodied-AI-Start (ppsdk/Embodied-AI-Start)

Searching Database…

What is this?A Chinese-language 'Embodied AI Starter Map' that organizes a learning path from robotics fundamentals (coordinates, kinematics, ROS 2) up to VLA policies, World Models, model-based RL and World Action Models (WAM), linking papers, code, benchmarks and practice guides at each step.
Is this a runnable codebase or just a reading index?It is purely a documentation/index repository of markdown pages and links — the author says you can treat it as a reading index or follow tutorials starting with MuJoCo, Isaac Sim or ROS 2 Humble, but the actual runnable code lives in the external linked projects.
Where should a beginner start?Start from the main route table and pick a track based on your goal — Robotics, VLA, World Model, WAM or RL/MBRL — each one links to an entry page like Robotics Basics or RL Basics; if unsure, start from the Knowledge Graph overview page.
Do I need ROS 2 or a simulator installed to follow this?The robotics chapters assume Ubuntu 22.04 with ROS 2 Humble as the baseline, and the hands-on tutorials use MuJoCo+Gymnasium or Isaac Sim; ROS 2/OpenCV install guidance is pointed to an external community forum rather than included here.
Does it include the actual model implementations, or just references?Just references — model and policy code (OpenVLA, OpenPI, Diffusion Policy, LeRobot, V-JEPA 2, TD-MPC2, DreamerV3, etc.) and benchmarks live in their original repos; for real hardware demos like the Piper arm or bimanual-vla, exact commands depend on the original project's own README.
Who is this guide meant for?Researchers and learners who already know some robotics basics (or want to pick them up) and want a structured path into VLA, World Models, MBRL and WAM, with papers, code and benchmarks mapped out for each direction.
What is the difference between a World Model (WM) and a World Action Model (WAM)?VLA learns directly from vision and language to action; WM predicts future states conditioned on actions; WAM structurally feeds that future prediction back into action generation, tying future representation, training-time supervision and asynchronous execution together.
Is a World Model the same thing as video generation?No — the README explicitly states WM is not equal to video generation and MBRL does not require a video-based WM; whether something counts as a full robotic World Model depends on action-conditioning, future goals, and closed-loop evidence, not on generating video.
What benchmarks does the guide cover?It surveys LIBERO, CALVIN, ManiSkill, Meta-World, RoboDojo, RoboTwin, RoboCasa and DMControl, explaining each one's intended use and the boundaries for fair comparison between them.
Can I follow a path from simulation to a real robot arm?Yes — there's a dedicated sim-to-real track covering eye-hand calibration, ros2control and rosbag2 leading to a real Piper arm under ROS 2 Humble, plus a bimanual-vla reference for dual-arm VLA deployment.
Creator
ppsdk
Size
3.3 MB
Stars
199
Updated
CommitSep 17
Age
1mo
Commits · 90 Days