3d-model-anything README

项目的 README,来自 github.com/wesbos/3d-model-anything。合并为一个 markdown 文件:README.md。

3D Model Anything

Watch the video: 3D Model Anything

Capture a room on an iPhone, then use its geometry and photographs to build an editable Three.js scene with an AI coding agent.

Open the office viewer · App support

This repository includes the 3D Model Anything iPhone app, a Three.js viewer, the scan-to-threejs agent skill, and Wes’s detailed office demo.

The app records the evidence. The skill guides an agent through measurement, modeling and matched-camera visual comparisons. This is an iterative reconstruction workflow, not a one-click scan-to-perfect-model converter. The current workflow focuses on rooms and interiors.

Run the viewer

Use Node.js 22.12+ (or a newer supported release).

npm ci
npm run dev

Open http://localhost:5188. Explore the office in dollhouse, walking, overhead, wireframe and knolling views. The playground is at /play.html?room=office-v4&mode=fpv.

npm run build
npm run preview

The demo includes the reconstructed office and selected textures. Original scans and photo collections are not distributed; Scan and Overlay are disabled for this example. Those modes remain available for your own rooms with reference assets.

Capture your own space

See the iPhone app for building with Xcode, device requirements, scanning and sharing. Scanning needs a LiDAR-equipped iPhone or iPad. Non-LiDAR devices can import and review scans.

The app is source-available here; an App Store release is a separate distribution step. Do not assume an App Store download is available yet.

Export a room or session through the system share sheet and extract it into an ignored data/captures-in/<room>/ directory. Exports keep the existing house-capture/5 contract; changing the app name does not change the files.

Use the skill

The skill lives at .agents/skills/scan-to-threejs/SKILL.md. Open this repository in an agent that supports local skills and ask it to use scan-to-threejs with your extracted export. You can also copy that skill directory into your agent's skill directory; the companion viewer/runtime in this repo is still needed for its capture workflow.

Example request:

Use scan-to-threejs to rebuild the room in data/captures-in/my-room. Inspect the measurements and photos, create an editable scene, and compare rendered views with the original photographs.

Start with the format guide and project layout. Helpers need Python 3; photo comparisons need Pillow, and optional depth reconstruction needs NumPy, Open3D and Pillow. Capture scripts use the agent-browser CLI.

A new room goes in demos/<id>/ and is registered in demos/index.ts. The office example retains its earlier reconstruction layers (office-v2, office-latest, office-v4) to preserve the final geometry.

Privacy and licensing

Only the office example is distributed. No other rooms, connected-house layout, original scan bundles, or development Git history are included. Keep your captures private; inspect assets before publishing your own demo.

Reusable source code and the skill are MIT licensed. The supplied office images/textures have separate asset terms. Third-party marks, artwork and depicted products are not licensed by the code license.

See release status for validation and iPhone distribution steps.

3d-model-anything (wesbos/3d-model-anything)

正在搜索数据库…

这是什么?这是一套工具,可以用 iPhone 的 LiDAR 和摄像头扫描房间,然后借助 AI 编程代理,把扫描结果转换成可编辑的 Three.js 3D 场景。
这是一个应用,还是几个部分协同工作?它包含四个部分:用于录制扫描的 iPhone 应用 3D Model Anything、Three.js 浏览器查看器、用于指导重建过程的代理技能 scan-to-threejs,以及一个办公室示例。
我怎样试用自带的示例?安装 Node.js 22.12 或更高版本,然后在本地打开查看器,即可体验重建后的办公室,包括俯视洋娃娃屋、第一人称步行、俯视、线框和平铺整理等视图。例如访问 /play.html?room=office-v4&mode=fpv。
要扫描并处理我自己的房间,需要准备什么?扫描需要配备 LiDAR 的 iPhone 或 iPad,并需要 Xcode 来编译应用;重建辅助工具需要 Python 3,照片比对需要 Pillow,深度重建可选装 NumPy 和 Open3D。
扫描后会自动得到成品 3D 模型吗?不会。这是一个由代理指导的反复迭代重建流程,并不是一键把扫描转换成完美模型的工具,而且目前只支持房间和室内空间。
这个 iPhone 应用现在已经上架 App Store 了吗?还没有。目前该应用只能在本仓库中获取源代码;上架 App Store 是一个单独的发布步骤,尚未确定。
这个仓库里包含别人扫描的房间吗?不包含。仓库只分发办公室示例;原始扫描、互联房屋布局和开发历史都已排除,并且会提醒用户自行保管好自己的扫描数据。
授权情况如何?代码和代理技能采用 MIT 许可证,但办公室示例中的图片和纹理有单独的素材条款;第三方商标或所展示的产品不受代码许可证覆盖。
scan-to-threejs 技能实际做什么?它会指导 AI 编程代理测量导出的扫描数据、在 Three.js 中建模房间,并将渲染视图与原始照片对比,以提高精度。
我怎样把自己的扫描数据交给代理?通过 iPhone 应用的分享菜单,将房间导出到本地的 data/captures-in/ 文件夹,然后让支持本地技能的代理对该导出数据运行 scan-to-threejs。
如果我的手机没有 LiDAR,还能用吗?没有 LiDAR 的 iPhone 和 iPad 仍然可以导入和查看已有的扫描数据,但无法进行基于 LiDAR 的扫描采集。
查看器的新房间应该添加到哪里?每个新房间都放入 demos/ 文件夹,并在 demos/index.ts 中注册,这样 Three.js 查看器才能加载它。
作者
wesbos
大小
35.2 MB
星标
3.1K
更新
提交Oct 22
时长
28天
提交 · 90 天