deepopen-3d-webs README

项目的 README,来自 github.com/deepopen-com/deepopen-3d-webs。合并为一个 markdown 文件:README.md。

DeepOpen-3d-webs

中文 中文说明

Project Overview

DeepOpen-3d-webs is an image-driven 3D scene generation system. You supply one reference image and a prompt, and the system generates scene results along a camera trajectory that you can preview, replay, and trace. The official 3D demo assets play color/depth animations and Gaussian point clouds directly in the browser. The web app ships as a Docker image and listens on port 8090 by default.

1. Background and Goals

A single image rarely turns into spatial content you can look around in, move through, and hand off. The traditional pipeline splits depth estimation, image completion, 3D representation, and camera flythrough across separate tools, so creators can't carry a scene from start to finish in one interface.

Guangyu Zaojing collapses that chain into a single studio:

The system runs in demo mode by default. Without a GPU, the pages, the gallery's 3D demos, and task replay all remain usable. With CUDA and model weights available, you can switch to the full 3D generation engine.

2. Use Cases

3. Core Features

The system has five tabs.

Workbench

Summarizes total tasks, completed and failed counts, sample scene count, run mode, CUDA, disk, host, and service port. Click "Refresh System Data" to re-collect.

Scene Generation

Example Gallery

Lists examples by name, category, model, trajectory, and date. Previews show, together:

The status line indicates whether the 3D demo assets are mounted.

Task History

Generation actions are written to data/history.json. Official demo-* 3D demo tasks are preloaded. Enter an ID and click "View & Demo" to see task details, the reference image, both animations, the point cloud preview, and the PLY download together.

System Status

Shows host, OS, Python, CUDA, run mode, and the data directory, along with the recommended order of operations.

In demo mode, the preview loop runs on the input image; the official PLY / MP4 assets in the gallery and history can be demoed independently. When LD_DEMO_MODE=0 and the engine loads successfully, the full luciddreamer.py pipeline runs.

4. Tech Stack

Layer Technology
UI Gradio 3.50, multi-tab, Chinese
Web runtime Python 3.9, FastAPI, Starlette, Uvicorn
Image / video Pillow, NumPy, imageio
Scene generation LucidDreamer: diffusion inpainting, depth estimation, 3D Gaussians
Depth ZoeDepth
Gaussian rendering 3D Gaussian Splatting rasterization and simple-knn
Point cloud preview Down-sampling preview via webui/ply_preview.py
Task data Local JSON (data/history.json)
Delivery Docker Compose; demo image and CUDA image

The web image uses requirements-web.txt. Full / CUDA dependencies are in requirements.txt and requirements-cuda.txt. Local machine and CUDA notes are in RUN_CUDA.md.

4.1 Code Structure

guang-yu-zao-jing
├── web_app.py                 Web entry point, listens on 8090
├── luciddreamer.py            Main 3D generation pipeline
├── Dockerfile                 Demo image
├── Dockerfile.cuda            Full CUDA image
├── docker-compose.yml         Demo orchestration
├── docker-compose.cuda.yml    CUDA orchestration
├── requirements-web.txt       Web dependencies
├── requirements-cuda.txt      CUDA dependencies
├── RUN_CUDA.md / start_*.bat  Local and CUDA start guide
├── webui
│   ├── app.py                 Five tabs
│   ├── engine.py              One-click / step-by-step generation and demo fallback
│   ├── catalog.py             Example gallery
│   ├── history.py             Task history and demo-* assets
│   ├── ply_preview.py         PLY down-sampling and browser preview
│   ├── stats.py / styles.py   Workbench stats and styling
│   └── paths.py               Data and output paths
├── scene / gaussian_renderer  Gaussian scene and rendering
├── utils / cameras / ZoeDepth
├── submodules                 Rasterization and simple-knn
├── examples                   Example images, prompts, official PLY / MP4
├── assets / data / outputs
├── scripts                    Deployment and local CUDA install/start scripts
└── docs                       Deployment docs, user manual, and screenshots
flowchart LR
  Browser[Browser] --> WebApp[web_app.py]
  WebApp --> UI[webui tabs]
  UI --> Engine[engine.py]
  Engine --> Demo[Demo preview]
  Engine --> Core[luciddreamer.py]
  Core --> Depth[ZoeDepth]
  Core --> Gauss[Gaussian scene and rendering]
  UI --> History[history and demo assets]
  History --> Examples[examples PLY/MP4]
  UI --> PlyPrev[ply_preview point cloud preview]
  Engine --> Outputs[outputs and results]

5. UI Preview

All screenshots are from docs/user/images/.

Scene Generation

Generation result

Example Gallery · Reference image and 3D demo

Example preview

Color and depth animation

Point cloud preview and PLY

Task History · View & Demo

View & Demo

Point cloud and full Gaussian download

6. Getting Started

6.1 Requirements

6.2 Startup

Demo (no GPU / default):

docker compose up -d --build

Linux server with GPU:

docker compose -f docker-compose.cuda.yml up -d --build

On Windows you can also double-click start_demo.bat / start_cuda.bat, or follow RUN_CUDA.md.

View logs and stop:

docker compose logs -f
docker compose down

6.3 Access

Local:

http://127.0.0.1:8090

Server:

http://<server-ip>:8090

6.4 Accounts

There is no login. Anyone who can open the address above in a browser can use the system. In production, restrict access by source with a firewall or reverse proxy.

7. Typical Workflow

  1. Open the workbench and confirm the run mode and free disk space.

  2. In the example gallery, pick an entry such as "Anime Lakeside Cabin" and click "Preview Example" to see the reference image, both animations, and the point cloud; download the full PLY if you need it.

  3. Or, in task history, enter demo-animelake / demo-girl and click "View & Demo".

  4. Go to Scene Generation, load an example or upload an image, and confirm the model, prompts, generation trajectory, and render trajectory.

  5. Click "One-Click Generate". To bake the space only, use "Step 1 · Generate Gaussians"; to change the camera moves, use "Step 2 · Render Video".

  6. Check the preview in the results area, then look up the details and media under the new task ID in Task History.

deepopen-3d-webs (deepopen-com/deepopen-3d-webs)

正在搜索数据库…

这是什么?光域造景(Guangyu Zaojing)是一个由图像驱动的 3D 场景生成系统:你提供一张参考图和一段文字提示词,它会沿着相机轨迹生成 3D 场景,你可以预览、回放和追踪,并输出颜色/深度动画以及高斯点云。
这是桌面应用,还是要在浏览器里打开?这是一个自托管的网页应用:它以 Docker 镜像形式发布,在 FastAPI/Uvicorn 之上运行 Gradio 界面,默认监听 8090 端口,因此你需要在浏览器中打开它。
怎么把它跑起来?使用 Docker Compose 部署(需要 Docker Engine 24+,并且可用 compose);演示模式不需要 GPU,默认的 Dockerfile 就够用了。在 Windows 上,你也可以直接双击 startdemo.bat 或 startcuda.bat,然后打开 http://localhost:8090。
如果没有 GPU,或者模型权重加载失败,会怎样?系统会自动切换到演示模式:图库中官方的演示素材和任务历史回放仍可使用,但你无法生成新场景,只能预览预加载的示例。
有登录或访问控制吗?没有——不需要登录,任何能在浏览器中打开应用网址的人都能使用它,因此用于生产环境时,你需要自己通过防火墙或反向代理来限制访问。
可以选择哪些扩散模型和相机轨迹?四个基于 Stable Diffusion 的模型检查点(SD1.5、Blazing Drive V11m、Realistic Vision V5.1、Cartoon Pixar V5),三种生成轨迹(环视、俯视环绕、原地 360 度旋转),以及三种渲染轨迹(推进与拉远、经典环绕、轻微摇摆)。
生成的场景可以导出什么?完整的 PLY 高斯点云(可能有数百 MB),可用于 SuperSplat 或 MeshLab,此外还有沿所选相机轨迹渲染的颜色和深度预览动画。
为什么浏览器里显示的是点云,而不是带纹理的 3D 模型?场景是通过 LucidDreamer 流程(扩散修复加 ZoeDepth 深度估计)烘焙为 3D 高斯溅射的,因此查看器显示的是可拖动的高斯点云,而不是常规网格模型。
大小
30.7 MB
星标
1.1K
更新
提交Nov 05
时长
23天
提交 · 90 天