Meshroom README

The project's README from github.com/alicevision/Meshroom. As one markdown file: README.md.

Meshroom - 3D Reconstruction Software

Meshroom is an open-source, node-based visual programming framework—a flexible toolbox for creating, managing, and executing complex data processing pipelines.

Meshroom uses a nodal system where each node represents a specific operation, and output attributes can seamlessly feed into subsequent steps. When a node’s attribute is modified, only the affected downstream nodes are invalidated, while cached intermediate results are reused to minimize unnecessary computation.

Meshroom supports both local and distributed execution, enabling efficient parallel processing on render farms. It also includes interactive widgets for visualizing images and 3D data. Official releases come with built-in plugins for computer vision and machine learning tasks.

Ask DeepWiki CII Best Practices Build status

Get the project

You can download pre-compiled binaries for the latest release.

If you want to build it yourself, see INSTALL.md to setup the project and pre-requisites.

To use Meshroom with custom plugins, see INSTALL_PLUGINS.md.

Concepts

User Interface

The Meshroom UI is divided into several key areas:

Manual and Tutorials

Plugins bundled by default

AliceVision Plugin

AliceVision Website

AliceVision Repository

AliceVision provides state-of-the-art 3D Computer Vision and Machine Learning algorithms that analyze and understand image content to transform collections of regular 2D photographs into detailed 3D models, camera positions, and scene geometry. Born from collaboration between academia and industry, it delivers research-grade algorithms with production-level robustness and quality. The AliceVision plugin offers comprehensive pipelines for:

Segmentation Plugin

MrSegmentation: A set of nodes for AI-powered image segmentation from natural language prompts. The plugin leverages foundation models to automatically identify and isolate specific objects or regions in images based on textual descriptions, enabling intuitive content-aware processing workflows.

Other plugins

See MeshroomHub for more plugins.

DepthEstimation Plugin

MrDepthEstimation: A set of nodes for AI-based monocular depth estimation from image sequences. The plugin leverages deep learning models to predict depth information from single images, enabling depth estimation in new scenarios.

RoMa Plugin

MrRoma: A set of nodes for RoMa (robust dense feature matching). The plugin leverages foundation models to provide pixel-dense correspondence estimation with reliable certainty maps, enabling robust matching even under extreme variations in scale, illumination, viewpoint, and texture.

GSplat Plugin

MrGSplat: A set of nodes for 3D Gaussian Splatting reconstruction. The plugin integrates seamlessly with AliceVision's photogrammetry pipeline, allowing users to create Gaussian splat representations from multi-view images and to render new viewpoints.

Research Plugin

Meshroom Research A research-oriented plugin for evaluating and benchmarking cutting-edge Machine Learning algorithms in 3D Computer Vision. The plugin provides experimental nodes and evaluation frameworks to test new methodologies, compare algorithm performance, and validate research innovations before integration into production pipelines.

MicMac Plugin

MeshroomMicMac An exploratory plugin integrating MicMac's photogrammetric algorithms into Meshroom workflows. MicMac is a mature open-source photogrammetric software developed by the National Institute of Geographic and Forestry Information (French Mapping Agency, IGN) and the National School of Geographic Sciences (ENSG) within the LASTIG lab, offering specialized tools for surveying and mapping applications. While the plugin does not yet support Meshroom's full invalidation system, it provides fully functional pipelines for users seeking MicMac's specific photogrammetric capabilities.

Geolocation Plugin

MrGeolocation A plugin for geospatial integration that extracts GPS data from photographs and downloads contextual geographic information. The plugin automatically places 3D reconstructions within their real-world geographical environment by retrieving worldwide 2D maps (OpenStreetMap), global elevation models (NASA datasets), and high-resolution 3D Lidar models where available (France via IGN open data). This enables accurate georeferencing and contextual visualization of photogrammetric reconstructions.

License

The project is released under MPLv2, see COPYING.md.

Citation

@inproceedings{alicevision2021,
  title={{A}liceVision {M}eshroom: An open-source {3D} reconstruction pipeline},
  author={Carsten Griwodz and Simone Gasparini and Lilian Calvet and Pierre Gurdjos and Fabien Castan and Benoit Maujean and Gregoire De Lillo and Yann Lanthony},
  booktitle={Proceedings of the 12th ACM Multimedia Systems Conference - {MMSys '21}},
  doi = {10.1145/3458305.3478443},
  publisher = {ACM Press},
  year = {2021}
}

Contributing

We welcome contributions! Check out our Contribution Guidelines to get started. Whether you are a developer, designer, or documentation enthusiast, there is a place for you in the Meshroom community.

Contact

Use the public mailing-list to ask questions or request features. It is also a good place for informal discussions like sharing results, interesting related technologies or publications: [email protected]

You can also contact the core team privately on: [email protected].

Meshroom (alicevision/Meshroom)

Searching Database…

这是什么?Meshroom 是一个开源的、基于节点的可视化编程框架,用于构建和运行摄影测量及三维计算机视觉流程,可将一组二维照片转换为三维模型、相机轨迹、HDR 全景图等内容。
这是单一应用,还是带插件的可扩展框架?它是一个可扩展的节点式框架:核心程序自带图形编辑器(Graph Editor)、节点编辑器(Node Editor)以及二维/三维查看器,而真正的处理能力(三维重建、分割、深度估计、高斯泼溅)则来自可以自行添加或编写的独立插件。
我该怎么把它跑起来?可以下载最新版本的预编译二进制文件,也可以按照 INSTALL.md 从源代码构建并安装其前置依赖;INSTALLPLUGINS.md 则介绍如何添加自定义插件。
要让三维重建正常工作,我还需要单独配置 AliceVision 吗?不需要。官方发行版已内置 AliceVision 插件,因此三维重建、相机跟踪、HDR 融合和全景拼接流程开箱即用。
所有插件对 Meshroom 的智能缓存支持都一样吗?并不完全一样。MicMac 插件提供的流程功能完整,但尚不支持 Meshroom 完整的失效与缓存机制;核心的 AliceVision 插件则支持。
驱动三维重建的主要插件是什么?默认捆绑的 AliceVision 插件提供多视图三维重建、相机跟踪、HDR 融合、全景拼接和光度立体等流程。
我能把重型任务分布到多台机器上运行吗?可以。Meshroom 同时支持本地和分布式执行,可以将节点计算卸载到渲染农场,并自动管理节点锁定。
除了核心的 AliceVision 之外,还有哪些插件?官方扩展包括:MrSegmentation(基于 AI 的物体分割)、MrDepthEstimation(单目深度预测)、MrRoma(稠密特征匹配)、MrGSplat(三维高斯泼溅)以及 MrGeolocation(将重建结果放置到真实世界地图上)。
我能自己编写节点吗?可以。自定义插件既可以用 Python 编写,也可以封装外部命令行工具;更多社区插件可以在 MeshroomHub 上找到。
Size
13.3 MB
Stars
13K
Age
11y
Commits · 90 Days