Topics / #segmentation

Segmentation projects on GitHub

Neural networks partitioning images into meaningful regions.

As of , the most-starred Segmentation projects on GitHub are segment-anything (55K stars), ControlNet (34.1K stars) and TaskMatrix (34K stars). GitHub.Locker tracks 33 Segmentation repositories with 467.6K stars combined. The fastest-growing on October 17 was VisionHOPE, with +98 stars in a day.

33Projects
467.6KStars in total
+208Stars in a day
Browse in the catalog →github.com/topics/segmentation ↗

Hot right now

Most stars gained in a day · Oct 17

+98

VisionHOPE

PSRben/VisionHOPE · ★ 1.3K

VisionHOPE is the official PyTorch implementation of a visual backbone built on self-referential nested learning (SRNL), supporting ImageNet-1K classification, COCO detection/instance segmentation, and ADE20K semantic segmentation.

+39

Genjustsu-Open-Source-Workflow

sirioberati/Genjustsu-Open-Source-Workflow · ★ 986

Genjustsu is an open-source workflow for replacing characters or objects in a video using colored depth maps, SAM 3 segmentation masks and optional face mesh tracking, then generating the replacement with Seedance through the Enhancor API. It runs a local web UI to prepare inputs, review masks, preview drafts, and export the result with the original audio restored.

+13

rembg

danielgatis/rembg · ★ 25.1K

Rembg removes the background from images using AI segmentation models. Feed it a photo and it returns a cutout with a transparent background — as a terminal command, a Python function, or an HTTP call.

+11

sam3

facebookresearch/sam3 · ★ 12K

SAM 3 is Meta's unified foundation model for promptable segmentation in images and videos. It can detect, segment, and track objects using text prompts or visual prompts like points, boxes, and masks.

The all-time top

33 projects · by stars

  1. #1 · facebookresearch/segment-anything

    segment-anything

    This is Meta AI's Segment Anything Model (SAM), a foundation model that produces object masks for images from prompts like points or boxes, or automatically generates masks for every object in an image.

    55K
  2. #2 · lllyasviel/ControlNet

    ControlNet

    ControlNet is a neural network structure that adds extra conditions to diffusion models like Stable Diffusion: instead of a text prompt alone, you steer generation with an edge map, depth map, pose skeleton or scribble. This repo is the official implementation.

    34.1K
  3. #3 · chenfei-wu/TaskMatrix

    TaskMatrix

    TaskMatrix (also known as Visual ChatGPT) connects ChatGPT to a set of Visual Foundation Models so you can send and receive images while chatting, letting the LLM draw, edit, and analyze pictures.

    34K
  1. 4

    mmdetection

    33Kopen-mmlab/mmdetection · Python

    MMDetection is an open source object detection toolbox built on PyTorch, part of the OpenMMLab project, that supports object detection, instance segmentation, panoptic segmentation, and semi-supervised detection.

  2. 5

    deep-learning-for-image-processing

    26.4KWZMIAOMIAO/deep-learning-for-image-processing · Python

    A video-based deep learning course that walks through classic computer-vision architectures for image classification, object detection, segmentation and keypoint detection, pairing each network with a lecture and runnable code.

  3. 6

    Detectron

    26.4Kfacebookresearch/Detectron · Python

    Detectron is Facebook AI Research's software system implementing state-of-the-art object detection algorithms like Mask R-CNN and RetinaNet, built as a research platform for computer vision.

  4. 7

    rembg

    25.1Kdanielgatis/rembg · Python

    Rembg removes the background from images using AI segmentation models. Feed it a photo and it returns a cutout with a transparent background — as a terminal command, a Python function, or an HTTP call.

  5. 8

    HivisionIDPhotos

    21.6KZeyi-Lin/HivisionIDPhotos · Python

    An open-source AI tool for making ID photos: it cuts the person out of an ordinary snapshot with matting models and generates standard ID photos in various sizes with the right background color.

  6. 9

    sam2

    20Kfacebookresearch/sam2 · Jupyter Notebook

    SAM 2 (Segment Anything Model 2) is Meta's foundation model for promptable segmentation of objects in both images and videos, extending the original Segment Anything Model with a streaming memory architecture for real-time video tracking.

  7. 10

    analysis-ik

    17.5Kinfinilabs/analysis-ik · Java

    A plugin for Elasticsearch and OpenSearch that integrates the Lucene IK analyzer, adding Chinese word segmentation with support for customized dictionaries.

  8. 11

    detr

    15.3Kfacebookresearch/detr · Python

    DETR is Facebook AI Research's object detection model that treats detection as a direct set prediction problem using a Transformer encoder-decoder, replacing the usual hand-crafted detection pipeline (anchors, NMS, etc).

  9. 12

    albumentations

    15.3Kalbumentations-team/albumentations · Python

    Albumentations is a fast, flexible Python library for image augmentation used in training computer vision models, offering a huge set of pixel-level and spatial-level transforms for images, masks, bounding boxes, keypoints, and even 3D volumes.

  10. 13

    imgaug

    14.7Kaleju/imgaug · Python

    imgaug is a Python library that augments images for machine learning by converting a set of input images into a much larger set of slightly altered versions.

  11. 14

    ar-cutpaste

    14.6Kcyrildiagne/ar-cutpaste · TypeScript

    AR Cut & Paste is a research prototype that lets you point your phone's camera at a real-world object, cut it out using AR and machine learning, and paste it directly into Photoshop as a new layer.

  12. 15

    Meshroom

    13Kalicevision/Meshroom · Python

    Meshroom is an open-source, node-based visual programming framework for building and running photogrammetry and 3D computer-vision pipelines, turning collections of 2D photos into 3D models, camera tracks, HDR panoramas, and more.

  13. 16

    sam3

    12Kfacebookresearch/sam3 · Python

    SAM 3 is Meta's unified foundation model for promptable segmentation in images and videos. It can detect, segment, and track objects using text prompts or visual prompts like points, boxes, and masks.

  14. 17

    segmentation_models.pytorch

    11.8Kqubvel-org/segmentation_models.pytorch · Python

    A Python library for building image semantic segmentation models in PyTorch, with over 500 pretrained convolutional and transformer-based backbones.

  15. 18

    dinov3

    11.6Kfacebookresearch/dinov3 · Jupyter Notebook

    Meta AI Research (FAIR)'s reference PyTorch implementation and model release for DINOv3, a family of vision foundation models that produce high-quality dense features and perform strongly across many vision tasks.

  16. 19

    kornia

    11.4Kkornia/kornia · Python

    Kornia is an open-source differentiable computer vision library for Python: 500+ image processing, geometry and augmentation operators plus pre-trained AI models, all built on PyTorch.

  17. 20

    yolov10

    11.3KTHU-MIG/yolov10 · Python

    YOLOv10 is a real-time object detection model (NeurIPS 2024) that removes the need for non-maximum suppression (NMS) post-processing, enabling true end-to-end detection with lower latency than previous YOLO versions.

  18. 21

    awesome-deep-vision

    11.2Kkjw0612/awesome-deep-vision

    A curated list of deep learning resources for computer vision, covering papers on classification, detection, segmentation and more, plus courses, books, software and tutorials.

  19. 22

    X-AnyLabeling

    10.7KCVHub520/X-AnyLabeling · Python

    A free cross-platform desktop app for AI-assisted annotation of text, image, video, and multimodal data — manual labeling tools plus built-in deep learning models that pre-label or batch-annotate, with multi-format export.

  20. 23

    mit-deep-learning

    10.5Klexfridman/mit-deep-learning · Jupyter Notebook

    This repository collects tutorials, assignments, and competitions from MIT's Deep Learning related courses, covering semantic segmentation, generative adversarial networks, and reinforcement learning for self-driving cars.

  21. 24

    AutoFigure-Edit

    4.4KResearAI/AutoFigure-Edit · Python

    AutoFigure-Edit turns the method section text of a research paper into a fully editable SVG scientific illustration, complete with an embedded SVG editor for refinement.

  22. 25

    tapnet

    2.2Kgoogle-deepmind/tapnet · Jupyter Notebook

    This is Google DeepMind's official repository for Tracking Any Point (TAP) research: it bundles the TAP-Vid and TAPVid-3D benchmark datasets, the TAPIR/BootsTAPIR/TAPNext/TAPNext++ point-tracking models, the RoboTAP robotics extension, and the TRAJAN trajectory autoencoder.

  23. 26

    VisionHOPE

    1.3KPSRben/VisionHOPE · Python

    VisionHOPE is the official PyTorch implementation of a visual backbone built on self-referential nested learning (SRNL), supporting ImageNet-1K classification, COCO detection/instance segmentation, and ADE20K semantic segmentation.

  24. 27

    Genjustsu-Open-Source-Workflow

    986sirioberati/Genjustsu-Open-Source-Workflow · Python

    Genjustsu is an open-source workflow for replacing characters or objects in a video using colored depth maps, SAM 3 segmentation masks and optional face mesh tracking, then generating the replacement with Seedance through the Enhancor API. It runs a local web UI to prepare inputs, review masks, preview drafts, and export the result with the original audio restored.

  25. 28

    djev-run

    584taeold/djev-run · HTML

    djev-run serves DiffusionGemma-Jev (djev) behind a TypeSafe AI compatible API on Google Cloud Run with an NVIDIA RTX PRO 6000 Blackwell or L4 GPU, or runs it directly inside Google Colab Pro via colab.ipynb; it is built on mmastrac/djev.

  26. 29

    Qwen-Drive-1.0

    515QwenLM/Qwen-Drive-1.0 · Python

    Qwen-Drive-1.0 is a vision-language foundation model for autonomous driving, built on the Qwen3.5-4B VLM and extended with 3D perception, visual question answering, and motion planning in one unified model.

  27. 30

    framefields

    418gatewai-dev/framefields · TypeScript

    Framefields is a TypeScript npm package for code-first video: you write a composition in code (layers, 3D, typography, audio, charts) and it renders it natively on GPU via WebGPU/Dawn into an MP4, with no desktop creative suite needed.

  28. 31

    vlo

    247PxTicks/vlo · TypeScript

    Vlo is a free, open-source, local video editor with built-in AI features like automatic rotoscoping, audio stem separation, and beat detection, plus a live bridge to ComfyUI for running any generative AI workflow directly on the timeline.

  29. 32

    Mira-Scene

    210VAST-AI-Research/Mira-Scene · Python

    Mira-Scene is a pipeline that reconstructs an editable 3D scene from a single image, combining interactive instance segmentation, depth estimation, canonical coordinate and voxel prediction, object mesh generation, scene assembly, and environment-map generation.

  30. 33

    InsertAny3D

    183FlagOpen/InsertAny3D · Python

    InsertAny3D is a pipeline that combines a Unity scene, a generative 3D model, and multi-view geometry alignment to insert a new object into a Unity scene as a Gaussian Splatting asset, estimating its position, rotation and scale in Unity world coordinates.

Often tagged together