What is UNet?
UNet is a deep convolutional neural network architecture originally designed for biomedical image segmentation. It was introduced in the 2015 MICCAI paper titled:
📄 U-Net: Convolutional Networks for Biomedical Image Segmentation
by Olaf Ronneberger, Philipp Fischer, and Thomas Brox [Paper Link]
UNet's core innovation lies in its U-shaped architecture, consisting of a contracting path (encoder) and an expanding path (decoder) with skip connections that merge feature maps from corresponding encoder and decoder layers. This design allows the network to capture context while achieving precise localization, which is crucial for tasks like cell segmentation, tumor boundary detection, and more.
Why UNet?
UNet’s simplicity and effectiveness made it the go-to architecture for medical image segmentation. Its ability to perform well even on small datasets, its flexibility across 2D and 3D medical imaging tasks, and the ease of implementation have led to hundreds of follow-up works and adaptations over the years. Researchers continue to modify and build upon UNet to improve accuracy, efficiency, and generalization across diverse domains.
🔍 About This Blog
This blog aims to showcase the evolution of the UNet family – a timeline of interesting and influential UNet-based architectures from 2015 to the latest publications. Whether you're a researcher, engineer, or enthusiast, this curated collection serves as a reference point and inspiration for exploring semantic segmentation models built upon UNet.
📚 UNet Family Timeline (updated 15/04/2025)
📅 2015
- U-Net: Convolutional Networks for Biomedical Image Segmentation (MICCAI 2015)
[Paper] • [PyTorch Implementation] • [Keras]
2016
- V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation [paper] [caffe][pytorch]
- 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation [paper][pytorch]2017
- H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation from CT Volumes (IEEE Transactions on Medical Imaging)[paper][keras]
- GP-Unet: Lesion Detection from Weak Labels with a 3D Regression Network (MICCAI) [paper]2018
- UNet++: A Nested U-Net Architecture for Medical Image Segmentation (MICCAI) [paper][my-pytorch][keras]
- MDU-Net: Multi-scale Densely Connected U-Net for biomedical image segmentation [paper]
- DUNet: A deformable network for retinal vessel segmentation [paper]
- RA-UNet: A hybrid deep attention-aware network to extract liver and tumor in CT scans [paper]
- Dense Multi-path U-Net for Ischemic Stroke Lesion Segmentation in Multiple Image Modalities [paper]
- Stacked Dense U-Nets with Dual Transformers for Robust Face Alignment [paper]
- Prostate Segmentation using 2D Bridged U-net [paper]
- nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation [paper][pytorch]
- SUNet: a deep learning architecture for acute stroke lesion segmentation and
outcome prediction in multimodal MRI [paper] - IVD-Net: Intervertebral disc localization and segmentation in MRI with a multi-modal UNet [paper]
- LADDERNET: Multi-Path Networks Based on U-Net for Medical Image Segmentation [paper][pytorch]
- Glioma Segmentation with Cascaded Unet [paper]
- Attention U-Net: Learning Where to Look for the Pancreas [paper]
- Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentation [paper]
- Concurrent Spatial and Channel ‘Squeeze & Excitation’ in Fully Convolutional Networks [paper]
- A Probabilistic U-Net for Segmentation of Ambiguous Images (NIPS) [paper] [tensorflow]
- AnatomyNet: Deep Learning for Fast and Fully Automated Whole-volume Segmentation of Head and Neck Anatomy [paper]
- 3D RoI-aware U-Net for Accurate and Efficient Colorectal Cancer Segmentation [paper][pytorch]
- Detection and Delineation of Acute Cerebral Infarct on DWI Using Weakly Supervised Machine Learning (Y-Net) (MICCAI) [paper](Page 82)
- Fully Dense UNet for 2D Sparse Photoacoustic Tomography Artifact Removal [paper]2019
- MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation [paper][keras]
- U-NetPlus: A Modified Encoder-Decoder U-Net Architecture for Semantic and Instance Segmentation of Surgical Instrument [paper]
- Probability Map Guided Bi-directional Recurrent UNet for Pancreas Segmentation [paper]
- CE-Net: Context Encoder Network for 2D Medical Image Segmentation [paper][pytorch]
- Graph U-Net [paper]
- A Novel Focal Tversky Loss Function with Improved Attention U-Net for Lesion Segmentation (ISBI) [paper]
- ST-UNet: A Spatio-Temporal U-Network for Graph-structured Time Series Modeling [paper]
- Connection Sensitive Attention U-NET for Accurate Retinal Vessel Segmentation [paper]
- CIA-Net: Robust Nuclei Instance Segmentation with Contour-aware Information Aggregation [paper]
- W-Net: Reinforced U-Net for Density Map Estimation [paper]
- Automated Segmentation of Pulmonary Lobes using Coordination-guided Deep Neural Networks (ISBI oral) [paper]
- U2-Net: A Bayesian U-Net Model with Epistemic Uncertainty Feedback for Photoreceptor Layer Segmentation in Pathological OCT Scans [paper]
- ScleraSegNet: an Improved U-Net Model with Attention for Accurate Sclera Segmentation (ICB Honorable Mention Paper Award) [paper]
- AHCNet: An Application of Attention Mechanism and Hybrid Connection for Liver Tumor Segmentation in CT Volumes [paper]
- A Hierarchical Probabilistic U-Net for Modeling Multi-Scale Ambiguities [paper]
- Recurrent U-Net for Resource-Constrained Segmentation [paper]
- MFP-Unet: A Novel Deep Learning Based Approach for Left Ventricle Segmentation in Echocardiography [paper]
- A Partially Reversible U-Net for Memory-Efficient Volumetric Image Segmentation (MICCAI 2019) [paper][pytorch]
- ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed data [paper]
- A multi-task U-net for segmentation with lazy labels [paper]
- RAUNet: Residual Attention U-Net for Semantic Segmentation of Cataract Surgical Instruments [paper]
- 3D U2-Net: A 3D Universal U-Net for Multi-Domain Medical Image Segmentation (MICCAI 2019) [paper] [pytorch]
- SegNAS3D: Network Architecture Search with Derivative-Free Global Optimization for 3D Image Segmentation (MICCAI 2019) [paper]
- 3D Dilated Multi-Fiber Network for Real-time Brain Tumor Segmentation in MRI [paper][pytorch] (MICCAI 2019)
- The Domain Shift Problem of Medical Image Segmentation and Vendor-Adaptation by Unet-GAN [paper]
- Recurrent U-Net for Resource-Constrained Segmentation [paper] (ICCV 2019)
- Siamese U-Net with Healthy Template for Accurate Segmentation of Intracranial Hemorrhage (MICCAI 2019)
📅 2020
- U²-Net: Going Deeper with Nested U-Structure for Salient Object Detection (Pattern Recognition 2020) [paper] [pytorch]
- UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation (ICASSP 2020) [paper] [pytorch]
- SA-UNet: Spatial Attention U-Net for Retinal Vessel Segmentation [paper] [pytorch]
- Multi-level colonoscopy malignant tissue detection with adversarial CAC-UNet[paper] [pytorch]
📅 2021
- TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation (arXiv 2021) [paper] [pytorch]
- UNETR: Transformers for 3D Medical Image Segmentation (arXiv 2021) [paper] [pytorch]
- Swin-Unet: UNet-like Pure Transformer for Medical Image Segmentation [paper] [pytorch]
📅 2022
- UNeXt: MLP-based Rapid Medical Image Segmentation Network [paper] [pytorch]
- Focal-UNet: UNet-like Focal Modulation for Medical Image Segmentation [paper] [pytorch]
- Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesis [paper] [pytorch]
📅 2023
- DA-TransUNet: Dual Attention Transformer U-Net for Improved Segmentation [paper] [pytorch]
- Diffusion Transformer UNet: Medical Image Segmentation with Diffusion Models (MICCAI 2023) [paper]
- Biomedical Image Segmentation Using UNet & Transfer Learning [paper]
- U-Net v2: Rethinking the Skip Connections of U-Net for Medical Image Segmentation [paper] [pytorch]
- Music Source Separation Based on a Lightweight Deep Learning Framework (DTTNET: DUAL-PATH TFC-TDF UNET) [paper] [pytorch]
- Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference [paper] [pytorch]
📅 2024
- LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation [paper] [pytorch]
- SelfReg-UNet: Self-Regularized UNet for Enhanced Feature Discrimination [paper]
- MPU-Net: Modality Preserving U-Net for Multimodal Image Segmentation [paper]
- VM-UNet: Vision Mamba UNet for Medical Image Segmentation [paper] [pytorch]
- Semi-Mamba-UNet: Pixel-Level Contrastive and Pixel-Level Cross-Supervised Visual Mamba-based UNet for Semi-Supervised Medical Image Segmentation [paper] [pytorch]
- SAM2-UNet: Segment Anything 2 Makes Strong Encoder for Natural and Medical Image Segmentation [paper] [pytorch]
- UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentation
- LKM-UNet: Large Kernel Vision Mamba UNet for Medical Image Segmentation [paper] [pytorch]
- H-vmunet: High-order Vision Mamba UNet for Medical Image Segmentation [paper] [pytorch]
- ViM-UNet: Vision Mamba for Biomedical Segmentation [paper] [pytorch]