Hybrid Architectures

They combine two or more components so that each covers the other's weakness: a convolution that captures local detail with a transformer that captures global context, a convolution that extracts the features of each frame with a recurrent network that links the frames in time, or a transformer encoder with a U-Net decoder for medical segmentation. Most of the modern medical architectures in the encyclopedia are of this kind.

Intermediate2017

Hybrid Capsule Networks

Hybrid Capsule Networks (CNN-CapsNet)

Designs that use a strong convolutional backbone (such as ResNet) to extract features, then a capsule layer with dynamic routing on top to represent part–whole relations…

Hybrid Architectures

Basic2015

U-Net

U-Net

A U-shaped segmentation architecture: a contracting path that captures context and an expanding path that restores spatial resolution, with skip connections that carry f…

FoundationsHybrid Architectures

Basic2018

Attention U-Net

Attention U-Net

A U-Net with attention gates on the skip connections that learn to highlight the relevant regions and suppress the background before the features are merged.

Hybrid Architectures

Advanced2022

Latent Diffusion Models

Latent Diffusion Models (LDM)

They apply diffusion in a compressed latent space from a pretrained autoencoder instead of pixel space, with a cross-attention mechanism for feeding in conditions (text,…

Generative NetworksHybrid Architectures

Intermediate2021

Hybrid CNN–Transformer Networks

CNN-Transformer Hybrids

Designs that combine convolution (local bias, efficiency, generalisation with less data) with attention (global context, large capacity): usually a convolutional stem or…

Hybrid ArchitecturesTransformer Architectures

Basic2015

Hybrid CNN–LSTM Networks

CNN-LSTM

A CNN extracts a representation of each spatial element (a video frame, a signal window, an image), then an LSTM models the sequence of these representations over time;…

Temporal and Sequential NetworksHybrid Architectures

Basic2014

Hybrid CNN–GRU Networks

CNN-GRU

One-dimensional convolutions capture local patterns in the signal and shorten it, then a GRU (often bidirectional) models relationships over time with fewer parameters t…

Temporal and Sequential NetworksHybrid Architectures

Intermediate2021

U-Net with Transformers

U-Net + Transformer (U-Net+Transformer)

A family of segmentation models that keeps the U-Net shape (an encoder–decoder with skip connections) and introduces the transformer somewhere: the bottleneck, the whole…

Hybrid ArchitecturesTransformer Architectures

Intermediate2021

TransUNet

TransUNet

A medical segmentation model that uses a hybrid encoder: a CNN (ResNet-50) extracts a feature map, which is split into patches and passed through a ViT, followed by a ca…

Hybrid ArchitecturesTransformer Architectures

Advanced2022

UNETR

UNETR

A 3D segmentation model whose encoder is a pure ViT on 16³ volumetric patches; representations are taken from its layers (3, 6, 9, 12), reshaped and upsampled with trans…

Hybrid ArchitecturesTransformer Architectures

Advanced2022

Swin UNETR

Swin UNETR (Swin-UNETR)

A volumetric segmentation model whose encoder is a hierarchical Swin Transformer (shifted local windows and patch merging) that gives features at five scales, connected…

Hybrid ArchitecturesTransformer Architectures

Basic2018

Attention-Augmented Convolutional Networks

Attention-based CNN (Attention CNN)

Convolutional networks that add lightweight attention modules that reweight the channels (which features matter most) or the positions (where the model looks), at a very…

Hybrid Architectures

Basic2015

Multi-Branch Neural Networks

Multi-Branch Neural Networks

Architectures that process the same input or different inputs through parallel branches (different kernel sizes, different modalities or different scales) and then merge…

Hybrid Architectures

Advanced2020

Scientific machine learning architectures

Scientific Machine Learning Architectures (SciML)

A family of architectures that blends mechanistic models (known equations) with neural networks that learn the unknown parts, trained through differentiable solvers. Not…

Physics-Informed Neural NetworksHybrid Architectures