Generative Adversarial Networks
Generative Adversarial Networks (GAN)
A generative framework of two competing networks: a generator that turns random noise into samples, and a discriminator that tries to tell real samples from generated on…
Choose two or more architectures and compare the idea, structure, data, applications, strengths and limitations, and the parameter count of the example that was actually run.
Loading the lab… If it does not appear, make sure JavaScript is enabled in your browser.
The comparison shows no performance number that was not computed or documented: parameters and timings come from actually running the teaching examples, and the rest is description from the encyclopedia pages.
Generative Adversarial Networks (GAN)
A generative framework of two competing networks: a generator that turns random noise into samples, and a discriminator that tries to tell real samples from generated on…
Diffusion Models (DDPM)
They gradually corrupt the data by adding Gaussian noise over T steps, then a network learns to reverse this process by predicting the added noise, so a new example is g…
Physics-Informed Neural Networks (PINN)
A network that approximates the solution of a partial differential equation u_θ(x,t) and is trained with a loss that combines the equation's residual (computed by automa…
Mixture of Experts (MoE)
Several "expert" networks and a gating network that decides, for each input, the weight of each expert in the output. The experts learn to specialize in different region…
Sparse Mixture of Experts (Sparse MoE)
An expert layer in which only a small number of experts (top-k) is activated per token, so the model's parameter count grows greatly without a similar increase in per-to…
Neural Architecture Search (NAS)
Automating architecture design: a search space that defines possible architectures, a search strategy (reinforcement learning, evolution, Bayesian, gradient) that propos…
Retrieval-Augmented Neural Architectures (RAG)
Models that combine a non-parametric memory (a document index) with a parametric model: a retriever finds passages relevant to the question, and a generator uses them to…
Transformer
An architecture based entirely on multi-head self-attention instead of recurrence or convolution, so it processes all sequence positions in parallel and links any two po…
Vision Transformer (ViT)
Applies the standard Transformer encoder directly to images after splitting them into fixed-size patches treated as tokens, with a special classification token and a lea…
Swin Transformer
A hierarchical vision transformer that computes attention within non-overlapping local windows and shifts the windows in successive layers to exchange information betwee…
No results match the filters.
Sections
No section has this name. Press “Search” to search all site content.
Favourites
My results & certificates
My academy progressMy quiz resultsKids’ progressAcademy certificatesQuiz certificatesStart any lesson or quiz and it will show up here so you can get back to it quickly.
Settings
I am the smart assistant for deep learning architectures. Ask me about an architecture, an equation or code, or ask for a comparison, a path or an explanation of a lab result.
Answers from the encyclopedia's content only, with no language model and without sending your question to any outside party.
The assistant can make mistakes, so check the attached sources.