Multilayer Perceptron
Multilayer Perceptron (MLP)
A network of successive linear layers separated by nonlinear activation functions; it is the first building block on which most modern architectures are built.
The architectures the rest of the encyclopedia builds on: the multilayer perceptron, convolution, residual connections, the autoencoder, the attention mechanism and U-Net. They are not among the specification's eight categories, but they are a prerequisite for most learning paths.
Multilayer Perceptron (MLP)
A network of successive linear layers separated by nonlinear activation functions; it is the first building block on which most modern architectures are built.
Convolutional Neural Network (CNN)
A network that uses small convolution filters with shared weights sliding over the image, so it captures local patterns with far fewer parameters than an MLP.
Residual Network (ResNet)
It adds skip connections that make each block learn the residual difference F(x) instead of the full transformation, so training networks with hundreds of layers becomes…
Autoencoder (AE)
A network that compresses the input into a small latent representation (the encoder) and then reconstructs it (the decoder), so it learns a compressed representation wit…
Attention Mechanism
A mechanism that lets the model compute a weight for each input element according to its relevance to the current step, then take a weighted average, instead of compress…
U-Net
A U-shaped segmentation architecture: a contracting path that captures context and an expanding path that restores spatial resolution, with skip connections that carry f…
No results match the filters.
Sections
No section has this name. Press “Search” to search all site content.
Favourites
My results & certificates
My academy progressMy quiz resultsKids’ progressAcademy certificatesQuiz certificatesStart any lesson or quiz and it will show up here so you can get back to it quickly.
Settings
I am the smart assistant for deep learning architectures. Ask me about an architecture, an equation or code, or ask for a comparison, a path or an explanation of a lab result.
Answers from the encyclopedia's content only, with no language model and without sending your question to any outside party.
The assistant can make mistakes, so check the attached sources.