Kolmogorov–Arnold Networks
Kolmogorov–Arnold Networks (KAN)
Networks that place learnable activation functions (B-spline curves) on the edges instead of fixed weights, while the nodes only sum their inputs, inspired by the Kolmog…
Architectures that change the computing unit itself, not just the order of layers: learnable activation functions on the edges in KAN, vectors instead of scalars in capsules, timed spikes in spiking networks, differential equations in liquid networks, networks that generate the weights of others, equilibrium points instead of a fixed depth, and a fixed random reservoir in reservoir computing. Many of them are still an active research topic, so they are not a general replacement for the common architectures.
Kolmogorov–Arnold Networks (KAN)
Networks that place learnable activation functions (B-spline curves) on the edges instead of fixed weights, while the nodes only sum their inputs, inspired by the Kolmog…
Capsule Networks (CapsNet)
Networks that represent entities as capsules (vectors) whose length expresses the probability that the entity is present and whose direction expresses its properties (po…
Spiking Neural Networks (SNN)
Networks whose neurons communicate with discrete binary spikes in time, like the brain. The membrane potential accumulates and fires a spike when it exceeds the threshol…
Liquid Neural Networks (LNN)
Continuous-time recurrent networks in which each neuron's time constant changes with the input (Liquid Time-Constant), so their dynamics adapt to the data with a small n…
Hypernetworks
A small network (the hypernetwork) generates the weights of another network (the target network), so the weights become a function of a conditioning input such as the ta…
Deep Equilibrium Models (DEQ)
Instead of stacking L layers, the model looks for a fixed point of a single layer z^*=f_θ(z^*,x), as if it were an infinitely deep network with shared weights, and compu…
Reservoir Computing (ESN / LSM)
A large recurrent network with fixed random weights (the reservoir) turns the input into rich states, and only the linear readout layer is trained, usually with closed-f…
No results match the filters.
Sections
No section has this name. Press “Search” to search all site content.
Favourites
My results & certificates
My academy progressMy quiz resultsKids’ progressAcademy certificatesQuiz certificatesStart any lesson or quiz and it will show up here so you can get back to it quickly.
Settings
I am the smart assistant for deep learning architectures. Ask me about an architecture, an equation or code, or ask for a comparison, a path or an explanation of a lab result.
Answers from the encyclopedia's content only, with no language model and without sending your question to any outside party.
The assistant can make mistakes, so check the attached sources.