Adaptive Second-order Derivative Approximate Greatest Descent Optimization for Deep Learning Neural Networks
الملخص
Backpropagation using Stochastic Diagonal Approximate Greatest Descent (SDAGD) is a novel adaptive second-order derivative optimization method in updating weights of deep learning neural networks. SDAGD applies two-phase switching strategy to seek for solution at far using long-term optimal trajectory and automatically switch to Newton method when nearer to optimal solution. SDAGD has the advantages of steepest training roll-off rate, adaptive adjustment of step-length and the ability to deal with vanishing gradient issues in deep architecture.
الكلمات المفتاحية
غير متوفر
التخصصات
رسائل وأطاريح مشابهة
- Adaptive and Responsible Machine Learning: From Incremental Learning to Unlearning and Safe Generation Sayedmoslem Shokrolahi · Queen's University Library · 2026
- A Unified Framework for Distributed and Resource-Aware Plant Disease Detection Using Federated and Adaptive Hybrid Deep Learning Ticauris S Stokes · University of Southern Mississippi · 2026
- Adaptive Deep Learning for Vision and Multimodal Understanding with Heterogeneous Data Youwei Liang · 2026
- Adaptive Machine Learning for Real-Time Intrusion Detection in Networks Anju Sobha · National College of Ireland · 2025
- Higher Order Transformers With Kronecker-Structured Attention Soroush Omranpour · 2025
- Hyperparameter Optimization of Convolutional Neural Networks (CNN) using an Adaptive Particle Swarm Optimization (PSO) and Genetic Algorithm (GA) charles usigbe · London South Bank University · 2025
