Awesome list for Neural Network Optimization methods.
-
Updated
Feb 17, 2025
Awesome list for Neural Network Optimization methods.
Stochastic gradient descent with model building
A Claude skill for producing compilable LaTeX in computational and applied mathematics — theorems, proofs, algorithms, convergence analyses, numerical experiments and beamer presentations
[Neurips 2022] "Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis" by Wuyang Chen*, Wei Huang*, Xinyu Gong, Boris Hanin, Zhangyang Wang
Implementation and comparison of zero order vs first order method on the AdaMM (aka AMSGrad) optimizer: analysis of convergence rates and minima shape
This repository contains notes and solutions from Kenneth A. Ross: Elementary Analysis. It focuses on building a strong foundation in Real Analysis for Probability, Statistical Inference, and Machine Learning. Some problems are skipped or deferred for later.
IRIS Gate Protocol: Cross-architecture phenomenological convergence research (RFC v0.2)
Toy models for Cauchy-Characteristic Extraction (CCE) and Matching (CCM)
Some VASP processing and convergence-testing shell scripts.
Worth-reading papers and related awesome resources on deep learning optimization algorithms. 值得一读的深度学习优化器论文与相关资源。
Collection of methods for numerical analysis and scientific computing, including numerical root-finders, numerical integration, linear algebra, and data visualization. Created for APPM4600 at CU Boulder.
This project investigates convergence for solving linear systems. It implements Jacobi and SOR methods, explores convergence, optimizes performance via ω, and analyzes spectral radius/determinant. It aims to enhance iterative method efficiency for linear systems.
Official implementation of "Unraveling the Hessian: A Key to Smooth Convergence in Loss Function Landscapes"
[EE580: Network System - Modelling & Analysis] This repo contains all the assignment of EE580 offered at IIT Mandi by Dr.Sreelakshmi Manjunath during Fall Session 2023.
StoMADS algorithm for stochastic blackbox optimization
Implementation and evaluation of the Ant Colony Optimization algorithm on the bin-packing problem
This repository is for reproducing the experimental results in our manuscript submitted to IEEE TIT. An early version of this work have been presented in part at ICML'24.
Record of Gachon Convergence Research Assistant
Special Project - CA classification (2019 Fall)
Alpha Belief Propagation
Add a description, image, and links to the convergence-analysis topic page so that developers can more easily learn about it.
To associate your repository with the convergence-analysis topic, visit your repo's landing page and select "manage topics."