A learning rate range test implementation in PyTorch

Play deep learning with CIFAR datasets

Visualize Tensorflow's optimizers.

An easy neural network for Java!

Videos of deep learning optimizers moving on 3D problem-landscapes

PyTorch implementation of some learning rate schedulers for deep learning researcher.

Improving MMD-GAN training with repulsive loss function

FIR & LMS filter implementation in C++ with Python & JAVA wrappers

Cyclic learning rate TensorFlow implementation.

One cycle policy learning rate scheduler in PyTorch

Learning rate multiplier

Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent

Benchmarking various Computer Vision models on TinyImageNet Dataset

Stochastic Weight Averaging - TensorFlow implementation

SaLSa Optimizer implementation (No learning rates needed)

Meta Transfer Learning for Few Shot Semantic Segmentation using U-Net

How optimizer and learning rate choice affects training performance

OneCycle LearningRateScheduler & Learning Rate Finder for TensorFlow 2.

Improved Hypergradient optimizers for ML, providing better generalization and faster convergence.

sharpDARTS: Faster and More Accurate Differentiable Architecture Search