Lion Optimizer by Lucidrains

Overview

Lion is a new optimizer developed by Google Brain that utilizes genetic algorithms to improve upon traditional optimizers like Adam. It is designed for deep learning practitioners looking to enhance their model training efficiency in PyTorch.