nGPT Implementation in PyTorch
Free294 GitHub stars
Learning ResourceAgnosticFile System
Overview
This repository provides a quick implementation of nGPT, focusing on learning entirely on the hypersphere. It is ideal for developers and researchers interested in deep learning and transformer models.