Awesome Knowledge Distillation of LLMs

Overview

This repository serves as a comprehensive collection of research papers focused on knowledge distillation techniques for large language models. It is ideal for researchers and practitioners looking to deepen their understanding of this emerging field.