Sinkhorn: Make Llms Even Smaller Through Quantisation While Maintaining Accuracy

The Sinkhorn project presents a quantization method to reduce the size of Large Language Models (LLMs) while maintaining accuracy, sparking interest in the community for its potential applications.

Snapshot generated from the HN discussion