Repositories list

• BitDecoding

  Public
  [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.

  C++

  •

  MIT License

  •7•77•1•0•Updated Dec 18, 2025Dec 18, 2025

• BitDistiller

  Public
  [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.

  Python

  •

  MIT License

  •17•132•10•0•Updated May 16, 2024May 16, 2024