What's Changed
- Refactor: Improve Quantization Suite & Benchmarking by @codewithdark-git in #3
- Feat: Introduce QuantizerFactory API and Refactor Quantization Workflow by @codewithdark-git in #4
- Fix/awq quantized linear device issue by @codewithdark-git in #6
- Fix: Unify nn.Module device placement across all quantizers and base … by @codewithdark-git in #7
- Fix: Handle nn.Module in move_to_device by @codewithdark-git in #8
- Hi there! I've made some improvements to the AWQ quantization impleme… by @codewithdark-git in #9
- feat: Isolate and optimize GGUF quantization by @codewithdark-git in #10
Full Changelog: https://github.com/codewithdark-git/QuantLLM/commits/v1.0.0
Contributors
codewithdark-git