gpo.zugaina.org

Search Portage & Overlays:

sci-libs/auto-gptq

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Screenshots

  • auto-gptq-0.2.2
    ~amd64
    test python_targets_python3_10 python_targets_python3_11

    View      Download      Browse     License: MIT   
    Overlay: Miezhiko