Concepts
Understand the theory behind quantization so you can make informed decisions.
In this section
| Page | What you'll learn |
|---|---|
| Quantization Types | AWQ vs GGUF vs GPTQ — what's the difference? |
| Perplexity vs Speed | How to think about quality/speed/size trade-offs |