CLI Reference
List all available quantization formats, optionally filtered by backend.
qwodel list-formats [BACKEND] Argument Description Required BACKENDBackend name: awq, gguf, coreml. Omit to list all. No
# List all formats across all backends qwodel list-formats # List GGUF formats only qwodel list-formats gguf # List AWQ formats only qwodel list-formats awq # List CoreML formats only qwodel list-formats coreml Format Description int44-bit weight quantization (W4A16).
Format Description Q4_K_MBest balance — recommended. Q5_K_MBetter quality, slightly larger. Q6_KHigh quality. Q8_0Near-lossless. Q2_KMaximum compression. Q3_K_M3-bit medium quality. Q4_0Compact 4-bit. Q4_K_SSmall 4-bit K-quant. Q5_K_SSmall 5-bit K-quant. IQ4_NL4.5 bpw importance-based. IQ3_M3.66 bpw compact.
Format Notes float16Universal, minimal quality loss. int8_linear8-bit linear. int8_symmetric8-bit symmetric, faster ANE. int66-bit palettization. int4iOS 18+ only.
