inference-optimization/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16
Updated
•
46
Qwen3-Next-80B-A3B Quantized Models
FP8-dynamic, FP8-block, NVFP4, INT4, INT8 versions of Qwen3-Next-80B-A3B-Instruct and Qwen3-Next-80B-A3B-Thinking Models
-
-
inference-optimization/Qwen3-Next-80B-A3B-Instruct-FP8-block
Text Generation • 80B • Updated • 76 -
inference-optimization/Qwen3-Next-80B-A3B-Instruct-FP8-dynamic
Text Generation • 80B • Updated • 80 -
inference-optimization/Qwen3-Next-80B-A3B-Instruct-NVFP4
Text Generation • Updated • 31 -
inference-optimization/Qwen3-Next-80B-A3B-Thinking-NVFP4
Text Generation • Updated • 22 -
inference-optimization/Qwen3-Next-80B-A3B-Thinking-FP8-block
Text Generation • 80B • Updated • 40 -
inference-optimization/Qwen3-Next-80B-A3B-Thinking-FP8-dynamic
Text Generation • 80B • Updated • 72 -
inference-optimization/Qwen3-Next-80B-A3B-Thinking-quantized.w4a16
Updated • 47