Qwen 3 235B-A22B

Apache 2.0

Alibaba Β· 235B (22B active) Β· Mixture of Experts

Massive MoE with 22B active β€” frontier quality Check if your GPU or Mac can run Qwen 3 235B-A22B locally β€” 131.3 GB min, 218.9 GB recommended.

2025-04128K context

Mixture of Experts

Total experts: 128
Active experts: 8
Active params: 22.0B

Quantization Options

QuantBitsVRAMQualityStatus
Q2_K275.7 GBlowβ€”
Q3_K_M3105.8 GBmoderateβ€”
Q4_K_M4120.9 GBgoodβ€”
Q5_K_M5151 GBgoodβ€”
Q6_K6181.1 GBexcellentβ€”
Q8_08241.2 GBexcellentβ€”
F1616482 GBlosslessβ€”

About this model

Qwen 3 logo

Qwen 3 is the latest generation of large language models in Qwen series, with newly updated versions of the 30B and 235B models:

New 30B model

ollama run qwen3:30b

Qwen3-30B-A3B-Instruct-2507.jpg

New 235B model

ollama run qwen3:235b

0d7zztq4GB7G2ZYowO-dQ.jpg

Overview

The Qwen 3 family is a comprehensive suite of dense and mixture-of-experts (MoE) models. The flagship model, Qwen3-235B-A22B, achieves competitive results in benchmark evaluations of coding, math, general capabilities, etc., when compared to other top-tier models such as DeepSeek-R1, o1, o3-mini, Grok-3, and Gemini-2.5-Pro. Additionally, the small MoE model, Qwen3-30B-A3B, outcompetes QwQ-32B with 10 times of activated parameters, and even a tiny model like Qwen3-4B can rival the performance of Qwen2.5-72B-Instruct.

  • Significantly enhancement in its reasoning capabilities, surpassing previous QwQ (in thinking mode) and Qwen2.5 instruct models (in non-thinking mode) on mathematics, code generation, and commonsense logical reasoning.

  • Superior human preference alignment, excelling in creative writing, role-playing, multi-turn dialogues, and instruction following, to deliver a more natural, engaging, and immersive conversational experience.

  • Expertise in agent capabilities, enabling precise integration with external tools in both thinking and unthinking modes and achieving leading performance among open-source models in complex agent-based tasks.

  • Support of 100+ languages and dialects with strong capabilities for multilingual instruction following and translation.

Reference

Can I run Qwen 3 235B-A22B locally?

Can I run Qwen 3 235B-A22B locally?
Qwen 3 235B-A22B needs about 131.3 GB of memory at a minimum and 218.9 GB recommended. Open this page to grade it against your GPU or Mac, then run it with runai, Ollama or LM Studio.
How much VRAM does Qwen 3 235B-A22B need?
At Q4_K_M, Qwen 3 235B-A22B uses about 120.9 GB of VRAM. Higher quants need more memory; lower quants fit tighter cards with a quality tradeoff.