Alibaba's Qwen announced releasing the quantised models of Qwen3 AI today which were deployed via LM Studio, Ollama, SGLang and vLLM platforms. The interested users can choose from multiple formats, such as GGUF (GPT-Generated Unified Format), AWQ (Activation-aware Weight Quantisation), and GPTQ (Gradient Post-Training Quantisation). The Qwen3 quantised models include Qwen3-235B-A22B, Qwen3-30B-A3B, Qwen3-32B, Qwen3-14B, Qwen3-8B, Qwen3-4B, Qwen3-1.7B and Qwen3-0.6B. Grok 3.5 Early Access To Be Available to SuperGrok Users, Elon Musk Confirms Next-Gen xAI Chatbot to Launched in Another Week or So After Improvements.
Qwen3 Quantised Models Launched by Alibaba's AI Company Qwen
We’re officially releasing the quantized models of Qwen3 today!
Now you can deploy Qwen3 via Ollama, LM Studio, SGLang, and vLLM — choose from multiple formats including GGUF, AWQ, and GPTQ for easy local deployment.
Find all models in the Qwen3 collection on Hugging Face and… pic.twitter.com/kH3KGskcEY
— Qwen (@Alibaba_Qwen) May 12, 2025
(SocialLY brings you all the latest breaking news, viral trends and information from social media world, including Twitter (X), Instagram and Youtube. The above post is embeded directly from the user's social media account and LatestLY Staff may not have modified or edited the content body. The views and facts appearing in the social media post do not reflect the opinions of LatestLY, also LatestLY does not assume any responsibility or liability for the same.)