Qwen3 Quantised Models Released: Alibaba’s Qwen Launches Multiple AI Models in Various Formats via LM Studio, Ollama, SGLang and vLLM

Alibaba’s Qwen has launched quantised models of Qwen3 AI, now available through platforms like LM Studio, Ollama, SGLang, and vLLM. Users can choose from multiple formats, including GGUF, AWQ, and GPTQ. The models range from Qwen3-235B-A22B to Qwen3-0.6B, offering various sizes for different needs.

Qwen3 Quantised Models Released: Alibaba’s Qwen Launches Multiple AI Models in Various Formats via LM Studio, Ollama, SGLang and vLLM
Qwen Logo (Photo Credits: X/@Alibaba_Qwen)

Alibaba's Qwen announced releasing the quantised models of Qwen3 AI today which were deployed via LM Studio, Ollama, SGLang and vLLM platforms. The interested users can choose from multiple formats, such as GGUF (GPT-Generated Unified Format), AWQ (Activation-aware Weight Quantisation), and GPTQ (Gradient Post-Training Quantisation). The Qwen3 quantised models include Qwen3-235B-A22B, Qwen3-30B-A3B, Qwen3-32B, Qwen3-14B, Qwen3-8B, Qwen3-4B, Qwen3-1.7B and Qwen3-0.6B. Grok 3.5 Early Access To Be Available to SuperGrok Users, Elon Musk Confirms Next-Gen xAI Chatbot to Launched in Another Week or So After Improvements.

Qwen3 Quantised Models Launched by Alibaba's AI Company Qwen

(SocialLY brings you all the latest breaking news, viral trends and information from social media world, including Twitter (X), Instagram and Youtube. The above post is embeded directly from the user's social media account and LatestLY Staff may not have modified or edited the content body. The views and facts appearing in the social media post do not reflect the opinions of LatestLY, also LatestLY does not assume any responsibility or liability for the same.)


You Might Also Like

Paytm Stock Falls Marginally As It Sees Larger Trade Order Involving 1.7 Crore Shares Worth INR 2,380 Crore, Reports Suggest Alibaba Group’s Subsidiary Antfin As Seller

Deepseek R1 Security Concerns: China’s AI Reasoning Model Fails Multiple Tests, Achieves 9.8 Security Risk Score Out 10, Says Report

DeepSeek AI Security Concerns: Chinese Ambassador Dai Bing Cites Joint Declaration at Paris AI Summit 2025 Amid South Korea Restricting Chinese AI Chatbot

Qwen 2.5 Max vs DeepSeek V3 and Llama-3.1–405B: Know All About Alibaba’s New AI Model, Performance, Benchmarks, Availability, Training Details and More