🤖Arch Linux on ProArt P16: 110GB RAM, 90GB Model Load
Arch Linux runs massive models on 110GB RAM
TL;DR
Arch Linux ARM runs Qwen3.8-Flash-Next-FP4-Local with 110GB RAM, allocating 90GB to the model. 16-minute load time, 4-second median response. Windows users lag behind.
Arch Linux ARM on an ASUS ProArt P16 with 128GB RAM and 6,144 CUDA cores runs Qwen3.8-Flash-Next-FP4-Local, allocating nearly 90GB to the model and KV cache. This setup is a game-changer for developers needing massive RAM for AI models. The model loads in 16 minutes, with a median response time of 4 seconds for code review. Windows users lag behind with 29.4 tokens/s vs 30.9 tokens/s on Linux. If you're working with large AI models, this setup could be a game-changer.
Key Points
Arch Linux ARM runs Qwen3.8-Flash-Next-FP4-Local with 110GB RAM, allocating 90GB to the model and KV cache.
16-minute load time for Qwen3.8-Flash-Next-FP4-Local before the first request.
Median response time of 4.036 seconds for code review on Linux setup.
Windows users lag behind with 29.4 tokens/s vs 30.9 tokens/s on Linux.
ProArt P16 tested with 20-core N1X, Windows 7-Zip score of 155.774.
Why It Matters
If you're working with large AI models on Linux, this setup could be a game-changer. Arch Linux ARM runs Qwen3.8-Flash-Next-FP4-Local with 110GB RAM, allocating 90GB to the model and KV cache. The 16-minute load time and 4-second median response time for code review make it a powerful tool for developers. Windows users lag behind with 29.4 tokens/s vs 30.9 tokens/s on Linux.
Comments
Be the first to comment
Enjoyed this article?
Get it daily. 7am. Free. Reads in 5 minutes.
Join 3,566 builders reading daily.