A 30B Model Crawled on My Mini PC, and the Weights Were Innocent
A mixture-of-experts model fell off a cliff on an AMD mini PC. The fix was a different runtime, not a different model.
Aug 1, 20265 min read5
Command Palette
Search for a command to run...
#amd
Articles tagged with #amd