Tagged with

Your 8GB GPU Can Now Run a 125B Model, and That Breaks Everything

Strata’s hybrid VRAM+RAM offloading makes MoE models run 5x faster on aging P100s. Here’s why dedicated engines beat general-purpose inference.