Tagged with

2 articles found

The Cloud Is Now Optional: Running Qwen 3.5 on WebGPU and Mobile Silicon

Technical deep dive into running Qwen 3.5 models locally on WebGPU browsers and Android devices without cloud dependencies.

#local inference#mobile LLMs#On-Device AI...

cuda

GLM-4.7-Flash’s CUDA Fix: When Flash Attention Was the Problem, Not the Solution

A critical CUDA fix for GLM-4.7-Flash in llama.cpp reveals how a performance optimization was actively sabotaging local inference speeds, and why the community had to rebuild the wheel to make it work.

#cuda#Flash Attention#GLM-4.7...