3 articles found
Ant Group dropped a 560B-parameter ‘flash’ model with 1M context. The naming convention needs therapy, and the hardware requirements need a second mortgage.
Aleph Alpha dropped a 78B MoE model under Apache 2.0 with a 1M token context window. Here’s what it means for enterprise AI, why the benchmarks matter, and where it falls short.
Community-led torture testing reveals which open-weight model actually survives 100K token contexts without hallucinating or crawling at 0.6 tokens per second.