Tencent’s Hy3 AI Model Boosts Efficiency with Sparse Attention

Tencent researchers released Hy3, a sparse attention mechanism that reduces computational cost in large language models. The method achieves up to 2x speedup on long-context tasks while maintaining accuracy. Hy3 is open-sourced and targets deployment on existing hardware.