Grouped-query attention

An attention variant that shares key/value projections across groups of query heads to shrink the KV cache and ease the memory-bandwidth bottleneck at long context.

grounded in: Trend theme 'cheaper long-context kernels' plus the existing kv-cache / memory-bandwidth-bound concepts it directly optimizes; GQA is a durable, ubiquitous inference technique.