Together AI has released OSCAR (Offline Spectral Covariance-Aware Rotation), an INT2 KV cache quantization method for long-context LLM serving. Unlike prior rotation-based approaches that apply ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results