Structs§
Functions§
- build_
projection - Random Gaussian projection matrix
Pof shape[head_dim, r], BF16, in row-major layout. Variance 1/head_dim so that ⟨k, p⟩ has unit variance for unit-normk. Standard JL setting (KVSwap §2.2).
P of shape [head_dim, r], BF16, in
row-major layout. Variance 1/head_dim so that ⟨k, p⟩ has unit variance
for unit-norm k. Standard JL setting (KVSwap §2.2).