Package klyn.math.nn.attention
Contains 2 type(s).
Types
Classes
- GatedDeltaAttention - Single-token gated delta recurrence with causal depthwise convolution on CPU/GPU.
- GroupedQueryAttention - Stateful single-sequence causal grouped-query attention on the selected CPU/GPU.