- gqa_decode_attn: rewrite to per-KV-head, K in smem - gqa_prefill_attn: new kernel for Q_len > 1 with GQA |
||
|---|---|---|
| .. | ||
| __init__.py | ||
- gqa_decode_attn: rewrite to per-KV-head, K in smem - gqa_prefill_attn: new kernel for Q_len > 1 with GQA |
||
|---|---|---|
| .. | ||
| __init__.py | ||