- Remove MIN_BLOCKS template param and __launch_bounds__ attribute - Profiling shows smem (not registers) is the occupancy bottleneck for D>=64, making the hint a no-op - D=64 sees 2-4% speedup, D=128 unchanged (smem-capped at 1 block/SM) - Update comment blocks in kernel header and both dispatch sites - Verified correctness via standalone CUDA test (max_err ~1e-4) |
||
|---|---|---|
| .. | ||
| attn_decode_test.cu | ||
| attn_paged_decode_test.cu | ||
| attn_prefill_test.cu | ||
| test_utils.cuh | ||