wu-arch/kernels
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
986d5072239cd565123794976fb25b8c8aa6311b
kernels/tests/regression/flash_attention
History
Hansung Kim 986d507223 flash: Fix single-tile GEMM for warp-specialized 
With 4 warps, we can only do 32x64 GEMM; serialize 64x64 into 2 32x64
GEMM calls by split by the row.
2024-08-30 17:12:46 -07:00
..
.gitignore
flash: gitignore
2024-08-15 21:04:59 -07:00
common.h
flash: Change kernel arg to contain qkv; strip stimulus gen from host code
2024-08-15 21:03:02 -07:00
half.hpp
Add flash attention kernel skeleton
2024-08-14 20:46:09 -07:00
kernel.cpp
flash: Fix single-tile GEMM for warp-specialized
2024-08-30 17:12:46 -07:00
main.cpp
flash: Fix load addr for V tile; test with seqlen=128
2024-08-20 14:34:09 -07:00
Makefile
Add flash attention kernel skeleton
2024-08-14 20:46:09 -07:00