Files
kernels/tests/regression/flash_attention/kernel.cpp
Hansung Kim 72b6004e24 flash: Fix online softmax for warp-specialized
Note: now that threads_per_threadblock is passed as compile-time
constant, the compiler likes to completely loop unroll which can cause a
lot of stack spills.

todo fix GEMM part.
2024-08-29 21:50:02 -07:00

26 KiB