Hansung Kim bdd6e6a9ce flash: Double-buffer between online softmax and GEMM II ...

TODO: O_after_PV at the last stage is incorrect.

2024-08-30 22:47:55 -07:00

..

.gitignore

flash: gitignore

2024-08-15 21:04:59 -07:00

common.h

flash: Change kernel arg to contain qkv; strip stimulus gen from host code

2024-08-15 21:03:02 -07:00

half.hpp

Add flash attention kernel skeleton

2024-08-14 20:46:09 -07:00

kernel.cpp

flash: Double-buffer between online softmax and GEMM II

2024-08-30 22:47:55 -07:00

main.cpp

flash: Fix load addr for V tile; test with seqlen=128

2024-08-20 14:34:09 -07:00

Makefile

Add flash attention kernel skeleton

2024-08-14 20:46:09 -07:00