Hansung Kim 4080dec9d6 flash: Do exponential approx to rowsum and Oi as well

2024-08-19 20:52:57 -07:00

..

.gitignore

flash: gitignore

2024-08-15 21:04:59 -07:00

common.h

flash: Change kernel arg to contain qkv; strip stimulus gen from host code

2024-08-15 21:03:02 -07:00

half.hpp

Add flash attention kernel skeleton

2024-08-14 20:46:09 -07:00

kernel.cpp

flash: Do exponential approx to rowsum and Oi as well

2024-08-19 20:52:57 -07:00

main.cpp

flash: Change kernel arg to contain qkv; strip stimulus gen from host code

2024-08-15 21:03:02 -07:00

Makefile

Add flash attention kernel skeleton

2024-08-14 20:46:09 -07:00