Hansung Kim d3de1b674a flash: Compute exponents using prev/next/this rowmax values ...

maybe there is a better way than storing all three in sharedmem?

2024-08-15 22:10:02 -07:00

..

.gitignore

flash: gitignore

2024-08-15 21:04:59 -07:00

common.h

flash: Change kernel arg to contain qkv; strip stimulus gen from host code

2024-08-15 21:03:02 -07:00

half.hpp

Add flash attention kernel skeleton

2024-08-14 20:46:09 -07:00

kernel.cpp

flash: Compute exponents using prev/next/this rowmax values

2024-08-15 22:10:02 -07:00

main.cpp

flash: Change kernel arg to contain qkv; strip stimulus gen from host code

2024-08-15 21:03:02 -07:00

Makefile

Add flash attention kernel skeleton

2024-08-14 20:46:09 -07:00