Hansung Kim
|
673e07ed43
|
flash: Add non-warp-specialized gemmini flash kernel
|
2024-11-09 19:08:39 -08:00 |
|
Hansung Kim
|
365b1d8e67
|
flash: Add begin end markers
|
2024-11-09 10:19:16 -08:00 |
|
Hansung Kim
|
1e3d476e70
|
Switch header configs to flash
|
2024-11-08 21:56:42 -08:00 |
|
Hansung Kim
|
221d5f75c2
|
flash: Optimize smem alloc for tcore for 8banks
Divide into first half & last half for warpgroup 0 & 1, and
allocate Q/K and P/V in different banks for parallel acccess.
|
2024-09-19 21:31:39 -07:00 |
|
Hansung Kim
|
be15cffbf3
|
flash: Revert to gemmini config, remove DEBUG and unnecessary checks
|
2024-09-12 14:25:33 -07:00 |
|
Hansung Kim
|
b5916f3f07
|
flash: Fix hardcoded barrier for tcore; move tcore-specific flags
|
2024-09-11 22:08:44 -07:00 |
|
Hansung Kim
|
18cf0e73cd
|
flash: Add early return for warp-indivisible row iter
|
2024-09-11 00:56:09 -07:00 |
|
Hansung Kim
|
90e03894fc
|
flash: Add flag in SMEM for dependency check on O
TODO: results unverified.
Stalls O rescale until GEMM II finishes.
|
2024-09-10 13:42:47 -07:00 |
|
Hansung Kim
|
a17edac875
|
flash: Fix barrier stall with DEBUG
Verified for up to P_expected on 2nd iter; O_before_PV is partially
correct
|
2024-09-09 17:02:05 -07:00 |
|
Hansung Kim
|
b652e25945
|
flash: Warp-specialize between warp 0 and 1-7
Finishes without stalls; No dependency check between O rescale and
GEMM-II.
|
2024-09-09 16:42:30 -07:00 |
|
Hansung Kim
|
cdb8377b62
|
flash: Do GEMM II in Gemmini; verify 1st iteration
|
2024-09-08 16:09:06 -07:00 |
|
Hansung Kim
|
3f50ac57ee
|
flash: use 12bit dma interface
|
2024-09-08 15:29:56 -07:00 |
|
Hansung Kim
|
c51dc4902d
|
flash: Fix online softmax for DMA layout
|
2024-09-07 23:21:28 -07:00 |
|
Hansung Kim
|
2e1485877d
|
flash: Add Gemmini-accelerated kernel
|
2024-09-07 22:40:58 -07:00 |
|
Hansung Kim
|
b3be271b88
|
flash: Split impl to header file
|
2024-09-07 21:16:35 -07:00 |
|