 cturan
|
bde1886208
fix: incorrect tensor variable used in reshape operations for k and v tensors
|
vor 2 Monaten |
|
cturan
|
2b40434af3
Enhance CUDA kernels for CUMSUM and DELTA_NET operations
|
vor 2 Monaten |
|
cturan
|
2e9f9bc889
Add CUDA kernels for TRI, CUMSUM, and DELTA_NET operations
|
vor 2 Monaten |
 Piotr Wilkin
|
42d7d1b137
Make Mr. Chunky talk less.
|
vor 2 Monaten |
|
Piotr Wilkin
|
abcacd4cd2
Mr. Chunky likes pizza!
|
vor 2 Monaten |
|
Piotr Wilkin
|
db247cf48f
Mr Chunky is such fun!
|
vor 2 Monaten |
|
Piotr Wilkin
|
5d0a237a1c
More food for Mr. Chunky.
|
vor 2 Monaten |
|
Piotr Wilkin
|
6798b69bcc
Some updates for Mr. Chunky
|
vor 2 Monaten |
|
Piotr Wilkin
|
2fdbf16eb1
Add proper check for previous state
|
vor 2 Monaten |
|
Piotr Wilkin
|
912339a5c2
Proper (?) offsetting
|
vor 2 Monaten |
|
Piotr Wilkin
|
16b3f9c300
Valgrind debugging session / multi-chunk support
|
vor 2 Monaten |
|
Piotr Wilkin
|
5417f3294b
Wrong dimension order
|
vor 2 Monaten |
|
Piotr Wilkin
|
e5ffc91d0a
Fix wrong shape for K norm
|
vor 3 Monaten |
|
Piotr Wilkin
|
875de2bcc2
e steps forward, pi steps back
|
vor 3 Monaten |
|
Piotr Wilkin
|
a60458ebee
Remove more debug
|
vor 3 Monaten |
|
Piotr Wilkin
|
78e0fbd8f4
Remove debug
|
vor 3 Monaten |
|
Piotr Wilkin
|
9de7244c26
Fix memory corruption
|
vor 3 Monaten |
|
Piotr Wilkin
|
75586ea36e
Delta.net chunked reimplemented
|
vor 3 Monaten |
|
Piotr Wilkin
|
61fbeef88b
Attempt 246461
|
vor 3 Monaten |
|
Piotr Wilkin
|
a51d4381d4
Like this.
|
vor 3 Monaten |
|
Piotr Wilkin
|
54bb6f1eb9
argh again
|
vor 3 Monaten |
|
Piotr Wilkin
|
20424d8785
argh
|
vor 3 Monaten |
|
Piotr Wilkin
|
413652178f
attempt 2
|
vor 3 Monaten |
|
Piotr Wilkin
|
c5dc442a5d
repeat_interleave
|
vor 3 Monaten |
 Piotr Wilkin
|
a4fe12821b
Fix layer counting logic
|
vor 3 Monaten |
|
Piotr Wilkin
|
610b0fede7
Wrong tensor for comparison
|
vor 3 Monaten |
|
Piotr Wilkin
|
4d571eda07
Let's dump extra tensors
|
vor 3 Monaten |
|
Piotr Wilkin
|
2cab86a09f
Let the debug out.
|
vor 3 Monaten |
|
Piotr Wilkin
|
7eef0bd948
Rewrite recurrent delta + softmax to separate ops
|
vor 3 Monaten |
|
Piotr Wilkin
|
554593d60d
Variable scopes are fun
|
vor 3 Monaten |
