Colin
|
f411b1cc5e
|
donot use auto optimizer.
|
2025-03-13 14:28:53 +08:00 |
|
Colin
|
90e94db2c1
|
Rename QwenModule to lightmodule.
|
2025-03-10 19:14:47 +08:00 |
|
Colin
|
1efda9fe25
|
Update rwkv train.
|
2025-03-10 16:26:53 +08:00 |
|
Colin
|
c4e9637c10
|
Add rwkv in wit.
|
2025-03-07 18:53:46 +08:00 |
|
Colin
|
002f132818
|
Add hook of attention for query qkv.
|
2025-03-03 15:38:00 +08:00 |
|
Colin
|
e3b63f4635
|
Refine model define.
|
2025-02-28 13:38:28 +08:00 |
|
Colin
|
bff65b189d
|
Add query file. Refine print tree.
|
2025-02-26 16:55:20 +08:00 |
|
Colin
|
3c34d12fba
|
Refine dataset and nodetree.
|
2025-02-24 21:38:31 +08:00 |
|
Colin
|
383c40afd7
|
Update inference for debug.
|
2025-02-21 15:51:27 +08:00 |
|
Colin
|
7cf31a1f78
|
Rename mask level and index.
|
2025-02-21 15:33:37 +08:00 |
|
Colin
|
bca06af2dc
|
Refine meaning dataset.
|
2025-02-20 17:30:46 +08:00 |
|
Colin
|
0b19fd576a
|
Refine train code.
|
2025-02-19 19:39:59 +08:00 |
|
Colin
|
3feec36059
|
refine code.
|
2025-02-19 18:01:41 +08:00 |
|
Colin
|
e635ce0df4
|
Regine wit config method.
|
2025-02-17 19:41:40 +08:00 |