Colin
|
bd5379f24e
|
Fix meaning dataset get NodeTree with stride.
|
2025-08-21 22:23:28 +08:00 |
|
Colin
|
e18ee0c781
|
Update meaning dataset stride token.
|
2025-08-21 18:11:58 +08:00 |
|
Colin
|
297c346df9
|
Add none linear dot.
|
2025-08-21 13:52:34 +08:00 |
|
Colin
|
a326df1bba
|
Reset base config of model.
|
2025-08-19 13:20:34 +08:00 |
|
Colin
|
d48a5563aa
|
Fix get_nodetree.
|
2025-08-18 13:03:32 +08:00 |
|
Colin
|
085bd92fb9
|
Refine get_nodetree to support stride and tree tokens.
|
2025-08-18 11:17:35 +08:00 |
|
Colin
|
3e6ff2d580
|
Refine query_block_output.
|
2025-08-17 17:58:23 +08:00 |
|
Colin
|
ee30eb4aab
|
Remove weight and height in the meaning dataset.
|
2025-08-17 14:43:13 +08:00 |
|
Colin
|
b2fe00c157
|
Add reserve_vocaba support, delete InitValDataset.
|
2025-08-14 14:51:43 +08:00 |
|
Colin
|
a983a2b6e6
|
Fix rank index and all calculater when tree mode enable.
|
2025-08-14 13:25:47 +08:00 |
|
Colin
|
47ba18a4f9
|
Refine base model.
|
2025-08-13 22:44:09 +08:00 |
|
Colin
|
57a06fed27
|
Fix light module config error.
|
2025-08-13 22:08:21 +08:00 |
|
Colin
|
59e079f5e7
|
Update stride test.
|
2025-08-13 16:37:24 +08:00 |
|
Colin
|
ce81f26845
|
Fix dataset cache check with vocab size.
|
2025-08-12 11:08:16 +08:00 |
|
Colin
|
2a09b9d9b1
|
Update meaning of stride mask label.
|
2025-08-11 16:07:32 +08:00 |
|
Colin
|
3f0eedfef8
|
Refine meaning dataset cache files.
|
2025-08-10 22:16:10 +08:00 |
|
Colin
|
3e52285ab6
|
Reset Base config.
|
2025-08-10 21:13:37 +08:00 |
|
Colin
|
133187d7bd
|
Refine vocab_size of meaning dataset.
|
2025-08-10 21:01:26 +08:00 |
|
Colin
|
a70e19df5d
|
Init status.
|
2025-08-10 15:25:14 +08:00 |
|
Colin
|
b56bbb2952
|
Refine import code.
|
2025-08-10 15:10:20 +08:00 |
|
Colin
|
b62444a9dc
|
Refine meaning dataset import.
|
2025-08-10 14:30:51 +08:00 |
|
Colin
|
71ab0bb57d
|
Add config of stride with_tree end, Rename dataset to meaning.
|
2025-08-10 13:17:04 +08:00 |
|
Colin
|
1c7635556f
|
Reconfig train model and code.
|
2025-08-09 16:32:48 +08:00 |
|
Colin
|
9c75b8920d
|
Add stride support in meaning_dataset.
|
2025-08-07 17:36:43 +08:00 |
|
Colin
|
d7191003e0
|
Add parent support in meaning_dataset.
|
2025-08-04 16:10:46 +08:00 |
|
Colin
|
8882073978
|
Update test model.
|
2025-08-03 18:23:26 +08:00 |
Colin
|
a7e0bd508c
|
Update get_relation_distance
|
2025-06-26 21:42:38 +08:00 |
|
Colin
|
927c98e823
|
Add meaning dataset get_relation_table support and paint to qk image.
|
2025-06-25 20:13:48 +08:00 |
|
Colin
|
392f507945
|
Add llamafactory, Refine binary LUT add SimpleLNN.
|
2025-06-06 17:25:04 +08:00 |
|
Colin
|
3eb711a97e
|
Update wit.
|
2025-05-22 15:26:43 +08:00 |
|
Colin
|
db97131caf
|
Update train code.
|
2025-04-09 19:12:21 +08:00 |
|
Colin
|
cda7f04e49
|
Fix model path.
|
2025-03-18 15:58:08 +08:00 |
|
Colin
|
7faf629d45
|
Refine seed config.
|
2025-03-14 17:38:24 +08:00 |
|
Colin
|
e3493163f3
|
Update configuration to str for tensorboard.
|
2025-03-13 23:02:11 +08:00 |
|
Colin
|
b3817f84fe
|
Refine model of wit.
|
2025-03-13 16:52:33 +08:00 |
|
Colin
|
f411b1cc5e
|
donot use auto optimizer.
|
2025-03-13 14:28:53 +08:00 |
|
Colin
|
990e27ba15
|
Fix train define.
|
2025-03-12 20:02:02 +08:00 |
|
Colin
|
90e94db2c1
|
Rename QwenModule to lightmodule.
|
2025-03-10 19:14:47 +08:00 |
|
Colin
|
1efda9fe25
|
Update rwkv train.
|
2025-03-10 16:26:53 +08:00 |
|
Colin
|
c4e9637c10
|
Add rwkv in wit.
|
2025-03-07 18:53:46 +08:00 |
|
Colin
|
002f132818
|
Add hook of attention for query qkv.
|
2025-03-03 15:38:00 +08:00 |
|
Colin
|
3eea09d78c
|
Add rwkv v7 demo.
|
2025-03-03 14:53:15 +08:00 |
|
Colin
|
e3b63f4635
|
Refine model define.
|
2025-02-28 13:38:28 +08:00 |
|
Colin
|
bff65b189d
|
Add query file. Refine print tree.
|
2025-02-26 16:55:20 +08:00 |
|
Colin
|
3c34d12fba
|
Refine dataset and nodetree.
|
2025-02-24 21:38:31 +08:00 |
|
Colin
|
a1d5fce300
|
Refine node tree define and print.
|
2025-02-23 16:46:37 +08:00 |
|
Colin
|
3a7ce45654
|
Refine meaning dataset map.
|
2025-02-22 16:50:16 +08:00 |
|
Colin
|
f0469b351c
|
refine meaning dataset tree print.
|
2025-02-22 01:53:58 +08:00 |
|
Colin
|
81f9e54ca3
|
Update inference and val dataset.
|
2025-02-21 17:28:21 +08:00 |
|
Colin
|
383c40afd7
|
Update inference for debug.
|
2025-02-21 15:51:27 +08:00 |