Commit Graph

212 Commits

Author SHA1 Message Date
Colin 3ceb02a6b0 Update llamafactory qwen3. 2025-06-06 17:26:32 +08:00
Colin 392f507945 Add llamafactory, Refine binary LUT add SimpleLNN. 2025-06-06 17:25:04 +08:00
Colin 9a8434df61 Update demo and readme. 2025-06-05 13:17:01 +08:00
Colin eed28ac06e Add finetune/. 2025-06-01 12:31:49 +08:00
Colin e2c8668a1b Update mnist use gather to speed up. 2025-05-28 16:05:34 +08:00
Colin dd71a5dedd Refine mnist LUT by add lutCNN. 2025-05-27 18:51:07 +08:00
Colin 30dd319d8c Update mnist. 2025-05-26 18:47:55 +08:00
Colin 855296be55 set the channel to 80 at first layer accuracy to 94. 2025-05-25 15:33:39 +08:00
Colin 3eb711a97e Update wit. 2025-05-22 15:26:43 +08:00
Colin f98a951b58 Update mnist. 2025-05-22 15:23:41 +08:00
Colin f1124bc3b1 Update binary mnist. 2025-05-21 11:29:15 +08:00
Colin 9194595716 Add binary/mnist.py. 2025-05-20 14:07:10 +08:00
Colin db97131caf Update train code. 2025-04-09 19:12:21 +08:00
Colin cda7f04e49 Fix model path. 2025-03-18 15:58:08 +08:00
Colin 7faf629d45 Refine seed config. 2025-03-14 17:38:24 +08:00
Colin e3493163f3 Update configuration to str for tensorboard. 2025-03-13 23:02:11 +08:00
Colin b3817f84fe Refine model of wit. 2025-03-13 16:52:33 +08:00
Colin f411b1cc5e donot use auto optimizer. 2025-03-13 14:28:53 +08:00
Colin 990e27ba15 Fix train define. 2025-03-12 20:02:02 +08:00
Colin 90e94db2c1 Rename QwenModule to lightmodule. 2025-03-10 19:14:47 +08:00
Colin 1efda9fe25 Update rwkv train. 2025-03-10 16:26:53 +08:00
Colin 0600d46f2f Add safe softmax demo code. 2025-03-09 14:39:34 +08:00
Colin c4e9637c10 Add rwkv in wit. 2025-03-07 18:53:46 +08:00
Colin 251ea7f004 Add rwkv flow graph. 2025-03-06 23:22:50 +08:00
Colin 821e7206b8 Refine rwkv. 2025-03-05 19:39:08 +08:00
Colin 240858c030 Update rwkv. 2025-03-03 21:30:58 +08:00
Colin 4f18296e40 Format rwkv/RWKV-v7/rwkv_v7_demo.py 2025-03-03 15:47:21 +08:00
Colin 002f132818 Add hook of attention for query qkv. 2025-03-03 15:38:00 +08:00
Colin 3eea09d78c Add rwkv v7 demo. 2025-03-03 14:53:15 +08:00
Colin e3b63f4635 Refine model define. 2025-02-28 13:38:28 +08:00
Colin bff65b189d Add query file. Refine print tree. 2025-02-26 16:55:20 +08:00
Colin 3c34d12fba Refine dataset and nodetree. 2025-02-24 21:38:31 +08:00
Colin a1d5fce300 Refine node tree define and print. 2025-02-23 16:46:37 +08:00
Colin 3a7ce45654 Refine meaning dataset map. 2025-02-22 16:50:16 +08:00
Colin f0469b351c refine meaning dataset tree print. 2025-02-22 01:53:58 +08:00
Colin 81f9e54ca3 Update inference and val dataset. 2025-02-21 17:28:21 +08:00
Colin 383c40afd7 Update inference for debug. 2025-02-21 15:51:27 +08:00
Colin 7cf31a1f78 Rename mask level and index. 2025-02-21 15:33:37 +08:00
Colin bca06af2dc Refine meaning dataset. 2025-02-20 17:30:46 +08:00
Colin 0b19fd576a Refine train code. 2025-02-19 19:39:59 +08:00
Colin 3feec36059 refine code. 2025-02-19 18:01:41 +08:00
Colin c92db47135 Benchmark single 4090D 15fps
cd /wit
python train.py
2025-02-18 21:40:49 +08:00
Colin f8480678d8 Refine meaning dataset document. 2025-02-18 19:36:16 +08:00
Colin 383125edc9 Refine dataset org. 2025-02-18 14:21:15 +08:00
Colin e635ce0df4 Regine wit config method. 2025-02-17 19:41:40 +08:00
Colin cdee69bf54 Regine minist unsuper. 2025-02-17 14:27:15 +08:00
Colin f74a5d29bd Update unsuper minist. 2024-11-04 14:23:29 +08:00
Colin df05002c90 Update unsuper minist. 2024-11-03 15:15:33 +08:00
Colin 1bb41f0ee7 Update. 2024-10-31 15:15:13 +08:00
Colin 2ad977a072 Update show. 2024-10-31 00:01:57 +08:00