Commit Graph

221 Commits

Author SHA1 Message Date
Colin 6cb969ac3b Refine LUT repeat from group to LUT. 2025-06-10 20:03:23 +08:00
Colin c322ee8228 Update Lut forward and backward. 2025-06-10 10:52:26 +08:00
Colin a676025d20 Update speed test. 2025-06-09 17:54:05 +08:00
Colin fa15680aa6 Add LNN. 2025-06-09 16:00:13 +08:00
Colin 50fb9bf6dc Add profile function. 2025-06-09 15:57:53 +08:00
Colin 878c690ac4 Refine LUTCNN, keep accuracy to ~93 2025-06-09 15:56:03 +08:00
Colin 5d03634595 Revert mnist to new backwoard of LUT 855296be55. 2025-06-09 15:04:53 +08:00
Colin 924a0ca9b4 Fix and update binary network. 2025-06-09 14:41:37 +08:00
Colin 710c901f5e Refine llamafactory train. 2025-06-08 16:01:19 +08:00
Colin 3ceb02a6b0 Update llamafactory qwen3. 2025-06-06 17:26:32 +08:00
Colin 392f507945 Add llamafactory, Refine binary LUT add SimpleLNN. 2025-06-06 17:25:04 +08:00
Colin 9a8434df61 Update demo and readme. 2025-06-05 13:17:01 +08:00
Colin eed28ac06e Add finetune/. 2025-06-01 12:31:49 +08:00
Colin e2c8668a1b Update mnist use gather to speed up. 2025-05-28 16:05:34 +08:00
Colin dd71a5dedd Refine mnist LUT by add lutCNN. 2025-05-27 18:51:07 +08:00
Colin 30dd319d8c Update mnist. 2025-05-26 18:47:55 +08:00
Colin 855296be55 set the channel to 80 at first layer accuracy to 94. 2025-05-25 15:33:39 +08:00
Colin 3eb711a97e Update wit. 2025-05-22 15:26:43 +08:00
Colin f98a951b58 Update mnist. 2025-05-22 15:23:41 +08:00
Colin f1124bc3b1 Update binary mnist. 2025-05-21 11:29:15 +08:00
Colin 9194595716 Add binary/mnist.py. 2025-05-20 14:07:10 +08:00
Colin db97131caf Update train code. 2025-04-09 19:12:21 +08:00
Colin cda7f04e49 Fix model path. 2025-03-18 15:58:08 +08:00
Colin 7faf629d45 Refine seed config. 2025-03-14 17:38:24 +08:00
Colin e3493163f3 Update configuration to str for tensorboard. 2025-03-13 23:02:11 +08:00
Colin b3817f84fe Refine model of wit. 2025-03-13 16:52:33 +08:00
Colin f411b1cc5e donot use auto optimizer. 2025-03-13 14:28:53 +08:00
Colin 990e27ba15 Fix train define. 2025-03-12 20:02:02 +08:00
Colin 90e94db2c1 Rename QwenModule to lightmodule. 2025-03-10 19:14:47 +08:00
Colin 1efda9fe25 Update rwkv train. 2025-03-10 16:26:53 +08:00
Colin 0600d46f2f Add safe softmax demo code. 2025-03-09 14:39:34 +08:00
Colin c4e9637c10 Add rwkv in wit. 2025-03-07 18:53:46 +08:00
Colin 251ea7f004 Add rwkv flow graph. 2025-03-06 23:22:50 +08:00
Colin 821e7206b8 Refine rwkv. 2025-03-05 19:39:08 +08:00
Colin 240858c030 Update rwkv. 2025-03-03 21:30:58 +08:00
Colin 4f18296e40 Format rwkv/RWKV-v7/rwkv_v7_demo.py 2025-03-03 15:47:21 +08:00
Colin 002f132818 Add hook of attention for query qkv. 2025-03-03 15:38:00 +08:00
Colin 3eea09d78c Add rwkv v7 demo. 2025-03-03 14:53:15 +08:00
Colin e3b63f4635 Refine model define. 2025-02-28 13:38:28 +08:00
Colin bff65b189d Add query file. Refine print tree. 2025-02-26 16:55:20 +08:00
Colin 3c34d12fba Refine dataset and nodetree. 2025-02-24 21:38:31 +08:00
Colin a1d5fce300 Refine node tree define and print. 2025-02-23 16:46:37 +08:00
Colin 3a7ce45654 Refine meaning dataset map. 2025-02-22 16:50:16 +08:00
Colin f0469b351c refine meaning dataset tree print. 2025-02-22 01:53:58 +08:00
Colin 81f9e54ca3 Update inference and val dataset. 2025-02-21 17:28:21 +08:00
Colin 383c40afd7 Update inference for debug. 2025-02-21 15:51:27 +08:00
Colin 7cf31a1f78 Rename mask level and index. 2025-02-21 15:33:37 +08:00
Colin bca06af2dc Refine meaning dataset. 2025-02-20 17:30:46 +08:00
Colin 0b19fd576a Refine train code. 2025-02-19 19:39:59 +08:00
Colin 3feec36059 refine code. 2025-02-19 18:01:41 +08:00