colin
/
Witllm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Commit Graph

  • bd5379f24e Fix meaning dataset get NodeTree with stride. master Colin 2025-08-21 22:23:28 +0800
  • e18ee0c781 Update meaning dataset stride token. Colin 2025-08-21 18:11:58 +0800
  • 297c346df9 Add none linear dot. Colin 2025-08-21 13:52:34 +0800
  • a326df1bba Reset base config of model. Colin 2025-08-19 13:20:34 +0800
  • d48a5563aa Fix get_nodetree. Colin 2025-08-18 13:03:32 +0800
  • 085bd92fb9 Refine get_nodetree to support stride and tree tokens. Colin 2025-08-18 11:17:35 +0800
  • 3e6ff2d580 Refine query_block_output. Colin 2025-08-17 17:58:23 +0800
  • ee30eb4aab Remove weight and height in the meaning dataset. Colin 2025-08-17 14:43:13 +0800
  • b2fe00c157 Add reserve_vocaba support, delete InitValDataset. Colin 2025-08-14 14:51:43 +0800
  • a983a2b6e6 Fix rank index and all calculater when tree mode enable. Colin 2025-08-14 13:25:47 +0800
  • 47ba18a4f9 Refine base model. Colin 2025-08-13 22:44:09 +0800
  • 57a06fed27 Fix light module config error. Colin 2025-08-13 22:08:21 +0800
  • 59e079f5e7 Update stride test. Colin 2025-08-13 16:37:24 +0800
  • ce81f26845 Fix dataset cache check with vocab size. Colin 2025-08-12 11:08:16 +0800
  • 2a09b9d9b1 Update meaning of stride mask label. Colin 2025-08-11 16:07:32 +0800
  • 3f0eedfef8 Refine meaning dataset cache files. Colin 2025-08-10 22:16:10 +0800
  • 3e52285ab6 Reset Base config. Colin 2025-08-10 21:13:37 +0800
  • 133187d7bd Refine vocab_size of meaning dataset. Colin 2025-08-10 21:01:26 +0800
  • a70e19df5d Init status. Colin 2025-08-10 15:25:14 +0800
  • b56bbb2952 Refine import code. Colin 2025-08-10 15:10:20 +0800
  • b62444a9dc Refine meaning dataset import. Colin 2025-08-10 14:30:51 +0800
  • 71ab0bb57d Add config of stride with_tree end, Rename dataset to meaning. Colin 2025-08-10 13:17:04 +0800
  • 1c7635556f Reconfig train model and code. Colin 2025-08-09 16:32:48 +0800
  • 9c75b8920d Add stride support in meaning_dataset. Colin 2025-08-07 17:36:43 +0800
  • d7191003e0 Add parent support in meaning_dataset. Colin 2025-08-04 16:10:46 +0800
  • 8882073978 Update test model. Colin 2025-08-03 18:23:26 +0800
  • ab65f98e39 Add weight dump. Colin 2025-06-27 13:49:15 +0800
  • 9acd89c98e Update binary readme. Colin 2025-06-27 12:23:56 +0800
  • a7e0bd508c Update get_relation_distance Colin 2025-06-26 21:42:38 +0800
  • 927c98e823 Add meaning dataset get_relation_table support and paint to qk image. Colin 2025-06-25 20:13:48 +0800
  • d8539b6b2b Update mnist to higher accuracy. Colin 2025-06-13 20:55:43 +0800
  • a68e5ba5ee Update binary mnist. Colin 2025-06-12 14:51:07 +0800
  • 3d2ff85fc0 Update mnist. Colin 2025-06-10 23:14:27 +0800
  • 6cb969ac3b Refine LUT repeat from group to LUT. Colin 2025-06-10 20:03:23 +0800
  • c322ee8228 Update Lut forward and backward. Colin 2025-06-10 10:52:26 +0800
  • a676025d20 Update speed test. Colin 2025-06-09 17:54:05 +0800
  • fa15680aa6 Add LNN. Colin 2025-06-09 16:00:13 +0800
  • 50fb9bf6dc Add profile function. Colin 2025-06-09 15:57:53 +0800
  • 878c690ac4 Refine LUTCNN, keep accuracy to ~93 Colin 2025-06-09 15:56:03 +0800
  • 5d03634595 Revert mnist to new backwoard of LUT 855296be55. Colin 2025-06-09 15:04:53 +0800
  • 924a0ca9b4 Fix and update binary network. Colin 2025-06-09 14:41:37 +0800
  • 710c901f5e Refine llamafactory train. Colin 2025-06-08 16:01:19 +0800
  • 3ceb02a6b0 Update llamafactory qwen3. Colin 2025-06-06 17:26:32 +0800
  • 392f507945 Add llamafactory, Refine binary LUT add SimpleLNN. Colin 2025-06-06 17:25:04 +0800
  • 9a8434df61 Update demo and readme. Colin 2025-06-05 13:17:01 +0800
  • eed28ac06e Add finetune/. Colin 2025-06-01 12:31:49 +0800
  • e2c8668a1b Update mnist use gather to speed up. Colin 2025-05-28 16:05:34 +0800
  • dd71a5dedd Refine mnist LUT by add lutCNN. Colin 2025-05-27 18:51:07 +0800
  • 30dd319d8c Update mnist. Colin 2025-05-26 16:11:11 +0800
  • 855296be55 set the channel to 80 at first layer accuracy to 94. Colin 2025-05-25 15:33:39 +0800
  • 3eb711a97e Update wit. Colin 2025-05-22 15:26:43 +0800
  • f98a951b58 Update mnist. Colin 2025-05-22 15:23:41 +0800
  • f1124bc3b1 Update binary mnist. Colin 2025-05-21 11:29:15 +0800
  • 9194595716 Add binary/mnist.py. Colin 2025-05-20 14:07:10 +0800
  • db97131caf Update train code. Colin 2025-04-09 19:12:21 +0800
  • cda7f04e49 Fix model path. Colin 2025-03-18 15:58:08 +0800
  • 7faf629d45 Refine seed config. Colin 2025-03-14 17:38:24 +0800
  • e3493163f3 Update configuration to str for tensorboard. Colin 2025-03-13 23:02:11 +0800
  • b3817f84fe Refine model of wit. Colin 2025-03-13 16:52:33 +0800
  • f411b1cc5e donot use auto optimizer. Colin 2025-03-13 14:28:53 +0800
  • 990e27ba15 Fix train define. Colin 2025-03-12 20:02:02 +0800
  • 90e94db2c1 Rename QwenModule to lightmodule. Colin 2025-03-10 19:14:47 +0800
  • 1efda9fe25 Update rwkv train. Colin 2025-03-10 16:26:53 +0800
  • 0600d46f2f Add safe softmax demo code. Colin 2025-03-09 14:39:34 +0800
  • c4e9637c10 Add rwkv in wit. Colin 2025-03-07 18:53:46 +0800
  • 251ea7f004 Add rwkv flow graph. Colin 2025-03-06 23:22:50 +0800
  • 821e7206b8 Refine rwkv. Colin 2025-03-05 19:39:08 +0800
  • 240858c030 Update rwkv. Colin 2025-03-03 21:30:58 +0800
  • 4f18296e40 Format rwkv/RWKV-v7/rwkv_v7_demo.py Colin 2025-03-03 15:47:21 +0800
  • 002f132818 Add hook of attention for query qkv. Colin 2025-03-03 15:23:39 +0800
  • 3eea09d78c Add rwkv v7 demo. Colin 2025-03-03 14:53:15 +0800
  • e3b63f4635 Refine model define. Colin 2025-02-28 13:16:39 +0800
  • bff65b189d Add query file. Refine print tree. Colin 2025-02-26 16:55:20 +0800
  • 3c34d12fba Refine dataset and nodetree. Colin 2025-02-24 21:38:31 +0800
  • a1d5fce300 Refine node tree define and print. Colin 2025-02-23 16:46:37 +0800
  • 3a7ce45654 Refine meaning dataset map. Colin 2025-02-22 16:50:16 +0800
  • f0469b351c refine meaning dataset tree print. Colin 2025-02-22 01:53:58 +0800
  • 81f9e54ca3 Update inference and val dataset. Colin 2025-02-21 17:28:21 +0800
  • 383c40afd7 Update inference for debug. Colin 2025-02-21 15:51:27 +0800
  • 7cf31a1f78 Rename mask level and index. Colin 2025-02-21 15:33:37 +0800
  • bca06af2dc Refine meaning dataset. Colin 2025-02-20 17:30:46 +0800
  • 0b19fd576a Refine train code. Colin 2025-02-19 19:39:59 +0800
  • 3feec36059 refine code. Colin 2025-02-19 18:01:41 +0800
  • c92db47135 Benchmark single 4090D 15fps Colin 2025-02-18 21:40:49 +0800
  • f8480678d8 Refine meaning dataset document. Colin 2025-02-18 19:35:23 +0800
  • 383125edc9 Refine dataset org. Colin 2025-02-18 14:21:15 +0800
  • e635ce0df4 Regine wit config method. Colin 2025-02-17 19:41:40 +0800
  • cdee69bf54 Regine minist unsuper. Colin 2025-02-17 14:27:15 +0800
  • f74a5d29bd Update unsuper minist. Colin 2024-11-04 14:23:29 +0800
  • df05002c90 Update unsuper minist. Colin 2024-11-03 15:15:33 +0800
  • 1bb41f0ee7 Update. Colin 2024-10-31 15:15:13 +0800
  • 2ad977a072 Update show. Colin 2024-10-31 00:01:57 +0800
  • 59449df047 Refine minist unsuper. Colin 2024-10-28 18:52:28 +0800
  • 5b2cd4da61 Add model.conv1.weight normal after update grad. Colin 2024-10-28 16:31:42 +0800
  • 6a0b47c674 Update show tools. Colin 2024-10-27 19:48:53 +0800
  • a0da2565fe Update minist unsuper. Colin 2024-10-22 19:13:19 +0800
  • 385c438c1c Update unsuper. Colin 2024-10-22 13:54:26 +0800
  • f3690fd47f Update unsuper learning. Colin 2024-10-07 16:39:29 +0800
  • 22464e7724 Update unsuper. Colin 2024-10-05 16:17:41 +0800
  • 45d5701835 Unsuper train with max confidense of conv output Colin 2024-10-04 01:30:18 +0800