Commit Graph

79 Commits

Author SHA1 Message Date
Colin cda7f04e49 Fix model path. 2025-03-18 15:58:08 +08:00
Colin 7faf629d45 Refine seed config. 2025-03-14 17:38:24 +08:00
Colin e3493163f3 Update configuration to str for tensorboard. 2025-03-13 23:02:11 +08:00
Colin b3817f84fe Refine model of wit. 2025-03-13 16:52:33 +08:00
Colin f411b1cc5e donot use auto optimizer. 2025-03-13 14:28:53 +08:00
Colin 990e27ba15 Fix train define. 2025-03-12 20:02:02 +08:00
Colin 90e94db2c1 Rename QwenModule to lightmodule. 2025-03-10 19:14:47 +08:00
Colin 1efda9fe25 Update rwkv train. 2025-03-10 16:26:53 +08:00
Colin c4e9637c10 Add rwkv in wit. 2025-03-07 18:53:46 +08:00
Colin 002f132818 Add hook of attention for query qkv. 2025-03-03 15:38:00 +08:00
Colin 3eea09d78c Add rwkv v7 demo. 2025-03-03 14:53:15 +08:00
Colin e3b63f4635 Refine model define. 2025-02-28 13:38:28 +08:00
Colin bff65b189d Add query file. Refine print tree. 2025-02-26 16:55:20 +08:00
Colin 3c34d12fba Refine dataset and nodetree. 2025-02-24 21:38:31 +08:00
Colin a1d5fce300 Refine node tree define and print. 2025-02-23 16:46:37 +08:00
Colin 3a7ce45654 Refine meaning dataset map. 2025-02-22 16:50:16 +08:00
Colin f0469b351c refine meaning dataset tree print. 2025-02-22 01:53:58 +08:00
Colin 81f9e54ca3 Update inference and val dataset. 2025-02-21 17:28:21 +08:00
Colin 383c40afd7 Update inference for debug. 2025-02-21 15:51:27 +08:00
Colin 7cf31a1f78 Rename mask level and index. 2025-02-21 15:33:37 +08:00
Colin bca06af2dc Refine meaning dataset. 2025-02-20 17:30:46 +08:00
Colin 0b19fd576a Refine train code. 2025-02-19 19:39:59 +08:00
Colin 3feec36059 refine code. 2025-02-19 18:01:41 +08:00
Colin c92db47135 Benchmark single 4090D 15fps
cd /wit
python train.py
2025-02-18 21:40:49 +08:00
Colin f8480678d8 Refine meaning dataset document. 2025-02-18 19:36:16 +08:00
Colin 383125edc9 Refine dataset org. 2025-02-18 14:21:15 +08:00
Colin e635ce0df4 Regine wit config method. 2025-02-17 19:41:40 +08:00
Colin d50cb798b6 Update more. 2024-07-31 22:04:01 +08:00
Colin 50e502ae96 Add auto size support in meaning dataset. 2024-04-23 19:05:06 +08:00
Colin 24957aa2ae Refine train. 2024-04-19 19:12:38 +08:00
Colin 2d415d9e44 Reduce memory cost when build dataset. 2024-04-19 16:57:59 +08:00
Colin 43883be692 Speedup meaning dataset build speed. 2024-04-19 15:08:40 +08:00
Colin b062cc9c94 Save memory cost when meaning dataset build by np array. 2024-04-19 00:51:06 +08:00
Colin a524d01ac3 Add multithread dataloder support. 2024-04-17 23:59:09 +08:00
Colin 17de117bda Refine train, 2024-04-17 20:22:49 +08:00
Colin ef08359a94 Refine meaning dataset memory cost when building. 2024-04-14 23:35:55 +08:00
Colin c907210fc1 Update document. 2024-04-14 17:41:30 +08:00
Colin 9926b893a4 Fix dataset. 2024-04-14 01:27:58 +08:00
Colin 6791264987 Update meaning dataset function. 2024-04-12 20:04:04 +08:00
Colin 43e486aa1c Add mask when validation. 2024-04-10 14:43:16 +08:00
Colin 7434427ec9 Update meaning dataset. 2024-04-10 00:34:47 +08:00
Colin 7560166b76 Dump dataset to single file. 2024-04-07 17:32:21 +08:00
Colin 9d3b9a210a Speedup dataset generate. 2024-04-07 17:03:35 +08:00
Colin 33d1e22655 Refine meaning dataset. 2024-04-07 00:25:21 +08:00
Colin 2bc9e3b57e Refine train dataset. 2024-04-03 17:09:30 +08:00
Colin 3c774983d4 Refine mapping print. 2024-04-03 13:03:59 +08:00
Colin 1642a91d80 Add meaning map print. 2024-04-03 11:24:00 +08:00
Colin a15e55bead Add mapping output. 2024-04-02 19:59:05 +08:00
Colin 7a8815cceb Refine the base code. 2024-03-29 22:10:25 +08:00
Colin 618d57f23c Update define. 2024-03-26 18:15:55 +08:00