Commit Graph

25 Commits

Author SHA1 Message Date
Colin d50cb798b6 Update more. 2024-07-31 22:04:01 +08:00
Colin 50e502ae96 Add auto size support in meaning dataset. 2024-04-23 19:05:06 +08:00
Colin 2d415d9e44 Reduce memory cost when build dataset. 2024-04-19 16:57:59 +08:00
Colin 43883be692 Speedup meaning dataset build speed. 2024-04-19 15:08:40 +08:00
Colin b062cc9c94 Save memory cost when meaning dataset build by np array. 2024-04-19 00:51:06 +08:00
Colin a524d01ac3 Add multithread dataloder support. 2024-04-17 23:59:09 +08:00
Colin ef08359a94 Refine meaning dataset memory cost when building. 2024-04-14 23:35:55 +08:00
Colin 9926b893a4 Fix dataset. 2024-04-14 01:27:58 +08:00
Colin 6791264987 Update meaning dataset function. 2024-04-12 20:04:04 +08:00
Colin 43e486aa1c Add mask when validation. 2024-04-10 14:43:16 +08:00
Colin 7434427ec9 Update meaning dataset. 2024-04-10 00:34:47 +08:00
Colin 7560166b76 Dump dataset to single file. 2024-04-07 17:32:21 +08:00
Colin 9d3b9a210a Speedup dataset generate. 2024-04-07 17:03:35 +08:00
Colin 33d1e22655 Refine meaning dataset. 2024-04-07 00:25:21 +08:00
Colin 3c774983d4 Refine mapping print. 2024-04-03 13:03:59 +08:00
Colin 1642a91d80 Add meaning map print. 2024-04-03 11:24:00 +08:00
Colin a15e55bead Add mapping output. 2024-04-02 19:59:05 +08:00
Colin 7a8815cceb Refine the base code. 2024-03-29 22:10:25 +08:00
Colin 618d57f23c Update define. 2024-03-26 18:15:55 +08:00
Colin b0ca4dc35d Update meaning dataset define. 2024-03-26 11:32:27 +08:00
Colin 01e5f86e94 Add inference. 2024-03-20 22:27:28 +08:00
Colin 72718e6b72 Add Batch dataloader support. 2024-03-18 11:43:41 +08:00
Colin 9feaafcb7a Apply meaning data train. 2024-03-15 11:16:42 +08:00
Colin 05f17b1221 Refine model config and init. 2024-03-14 11:40:26 +08:00
Colin 8330cbb036 Add meaning dataset. 2024-03-13 19:41:02 +08:00