• Joined on 2023-12-30
colin pushed to master at colin/Witllm 2024-04-19 00:51:39 +08:00
b062cc9c94 Save memory cost when meaning dataset build by np array.
colin pushed to master at colin/Witllm 2024-04-17 23:59:32 +08:00
a524d01ac3 Add multithread dataloder support.
colin pushed to master at colin/Witllm 2024-04-17 20:23:06 +08:00
17de117bda Refine train,
colin pushed to master at colin/Witllm 2024-04-14 23:36:27 +08:00
ef08359a94 Refine meaning dataset memory cost when building.
colin pushed to master at colin/Witllm 2024-04-14 17:41:41 +08:00
c907210fc1 Update document.
colin pushed to master at colin/Witllm 2024-04-14 01:28:09 +08:00
9926b893a4 Fix dataset.
colin pushed to master at colin/Witllm 2024-04-12 20:04:17 +08:00
6791264987 Update meaning dataset function.
colin pushed to master at colin/Witllm 2024-04-10 14:43:33 +08:00
43e486aa1c Add mask when validation.
colin pushed to master at colin/Witllm 2024-04-10 00:35:03 +08:00
7434427ec9 Update meaning dataset.
7560166b76 Dump dataset to single file.
Compare 2 commits »
colin pushed to master at colin/Witllm 2024-04-07 17:04:14 +08:00
9d3b9a210a Speedup dataset generate.
colin pushed to master at colin/Witllm 2024-04-07 00:25:34 +08:00
33d1e22655 Refine meaning dataset.
colin pushed to master at colin/Witllm 2024-04-03 17:09:55 +08:00
2bc9e3b57e Refine train dataset.
colin pushed to master at colin/Witllm 2024-04-03 13:04:12 +08:00
3c774983d4 Refine mapping print.
colin pushed to master at colin/Witllm 2024-04-03 11:24:15 +08:00
1642a91d80 Add meaning map print.
colin pushed to master at colin/Witllm 2024-04-02 22:35:08 +08:00
89c12380cb Delete no used files.
colin pushed to master at colin/Witllm 2024-04-02 19:59:23 +08:00
a15e55bead Add mapping output.
colin pushed to master at colin/Witllm 2024-04-02 15:38:59 +08:00
e2b48c0ab4 Add mamba.
colin pushed to master at colin/Witllm 2024-03-29 22:10:46 +08:00
7a8815cceb Refine the base code.
colin pushed to master at colin/Witllm 2024-03-26 18:16:08 +08:00
618d57f23c Update define.
colin pushed to master at colin/Witllm 2024-03-26 15:01:29 +08:00
33b351ff8a Refine train.py.