colin

colin pushed to master at colin/Witllm

2024-03-04 21:42:40 +08:00

9e8e92ae25 Update trainer to custom data.

colin pushed to master at colin/Witllm

2024-03-03 23:35:56 +08:00

1622bf3054 add mnbvc dataset .

colin pushed to master at colin/Witllm

2024-02-26 23:59:44 +08:00

8120be66a6 sperate train and val dataset.

colin pushed to master at colin/Witllm

2024-02-26 22:44:47 +08:00

d1906629ab Enable wit train on cutome dataset and loss down.

1ef3e419cb Add custom dataset support.

e5f97af291 Add wit train support.

Compare 3 commits »

colin pushed to master at colin/vscodesetting

2024-02-26 16:43:36 +08:00

b44ff7f8a0 更新 keybindings_windows.json

colin pushed to master at colin/vscodesetting

2024-02-26 16:41:05 +08:00

5c4734d2c3 添加 keybindings_windows.json

colin pushed to main at colin/gpt-pretrain

2024-02-24 14:14:29 +08:00

122cbd9ff8 Use local tokenizer.

colin pushed to main at colin/gpt-pretrain

2024-02-24 13:44:39 +08:00

ac61c4d925 set use local dataset.

colin pushed to main at colin/gpt-pretrain

2024-02-24 13:42:16 +08:00

087366c59b init gpt train without download.

colin pushed to main at colin/gpt-pretrain

2024-02-24 12:07:29 +08:00

b992ae99fa Train on wiki data.

colin created branch master in colin/Dataset

2024-02-24 11:30:31 +08:00

colin pushed to master at colin/Dataset

2024-02-24 11:30:31 +08:00

cf6fe659c8 init dateset repo.

colin created repository colin/Dataset

2024-02-24 11:30:18 +08:00

colin created branch main in colin/gpt-pretrain

2024-02-22 15:04:17 +08:00

colin pushed to main at colin/gpt-pretrain

2024-02-22 15:04:17 +08:00

7d16743184 enable pretrain.

b655153ec7 Merge pull request #2 from Yiqing-Zhou/fix-custom-models

9f8f9ecc89 [fix] fix genarate with custom models does not go to custom_models

e8d543558c Merge pull request #1 from Yiqing-Zhou/custom-model-configs

fcb93e52c4 [feature] custom model configs

Compare 10 commits »

colin created repository colin/gpt-pretrain

2024-02-22 15:04:07 +08:00

colin pushed to master at colin/Witllm

2024-02-21 21:11:29 +08:00

fc071dce70 Remove no use tiktoken.

colin created branch main in colin/SDL2Demo

2024-02-21 00:04:13 +08:00

colin pushed to main at colin/SDL2Demo

2024-02-21 00:04:13 +08:00

bd8c9540d4 init.

colin created repository colin/SDL2Demo

2024-02-21 00:03:39 +08:00