colin

colin pushed to main at colin/gpt-pretrain

2024-02-24 14:14:29 +08:00

122cbd9ff8 Use local tokenizer.

colin pushed to main at colin/gpt-pretrain

2024-02-24 13:44:39 +08:00

ac61c4d925 set use local dataset.

colin pushed to main at colin/gpt-pretrain

2024-02-24 13:42:16 +08:00

087366c59b init gpt train without download.

colin pushed to main at colin/gpt-pretrain

2024-02-24 12:07:29 +08:00

b992ae99fa Train on wiki data.

colin created branch master in colin/Dataset

2024-02-24 11:30:31 +08:00

colin pushed to master at colin/Dataset

2024-02-24 11:30:31 +08:00

cf6fe659c8 init dateset repo.

colin created repository colin/Dataset

2024-02-24 11:30:18 +08:00

colin created branch main in colin/gpt-pretrain

2024-02-22 15:04:17 +08:00

colin pushed to main at colin/gpt-pretrain

2024-02-22 15:04:17 +08:00

7d16743184 enable pretrain.

b655153ec7 Merge pull request #2 from Yiqing-Zhou/fix-custom-models

9f8f9ecc89 [fix] fix genarate with custom models does not go to custom_models

e8d543558c Merge pull request #1 from Yiqing-Zhou/custom-model-configs

fcb93e52c4 [feature] custom model configs

Compare 10 commits »

colin created repository colin/gpt-pretrain

2024-02-22 15:04:07 +08:00

colin pushed to master at colin/Witllm

2024-02-21 21:11:29 +08:00

fc071dce70 Remove no use tiktoken.

colin created branch main in colin/SDL2Demo

2024-02-21 00:04:13 +08:00

colin pushed to main at colin/SDL2Demo

2024-02-21 00:04:13 +08:00

bd8c9540d4 init.

colin created repository colin/SDL2Demo

2024-02-21 00:03:39 +08:00

colin pushed to master at colin/Witllm

2024-02-06 14:08:57 +08:00

fe13f12327 Add wit.

colin pushed to master at colin/Witllm

2024-02-04 23:50:04 +08:00

6366b52fef Add reaserch sile resault.

9d5d590b09 Add dataset and wit.

Compare 2 commits »

colin pushed to master at colin/Witllm

2024-01-29 00:12:39 +08:00

b7c27af6c8 Add research_token to dump token relationship in attention layer0.

185278f3a9 Update research_attention dump without sum.

Compare 2 commits »

colin pushed to master at colin/Witllm

2024-01-26 20:35:38 +08:00

3f296ccdb2 Update research.

bba27e3444 Refine prepareInput.

Compare 2 commits »

colin pushed to master at colin/Witllm

2024-01-24 21:26:29 +08:00

19491d1f4a Refine model of qwen.

colin pushed to master at colin/Witllm

2024-01-24 21:22:16 +08:00

a4fafd460f Refine model of qwen.

11af10e710 Refine research_attention and forward model.

Compare 2 commits »