colin

colin created branch main in colin/gpt-pretrain

2024-02-22 15:04:17 +08:00

colin pushed to main at colin/gpt-pretrain

2024-02-22 15:04:17 +08:00

7d16743184 enable pretrain.

b655153ec7 Merge pull request #2 from Yiqing-Zhou/fix-custom-models

9f8f9ecc89 [fix] fix genarate with custom models does not go to custom_models

e8d543558c Merge pull request #1 from Yiqing-Zhou/custom-model-configs

fcb93e52c4 [feature] custom model configs

Compare 10 commits »

colin created repository colin/gpt-pretrain

2024-02-22 15:04:07 +08:00

colin pushed to master at colin/Witllm

2024-02-21 21:11:29 +08:00

fc071dce70 Remove no use tiktoken.

colin created branch main in colin/SDL2Demo

2024-02-21 00:04:13 +08:00

colin pushed to main at colin/SDL2Demo

2024-02-21 00:04:13 +08:00

bd8c9540d4 init.

colin created repository colin/SDL2Demo

2024-02-21 00:03:39 +08:00

colin pushed to master at colin/Witllm

2024-02-06 14:08:57 +08:00

fe13f12327 Add wit.

colin pushed to master at colin/Witllm

2024-02-04 23:50:04 +08:00

6366b52fef Add reaserch sile resault.

9d5d590b09 Add dataset and wit.

Compare 2 commits »

colin pushed to master at colin/Witllm

2024-01-29 00:12:39 +08:00

b7c27af6c8 Add research_token to dump token relationship in attention layer0.

185278f3a9 Update research_attention dump without sum.

Compare 2 commits »

colin pushed to master at colin/Witllm

2024-01-26 20:35:38 +08:00

3f296ccdb2 Update research.

bba27e3444 Refine prepareInput.

Compare 2 commits »

colin pushed to master at colin/Witllm

2024-01-24 21:26:29 +08:00

19491d1f4a Refine model of qwen.

colin pushed to master at colin/Witllm

2024-01-24 21:22:16 +08:00

a4fafd460f Refine model of qwen.

11af10e710 Refine research_attention and forward model.

Compare 2 commits »

colin pushed to master at colin/Witllm

2024-01-22 20:57:39 +08:00

1811b9611a Refine research_attention.

colin pushed to master at colin/Witllm

2024-01-21 22:43:29 +08:00

5dbac40925 Refien.

colin pushed to master at colin/Witllm

2024-01-21 20:50:59 +08:00

17a2df2e6f Update show and q@k dump.

colin pushed to master at colin/Witllm

2024-01-21 17:54:14 +08:00

ae6ea67bbe Refine qwen/research_attention.py.

colin pushed to master at colin/Witllm

2024-01-21 16:48:00 +08:00

dab1c94bc6 Refine qwen to module fomater.

colin pushed to master at colin/Witllm

2024-01-21 16:46:25 +08:00

79573867af Refine qwen to module fomater.

colin pushed to master at colin/Witllm

2024-01-21 12:46:20 +08:00

9d28280cb1 Refine model of qwen and add runner.