• Joined on 2023-12-30
colin pushed to master at colin/Witllm 2024-01-22 20:57:39 +08:00
1811b9611a Refine research_attention.
colin pushed to master at colin/Witllm 2024-01-21 22:43:29 +08:00
5dbac40925 Refien.
colin pushed to master at colin/Witllm 2024-01-21 20:50:59 +08:00
17a2df2e6f Update show and q@k dump.
colin pushed to master at colin/Witllm 2024-01-21 17:54:14 +08:00
ae6ea67bbe Refine qwen/research_attention.py.
colin pushed to master at colin/Witllm 2024-01-21 16:48:00 +08:00
dab1c94bc6 Refine qwen to module fomater.
colin pushed to master at colin/Witllm 2024-01-21 16:46:25 +08:00
79573867af Refine qwen to module fomater.
colin pushed to master at colin/Witllm 2024-01-21 12:46:20 +08:00
9d28280cb1 Refine model of qwen and add runner.
colin pushed to master at colin/Witllm 2024-01-21 02:34:08 +08:00
7c047f0b32 Refine model of qwen.
colin pushed to master at colin/Witllm 2024-01-20 23:01:20 +08:00
40ae899515 Refine model of qwen.
colin pushed to master at colin/Witllm 2024-01-20 20:47:42 +08:00
04f9fe002f Refine model of qwen.
colin pushed to master at colin/Witllm 2024-01-20 20:20:31 +08:00
4d493014ba Refine model of qwen.
12dcbec718 PreTrainedModel to mm.Module
0458e7303c Remove attention_mask
Compare 3 commits »
colin pushed to master at colin/Witllm 2024-01-20 00:11:28 +08:00
cd50c10e8c Move readme to charglm.
colin pushed to master at colin/Witllm 2024-01-20 00:10:38 +08:00
e7ba788982 Delete docs.
colin pushed to master at colin/Witllm 2024-01-19 18:22:52 +08:00
69154a4777 删除 doc/主观意识生成对话.md
colin pushed to master at colin/Witllm 2024-01-19 18:22:41 +08:00
fd0b0c63ba 删除 chatglm/graph.md
colin created branch query_matmul_key in colin/Witllm 2024-01-19 16:33:50 +08:00
colin pushed to query_matmul_key at colin/Witllm 2024-01-19 16:33:50 +08:00
7cf19b15cf Add image dump of query matmul key
colin pushed to master at colin/Witllm 2024-01-19 14:59:25 +08:00
f96bcc799c Refine model of qwen for long sequence in eval.
45c2f532ff Add mem_tracker in tools.
Compare 2 commits »
colin pushed to master at colin/Witllm 2024-01-18 20:29:16 +08:00
3233616aac Delete kv cache of qwen.
colin pushed to master at colin/Witllm 2024-01-17 23:07:12 +08:00
0a78627e48 Add doc