• Joined on 2023-12-30
colin pushed to master at colin/Witllm 2025-03-10 19:15:12 +08:00
90e94db2c1 Rename QwenModule to lightmodule.
colin pushed to master at colin/Witllm 2025-03-10 16:27:23 +08:00
1efda9fe25 Update rwkv train.
colin pushed to master at colin/Witllm 2025-03-09 14:39:54 +08:00
0600d46f2f Add safe softmax demo code.
c4e9637c10 Add rwkv in wit.
Compare 2 commits »
colin pushed to master at colin/Witllm 2025-03-06 23:23:15 +08:00
251ea7f004 Add rwkv flow graph.
821e7206b8 Refine rwkv.
Compare 2 commits »
colin pushed to main at colin/deskhop 2025-03-06 00:08:00 +08:00
a36e6d30d6 Delete unused functions.
colin pushed to main at colin/deskhop 2025-03-04 11:52:16 +08:00
1e8dd35451 Update mouse speed up scale.
colin pushed to master at colin/Witllm 2025-03-03 21:31:15 +08:00
240858c030 Update rwkv.
4f18296e40 Format rwkv/RWKV-v7/rwkv_v7_demo.py
Compare 2 commits »
colin renamed repository from PyorchHack to colin/PytorchHack 2025-03-03 18:01:11 +08:00
colin pushed to master at colin/Witllm 2025-03-03 15:38:18 +08:00
002f132818 Add hook of attention for query qkv.
colin pushed to master at colin/Witllm 2025-03-03 15:24:23 +08:00
2e075552db Add hook of attention for query qkv.
3eea09d78c Add rwkv v7 demo.
e3b63f4635 Refine model define.
Compare 3 commits »
colin pushed to master at colin/Witllm 2025-02-26 16:56:08 +08:00
bff65b189d Add query file. Refine print tree.
3c34d12fba Refine dataset and nodetree.
a1d5fce300 Refine node tree define and print.
Compare 3 commits »
colin pushed to master at colin/Witllm 2025-02-22 16:50:36 +08:00
3a7ce45654 Refine meaning dataset map.
colin pushed to master at colin/Witllm 2025-02-22 01:54:31 +08:00
f0469b351c refine meaning dataset tree print.
colin pushed to master at colin/Witllm 2025-02-21 17:28:46 +08:00
81f9e54ca3 Update inference and val dataset.
colin pushed to master at colin/Witllm 2025-02-21 15:51:49 +08:00
383c40afd7 Update inference for debug.
colin pushed to master at colin/Witllm 2025-02-21 15:33:57 +08:00
7cf31a1f78 Rename mask level and index.
colin pushed to master at colin/Witllm 2025-02-20 17:31:06 +08:00
bca06af2dc Refine meaning dataset.
colin pushed to master at colin/Witllm 2025-02-19 19:40:15 +08:00
0b19fd576a Refine train code.
colin pushed to master at colin/Witllm 2025-02-19 18:01:56 +08:00
3feec36059 refine code.
colin pushed to master at colin/Witllm 2025-02-18 21:41:51 +08:00
c92db47135 Benchmark single 4090D 15fps