Colin 1622bf3054 add mnbvc dataset .		2024-03-03 23:35:40 +08:00
..
MNBVC.py	add mnbvc dataset .	2024-03-03 23:35:40 +08:00
__init__.py	Add dataset and wit.	2024-02-04 23:48:24 +08:00
configuration_qwen.py	Add wit.	2024-02-06 14:08:45 +08:00
demo.py	Add wit.	2024-02-06 14:08:45 +08:00
lit_module.py	Enable wit train on cutome dataset and loss down.	2024-02-26 22:44:26 +08:00
lit_train.py	sperate train and val dataset.	2024-02-26 23:59:00 +08:00
model.safetensors.index.json	Add dataset and wit.	2024-02-04 23:48:24 +08:00
modeling_wit.py	Add wit train support.	2024-02-26 22:44:26 +08:00
qwen_generation_utils.py	Add dataset and wit.	2024-02-04 23:48:24 +08:00
tokenization_qwen.py	Add wit train support.	2024-02-26 22:44:26 +08:00
tokenizer_config.json	Add dataset and wit.	2024-02-04 23:48:24 +08:00
wit_b64.tiktoken	Add wit.	2024-02-06 14:08:45 +08:00
wit_char.tiktoken	Add wit.	2024-02-06 14:08:45 +08:00