Witllm/wit/lightning_logs/version_1/hparams.yaml

4 lines
117 B
YAML
Raw Normal View History

2024-03-09 16:55:03 +08:00
model_dir: /home/colin/.cache/modelscope/hub/qwen/Qwen-1_8B-Chat
learning_rate: 0.0001
use_tril_attention_mask: null