# GPT-Pretrain

## Usage

```
python lit_train.py --model_name gpt2
python lit_export.py --version 0
python generate.py --model_name_or_path exports/version_0 --tokenizer_name_or_path gpt2
```