### Lecture 6: Pretraining

1. `pretraining.ipynb`: load a pretrained model and view actual pretraining data