Category
1 article in this category.
Written by me.
Continued pretraining adapts a base model on more data, and its cost tracks corpus size and compute. Learn the definitions, a worked estimate, and the limits.