Pretraining
What does Pretraining mean?
Initial large-scale training that gives a model broadly reusable capabilities.
A practical example
A language model learns from a large text collection before task-specific adaptation.
MICHAEL ORACLE’S AI DICTIONARY
Training & models · Advanced