Self-supervised learning
What does Self-supervised learning mean?
Learning from targets constructed from the data itself.
A practical example
A language model predicts a hidden or next token in text.
MICHAEL ORACLE’S AI DICTIONARY
Foundations · Beginner