6
Can gpt generate a gpt model?
(sh.itjust.works)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 09 Jun 2024
6 points (75.0% liked)
Machine Learning
1779 readers
1 users here now
founded 4 years ago
MODERATORS
You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that's about it.
Yep, this is called model distillation.