Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You're basically describing what happened to GPT-2 when T5-flan came out. Not to mention, the incumbent model at the time (BERT) was extremely competitive for it's smaller size. Pretty much nobody was talking about OpenAI's models back then because they were too large to be realistically useful.

So yeah, I do actually anticipate smaller projects that devalue turtle-tower model scaling.



Cool. Send me a note when that happens.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: