Aw man, I'm going to shed a tear, the poor AI companies that stole books, works of art, writings any anything they could get their grubby hands on while happily telling everyone that their jobs are over by the exabyte are getting their precious little tokens stolen by big evil chinese LLMs :(

It's morally right to fuck over Anthropic (and OpenAI, or any other lab). Works generated by AI are not copyrightable anyways, and their terms of service have zero legal value.

How immoral of those LLM developers. The rest of the field does such a good job of crediting their inputs.

And the credit of OpenAI is to Google?

https://arxiv.org/abs/1706.03762

Is there real evidence that the volume was meaningful for distillation vs say extensive benchmarking and testing?

It’s certain all the labs use each others APIs extensively for testing - what’s the actual evidence that Deepseek was at significantly higher scale etc.?