Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It's possible but it's not linear. A modern AI training cluster is a supercomputer that uses very different architectures and hardware to a bunch of small PCs connected via normal networking. The networking advantage alone kills any chance of decentralized training.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: