Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Can I run this on my RTX 5090?


Yes they have quants for 32GB and 20GB use-cases (including mmproj and kv cache + context)




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: