I think we're using different meaning of "behaves like". I meant "has tokens/sec... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

yencabulator 4 months ago | parent | context | favorite | on: iPhone 17 Pro Demonstrated Running a 400B LLM

I think we're using different meaning of "behaves like". I meant "has tokens/sec performance comparable to".

BoorishBears 4 months ago [–]

I'm using model performance because inference is definitely not comparable to a 17B model when you're streaming model weights on and off disk storage.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact