Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
com2kid
on Dec 31, 2024
|
parent
|
context
|
favorite
| on:
Things we learned about LLMs in 2024
Apple uses HBM, basically RAM on the same die as the CPU. It has a lot more memory bandwidth than typically PC dram, but still less than many GPUs. (Although the highest end macs have bandwidth that is in the same ballpark as GPUs)
jsheard
on Dec 31, 2024
|
next
[–]
Apple does not use HBM, they use LPDDR. The way they use it is similar in principle to HBM (on-package, very wide bus) but it's not the same thing.
karmakaze
on Dec 31, 2024
|
parent
|
next
[–]
Right so Apple uses high-bandwidth memory, but not HBM.
justincormack
on Dec 31, 2024
|
prev
|
next
[–]
Its not HBM, which GPUs tend to use, but it is on package and wider interface than other PCs
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: