I'm running it in router mode, but people on Reddit were recommending people use... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

kingo55 20 days ago | parent | context | favorite | on: Muse Glimmer: 30B-parameter model optimized for al...

I'm running it in router mode, but people on Reddit were recommending people use llama-swap instead. Am I missing something by using router mode?

mudkipdev 19 days ago [–]

I believe it's useful for running multiple llama.cpp forks at the same time (e.g. a model you want requires special patching)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact