Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Cool I actually got it ported to iPhone’s ANE finally yesterday! So we can get both rt natural local TTS and 4x less battery drainage and thermals


lol, I just finished a port to the iPhone ANE as well. I would love to compare notes


The biggest part was dynamic shapes that weren’t allowed for newer iOS. I’d do it with masking similar to other transformers being ported to ANE. Another thing was people would cut the graph cause some operations are not allowable on this chip - tho if you look at the op that is doing segfault, i.e. tile - you can rewrite the same functionality with other supported ops and port the weights to the new graph. Works the same way compared to PyTorch weights comparing spectrograms, around 10x realtime on 14pro :)

Anything you found interesting there? Every proposal on GitHub I found was kinda lucking in both documentation and completeness




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: