- cross-posted to:
- bootstrappable@slrpnk.net
- cross-posted to:
- bootstrappable@slrpnk.net
There is a discussion on Hacker News, but feel free to comment here as well.
You must log in or register to comment.
I cloned and compiled the alpaca.cpp on my Android Oneplus 9, I can get it started but dies due to not enough RAM. I have 8 GB total, but cant get the required 4 GB free to run the trimmed Llama (alpaca) model.
I might splash out on the orange pi for some fun.