Upcoming Mobile Size Mini LLM Computer that is Arm powered: Tiiny LLM Device
Tiiny a new company building something different in the LocalLLM space has unveiled a pocket size mini LLM computer that will run the 120B GPT-OSS LLM at a generous speed of 21 tok/s while consuming only 30-65 watts of power. So, how did they cram all that power into such a tiny package? The secret sauce lies in⦠Read More »
