The team got Google’s open model Gemma4-26B running by splitting it across the 15 boxes, each of which had only 4GB of memory. Two tricks made it fit. One is quantization, which stores the model’s internal numbers using fewer bits so the whole thing takes up less space. The other is cutting the work into pieces, called shards, with each device handling one piece.
It was not fast. The model produced less than half a token per second, and a token is roughly a fragment of a word. At that pace, a single sentence is a long wait. But speed was not the point. The point was to show that hardware on sale today, at very low prices, can load a capable model and get output from it.
A second result may be the more striking one. A smaller model, Qwen3.5-9B, managed to set up other AI models to run on eight of nine types of hardware it was tried on. The tests used real or simulated low-cost devices, including the TV boxes and other connected hardware. Ordinary malware has to be written for particular hardware or software. Here, the model worked out a setup to suit each device as it went.