KV cache

Galahad AI memory SSD claims 14x speed when it reads far less text

Corbenic AI's Galahad saves a model's working memory to a server's SSD, but its own tests show the 14x figure comes mostly from feeding the model less text.