I have summarized the overview of "Project Maya".1. IntroductionIn local LLMs, GPU VRAM capacity is a major constraint.
The question has changed from "can we afford a GPU cluster?" to "what does one hour of the right GPU cost, and how fast can I ...