The Inference Chip Revolution: Breaking Nvidia's Grip on AI The latest deal between General Compute and Upper90 may seem like a minor development, but it signals a significant shift in how companies approach artificial intelligence.
For years, expensive GPUs have been the go to choice for running large language models (LLMs).
However, this $400 million loan deal marks a growing recognition that inference chips – designed specifically for efficiently running already trained AI models – can be just as effective.