semiconductor / news / / The News International
Google announces two new Tensor Processing Units.
Google announced distinct TPUs for training (8t) and inference (8i) tasks, a historical first.
KEY POINTS
- TPU 8i dramatically increases high-bandwidth memory to address inference's 'memory wall' bottleneck.
- Google's TPUs now offer compatibility with Nvidia tooling, easing transitions for customers using Nvidia hardware.
- Google Cloud will soon provide access to Nvidia's Vera Rubin GPU series alongside its own TPUs.
- AI investment focus is shifting from training models to deploying reasoning agents that run at inference.
COMPANIES
Summarized by Newsio from The News International. How we summarize →