#inference-vs-training

[ follow ]
#ai-infrastructure #data-centers #cloud-services #compute-scaling #meta #nvidia #ai-chips #data-center-buildout
Artificial intelligence
fromIntelligencer
1 day ago

Elon Musk and Dario Amodei Are Burying the Hatchet in Sam Altman's Back

Anthropic and xAI formed a deal to share data-center compute, aligning Anthropic’s inference needs with xAI’s hardware while advancing xAI’s broader scaling ambitions.
fromAxios
2 months ago

Meta commits billions to Nvidia chips

Driving the news: Meta will buy millions of chips from Nvidia, ranging from standalone Grace CPUs to next-gen Blackwell GPUs and upcoming Vera Rubin systems, to use across its U.S. data center buildout. This makes Meta the first Big Tech firm to commit to buying standalone central processing units from Nvidia, which are used to run AI rather than train AI. This signals a shift toward inference over training, with the latter typically requiring more intense and expensive general processing units, or GPUs
US news
[ Load more ]