CoreWeave Leads the AI Infrastructure Space
CoreWeave, renowned as the AI Hyperscaler™, has made headlines once again by setting a remarkable record in AI inference performance. The company is the first cloud service provider to submit MLPerf Inference v5.0 results using NVIDIA's cutting-edge GB200 Grace Blackwell Superchips. This significant achievement underscores CoreWeave's dedication to harnessing the power of advanced technology to enhance AI capabilities for its clients.
Impressive MLPerf Inference Results
Utilizing a dedicated CoreWeave instance with NVIDIA GB200 technology, which consists of two powerful NVIDIA Grace CPUs and four NVIDIA Blackwell GPUs, the company achieved a staggering throughput of 800 tokens per second (TPS) on the highly regarded Llama 3.1 405B model. This model stands out as one of the largest open-source AI models currently available.
Comments from Leadership
Peter Salanki, the Chief Technology Officer of CoreWeave, emphasized the company's commitment to providing top-notch infrastructure optimized for large-model inference. He remarked, "CoreWeave is committed to delivering cutting-edge infrastructure optimized for large-model inference through our purpose-built cloud platform. These benchmark MLPerf results reinforce CoreWeave's position as a preferred cloud provider for leading AI labs and enterprises." This kind of forward-thinking leadership continues to set CoreWeave apart in a competitive landscape.
Further Advancements and New Results
In addition to the groundbreaking results with the GB200 Superchips, CoreWeave has also submitted impressive performance metrics for its NVIDIA H200 GPU instances. It reported achieving an outstanding 33,000 TPS on the Llama 2 70B model, illustrating an impressive 40 percent improvement in throughput over its previous NVIDIA H100 instances. This enhancement showcases the continual evolution and growth of CoreWeave’s services.
Industry Recognition
CoreWeave's strides in AI infrastructure have not gone unnoticed. Earlier this year, the company was recognized as the first to offer general availability of NVIDIA GB200 NVL72-based instances. This follows a successful trajectory from last year when the firm led the industry by being among the first to deploy NVIDIA H100 and H200 GPUs and demo the unique NVIDIA GB200 NVL72. This recognition positions CoreWeave as a formidable leader in cloud computing service innovations.
The Significance of MLPerf Inference
The MLPerf Inference suite is pivotal in evaluating machine learning performance across various realistic scenarios. The speed at which systems can process data and deliver results from trained models significantly affects user experience. CoreWeave’s achievement in this regard demonstrates not just technical prowess but also a commitment to enhancing user satisfaction in AI applications.
About CoreWeave
CoreWeave stands at the forefront of AI technology, delivering an advanced cloud platform filled with innovative software solutions that power the next generation of AI applications. Catering to enterprises and leading AI laboratories, it provides accelerated computing environments that enable the efficient execution of complex tasks. Since its inception in 2017, CoreWeave has expanded its presence, operating a network of data centers across the United States and Europe. Notably, the company has been recognized in TIME100 as one of the most influential companies and featured in the Forbes Cloud 100 ranking for 2024.
Media Inquiries
For more information or media inquiries, please contact Gurion Kastenberg.
Frequently Asked Questions
What significant benchmark did CoreWeave achieve?
CoreWeave set a new AI inference benchmark by achieving 800 tokens per second on the MLPerf v5.0 with NVIDIA GB200 Superchips.
What is the importance of MLPerf Inference?
MLPerf Inference is crucial for measuring machine learning performance, impacting user experience through the speed of data processing and results delivery.
How has CoreWeave improved its GPU performance?
CoreWeave achieved 33,000 TPS on the Llama 2 70B model with NVIDIA H200 GPU instances, marking a 40 percent improvement over previous models.
Who leads the technical aspects of CoreWeave?
Peter Salanki, the Chief Technology Officer, oversees the technology strategy and innovations at CoreWeave.
Where can I learn more about CoreWeave?
For further information, visit CoreWeave's official website, showcasing their services and technological advancements.
