OpenAI to use AWS infra for increased workload

Blitz Bureau

NEW DELHI: Amazon Web Services (AWS) and OpenAI have announced a multi-year, strategic partnership that provides AWS’s infrastructure to run and scale OpenAI’s core artificial intelligence (AI) workloads, starting immediately.

Under this new $38 billion agreement, which will have continued growth over the next seven years, OpenAI is accessing AWS compute comprising hundreds of thousands of Nvidia GPUs, with the ability to expand to tens of millions of CPUs to rapidly scale agentic workloads.

$38 b agreement signed for a seven-year deal

AWS has vast experience running large-scale AI infrastructure at scale – with clusters topping 500K chips. This partnership will help millions of users continue to get value from ChatGPT.

The rapid advancement of AI technology has created unprecedented demand for computing power. As frontier model providers seek to push their models to new heights of intelligence, they are increasingly turning to AWS due to the performance, scale, and security they can achieve.

OpenAI will immediately start utilising AWS compute as part of this partnership, with all capacity targeted to be deployed before the end of 2026, and the ability to expand further into 2027 and beyond.

The infrastructure deployment that AWS is building for OpenAI features an architectural design optimised for maximum AI processing efficiency and performance. Clustering the Nvidia GPUs — both GB200s and GB300s — via Amazon EC2 UltraServers on the same network enables low-latency performance across interconnected systems, allowing OpenAI to efficiently run workloads with optimal performance.

AWS has vast experience running large-scale AI infrastructure at scale – with clusters topping 500K chips. This partnership will help millions of users continue to get value from ChatGPT.

The clusters are designed to support various workloads, from serving inference for ChatGPT to training next generation models, with the flexibility to adapt to OpenAI’s evolving needs.

“Scaling frontier AI requires massive, reliable compute,” said OpenAI co-founder and CEO Sam Altman. “Our partnership with AWS strengthens the broad compute ecosystem that will power this next era and bring advanced AI to everyone.”

“As OpenAI continues to push the boundaries of what’s possible, AWS’s best-in-class infrastructure will serve as a backbone for their AI ambitions,” said Matt Garman, CEO of AWS. “The breadth and immediate availability of optimized compute demonstrates why AWS is uniquely positioned to support OpenAI’s vast AI workloads.”

Earlier this year, OpenAI open weight foundation models became available on Amazon Bedrock, bringing these additional model options to millions of customers on AWS.

OpenAI has quickly become one of the most popular publicly available model providers in Amazon Bedrock with thousands of customers — including Bystreet, Comscore, Peloton, Thomson Reuters, Triomics, and Verana Health — working with their models for agentic workflows, coding, scientific analysis, mathematical problem-solving, and more.

Latest News

Service sector growth falls to 5-month low in October

Blitz Bureau NEW DELHI: India’s services sector growth witnessed the...

Time for cheap Macs

Blitz Bureau NEW DELHI: Apple is preparing to launch a...

Air fare refund norms may change soon

Blitz Bureau NEW DELHI: The Directorate General of Civil Aviation...

The Idea that inspired Airtel- To seek review of its own AGR dues after SC relief for Vodafone

Blitz Bureau NEW DELHI: A day after the Supreme Court...

AI policy for India

Blitz Bureau NEW DELHI: The Ministry of Electronics and Information...

Topics

Service sector growth falls to 5-month low in October

Blitz Bureau NEW DELHI: India’s services sector growth witnessed the...

Time for cheap Macs

Blitz Bureau NEW DELHI: Apple is preparing to launch a...

Air fare refund norms may change soon

Blitz Bureau NEW DELHI: The Directorate General of Civil Aviation...

AI policy for India

Blitz Bureau NEW DELHI: The Ministry of Electronics and Information...

Epic victory over Google- Tech giant forced to accept app store freedom, lower commission

Blitz Bureau NEW DELHI: After a protracted, five-year legal battle...

Population PARADOX South ageing, prospering; north bulging, yearning

India’s economic future is walking a demographic tightrope. The...

Big push to aerospace ambitions To build its own fighter jet engines by 2035

India is gearing up to give its aerospace ambitions...
spot_img