OpenAI to use AWS infra for increased workload

Blitz Bureau

NEW DELHI: Amazon Web Services (AWS) and OpenAI have announced a multi-year, strategic partnership that provides AWS’s infrastructure to run and scale OpenAI’s core artificial intelligence (AI) workloads, starting immediately.

Under this new $38 billion agreement, which will have continued growth over the next seven years, OpenAI is accessing AWS compute comprising hundreds of thousands of Nvidia GPUs, with the ability to expand to tens of millions of CPUs to rapidly scale agentic workloads.

$38 b agreement signed for a seven-year deal

AWS has vast experience running large-scale AI infrastructure at scale – with clusters topping 500K chips. This partnership will help millions of users continue to get value from ChatGPT.

The rapid advancement of AI technology has created unprecedented demand for computing power. As frontier model providers seek to push their models to new heights of intelligence, they are increasingly turning to AWS due to the performance, scale, and security they can achieve.

OpenAI will immediately start utilising AWS compute as part of this partnership, with all capacity targeted to be deployed before the end of 2026, and the ability to expand further into 2027 and beyond.

The infrastructure deployment that AWS is building for OpenAI features an architectural design optimised for maximum AI processing efficiency and performance. Clustering the Nvidia GPUs — both GB200s and GB300s — via Amazon EC2 UltraServers on the same network enables low-latency performance across interconnected systems, allowing OpenAI to efficiently run workloads with optimal performance.

AWS has vast experience running large-scale AI infrastructure at scale – with clusters topping 500K chips. This partnership will help millions of users continue to get value from ChatGPT.

The clusters are designed to support various workloads, from serving inference for ChatGPT to training next generation models, with the flexibility to adapt to OpenAI’s evolving needs.

“Scaling frontier AI requires massive, reliable compute,” said OpenAI co-founder and CEO Sam Altman. “Our partnership with AWS strengthens the broad compute ecosystem that will power this next era and bring advanced AI to everyone.”

“As OpenAI continues to push the boundaries of what’s possible, AWS’s best-in-class infrastructure will serve as a backbone for their AI ambitions,” said Matt Garman, CEO of AWS. “The breadth and immediate availability of optimized compute demonstrates why AWS is uniquely positioned to support OpenAI’s vast AI workloads.”

Earlier this year, OpenAI open weight foundation models became available on Amazon Bedrock, bringing these additional model options to millions of customers on AWS.

OpenAI has quickly become one of the most popular publicly available model providers in Amazon Bedrock with thousands of customers — including Bystreet, Comscore, Peloton, Thomson Reuters, Triomics, and Verana Health — working with their models for agentic workflows, coding, scientific analysis, mathematical problem-solving, and more.

Latest News

Pilot Travails: Shortage of skilled manpower takes its first toll

Sukumar SAH India’s aviation sector has always lived on the...

Boat IPO papers show audit flags Draft red herring prospectus mentions financial mismatches, compliance issues in group entities

Blitz Bureau NEW DELHI: Consumer electronics maker Boat’s auditors have...

TCS acquires Coastal Cloud for $700 million Biggest purchase after public issue in 2004

Blitz Bureau NEW DELHI: Tata Consultancy Services (TCS) last week...

Toyota fuel cell car to be tested on roads India advances green hydrogen mobility with vehicle pilot

Blitz Bureau NEW DELHI: Union Minister for New & Renewable...

Topics

Pilot Travails: Shortage of skilled manpower takes its first toll

Sukumar SAH India’s aviation sector has always lived on the...

TCS acquires Coastal Cloud for $700 million Biggest purchase after public issue in 2004

Blitz Bureau NEW DELHI: Tata Consultancy Services (TCS) last week...

No flying high without human capital

Blitz Bureau NEW DELHI: India’s aviation industry can no longer...

Smash India’s aviation tyranny now

In any market mutilated into a duopoly or distorted...
spot_img