Amazon cracks down on 'CPU waste' among engineers as agentic AI crunch intensifies
From aiste.ulozaite@gmail.com · original ↗ · unsubscribe
AWS is cracking down on internal use of EC2 instances among its engineers. Engineers have been told to reduce CPU waste to ensure the company has enough CPU capacity to meet customer demand. The increased demand for CPU is due to the rise of AI agentic workloads. Other cloud companies are also seeing high demand for CPUs.
Amazon cracks down on ‘CPU waste’ among engineers as agentic AI crunch intensifies — CPU demand makes low-utilization EC2 instances a hot commodity [Updated]
By Jake Roach
Last updated 7 August 2026
What used to take engineers a few hours can now take several days.
When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.
(Image credit: AWS)
Share this article
Join the conversation
Add us as a preferred source on Google
Newsletter
Subscribe to our newsletter
Amazon Web Services is cracking down on internal use of EC2 instances among its engineers. In May, the company reportedly met with engineers and told them to reduce CPU waste to ensure AWS has enough CPU capacity to meet customer demand, The Information reports. The message comes as demand for CPUs in the data center has hit a fever pitch, with the traditional eight-to-one or four-to-one ratio of GPUs to CPUs moving closer to parity.
Go deeper with TH Premium: CPU
(Image credit: Tom’s Hardware)
- CPU scaling with DLSS
- Ryzen to the top: How AMD innovated in the gaming CPU market
- How ARM is working its way into PCs
- AMD CES 2026 gaming trends press Q&A roundtable transcript
EC2 instances make up a large chunk of the modern internet, and they’re used in private deployments, as well. Traditionally, AWS engineers have been able to spin up their own instances for development, leveraging the relatively low CPU utilization required for web infrastructure to use more virtual machines. Now, engineers say they’re waiting days to get access when they previously could get access within hours. One engineer told The Information that they’ve never had to wait this long for an instance, even after several years of working at Amazon.
Amazon deploys several different types of CPUs in EC2 instances, including AMD and Intel options and its relatively new Graviton5 chip. Graviton5 is Amazon’s most powerful CPU to date, and it uses an Arm-based architecture along the lines of Nvidia’s Vera CPU and Arm’s own AGI.
Latest Videos FromTom’s Hardware
Watch full video here:
The increased demand for CPU comes on the back of AI agents, a new paradigm in productivity that even companies as large as Amazon are struggling to reckon with. Last month, for instance, a coding agent blew through $1.8 million in token costs at Amazon, surpassing a development budget by 860%.
Much of the AI infrastructure currently in place is designed around inference, a workload that’s accelerated by GPUs. With the four-to-one ratio, the CPU served as a way to keep the GPUs fed, and nothing more. However, agentic workloads are much more complex. They often involve tool calls that run on the CPU, as well as more complex orchestration of inference on GPUs. This is what has brought CPUs center stage in the agentic era. Intel, AMD, and others have echoed what we’ve heard from memory and storage companies over the past several months: the demand is so high for CPUs that most companies will take whatever they can get.
You may like
Demand for data center CPUs has surged, and AI agents are responsible
Intel tells PC makers to adopt 18A CPUs or lose their supply, report claims
Nvidia has ‘shipped hundreds of thousands of Grace standalone servers’
The major players are capitalizing on that demand. AMD just recently unveiled its portfolio of Zen 6 ‘Venice’ CPUs for the data center, marking the first time AMD has launched a new architecture in the data center before the client market in decades. Nvidia has also pivoted its messaging away from accelerators and toward its new Vera CPU, vying to stake its claim in an expanding market of agentic AI infrastructure.
Although Amazon is wrestling with CPU capacity across its internal engineers and external customers, The Information reports that shortages are largely a problem for spot instances. A consultant told the outlet that contracted capacity hasn’t experienced any shortages.
Stay On the Cutting Edge: Get the Tom’s Hardware Newsletter
Get Tom’s Hardware’s best news and in-depth reviews, straight to your inbox.
Contact me with news and offers from other Future brandsReceive email from us on behalf of our trusted partners or sponsors
By submitting your information you agree to the Terms & Conditions and Privacy Policy and are aged 16 or over.
Following publication, an Amazon Web Services spokesperson reached out with the following statement:
“Demand for AWS services, including EC2, is incredibly strong and growing. Even with this heavy demand, we continue to satisfy the overwhelming majority of compute needs for both our internal and external customers. We work closely with internal teams to meet their compute needs while ensuring they use EC2 resources as efficiently as possible, such as reclaiming idle instances, right-sizing, and scaling up and down as needs change – just as we’ve always done. These efficiencies help manage capacity for internal and external customers alike, and any suggestions that these long-standing efforts reflect new capacity constraints is simply wrong.
This premise is sensationalized. Frugality is in our DNA since Day 1. We have always encouraged our teams to operate efficiently. We also share best practices for how customers can optimize resources to external customers. This isn’t a new directive, and encouraging efficient use of resources isn’t unique to Amazon.”
We pressed Amazon on if engineers had been given deadlines to reduce their compute usage, as The Information originally reported. An AWS spokesperson responded: “This narrative on EC2 is inaccurate. As part of our normal business operations, and backed by our leadership principle of frugality, we are always driving efficiency across our resources to ensure teams are optimizing capacity.”
Follow Tom’s Hardware on Google News, or add us as a preferred source, to get our latest news, analysis, & reviews in your feeds.
TOPICS
Social Links Navigation
Senior Analyst, CPUs
Jake Roach is the Senior CPU Analyst at Tom’s Hardware, writing reviews, news, and features about the latest consumer and workstation processors.
Read more
[
CPUs Demand for data center CPUs has surged, and AI agents are responsible](https://www.tomshardware.com/pc-components/cpus/demand-for-data-center-cpus-has-surged-and-ai-agents-are-responsible-why-the-cpu-to-gpu-ratio-is-more-important-than-ever-for-hyperscalers “Demand for data center CPUs has surged, and AI agents are responsible “)
[
Tech Industry Intel tells PC makers to adopt 18A CPUs or lose their supply, report claims](https://www.tomshardware.com/tech-industry/intel-tells-pc-makers-to-adopt-18a-cpus-or-lose-their-allocations “Intel tells PC makers to adopt 18A CPUs or lose their supply, report claims”)
[
CPUs Nvidia has ‘shipped hundreds of thousands of Grace standalone servers’](https://www.tomshardware.com/pc-components/cpus/nvidia-has-shipped-hundreds-of-thousands-of-grace-standalone-servers-gpu-firm-pivots-messaging-as-cpus-take-center-stage-in-agentic-data-centers “Nvidia has ‘shipped hundreds of thousands of Grace standalone servers’”)
[
CPUs Nvidia touts Vera CPU’s single-threaded performance as its agentic AI advantage](https://www.tomshardware.com/pc-components/cpus/nvidia-touts-vera-cpus-single-threaded-performance-as-its-agentic-ai-advantage-frames-chip-as-a-max-single-threaded-cpu-at-scale-not-a-parallel-monster “Nvidia touts Vera CPU’s single-threaded performance as its agentic AI advantage”)
[
Semiconductors TSMC CEO C.C. Wei says, ‘It will be a long time before we can meet customer demand’](https://www.tomshardware.com/tech-industry/semiconductors/tsmc-ceo-c-c-wei-says-it-will-be-a-long-time-before-we-can-meet-customer-demand-tells-shareholders-that-he-will-keep-prices-stable-refrain-from-implementing-price-hikes “TSMC CEO C.C. Wei says, ‘It will be a long time before we can meet customer demand’”)
[
CPUs Intel and AMD sign long-term server CPU deals with Chinese customers as prices jump over 40%, report claims](https://www.tomshardware.com/pc-components/cpus/intel-and-amd-sign-long-term-server-cpu-deals-with-chinese-customers-as-prices-jump-over-40-percent “Intel and AMD sign long-term server CPU deals with Chinese customers as prices jump over 40%, report claims”)
Latest in CPUs
[
CPUs AMD borrows $4.75 billion for ‘general corporate purposes’](https://www.tomshardware.com/pc-components/cpus/amd-borrows-usd4-75-billion-for-general-corporate-purposes-company-gives-no-insight-into-how-it-plans-to-spend-cash-injection “AMD borrows $4.75 billion for ‘general corporate purposes’”)
[
CPUs Older Raptor Lake CPUs are a ‘core part of the portfolio’ for years to come, says Intel](https://www.tomshardware.com/pc-components/cpus/raptor-lake-is-a-core-part-of-the-portfolio-for-years-to-come-says-intel-theres-been-a-sudden-inrush-of-demand-for-lga-1700-chips-due-to-ddr5-prices “Older Raptor Lake CPUs are a ‘core part of the portfolio’ for years to come, says Intel “)
[
CPUs Intel says PC market is ‘a tale of two kingdoms’ with mainstream ‘taking a beating’](https://www.tomshardware.com/pc-components/cpus/intel-says-pc-market-is-a-tale-of-two-kingdoms-with-mainstream-taking-a-beating-vp-suggests-a-split-between-mainstream-and-enthusiast-sockets-across-the-industry “Intel says PC market is ‘a tale of two kingdoms’ with mainstream ‘taking a beating’”)
[
CPUs Intel VP Robert Hallock sets Nova Lake expectations, teases return to Raptor Lake for DDR4 platforms — our full 1:1 interview transcript](https://www.tomshardware.com/pc-components/cpus/intel-vp-robert-hallock-sets-nova-lake-expectations-teases-return-to-raptor-lake-for-ddr4-platforms-our-full-1-1-interview-transcript “Intel VP Robert Hallock sets Nova Lake expectations, teases return to Raptor Lake for DDR4 platforms — our full 1:1 interview transcript”)
[
CPUs Analysts see ‘increasing foundry success conviction’ as Intel CEO puts $12 million more of his own money in company](https://www.tomshardware.com/pc-components/cpus/analysts-see-increasing-foundry-success-conviction-as-intel-ceo-puts-usd12-million-more-of-his-own-money-in-company-analysts-point-to-accelerating-foundry-progress-and-capex-expansion “Analysts see ‘increasing foundry success conviction’ as Intel CEO puts $12 million more of his own money in company”)
[
CPUs Qualcomm details Snapdragon C specs for $300 laptops for the first time](https://www.tomshardware.com/pc-components/cpus/qualcomm-details-snapdragon-c-specs-for-usd300-laptops-for-the-first-time-claims-67-percent-faster-performance-on-battery-than-intel-n250-ac-performance-remains-a-mystery “Qualcomm details Snapdragon C specs for $300 laptops for the first time”)
Latest in News
[
HDDs Peer-reviewed study of 443,000 Backblaze hard drives ranks HGST most reliable and Toshiba the least](https://www.tomshardware.com/pc-components/hdds/peer-reviewed-study-of-443000-backblaze-drivers-ranks-hgst-most-reliable-and-toshiba-least “Peer-reviewed study of 443,000 Backblaze hard drives ranks HGST most reliable and Toshiba the least”)
[
Peripherals Futuristic mosquito-zapping laser now available to buy, video shows device in action](https://www.tomshardware.com/peripherals/futuristic-mosquito-zapping-laser-now-available-to-buy-video-shows-device-in-action-tiny-device-shoots-down-bugs-like-a-personal-air-defense-system-but-costs-usd1-000 “Futuristic mosquito-zapping laser now available to buy, video shows device in action”)
[
Tech Industry Nvidia turns $5B Intel stock bet into $30B windfall](https://www.tomshardware.com/tech-industry/nvidia-turns-usd5b-intel-stock-bet-into-usd30b-windfall-filing-reveals-new-usd21b-spacex-stake-and-complete-exit-from-arm-stock “Nvidia turns $5B Intel stock bet into $30B windfall”)
[
Drones US Navy 3D prints combat-ready drones and 1,000+ parts aboard aircraft carrier during exercise](https://www.tomshardware.com/tech-industry/drones/flight-ready-drones-3d-printed-and-built-on-aircraft-carrier-during-us-navy-exercise-a-containerized-factory-on-uss-essex-functioned-despite-rough-seas-and-12-foot-waves “US Navy 3D prints combat-ready drones and 1,000+ parts aboard aircraft carrier during exercise”)
[
DRAM Engineer used 360-degree cam hidden in bag of snacks in attempt to steal DRAM process tech for China](https://www.tomshardware.com/pc-components/dram/nanya-engineer-used-360-degree-cam-hidden-in-snacks-in-attempt-to-steal-dram-process-tech-for-china-it-security-team-pinpointed-perp-due-to-cameras-leaky-wireless-signals “Engineer used 360-degree cam hidden in bag of snacks in attempt to steal DRAM process tech for China “)
[
Windows Devs blame Windows for VLC media player bug that causes 33-second delay when playing MP3 files](https://www.tomshardware.com/software/windows/vlc-media-player-bug-reportedly-causes-33-second-delay-when-playing-mp3-files-on-windows-developers-say-microsoft-defender-is-to-blame “Devs blame Windows for VLC media player bug that causes 33-second delay when playing MP3 files “)
No comments yet Comment from the forums