AI Data Centre Power Demand: The Sustainability Challenge

The energy requirements of AI systems have emerged as a global market constraint, with datacentres worldwide now consuming 460 terawatt-hours of electricity annually.

Dr. Vanessa Just, Founder and Chief Executive Officer of JUS.TECH GmbH, a sustainability-focused technology consultancy, says: “Today's data centres already consume lots of power: Globally 460 terawatt-hours (TWh) of electricity are needed annually. That's equivalent to the entire country of Germany.”

This escalation in power consumption, driven by the computational requirements of AI model training and inference, presents systemic challenges to global electricity grids and sustainability targets, according to research from Arm.

The study covers 650 business leaders across multiple industries.

The data centre problem

Current trends suggest data centre electricity consumption in the US will triple from 2.5% of the national total in 2022 to 7% by 2030, based on analysis from Boston Consulting Group.

This represents approximately 390 terawatt-hours, comparable to the electricity used by 40 million US households.

Dr. Nicole Höher, Project Manager for Sustainability & Digitalisation at JUS.TECH GmbH, says: “Without significant infrastructure investment, the risk of grid instability and supply constraints grows.”

Grid operators in several regions are encountering capacity limitations.

In locations such as Virginia in the US and Ireland, high-voltage transmission networks face congestion, delaying the establishment of new data centres.

Some utility companies have implemented connection restrictions or rationing measures in response.

Arm indicates that addressing these challenges will require coordination between infrastructure providers, technology companies and energy suppliers to prevent AI energy requirements from undermining broader climate objectives.

Hardware innovation as a solution for AI energy efficiency

Arm emphasises the role of hardware design in mitigating AI's environmental impact, noting that hardware optimisation remains fundamental to sustainability progress despite the contribution of software efficiency improvements.

For instance, AWS Graviton processors, which utilise Arm technology, demonstrate potential for reducing workload carbon intensity by up to 67% compared with conventional x86 processors for cloud-based AI tasks.

Meanwhile, in mobile and edge computing environments, Arm-based accelerators reduce energy consumption by 50 to 80% compared with general-purpose graphics processing units (GPUs).

For data centre environments, Arm Neoverse processors deliver energy efficiency improvements that can reduce server rack energy consumption by up to 40%, potentially making large-scale AI deployments more sustainable.

Maureen McDonagh, Head of Sustainability at Arm, warns: “Without proactive measures, AI-driven energy consumption could push the world further off track from climate targets, with projections indicating an increase of over 2°C in global temperatures; breaching the recommendations to limit the rise to a much safer 1.5°C.”

Arm further notes electronic waste concerns, citing research from The Register that suggests Gen AI could increase electronic waste by up to 2.5 million tonnes annually by 2030 without implementation of waste reduction strategies.

The impact of AI workforce readiness challenges

Arm indicates that while 75% of companies have adopted AI technology, only one-third of employees have received AI-related training in the past year, creating a skills gap that threatens to undermine technology investments.

According to the Arm AI Readiness Index referenced in the report, 34% of organisations report being under-resourced with AI talent.

Additionally, 39% have no dedicated programmes for developing AI skills among existing employees.

Furthermore, the employee preparation statistics reveal a disconnect: only 15% of US workers report that their organisation has communicated a clear AI strategy, while 11% feel “very prepared” to work with AI in their role.

Mark Hinkle, Chief Executive Officer and Founder of Peripety Labs, a publisher focusing on AI in enterprise environments, says: “Corporate leaders risk underutilising their AI investments when the workforce isn't on board.

“When employees aren't empowered to use AI, those expensive platforms and algorithms can turn into costly shelfware, delivering only a fraction of the promised productivity gains.

“AI Adoption isn't just a Digital Transformation – it's a People Transformation,” he adds.

Training programmes for enterprise AI success

Noting that developing existing talent is more cost-effective than hiring new specialists, Arm recommends organisations invest in comprehensive training and upskilling programmes.

The company also indicates that 57% of workers want their employers to provide AI training.

Business leaders in the survey report various approaches to training.

One respondent says: “Our organisation offers a comprehensive AI training program that includes workshops, online courses and practical projects.”

Another explains: “Selected personnel from each department undergo intensive Python development education twice a week for one month, with certification exams conducted upon completion.”

Khaled Benkrid, Senior Director of Education and Research at Arm, says: “In a world where humans and machines are working together more than ever, the ability to build and use AI tools effectively is becoming a fundamental skill.”

To address these challenges, Arm has established partnerships with academic institutions, including funding for the University of Cambridge's CASCADE (Computer Architecture and Semiconductor Design) Centre.This initiative will support 15 PhD students over five years researching processor designs for AI applications.

“Companies must invest in training programmes that help employees understand AI's capabilities and applications,” says Khaled.

“Furthermore, the future workforce will need to combine human ingenuity with new and emerging AI technologies; going beyond just the technical skills.”

Explore the latest edition of AI Magazine and be part of the conversation at our global conference series, Tech & AI LIVE. 

Discover all our upcoming events and secure your tickets today.

Also sign up to our free weekly newsletter for the latest insights and stories straight into your inbox.

AI Magazine is a BizClik brand