When AI energy and water footprint becomes a regulatory disclosure

Level Medium Timing Post deployment

What this risk is

The direct environmental costs of AI infrastructure — the electricity consumption, carbon emissions, and water use associated with training large AI models and running inference at scale — and the governance challenge of measuring, disclosing, and reducing these costs in a context where AI use is growing rapidly.

How it occurs · Mechanisms

Energy

  • Single LLM training run: Training GPT-4 class models estimated at 50–100+ GWh — equivalent to the annual electricity use of several thousand US homes
  • Inference at scale: ChatGPT serves ~100M+ users daily; each query uses approximately 10× the energy of a Google search. Annual inference energy for a frontier model at scale: gigawatts
  • IEA projection (2024): AI data centers globally could consume 1,000 TWh/year by 2026 — equivalent to Japan’s annual electricity consumption
  • Google disclosure (2024): Google’s total emissions increased 48% from 2019–2023, with AI infrastructure growth cited as a primary driver. This from a company with significant renewable energy commitments.

Water

  • Data center cooling requires large volumes of water. Microsoft disclosed consuming 6.4 million liters of water per day for AI operations.
  • Many large AI data centers are located in water-stressed regions (Arizona, Nevada, parts of Europe)
  • Water consumption is less visible than energy consumption but locally significant

Hardware

  • AI chips (GPUs, TPUs) require rare earth elements, significant manufacturing energy, and generate e-waste
  • TSMC’s semiconductor fabs (manufacturing Nvidia GPUs) are among the world’s largest water consumers

Mitigations · Governance

Technical Efficiency

  • Model efficiency — Use the smallest model that achieves required performance; resist capability overhang
  • Quantization and distillation — Compress models without significant capability loss
  • Inference optimization — Caching, batching, and hardware optimization for inference workloads
  • Green compute scheduling — Schedule training workloads for low-carbon grid times and locations

Procurement and Infrastructure

  • Renewable energy procurement — Power AI infrastructure with renewable energy; PPAs or RECs
  • Water efficiency — Data centers in water-abundant regions; water recycling
  • Hardware lifecycle — Maximize hardware lifespan; responsible e-waste disposal

Measurement and Disclosure

  • Carbon accounting — Measure and report AI-related energy and emissions
  • Efficiency metrics — Track performance per unit energy across model versions

Risk you cannot name is risk you cannot manage.

Map your AI portfolio against this taxonomy with Zertia.