When AI energy and water footprint becomes a regulatory disclosure
Level
Medium
Timing
Post deployment
What this risk is
The direct environmental costs of AI infrastructure — the electricity consumption, carbon emissions, and water use associated with training large AI models and running inference at scale — and the governance challenge of measuring, disclosing, and reducing these costs in a context where AI use is growing rapidly.
How it occurs · Mechanisms
Energy
- Single LLM training run: Training GPT-4 class models estimated at 50–100+ GWh — equivalent to the annual electricity use of several thousand US homes
- Inference at scale: ChatGPT serves ~100M+ users daily; each query uses approximately 10× the energy of a Google search. Annual inference energy for a frontier model at scale: gigawatts
- IEA projection (2024): AI data centers globally could consume 1,000 TWh/year by 2026 — equivalent to Japan’s annual electricity consumption
- Google disclosure (2024): Google’s total emissions increased 48% from 2019–2023, with AI infrastructure growth cited as a primary driver. This from a company with significant renewable energy commitments.
Water
- Data center cooling requires large volumes of water. Microsoft disclosed consuming 6.4 million liters of water per day for AI operations.
- Many large AI data centers are located in water-stressed regions (Arizona, Nevada, parts of Europe)
- Water consumption is less visible than energy consumption but locally significant
Hardware
- AI chips (GPUs, TPUs) require rare earth elements, significant manufacturing energy, and generate e-waste
- TSMC’s semiconductor fabs (manufacturing Nvidia GPUs) are among the world’s largest water consumers
Mitigations · Governance
Technical Efficiency
- Model efficiency — Use the smallest model that achieves required performance; resist capability overhang
- Quantization and distillation — Compress models without significant capability loss
- Inference optimization — Caching, batching, and hardware optimization for inference workloads
- Green compute scheduling — Schedule training workloads for low-carbon grid times and locations
Procurement and Infrastructure
- Renewable energy procurement — Power AI infrastructure with renewable energy; PPAs or RECs
- Water efficiency — Data centers in water-abundant regions; water recycling
- Hardware lifecycle — Maximize hardware lifespan; responsible e-waste disposal
Measurement and Disclosure
- Carbon accounting — Measure and report AI-related energy and emissions
- Efficiency metrics — Track performance per unit energy across model versions
Risk you cannot name is risk you cannot manage.
Map your AI portfolio against this taxonomy with Zertia.
