Assess
Why?
- Large AI workloads drive significant energy consumption; sustainability is both a cost and reputational concern.
- Tracking and optimizing carbon impact is becoming a requirement for procurement and customer contracts.
What?
- Instrument energy use at the rack and job level; include carbon estimates in cost calculations.
- Evaluate energy-efficient hardware, scheduling strategies (time-of-day, spot capacity), and model efficiency techniques (quantization, pruning).
- Report sustainability metrics in regular infra dashboards and procurement decisions.