Calculation assumptions
Server: climate impact0.12 gCO2e
Electricity, including PUE0.3 Wh
Configuration used for this calculationMeta - Llama 3.1 405B · NVIDIA DGX H100 (8 GPU)
These values determine the result above and reflect the selected model. “Calculation assumptions” groups the hardware and operating-condition settings.
Selected model
Meta - Llama 3.1 405B
Referenced architecture and size
- Architecture
- dense
- Active parameters
- 405.87 billion
- Total parameters
- 405.87 billion
Selected server
NVIDIA DGX H100 (8 GPU)
Hardware profile used as a proxy
- CPUs per server
- 2
- GPUs per server
- 8
- Throughput per GPU (TFLOP/s)
- 989
- RAM (GB)
- 2,000
- SSD (GB)
- 30,000
Power and manufacture
- Power per CPU (W)
- 350
- Manufacture per CPU (kg CO₂e)
- 25
- Power per GPU (W)
- 700
- Manufacture per GPU (kg CO₂e)
- 250
- RAM power (W/GB)
- 0.392
- RAM manufacture (kg CO₂e/GB)
- 1.38802
- SSD power (W/GB)
- 0.0012
- SSD manufacture (kg CO₂e/GB)
- 0.16
- Auxiliary power (W)
- 0
- Enclosure manufacture (kg CO₂e)
- 250
Operating conditions
- Electricity region
- United States
- Electricity factor
- 0.3548 kg CO₂e/kWh
- PUE
- 1.2
- Hardware lifetime
- 5 years
Calculation and breakdown
Results
Compute load : 405.87 TFLOP
Latency : 26 ms
Processing time : 128 ms
Throughput : 3,898.79 tokens/s
Energy : 0.3 Wh
GPU
CPU
RAM
Storage
Chassis
GHG emissions : 0.12 gCO2e
GPU
CPU
RAM
Storage
Chassis
Operational
Embodied
Result assumptions and limitations
Active assumptions: MFU 40 % · PUE 1.2 · lifetime 5 years. Constant profile power and manufacturing factors, allocated by active time.
Selected case limitation: The 2PT proxy simplifies long-context attention and MoE routing. Prefix caching reduces the prompt only.
Not included: devices, external networks, idle capacity, buildings and application services. Training is not automatically allocated to inference.
Partial estimate to calibrate against duration and energy measurements.