In modern AI workloads, about 60% of energy is consumed by data movement between memory and compute.
60% of AI energy going to data movement not compute is the structural reframe. same memory wall pattern hitting our briefings this week from KV cache to HBM repricing
60% of AI energy going to data movement not compute is the structural reframe. same memory wall pattern hitting our briefings this week from KV cache to HBM repricing