SORS: Memory Bandwidth and System Balance in HPC Systems - 2024 update

Speaker: John D. McCalpin, Research Scientist, Texas Advanced Computing Center.
This talk reviews the history of supercomputing systems with a focus on the "balance" between computation and memory access and on the interaction of technology, architecture, and market forces in driving the evolution of these systems. Since the “Attack of the Killer Micros” began over 30 years ago, the combination of Moore’s Law and Dennard Scaling has led to astounding increases in the computational capabilities of microprocessors, while the technology behind memory subsystems has not enjoyed comparable performance improvements. The increasing imbalance between computation and memory access costs has led to stunningly complex processor implementations with increasing design and fabrication costs as well as increasingly opaque and confounding performance characteristics.
A review of new technologies (such as HBM) shows that the difficulties of delivering increased memory bandwidth are not alleviated unless the underlying computer architectures are changed in fundamental ways. The combination of technology trends and economic factors suggests that system balances will continue to shift in the same direction -- favoring workloads with increasingly high compute intensity and increasing available concurrency.
Further information here: www.bsc.es/res....
This talk was hosted by the BSC Memory Systems Group, focused on advancing memory systems for HPC and AI. Learn more about their research here: www.bsc.es/res...