Parallel Computing

An Introduction to Parallel Computing Originally published in Chinese on 2020-08-12; this English edition preserves the original scope and technical context. 1 Overview 1.1 Parallel Computing High Performance Computing (HPC) is a subfield of computer science focused on performance optimization. It encompasses techniques such as caching, data structures, algorithms, I/O optimization, instruction reordering, and compiler optimizations; Parallel Computing is a subfield of HPC, focusing on breaking down complex problems into smaller parts that can be computed independently by separate processors (computational resources) to improve efficiency; Different problems require specialized parallel architectures, which can be dedicated hardware with multiple processors or clusters of independent computers connected in a specific manner. ...