Parallel computing

Submitted by aua on
vf_node_title_variants
vf_node_webs
title (web) field_t_title_web
https://en.wikipedia.org/wiki/Template:Parallel_computing
vf_node_items
vf_node_pictures_all title (item) field_cer_web field_cer_navbox g_geofield field_t_coordinates g_geofield
supercomputer
Computer cluster
body
Parallel computing
General Distributed computing • Parallel computing • Massively parallel • Cloud computing • High-performance computing • Multiprocessing • Manycore processor • GPGPU • Computer network • Systolic array
Levels Bit • Instruction • Thread • Task • Data • Memory • Loop • Pipeline
Multithreading Temporal • Simultaneous (SMT) • Speculative (SpMT) • Preemptive • Cooperative • Clustered Multi-Thread (CMT) • Hardware scout
Theory PRAM model • PEM Model • Analysis of parallel algorithms • Amdahl's law • Gustafson's law • Cost efficiency • Karp-Flatt metric • Slowdown • Speedup
Elements Process • Thread • Fiber • Instruction window • Array data structure
Coordination Multiprocessing • Memory coherency • Cache coherency • Cache invalidation • Barrier • Synchronization • Application checkpointing
Programming Stream processing • Dataflow programming • Models • Implicit parallelism • Explicit parallelism • Concurrency • Non-blocking algorithm
Hardware Flynn's taxonomy • SISD • SIMD • SIMT • MISD • MIMD • Dataflow architecture • Pipelined processor • Superscalar processor • Vector processor • Multiprocessor • symmetric • asymmetric • Memory • shared • distributed • distributed shared • UMA • NUMA • COMA • Massively parallel computer • Computer cluster • Grid computer • Hardware acceleration
APIs Ateji PX • Boost • Chapel • HPX • Charm++ • Cilk • Coarray Fortran • CUDA • Dryad • C++ AMP • Global Arrays • GPUOpen • MPI • OpenMP • OpenCL • OpenHMPP • OpenACC • Parallel Extensions • PVM • POSIX Threads • RaftLib • UPC • TBB • ZPL
Problems Automatic parallelization • Deadlock • Deterministic algorithm • Embarrassingly parallel • Parallel slowdown • Race condition • Software lockout • Scalability • Starvation
fr_importance
No votes yet