A Review on Parallel Computing Issue s and Different Parallel Programming Modules

Abstract

Although the performance of sequential computersincreases incredibly fast, it is insufficient for a large number ofchallenging applications. Most of these applications requires moreperformance, to solve the problems like numerical simulations inindustry, research as well as commercial applications, so the conceptof parallel computing come into existence.Parallel computing is a form of computation in which manycalculations are carried out simultaneously, in which large problemscan often be divided into smaller ones, which are then solvedconcurrently by applying certain principle. It uses multiple computerresources to solve computational problem. The parallelimplementation is then based on either the message passing or theshared memory model. The standard programming interface for themessage passing model is MPI, offering a complete set ofcommunication routines OpenMP.