Cost Involved in Inter-Processor Communication
As the data is assigned to many processors in a parallel computer while implementing a parallel algorithm, the processors might be needed to interact with other processes therefore requiring inter-processor communication. Thus, there is a cost involved in transferring data among processors which incurs an overhead.