Cost Involved in Inter-Processor Communication
Because data is assigned to too many processors in a parallel computer whilst executing a parallel algorithm processors may be needed to interact with other processes so requiring inter-processor communication. Consequently there is a cost engaged in transferring data between processors that incurs an overhead.