Greater potential for bugs: Since the sites of a distributed system operate simultaneously, it is more complex to ensure the correctness of algorithms. The art of constructing distributed algorithms is an important and active area of research.
Increased processing overhead: The exchange of messages and the additional computation needed to achieve coordination between the sites is an overhead that does not arise in centralised systems.