There's overhead with parallelization. Security issues, race conditions and resource contention. I think the big one is its ass to debug.