MORE OFTEN THAN NOT, performance tuning a system requires you to alter code. When we need to alter code, every chunk that is overly complex or highly coupled is a dirty code bomb lying in wait to derail the effort.
Consider the case where you find an execution hot spot. The normal course of action is to reduce the strength of the underlying algorithm.