Punishing error

Shall we punish error, which may lead to correction and improvement, or ignorance of error, which can be instructed, or love of error, which results in long-term harm to self and others?