Irony of automation

The problem

The term refers to an explanation for the improper behavior of the operator when required to handle exceptional situations. The term was introduced by Bainbridge (1983 ) for explaining why automation, while effective in preventing exceptional situations, inevitably hampers the operators' capability to handle

Sources of the operator's incapability to handle exceptional situations

The more the system is automated ,the less the for experiencing and practicing the exceptional situations. This means that system design intended to protect from error, inevitably presents new risks, due to the insufficient training in the exceptional situations.

Example

Pilots of modern aircrafts typically use the autopilot, therefore, they do not practice manual operation only in special situations. In special circumstances when they need to operate manually they often respond wrongly, a phenomena called automation addiction .