Guideline summary

Guidelines for proactive testing:

The subjects of the test are according to the resilience requirements .

Preparing

The architecture is key to the resilience assurance, therefore, its operation should be validated prior to the testing.

The admin station should be developed prior to the testing

The admin station should be integral part of the system enabling on-site testing, and facilitating maintenance and training activities.

Integration testing

Following the functional testing, the goal is to identify missed hazards due to mistakes in rule implementation

Alpha testing

Following the functional testing, the goal is to set proper resilience parameters

Usability testing

Following the testing of routine operation, the goal is to identify operators' difficulties in detecting and identifying hazards, and in conducting recovery procedures

Beta testing

Following the functional testing, the goal is to tune the alarm thresholds

On-site testing

Beside the need to identify bugs and design mistakes that we missed during functional testing, we need to identify resilience problems not detected in the regular resilience testing mentioned above