Advanced Techniques
Techniques for Larger Testware Systems


Coton Park House
Linton
Swadlincote
Derbyshire
DE12 6RA UK


T: +44(0)1283 763632
F: +44(0)1283 763631



Introduction




Contents

Introduction

Test Resilience

Re-use

More Info

Resilience

Reuse


This section introduces some advanced techniques that become more appropriate as the size of the testware system and the complexity of the test increases. The descriptions assume that a test-interaction based approach to structuring the testware is in use. The descriptions are informal and high level, they do not attempt to address all of the complexities of implementing the techniques in testware.


Test Resilience


Many automatic test systems suffer from problems once anomalies have started to occur. Relatively minor insignificant anomalies can result in a test being classified as a failure when the anomaly has nothing to do with the purpose of the test. The system and the testware's view of the system can get out of sync resulting in an avalanche of spurious anomaly reports.

When testware is test-interaction based there are techniques that can be incorporated to increase the resilience of the testing when anomalies do occur. The techniques described here address:

  • Associating anomalies with domains of interest to control when an anomaly fails a test. More...
  • Handling situations where a test-interaction reports undefined behaviour. More...
  • Test-Interaction tolerance of behaviour discrepancies. More...

Reuse

Reuse of testware is desirable. Reuse results in lower development costs, makes the testware more responsive to system changes and helps to improve consistency. Techniques that increase reuse described here address:

  • Providing alternative concrete implementations of a test-interaction. More...
  • Test based selection & combinations of specific implementations of test-interactions. More...