Contents

Management summary 7

Foreword by Luc-François Salvador 9

Recommendations 11

Foreword from the authors 13

1 Introduction 15
   1.1 The history of TMap 16
   1.2 TMap evolves in step 18
   1.3 What TMap offers 20
      1.3.1 Where TMap helps 21
      1.3.2 Where TMap can be applied 21
   1.4 Reading guide 22

2 Framework and importance of testing 25
   2.1 What is testing? 25
   2.2 Why test? 28
   2.3 The role of testing 30
      2.3.1 Testing and quality management 30
      2.3.2 Testing: how and by whom 31
      2.3.3 Test and system development process 33
      2.3.4 Test levels and responsibilities 36
      2.3.5 Test types 40
   2.4 What is structured testing? 41

3 The essentials of TMap 43
   3.1 Structured test process 44
      3.1.1 Process: master test plan, managing the total test process 45
      3.1.2 Process: acceptance and system tests 46
      3.1.3 Process: development tests 50
   3.2 Complete tool box 51
      3.2.1 Techniques 51
      3.2.2 Infrastructure 55
      3.2.3 Organisation 57
   3.3 Adaptive method 59
      3.3.1 Respond to changes 60
      3.3.2 (Re)use products and processes 60
      3.3.3 Learn from experience 60
      3.3.4 Try before use 61

4 BDTM for clients 63

5 BDTM for test managers 75
   5.1 Establishing the assignment and collecting test goals 81
      5.1.1 Establishing the assignment 82
      5.1.2 Collecting test goals 88
   5.2 Determining the risk class 93
      5.2.1 Executing the product risk analysis 94
      5.2.2 Dealing with inadequate information 107
      5.2.3 Product risk management 109
      5.2.4 Alternative PRA 110
      5.2.5 Difference between product and process risks 112
   5.3 Determining test intensity 114
      5.3.1 Determining test levels 115
      5.3.2 Determining test intensity across test levels 119
      5.3.3 Determining intensity per combination of characteristic and object part in a test level 123
   5.4 Estimating, planning and feedback 126
      5.4.1 Estimating and planning in BDTM 126
      5.4.2 Feedback on BDTM aspects 131
   5.5 Allocating test design techniques 134
      5.5.1 Substantiate the test strategy with test design techniques 134
      5.5.2 Choosing the best possible technique 137
      5.5.3 The result 146
   5.6 Providing insight and control options 148
      5.6.1 Overview of reports and information blocks 149
      5.6.2 BDTM dashboard 151
      5.6.3 Status of the test object (BDTM: result) 151
      5.6.4 Product risk and strategy adjustment (BDTM: risk) 157
      5.6.5 Progress of the test process (BDTM: time and cost) 160
      5.6.6 Bottlenecks and points requiring discussion (BDTM: all aspects) 163
      5.6.7 Control options 164

Glossary 165

References 179

About Sogeti 181

Index 185