I have been very lucky to have been involved in TMMi since it was initiated. When we started out on the journey of developing a standard reference model for test and quality we had no idea how popular this would be. We were just a few consultants concerned that there was no standard approach to test assessment and, therefore, clients were simply at the mercy of the quality and experience of the consultant they employed when they wanted to understand how good their process was. It was also the case that the reviews undertaken where not repeatable stopping any ongoing measurement of improvements. TMMi, owned and managed by the TMMi Foundation, now provides the first non-commercial assessment model. The foundation provides a common test model and TAMAR (TMMi Assessment Method Accreditation Requirements) to ensure consistent implementation and results from a test process assessment.
It is very fitting, therefore, that although the initial concept of a maturity model for testing was developed in the US, the first book based upon the new TMMi model should have been initially published in The Netherlands, where most often in recent years step changes in software testing have originated. Now with its growing popularity it is pleasing to see it translated into English opening the contents to a far wider audience.
The content is clear and easy to read and understand. I know this book will be successful in helping many test engineers and test managers to understand the TMMi model and how they can change the testing process in a controlled and successful way.
Improving software testing and quality is the way forward for all of us if we hope to stop all of those high profile software disasters that regularly appear on the news. Unless we approach things differently, nothing will change; this book will be an invaluable companion on that journey.
After reading this book I hope you too will see the benefits of using TMMi.
Chair – TMMi Management Executive
Welcome to The Little TMMi – Objective-Driven Test Process Improvement. TMMi is a non-commercial, organization-independent test maturity model. With TMMi, organizations can have their test processes objectively evaluated by certified assessors, improve their test processes and even have their test process and test organization formally accredited if it complies with the requirements. The main advantages of TMMi over other test improvement models are independence, the alignment with international standards, the business-orientation (objective-driven) and the perfect match with the CMMI-framework.
TMMi has been developed by the TMMi Foundation, a non-profit organization based in Dublin (Ireland) that has as main objectives to develop and maintain the TMMi model, create a benchmark database and facilitate formal assessment by accredited lead assessors. Testers can (free of charge) become a member of the TMMi Foundation, and from that membership a board is being elected. Many international test experts have contributed to the current version of TMMi. It has already proven to be highly useful in practice. Many organizations world-wide are already using TMMi for their internal test improvement process. Other organizations already have formally achieved TMMi level 2 and even TMMi level 3.
Advantages of TMMi
TMMi is aligned with international testing standards such as IEEE and the syllabi and terminology of the International Software Testing Qualifications Board (ISTQB). The TMMi Foundation has consciously not introduced new or their own terminology, but re-uses the ISTQB terminology. This is an advantage for all those test professionals who are ISTQB certified (approximately 170.000 world-wide at the time of this publishing). TMMi also differs from other test improvement models by being business-driven.
Testing is never an activity on its own. By introducing the process area Test Policy and Goals already at TMMi level 2, testing becomes aligned with organizational and quality objectives early in the improvement model. It should be clear to all stakeholders why there is a need to improve as well as an understanding of the business case. A final difference between TMMi and other test improvement models is the conformity of TMMi to the CMMI framework. The structure and the generic components of CMMI have been re-used within TMMi. This has two main advantages: first, the structure already has been shown in practice to be successful and, second, organizations that use CMMI are already familiar with the structure and terminology which makes it easier to accept TMMi and simplifies the application of TMMi in these organizations.
The Little TMMi has been written to address a large target audience. Testers and test managers can use it to evaluate and improve their processes. Test consultants can use it during assessments of test improvement projects. Other stakeholders can use it to acquire testing knowledge in general and TMMi knowledge in particular. CMMI consultants and QA employees can, by means of this compact publication, relatively easily become familiar with a test improvement model that is compliant with CMMI.
The book does not contain a full and detailed description of TMMi. The model is described at a higher level as are the goals and practices per process area, including a specific list of supporting literature to be used when one wants to improve a certain test process. The way assessments are performed and the implementation of TMMi are also discussed. The book also contains a number of appendices, including a table explaining the relationship with CMMI, a glossary and an index list.
The full TMMi model can be found at the web site of the TMMi Foundation: www.TMMifoundation.org. In this first edition of The Little TMMi, the TMMi framework version 3.1 is used. This implies that the TMMi model and levels 2 to 5 are described. However, for TMMi level 5 only the goals are described. The full description, including practices is expected to be published in mid 2011. The authors have decided to publish The Little TMMi now, since it allows organizations to start using TMMi level 2, 3 and 4. In a future edition the practices of TMMi level 5 will be described.
Many people reviewed the draft versions of this book, and also the earlier published Dutch version [Van Veenendaal/Cannegieter]. We would like to thank explicitly the following people (in alphabetical order): Frans van Asten, Bryan Bakker, Bart Bouwers, Bart Fessl, Pascal Maus, Judy McKay, Fran O’Hara, Manfred van Roekel, Geoff Thompson, Brian Wells and Johan Zandhuis.
Our objective is to support (test) organizations in improving their test process, to expand the adoption of TMMi and to enhance the growth of the testing profession. We wish you lots of success.
Erik van Veenendaal
Jan Jaap Cannegieter