Most testing organizations and independent test business units across the IT industry have a nightmare situation driving an organizational metrics base-lining exercise. MindTree has gone through a similar arduous journey and come out successfully with solutions to share, which is the heart of this paper. We would like to share the solutions and strategies with the IT Organizations, specifically in the testing space, on how one could establish similar organizational metric platform.
This paper mainly focuses on organizational test metrics standardization and base-lining. However, we also cover common issues and solutions, related to metrics initiatives, like reliability of metrics, metrics analysis and decision making, estimations based on historical baselines, and continuous improvement based on organizational metrics.

Sylvia Veeraraghavan is currently General Manager – Testing Practice. She has over 19 years of experience in the software industry. Currently she plays the role of a Test Process Evangelist for the Testing Business Unit providing consultancy and leading various process initiatives. In the past, Sylvia has successfully led the IT testing Practice growing it to a size of 500+ test team. During this period she was instrumental in developing many successful Testing- CoE for various large accounts in MindTree.

Sylvia has worked with Wipro for 9 years, scaling up to the QA manager role before joining MindTree. Smita Mukherjee currently acts as Process Evangelist for the Testing Business Unit. Her current core focus areas include Test Dashboard initiative, Test Metrics Analysis and Test Estimation design and adoption. She holds a MBAIT with specialization in Software Process Management from Symbiosis International University Pune. Smita has also played the role of Business Analyst for the Testing projects with over 3 years of IT industry experience.

Shankaranarayanan G A, Sr Test Specialist with over 8 years of IT experience, currently a Test Process Evangelist for the Testing Business Unit. He is leading the following initiatives: Agile Testing and Test Quality Index Adoption and Effectiveness. His areas of interest are Testing Process Improvements, Metrics Analysis and Innovations in Testing. He had also led many initiatives for the Test R&D labs like Techwork on Bugsportz, Testers’ Toolkit, Test Quality Index prediction (TQIp) model to name a few. He is also acts as the Champion for the Innovation community in MindTree. Earlier in Honeywell he had led innovation initiatives acting as Domain Innovation Focal for the Security and Life Safety Domain. He is a Certified Six Sigma Green Belt with expertise in Innovation process, workouts, IP, Patents and mentoring six sigma green belt projects. He has worked for over 6 years with Honeywell, scaling up to Sub- Domain Project Lead prior to joining MindTree.