Test Environment Management Return On Investment
10th November 2018
Return on Investment (ROI) - Cost of building and maintaining test or development environments (includes all pre-production environments).
A guide or formula for calculating ROI for test or development environments related spending, will be best put forward by looking at more recent studies such as one conducted jointly by Capgemini and HP which...
“Finds that, by 2015, quality assurance testing is expected to consume as much as 28 percent of the IT budget, up five percentage points from 2013. Despite the rise of cloud computing, most of that money is being spent on IT infrastructure to maintain a permanent test environment.”
- See more at:
So, to calculate ROI;
Cost to build, maintain test/dev environment for Quality Assurance Testing = 28% of Total IT Budget.
To allow for some level of variation of this percentage spend, we will take 25% to be an average percentage. Cost of building, maintaining test and dev environments used for Quality Assurance Testing = 25% of IT Spend.
ROI on what is spent on building, maintaining test/dev environments for Quality Assurance testing will now be; Increased Revenue or Profit gained from each new enhancement or features delivered by a software project that has utilised the test or development environments subtracted or deducted from the Cost of building, maintaining test and dev environments for Quality Assurance Testing.
We will also need to make allowances for other factors such as marketing, new government legislation, existing brand acceptance etc that could have contributed to the increased revenue or turnover and deduct/subtract accordingly.
For example, company ABCDE spent $120 million in 2013 and its total turnover for the same year was $600 million, by 2014 even though there was a recession, still turned over $700 million dollars. Between 2013 and 2014 there were 5 software projects that successfully delivered various enhancements, added value, fixes, new features, new products and services etc. These projects all used the same environments at different times for QA.
Increased Revenue from the Projects subtracted from the Cost of building, maintaining test and dev environments.
Increased Revenue from the Projects = $700,000,000 – $600,000,000 = $100,000,000.
Make allowance for other factors = 35% of $100,000,000 = $35,000,000.00.
Cost of building, maintaining test and dev environments = 25% of $120,000,000 = $30,000,000.00.
Estimated ROI = Increased Revenue from the Projects less Allowance made for other factors subtracted/deducted from the Cost of building, maintaining test and dev environments.
$100,000,000 – ($35,000,000) – $30,000,000 = $35000000
Note the above information has only been offered as a guide and to provoke some similar thinking to account for the spend on test and development environments. With the advent of Cloud Computing and Virtualisation apparently offering significant reduction in the cost of maintaining test and development environments, the ROI should even be higher.
For all third party hosted services especially with hosting your environments in the Cloud, the quality of service and any degradation of service needs to be monitored closely to actually, prove or debunk any such increased ROI.