October 22, 2012, 8:39 PM — In general, QA has been quietly evolving from in-house testing generalists into a structured and efficient discipline, says Charlie Li, vice president, Global Service Line Testing, at consulting firm Capgemini. QA is exerting more influence on the application development lifecycle. But that holds true only for traditional QA. Most organizations today don't even test their mobile apps, Li says: Only 31% of organizations today currently test mobile applications, according to a recent report by Capgemini, its subsidiary Sogeti and HP.
The 2012-2013 World Quality Report was based on 1,553 detailed interviews with senior executives from a range of IT and business-related functions in medium and large companies, government and public sector organizations across 25 countries.
QA Lacks Tools for Mobility Testing
"We found that a large number of organizations out there today do not have the right tools or processes to do mobility testing," says Li, co-author of the World Quality Report.
Sixty-five percent of organizations say they do not have the right tools to test mobile applications, and 52% say they do not have access to the required devices. In addition, 34% of organizations say they lack the necessary testing methodologies and processes, and 29% say they lack the specialist expertise to effectively certify mobile applications.
"Really, from a development perspective, developing for mobile isn't all that different," Li says. "But QA has been kind of left in the dark. How do you simulate a network, especially a roaming network? How do I get India and China to test a mobile phone roaming in France? What happens when consumers take a device outside the country and begin roaming in a different country? Not all mobile networks are built the same. You have different technologies, speeds and security parameters."
BYOD Exacerbates IT's Problem
The BYOD culture exacerbates the problem, Li says, by dramatically increasing the number of possible combinations that organizations need to consider. After all, in the U.S. you have four carriers, a plethora of operating systems and a multitude of firmware versions.
This issue has influenced how organizations select external partners to assist with mobile testing, Li says. The number one criterion (62%) cited by firms when selecting an external partner was the capacity to test across several networks.