The 12th edition of the World Quality Report 2020-21 (WQR), released today by Capgemini, Sogeti, and Micro Focus, shows the steady evolution of quality assurance (QA) from a backroom discipline to an integral part of wider enterprise digital transformation. Contributing to business growth and business outcomes was the highest rated objective for testing and QA at 74% – up 6 percentage points from 2018.

The WQR 2020 highlights that expectations from QA have been increasing with an upward trend across various strategic objectives including the need for QA to support business growth and the importance of ensuring end-user satisfaction. There has been steady and promising progress hindered only slightly by recurring struggles, also noted in previous editions, that include skill gaps and getting a return on investment on test automation.

The adoption of agile and DevOps is steadily increasing, but challenges remain

In line with the trend observed in the last two years, this year too saw an acceleration in the adoption of Agile and DevOps methodologies. While there is a marked focus in increasing the level of test automation and shifting testing to the left using Agile and DevOps, achieving higher levels of in-sprint automation and lack of expertise within the QA team to achieve the desired objectives remain challenging.

Expectations of the benefits that AI and ML can bring to quality assurance remain high

The uptake of artificial intelligence (AI) and machine learning (ML) in QA has also increased. 88% of respondents said that AI was now the strongest growth area of their test activities, and 86% consider AI a key criterion for selecting new QA solutions. Even though the benefits may not yet be fully in reach, the vast majority are enthusiastic about the prospects for AI and ML. The greatest challenge in applying AI and ML in QA was identified as skill gaps, mentioned by 34% of respondents (down two percentage points from last year).

Test automation: Organizations are working to achieve greater control of their QA activities

Previous World Quality Reports have consistently shown challenges in the test automation arena. In achieving quality assurance to a professional’s desired level of test automation, the most common challenge in 2019 was the frequency with which applications were changing. In previous years, the lack of people with sufficient specialist skills and experience within test automation was highlighted. In the 2020 survey organizations expressed a degree of confidence when they were asked for their views on various aspects of test automation: 68% said they have the required automation tools while 63% have enough time to automate tests. However, despite these promising statistics, only 37% felt they get a return on that investment, indicating a gap between confidence and results.

COVID-19 and QA: While there are currently many challenges, organizations are taking advantage of the upheaval to improve their entire approach to QA

As a result of the pandemic, 47% of respondents said there would be significantly greater focus on customer experience validation and on usability testing. Meanwhile, 43% of respondents said that the focus on more and better collaboration tools will go up, and 34% said they will need more remote access to test systems and test environments. There have also been COVID-19-related QA implications around security: 83% of CIOs and IT directors said their application security concerns have increased over the past 12 months, likely a result of the move to a remote working world.

“Despite the challenges brought about by COVID-19 it’s been a promising year for orchestration and quality assurance in the enterprise,” says Mark Buenen, Global Leader of Digital Assurance and Quality Engineering Services at Capgemini Group. “In fact, COVID-19 has acted as an accelerator for QA, demonstrating its integral importance to operations. It’s encouraging to see that QA professionals are optimistic about their testing capabilities. However, as the findings show, this optimism does not always match up to results. By relying more on cloud infrastructure and progressing further with AI for QA, these teams will be able to work faster, smarter and have greater business impact.” 

Raffi Margaliot, Micro Focus Senior Vice President and General Manager for Application Delivery Management, said, “QA teams are being spread thinner than ever before, and have responded by accomplishing more with less. This has helped them prepare for the challenges posed by the COVID-19 pandemic, which have accelerated new digital transformation initiatives, and boosted those already in progress. This year’s World Quality Report offers unique insight into how software quality organizations are adapting to the new normal and the escalated urgency for modernization. Progress has been made across the board, and our customers are now looking to expand automation across their organization, and enhance automation through increased adoption of AI.”

For further information and the recommendations based on the research, access the full report here.

World Quality Report 2020 research methodology

The World Quality Report, which this year interviewed 1,750 CIOs and other senior technology professionals, across 10 industries, from 32 countries, is the only global report analyzing application quality and testing trends. It has been produced annually since 2009. Now in its 12th edition, the 2019 report adopted data collection through computer aided telephone interviews. Based on analysis of six respondent groups: CIO, VP Applications, IT Director, QA/Testing Manager, CDO/CMO, and CTO/Product Head, the report surveyed respondents from across the globe through quantitative interviews followed by qualitative deep-dive discussions.

About Capgemini

Capgemini is a global leader in consulting, digital transformation, technology, and engineering services. The Group is at the forefront of innovation to address the entire breadth of clients’ opportunities in the evolving world of cloud, digital and platforms. Building on its strong 50-year heritage and deep industry-specific expertise, Capgemini enables organizations to realize their business ambitions through an array of services from strategy to operations. A responsible and multicultural company of 265,000 people in nearly 50 countries, Capgemini’s purpose is to unleash human energy through technology for an inclusive and sustainable future. With Altran, the Group reported 2019 combined global revenues of €17 billion. 

About Sogeti

Part of the Capgemini Group, Sogeti operates in more than 100 locations globally. Working closely with clients and partners to take full advantage of the opportunities of technology, Sogeti combines agility and speed of implementation to tailor innovative future-focused solutions in Digital Assurance and Testing, Cloud and Cybersecurity, all fueled by AI and automation. With its hands-on ‘value in the making’ approach and passion for technology, Sogeti helps organizations implement their digital journeys at speed.

About Micro Focus

Micro Focus delivers enterprise software to empower our 40,000 customers worldwide to digitally transform. With a broad portfolio, underpinned by a robust analytics ecosystem, the company enables customers to address the four core pillars of digital transformation: Enterprise DevOps, Hybrid IT Management, Predictive Analytics and Security, Risk & Governance. By design, these tools bridge the gap between existing and emerging technologies so customers can run and transform at the same time.