This disclosure describes tools and techniques to analyze input and configuration coverage of software by performing large scale analysis of production and integration test data in a privacy-compliant manner. Test coverage analysis is made possible for highly complex input schema or for input schema that evolve with time. The techniques uncover the input-subspace that has been thus far integration-tested and the input-subspace that remains untested (known as test-gaps). When gathering data on how a specific software input/configuration is used in production, the techniques determine not only if they are used, but also how often they are used. Such data can help a developer evaluate the severity associated with a specific test gap.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Gao, Yifan; Rafferty, Ben; Sampson, Tylor; and Kubik, Joseph, "Test Coverage Analysis by Diffing Production Logs Against Integration Test Logs", Technical Disclosure Commons, (March 01, 2021)