This disclosure describes tools and techniques to analyze input and configuration coverage of software by performing large scale analysis of production and integration test data in a privacy-compliant manner. Test coverage analysis is made possible for highly complex input schema or for input schema that evolve with time. The techniques uncover the input-subspace that has been thus far integration-tested and the input-subspace that remains untested (known as test-gaps). When gathering data on how a specific software input/configuration is used in production, the techniques determine not only if they are used, but also how often they are used. Such data can help a developer evaluate the severity associated with a specific test gap.

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.