Journal Article

Discovering boundary values of feature-based machine learning classifiers through exploratory datamorphic testing

Abstract

Testing has been widely recognised as dicult for AI applications. Œis paper proposes a set of testing strategies for testing machine learning applications in the framework of the datamorphism testing methodology. In these strategies, testing aims at exploring the data space of a classi€cation or clustering application to discover the boundaries between classes that the machine learning application de€nes. Œis enables the tester to understand precisely the behaviour and function of the so‰ware under test. In the paper, three variants of exploratory strategies are presented with the algorithms implemented in the automated datamorphic testing tool Morphy. Œe correctness of these algorithms are formally proved. Œeir capability and cost of discovering borders between classes are evaluated via a set of controlled experiments with manually designed subjects and a set of case studies with real machine learning models.

Authors

Zhu Hong
Bayley, Ian

Oxford Brookes departments

School of Engineering, Computing and Mathematics

Dates

Year of publication: 2022
Date of RADAR deposit: 2022-01-26

---

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License

---

Related resources

This RADAR resource is the Accepted Manuscript of Discovering boundary values of feature-based machine learning classifiers through exploratory datamorphic testing
This RADAR resource is the Accepted Manuscript of [arXiv preprint] Discovering boundary values of feature-based machine learning classifiers through exploratory datamorphic testing