Measuring AI Systems Beyond Accuracy

04/07/2022
by   Violet Turri, et al.
0

Current test and evaluation (T E) methods for assessing machine learning (ML) system performance often rely on incomplete metrics. Testing is additionally often siloed from the other phases of the ML system lifecycle. Research investigating cross-domain approaches to ML T E is needed to drive the state of the art forward and to build an Artificial Intelligence (AI) engineering discipline. This paper advocates for a robust, integrated approach to testing by outlining six key questions for guiding a holistic T E strategy.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset