Sven Weinzierl (Friedrich Alexander U Erlangen Nuremberg) et al. have posted “How Risky is my AI System? A Method for Transparent Classification of AI System Descriptions by Regulated AI Risk Categories” (Proceedings of the 45th International Conference on Information Systems) on SSRN. Here is the abstract:
Risk-based artificial intelligence (AI) regulations define risk categories for AI-enabled systems. The operators of such systems must determine the risk category applicable to their AI systems. This requires detailed knowledge of the classification rules defined in the regulations. Only a few supporting tools have been developed to facilitate the task of risk classification. This paper presents a novel method that describes all the necessary steps to develop such a tool. To demonstrate and evaluate the method, it is instantiated for the European Union’s AI Act. The evaluation shows i) that the classification model achieves promising performance in predicting the risk categories for AI systems, ii) that users can effectively use the web application to carry out a risk classification, and iii) that users find SHAP text plots integrated into the web application helpful for understanding the reasons of a classification prediction.