Интерпретируемость — степень, в которой человек может понять, как система или модель ИИ производит свои результаты. Она может обеспечиваться изначально понятными структурами моделей или методами, объясняющими признаки, правила, пути рассуждения или факторы, влияющие на результат.
The ability to explain or to present an ML model's reasoning in understandable terms to a human. Most linear regression models, for example, are highly interpretable. (You merely need to look at the trained weights for each feature.) Decision forests are also highly interpretable. Some models, however, require sophisticated visualization to become interpretable. You can use the Learning Interpretability Tool (LIT) to interpret ML models.
Some machine learning models, particularly those trained with deep learning, are so complex that it may be difficult or impossible to know how the model produced the output (PB 57, PN 633). Interpretability often describes the ability to present or explain a machine learning system's decision-making process in terms that can be understood by humans (PN 633). Interpretability is sometimes referred to as transparency or explainability.