La interpretabilidad es el grado en que una persona puede entender cómo un sistema o modelo de IA produce sus resultados. Puede provenir de estructuras de modelo inherentemente comprensibles o de métodos que explican características, reglas, rutas de razonamiento o factores que impulsan los resultados.
The ability to explain or to present an ML model's reasoning in understandable terms to a human. Most linear regression models, for example, are highly interpretable. (You merely need to look at the trained weights for each feature.) Decision forests are also highly interpretable. Some models, however, require sophisticated visualization to become interpretable. You can use the Learning Interpretability Tool (LIT) to interpret ML models.
Some machine learning models, particularly those trained with deep learning, are so complex that it may be difficult or impossible to know how the model produced the output (PB 57, PN 633). Interpretability often describes the ability to present or explain a machine learning system's decision-making process in terms that can be understood by humans (PN 633). Interpretability is sometimes referred to as transparency or explainability.