Explainable AI

A human hand with tattoos reaching out to a robotic hand on a white background.

A very traditional problem solving method is the following: given a set of features or variables, can we understand the features to form a conclusion. This could be something like a treatment strategy wherein the strategy is built on a series of data and then ingesting the data helps make a conclusion. However, an equally complicated question is that given that there are many factors that affect the decision – is there one or few factors that play a key role and changing those factors will affect the decision. Which means that if there are many factors that would affect the decision, can you change/alter that one factor and that would make a change to that decision.

Using AI to ingest a variable factors and then come up with an answer is usually opaque. And therefore finding the key factor is the basis of xAI -explainable AI. It is also called feature attribution. The method to figure this out is SHAP (Shapley addition explanations). One good website for a book chapter is here : https://christophm.github.io/interpretable-ml-book/shap.html

Similar Posts

  • Text from Image

    Starting with a base image, it is possible to generate a description. An AI (Qwen-3-VL) simple description : This is a simple, hand-drawn black-and-white sketch of a person’s upper body. Here’s a breakdown of the key elements: Hair: Long, flowing hair depicted with two smooth, curved lines extending from the top of the head down…

  • |

    AI for drug discovery

    There are many companies that promise AI for drug discovery such as ChatGPT from OpenAI, Anthropic’s AI suite and Perplexity and there are more companies coming up too. One specific company that is unusual is that it seems to be promising much more deeper understanding of the drug discovery pathways then the others. It can…

  • AI job search

    With AI enabling many activities in the job hunt process, it is expected that many job applicants and executive at hiring companies use AI based tools for the process. The “automated” process used to be enabled by keywords which was the way that the candidates were selected from a large pool but with the availability…

  • |

    Reinforcement learning

    Reinforcement learning is a method that drives learning and memory in primitive species such as birds, humans and other living species to its use in machine learning. It is used to influence the behavior of us humans on social media to its use to train machines. The essential components were initiated by BF Skinner 20th…

  • |

    Knowledge graphs

    Knowledge graph is a way of representing information where entities/nodes (people, places, products, concepts) are linked by relationships/edges (works, creates, has ). It is a semantic network that captures facts and context. There is also an ontology that defines different types of node/edges and defines what types exist and how they relate. These are used…

  • Observability

    Observability is important for AI and AI tools. It is the ability to monitor them for token usage, response quality and model drift. Typically, an AI system is monitored through logs, traces and metrics but an AI system on AI agent may need other metrics. Troubleshooting a complex AI system that produces its output probabilistically…