Explainable AI

A human hand with tattoos reaching out to a robotic hand on a white background.

A very traditional problem solving method is the following: given a set of features or variables, can we understand the features to form a conclusion. This could be something like a treatment strategy wherein the strategy is built on a series of data and then ingesting the data helps make a conclusion. However, an equally complicated question is that given that there are many factors that affect the decision – is there one or few factors that play a key role and changing those factors will affect the decision. Which means that if there are many factors that would affect the decision, can you change/alter that one factor and that would make a change to that decision.

Using AI to ingest a variable factors and then come up with an answer is usually opaque. And therefore finding the key factor is the basis of xAI -explainable AI. It is also called feature attribution. The method to figure this out is SHAP (Shapley addition explanations). One good website for a book chapter is here : https://christophm.github.io/interpretable-ml-book/shap.html

Similar Posts

  • Error codes

    There is no error code in the answers that are provided by AI prompts. It will return an answer that is the best fit to the prompt or the question, but it does not tell you the probability that it is not correct or that it is low probability of answer. The conversational AI will…

  • | |

    Functional prediction of microbial sequences

    Even with E.coli and M.tuberculosis we only know ½ of them. Can you use ML model to define function: as natural language, or molecular interaction or chemical reaction. Function as molecular interaction: protein – protein interaction. Genomics: Learn association between genes (just like words). It is called gLM2. A multi-modal single residue resolution gLM. GLM2…

  • Detection of AI created content

    As AI has progressed generating code, writing, music or other intelligent language based skills through an LLM there is a parallel growth in detection of AI generated content.  Like everything AI, it is a probability game. Trying to estimate the combination of words/tokens and comparing with what is in the model. Using a standard model…

  • LoRa adaptors

    LoRa in the IOT community are the low power long range wireless standards devices that are utilized to send a signal over large distances. However, in the AI field LoRa implies Low rank adaptation – which is relatively more efficient compute way to fine tune pretrained models (LLM, vision transformers, diffusion models). With a pretrained…

  • |

    Open source protein models

    A company called Profluent (profluent.bio) has been developing protein models that can be used for designing new proteins (https://www.nature.com/articles/s41587-022-01618-2), modeling of new CRISPR-Cas sequences (https://www.nature.com/articles/s41586-025-09298-z) and developing LLM for protein generation (https://www.biorxiv.org/content/10.1101/2025.11.12.688125v1.article-info). What is amazing is that they have open sourced all their models and Profluent-E1 is available in GitHub to download and use. (https://github.com/Profluent-AI/E1)…