Observability

Byscientist
Close-up view of binoculars on a surface with sunset reflection in lenses.

Observability is important for AI and AI tools. It is the ability to monitor them for token usage, response quality and model drift. Typically, an AI system is monitored through logs, traces and metrics but an AI system on AI agent may need other metrics. Troubleshooting a complex AI system that produces its output probabilistically is much more difficult since subtle changes in the input layer may change the output and hence a very different observability metric is needed. The requirement may be simple – decrease the hallucinations, and latency while removing any observable bottlenecks.

Check out this AI observability video : https://www.youtube.com/watch?v=v_SPcIGOJvs

Similar Posts

  • Detection of AI created content

    Byscientist

    As AI has progressed generating code, writing, music or other intelligent language based skills through an LLM there is a parallel growth in detection of AI generated content.  Like everything AI, it is a probability game. Trying to estimate the combination of words/tokens and comparing with what is in the model. Using a standard model…

  • |

    Knowledge graphs

    Byscientist

    Knowledge graph is a way of representing information where entities/nodes (people, places, products, concepts) are linked by relationships/edges (works, creates, has ). It is a semantic network that captures facts and context. There is also an ontology that defines different types of node/edges and defines what types exist and how they relate. These are used…

  • Error codes

    Byscientist

    There is no error code in the answers that are provided by AI prompts. It will return an answer that is the best fit to the prompt or the question, but it does not tell you the probability that it is not correct or that it is low probability of answer. The conversational AI will…

  • AI Automations

    Byscientist

    The AI automations have only increased. There is one interesting one that has been receiving publicity. Check it out: https://knowledgework.ai It takes notes while the person is working and becomes the second brain. Privacy and access may be of concern but capability is available with AI tools.

  • LoRa adaptors

    Byscientist

    LoRa in the IOT community are the low power long range wireless standards devices that are utilized to send a signal over large distances. However, in the AI field LoRa implies Low rank adaptation – which is relatively more efficient compute way to fine tune pretrained models (LLM, vision transformers, diffusion models). With a pretrained…

  • | |

    Functional prediction of microbial sequences

    Byscientist

    Even with E.coli and M.tuberculosis we only know ½ of them. Can you use ML model to define function: as natural language, or molecular interaction or chemical reaction. Function as molecular interaction: protein – protein interaction. Genomics: Learn association between genes (just like words). It is called gLM2. A multi-modal single residue resolution gLM. GLM2…