Observability

Byscientist
Close-up view of binoculars on a surface with sunset reflection in lenses.

Observability is important for AI and AI tools. It is the ability to monitor them for token usage, response quality and model drift. Typically, an AI system is monitored through logs, traces and metrics but an AI system on AI agent may need other metrics. Troubleshooting a complex AI system that produces its output probabilistically is much more difficult since subtle changes in the input layer may change the output and hence a very different observability metric is needed. The requirement may be simple – decrease the hallucinations, and latency while removing any observable bottlenecks.

Check out this AI observability video : https://www.youtube.com/watch?v=v_SPcIGOJvs

Similar Posts

  • Language of Graphics

    Byscientist

    Key IDEA: Chart types are great shortcuts but graphics are really sophisticated visual structures GoFish language for python using the Gestalt grouping principle. It can make graphics or chart that can display the messages that are intentional. .mark() – what shape to draw at each postion and what channels to encode part to whole relationships…

  • |

    Reinforcement learning

    Byscientist

    Reinforcement learning is a method that drives learning and memory in primitive species such as birds, humans and other living species to its use in machine learning. It is used to influence the behavior of us humans on social media to its use to train machines. The essential components were initiated by BF Skinner 20th…

  • LoRa adaptors

    Byscientist

    LoRa in the IOT community are the low power long range wireless standards devices that are utilized to send a signal over large distances. However, in the AI field LoRa implies Low rank adaptation – which is relatively more efficient compute way to fine tune pretrained models (LLM, vision transformers, diffusion models). With a pretrained…

  • Sparql tool – connect LLM to knowledge graphs

    Byscientist

    Talk to knowledge graph – sparql-tool Use LLM.: Hallucinations (sometimes good for creativity), Outdated knowledge, no access to your data ( trained on public knowledge). Solutions: Fine tuning – retrain the model on domain data RAG – Search: look things up in real time. Claude code looks at searched doc. Vector embeddings: semantic similarity search…