Observability for Large Language Models

Observability for Large Language Models

Ankush Sharma

72,19 €
IVA incluido
Disponible
Editorial:
Springer Nature B.V.
Año de edición:
2026
Materia
Probabilidad y estadística
ISBN:
9798868828263
72,19 €
IVA incluido
Disponible

Selecciona una librería:

  • Librería Samer Atenea
  • Kálamo Books
  • Librería Elías (Asturias)
  • Librería Kolima (Madrid)
  • Librería Proteo (Málaga)

This book is a comprehensive guide designed to equip engineers, data scientists, and AI practitioners with the principles, tools, and strategies needed to ensure reliability, performance, and accountability in Large Language Models (LLMs). The book begins by laying the groundwork with the foundations of observability, introducing LLMs, their significance in modern AI, and the critical role observability plays in maintaining robust systems. It then explores SRE principles, service level objectives, and incident response, while distinguishing the unique observability challenges that arise in AI and ML systems. Building on this foundation, the book dives into measuring performance, from defining SLOs tailored for LLMs to monitoring computational and token-level metrics. Readers gain practical insights into structured logging, debugging, and distributed tracing methods that provide visibility into complex LLM workflows. Scaling challenges are addressed through strategies for cross-model observability, autoscaling, latency reduction, and fault-tolerant infrastructure design. The book further explores chaos engineering, guiding readers through resilience testing in LLMs and the automation of chaos experiments in CI/CD pipelines. Finally, it highlights monitoring, retraining, and ethical considerations in AI observability, including governance, privacy, and accountability.In conclusion, this book provides a holistic roadmap to building reliable, transparent, and future-ready LLM systems.What you will learn: How to design observability pipelines for LLMs, including token-level logging, prompt tracing, and latency analysis. Techniques for applying chaos engineering principles to test LLM robustness under stress and failure scenarios. Methods for building SLOs, SLAs, and dashboards tailored to inference quality and model reliability. Strategies for monitoring hallucinations, drift, bias, and ethical failures in real-time. Who this book is for:This book is for AI infrastructure engineers, SREs, machine learning platform teams, and applied AI practitioners deploying or maintaining LLM-based applications.

Artículos relacionados

  • ENGINEERING UNCERTAINTY AND RISK ANALYSIS
    Sergio E. Serrano
    An integrated coverage of probability, statistics, Monte Carlo simulation, inferential statistics, design of experiments, systems reliability, fitting random data to models, analysis of variance, stochastic processes, and stochastic differential equations for engineers and scientists. The author for first time presents an introduction to the broad field of applied engineering u...
    Disponible

    134,56 €

  • UNDERSTANDING AND CALCULATING THE ODDS
    Catalin Barboianu
    Man’s daily life is full of decisional situations. Whether we have math skills or not, we frequently estimate and compare probabilities, sometimes without realizing it, especially when making decisions. But probabilities are not just simple numbers attached objectively or subjectively to events, as they perhaps look, and their calculus and usage is highly predisposed to qualita...
    Disponible

    31,61 €

  • Random Graphs and Complex Networks
    Remco van der Hofstad
    ...
  • Introduction to Malliavin Calculus
    David Nualart / Eulalia Nualart
    ...
    Disponible

    64,04 €

  • Probability, Markov Chains, Queues, and Simulation
    William J. Stewart
    Probability, Markov Chains, Queues, and Simulation provides a modern and authoritative treatment of the mathematical processes that underlie performance modeling. The detailed explanations of mathematical derivations and numerous illustrative examples make this textbook readily accessible to graduate and advanced undergraduate students taking courses in which stochastic process...
  • SPSS for you
    A. Rajathi / P. Chandran
    In an era where statistical analysis underpins breakthroughs across all fields, the importance of mastering statistical software cannot be overstated. 'SPSS for you' emerges as a pivotal resource for anyone keen to navigate the complexities of statistical analysis with ease and precision. Drawing from over 25 years of teaching experience, practical guidance in statistical analy...
    Disponible

    29,30 €

Otros libros del autor

  • Ranbhoomi Mein, Main Nahi
    Ankush Sharma
    'रणभूमि में, मैं हूँ नहीं' एक काव्य संग्रह के रूप में प्रस्तुत पुस्तक है, जिसमें लेखक ने कविताओं के माध्यम से अपने विचारों को अभिव्यक्त करने का प्रयास किया है।इस पुस्तक का शीर्षक मनुष्य के आंतरिक युद्ध से जुड़ा हुआ है। यह किसी साहित्यिक परंपरा या विशेष उद्देश्य से नहीं लिखी गई, बल्कि मन के भीतर चल रहे संघर्षों की स्वाभाविक अभिव्यक्ति है।यदि आप भी अस्तित्व से जुड़े प्रश्नों में ...
    Disponible

    18,00 €