vLLM Serving

vLLM Serving

Trex Team

34,57 €
IVA incluido
Disponible
Editorial:
NobleTrex Press
Año de edición:
2026
ISBN:
9798896653417
34,57 €
IVA incluido
Disponible

Selecciona una librería:

  • Librería Samer Atenea
  • Kálamo Books
  • Librería Elías (Asturias)
  • Librería Kolima (Madrid)
  • Librería Proteo (Málaga)

'vLLM Serving: High‑Throughput LLM APIs with PagedAttention and KV Cache Tuning'Built for experienced ML systems engineers, platform architects, and performance-minded practitioners, this book is a deep technical guide to serving large language models with vLLM at production scale. Rather than treating inference as a black box, it explains the real control surfaces behind throughput, latency, and memory efficiency. Readers who already know LLM fundamentals but want to reason rigorously about serving behavior will find an internals-first, systems-oriented treatment.At the core of the book are the mechanisms that make vLLM distinctive: PagedAttention, continuous batching, KV cache design, and scheduler-driven execution. You will learn how request flow, cache allocation, sequence length, prefix reuse, quantized KV storage, and offloading strategies interact to determine concurrency limits and user-visible performance. The book also covers OpenAI-compatible API serving, streaming semantics, realistic benchmarking, and disciplined troubleshooting, so readers can move from conceptual understanding to evidence-based tuning and operational decisions.The emphasis throughout is on advanced mental models, trade-offs, and production diagnostics rather than introductory walkthroughs. This is a focused guide for readers comfortable with GPU inference, transformer decoding, and performance measurement who want a precise framework for designing, tuning, and operating high-throughput LLM APIs with confidence.

Artículos relacionados

  • Innovations in XML Applications and Metadata Management
    As new concepts such as virtualization, cloud computing, and web applications continue to emerge, XML has begun to assume the role as the universal language for communication among contrasting systems that grow throughout the internet. Innovations in XML Applications and Metadata Management: Advancing Technologies addresses the functionality between XML and its related technolo...
  • THEORY AND PRACTICE OF COMPUTATION
    MASAYUKI NUMAO JAIME SHIN-YA NISHIZAKI / NISHIZAKI SHIN-YA
     This is the proceedings of the Third Workshop on Computing: Theory and Practice, WCTP 2013 devoted to theoretical and practical approaches to computation. This workshop was organized by four top universities in Japan and the Philippines: Tokyo Institute of Technology, Osaka University, University of the Philippines — Diliman, and De La Salle University. The proceedings provide...
  • React 16 Tooling
    Adam Boduch
    ...
    Disponible

    69,99 €

  • HP Certified Systems Administrator (2nd Edition)
    Asghar Ghori
    Like the first edition of this book, the second edition also covers three main objectives ¿ to provide a comprehensive resource to individuals, including novice, IT/Non-HP-UX administrators, and HP-UX administrators who intend to take the new HP Certified Systems Administrator exam HP0-095 and pass it; to provide a quick and valuable on-the-job resource to HP-UX administrators,...
    Disponible

    58,77 €

  • Build your own Programming Language - Second Edition
    Clinton L. Jeffery / Imran Ahmad
    Learn to design your own programming language in a hands-on way by building compilers, using preprocessors, transpilers, and more, in this fully-refreshed second edition, written by the creator of the Unicon programming language.Purchase of the print or Kindle book includes a free PDF eBookKey Features- Takes a hands-on approach; learn by building the Jzero language, a subset o...
    Disponible

    74,14 €

  • Hands-On Unity Game Development - Fourth Edition
    Juan Gabriel Gomila Salas / Nicolas Alejandro Borromeo
    Unlock game development mastery with Unity 2023! This book takes you from conception to publication, equipping you with the key tools and techniques you need to bring your gaming vision to life.Key FeaturesLearn the fundamentals of Unity 2023 and create your dream gameExplore the world of augmented reality (AR) to create captivating mobile gamesPropel game performance and playe...
    Disponible

    73,58 €

Otros libros del autor

  • OpenSearch Neural Search
    Trex Team
    'OpenSearch Neural Search: Hybrid Retrieval, Reranking, and Operations'Modern search systems are no longer won by keywords alone. This book is written for experienced search engineers, platform architects, and relevance practitioners who need to design high-quality retrieval systems in OpenSearch that combine semantic understanding with production-grade control. Rather than off...
    Disponible

    34,35 €

  • NVIDIA Triton Inference Server in Practice
    Trex Team
    'NVIDIA Triton Inference Server in Practice: Operating Multi‑Model GPU Inference at Scale'NVIDIA Triton is often introduced as a model server, but operating it well in production is a far more demanding discipline. This book is written for experienced machine learning platform engineers, MLOps practitioners, performance specialists, and infrastructure teams who need to run many...
    Disponible

    34,36 €

  • OpenPubkey
    Trex Team
    'OpenPubkey: OIDC‑Backed SSH and Workload Identity Without PKI Pain'SSH still runs the world, yet most organizations pay an ongoing 'PKI tax' in the form of long‑lived keys, brittle rotation, and sprawling authorized_keys files that quietly outlive teams and incidents. This book is written for experienced security engineers, platform/SRE leaders, and identity-minded builders wh...
    Disponible

    42,69 €

  • Cedar Policy Language
    Trex Team
    'Cedar Policy Language: Writing Fast, Auditable Authorization Rules'Authorization logic is too important to be scattered across application code-and too subtle to be left unaudited. This book is written for experienced engineers, security architects, and platform teams who need deterministic, low-latency authorization decisions that stand up to scrutiny. If you’re building mult...
    Disponible

    42,36 €

  • Crossplane Compositions
    Trex Team
    'Crossplane Compositions: Building a Self‑Service Internal Cloud Platform'This book is for experienced Kubernetes and platform engineers who want to turn infrastructure provisioning into a product: a self-service internal cloud platform with stable APIs, predictable behavior, and guardrails that scale across teams. Instead of treating Crossplane as 'Kubernetes for cloud resourc...
    Disponible

    34,58 €

  • Backstage Developer Portals
    Trex Team
    'Backstage Developer Portals: Creating Golden Paths and Platform Product UX'Internal developer portals often fail not because the technology is wrong, but because the product thinking is missing. This book is for experienced platform engineers, DX leaders, and senior developers who need to turn Backstage into a trusted, high-leverage interface to their platform-not a link farm ...
    Disponible

    34,42 €