NVIDIA Triton Inference Server in Practice

NVIDIA Triton Inference Server in Practice

Trex Team

34,36 €
IVA incluido
Disponible
Editorial:
NobleTrex Press
Año de edición:
2026
ISBN:
9798896653431
34,36 €
IVA incluido
Disponible

Selecciona una librería:

  • Librería Samer Atenea
  • Kálamo Books
  • Librería Elías (Asturias)
  • Librería Kolima (Madrid)
  • Librería Proteo (Málaga)

'NVIDIA Triton Inference Server in Practice: Operating Multi‑Model GPU Inference at Scale'NVIDIA Triton is often introduced as a model server, but operating it well in production is a far more demanding discipline. This book is written for experienced machine learning platform engineers, MLOps practitioners, performance specialists, and infrastructure teams who need to run many models efficiently on shared GPU fleets. It treats Triton not as a black box, but as a controllable serving system whose architecture, scheduling, and lifecycle behavior determine real business outcomes.Across the book, readers learn how Triton’s request path, model repository, configuration model, and execution instances work together under load. It covers dynamic and sequence batching, queue policy design, multi-model resource governance, server-side pipelines with ensembles and Business Logic Scripting, decoupled and streaming inference, response caching, and rigorous observability and benchmarking. The result is a practical framework for tuning throughput, protecting latency objectives, managing rollouts safely, and making sound backend and version-compatibility decisions.The treatment is intentionally operational and version-aware, emphasizing trade-offs, failure modes, and production control surfaces rather than introductory usage. Readers should already be comfortable with GPU inference, containerized deployment, and modern ML serving concepts. In return, they will gain a systematic, deeply practical understanding of how to design, tune, and evolve Triton deployments that remain fast, st

Artículos relacionados

  • Managing and Processing Big Data in Cloud Computing
    Big data has presented a number of opportunities across industries. With these opportunities come a number of challenges associated with handling, analyzing, and storing large data sets. One solution to this challenge is cloud computing, which supports a massive storage and computation facility in order to accommodate big data processing. Managing and Processing Big Data in Clo...
  • Edge Computing with Amazon Web Services
    Sean Howard
    Build scalable, cost-effective, high-performance, and secure architectures using AWS Outposts, AWS Local Zones, AWS Wavelength, and AWS Snow services guided by best practices and practical examplesKey Features- Take advantage of the opportunities and challenges arising from the exponential growth of connected devices- Use AWS edge compute services to extend your applications to...
    Disponible

    74,80 €

  • Enterprise-Grade Hybrid and Multi-Cloud Strategies
    Sathya AG
    Leverage cloud technologies, proven strategies, and effective frameworks to drive seamless digital transformation.Key Features- Understand the challenges enterprises face with cloud adoption and the importance of leadership vision- Learn how to build the foundation for a vendor agnostic cloud-ready enterprise- Discover best practices to architect an enterprise cloud strategy an...
    Disponible

    71,99 €

  • Mastering Amazon EC2
    Badri Kesavan
    Master Amazon EC2 with this comprehensive guide to unleashing the full potential of cloud computing, optimizing performance, and revolutionizing your business processesKey Features- Gain an in-depth understanding of EC2 core components, connectivity, networking, and security best practices- Build resilient applications with load balancing, autoscaling and diverse storage option...
    Disponible

    65,94 €

  • The Linux DevOps Handbook
    Damian Wojsław / Grzegorz Adamowicz
    Build a solid foundation in DevOps and Linux systems as well as advanced DevOps practices such as configuration, IAC, and CI/CDKey Features:Master Linux basics, the command line, and shell scriptingBecome a DevOps expert by mastering Docker, Git, monitoring, automation, and CI/CDImplement networking, manage services, and leverage Infrastructure as Code (IaC)Purchase of the prin...
    Disponible

    72,74 €

  • Azure Data Engineer Associate Certification Guide - Second Edition
    Giacinto Palmieri / Newton Alex / Surendra Mettapalli
    Achieve Azure Data Engineer Associate certification success with this DP-203 exam guidePurchase of this book unlocks access to web-based exam prep resources including mock exams, flashcards, and exam tips, and the eBook PDFKey Features- Prepare for the DP-203 exam with expert insights, real-world examples, and practice resources- Gain up-to-date skills to thrive in the dynamic ...
    Disponible

    74,06 €

Otros libros del autor

  • OpenSearch Neural Search
    Trex Team
    'OpenSearch Neural Search: Hybrid Retrieval, Reranking, and Operations'Modern search systems are no longer won by keywords alone. This book is written for experienced search engineers, platform architects, and relevance practitioners who need to design high-quality retrieval systems in OpenSearch that combine semantic understanding with production-grade control. Rather than off...
    Disponible

    34,35 €

  • vLLM Serving
    Trex Team
    'vLLM Serving: High‑Throughput LLM APIs with PagedAttention and KV Cache Tuning'Built for experienced ML systems engineers, platform architects, and performance-minded practitioners, this book is a deep technical guide to serving large language models with vLLM at production scale. Rather than treating inference as a black box, it explains the real control surfaces behind throu...
    Disponible

    34,57 €

  • OpenPubkey
    Trex Team
    'OpenPubkey: OIDC‑Backed SSH and Workload Identity Without PKI Pain'SSH still runs the world, yet most organizations pay an ongoing 'PKI tax' in the form of long‑lived keys, brittle rotation, and sprawling authorized_keys files that quietly outlive teams and incidents. This book is written for experienced security engineers, platform/SRE leaders, and identity-minded builders wh...
    Disponible

    42,69 €

  • Cedar Policy Language
    Trex Team
    'Cedar Policy Language: Writing Fast, Auditable Authorization Rules'Authorization logic is too important to be scattered across application code-and too subtle to be left unaudited. This book is written for experienced engineers, security architects, and platform teams who need deterministic, low-latency authorization decisions that stand up to scrutiny. If you’re building mult...
    Disponible

    42,36 €

  • Crossplane Compositions
    Trex Team
    'Crossplane Compositions: Building a Self‑Service Internal Cloud Platform'This book is for experienced Kubernetes and platform engineers who want to turn infrastructure provisioning into a product: a self-service internal cloud platform with stable APIs, predictable behavior, and guardrails that scale across teams. Instead of treating Crossplane as 'Kubernetes for cloud resourc...
    Disponible

    34,58 €

  • Backstage Developer Portals
    Trex Team
    'Backstage Developer Portals: Creating Golden Paths and Platform Product UX'Internal developer portals often fail not because the technology is wrong, but because the product thinking is missing. This book is for experienced platform engineers, DX leaders, and senior developers who need to turn Backstage into a trusted, high-leverage interface to their platform-not a link farm ...
    Disponible

    34,42 €