Hands-On LLM Serving and Optimization Hosting LLMs at Scale (Chi Wang, Peiheng Hu)（Z-Library）

Author： Chi Wang, Peiheng Hu

Large language models (LLMs) are the reasoning engines of modern AI. Today, a major inflection point has arrived: as the world races to deploy AI at scale, model inference has moved to the center of the stack. Welcome to the inference era. Without proper optimization, however, LLMs can be expensive and slow to serve. Hands-On LLM Serving and Optimization is a comprehensive guide to the complexities of deploying and optimizing LLMs at scale. In this hands-on, engineering-focused book, authors Chi Wang and Peiheng Hu combine practical examples, code, and strategies for building robust, performant, and cost-efficient AI token factories. Whether you’re building the LLM inference infrastructure or the applications that consume it, a deep understanding of LLM serving will make you a more effective, future-ready engineer as AI transforms how we work and build. Learn the foundations of model serving with core concepts, design paradigms, and industry best practices Understand the common challenges of hosting LLMs at scale Balance latency and throughput to meet the demands of AI applications and business requirements Host LLMs cost-effectively with practical, code-backed techniques

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

Generate book guide

Help cover token costs

Tip the Site

Support this site Your recognition and a small knowledge-service contribution help keep this technical work open source. Scan the WeChat Pay or Alipay code below. Logged-in and guest visitors can both tip.

Open WeChat or Alipay and scan. No login required.

Regenerate

Passage locations

Ask

Collapse guide