PyTorch Systems Engineering is a deep, architecture-driven exploration of PyTorch as a modern execution platform for large-scale AI systems. It moves beyond model building and API usage to focus on the internal mechanisms that define performance, scalability, and reliability in production deep learning workloads.
As AI systems grow in complexity-from large language models to distributed multimodal pipelines-the challenges shift away from model design and toward systems engineering: how tensors are executed across heterogeneous hardware, how autograd constructs and traverses dynamic computation graphs, how GPU memory is allocated and optimized under pressure, and how distributed training systems maintain correctness and efficiency at scale.
This book treats PyTorch not as a library, but as a full runtime system composed of tightly integrated subsystems: a dynamic execution engine, a tensor computation backend, a compiler pipeline, a distributed coordination layer, and a GPU-accelerated memory management system.
Throughout the book, readers will gain a practical understanding of how PyTorch actually behaves under production workloads, including its performance characteristics, internal abstractions, and failure modes.
You will learn how to reason about deep learning systems in terms of execution flow, memory behavior, and infrastructure constraints rather than isolated model architectures.
Key topics include:
PyTorch runtime architecture and execution model
Tensor memory layout, storage semantics, and GPU data movement
Autograd internals and dynamic computation graph construction
CUDA execution, kernel optimization, and GPU performance tuning
Mixed precision training and numerical stability in large models
Compiler pipelines including graph capture and kernel fusion systems
Distributed training architectures such as DDP and FSDP
Transformer and large language model training systems
Memory optimization strategies for large-scale workloads
Production inference pipelines and deployment architectures
PyTorch extensibility through C++ extensions and CUDA kernels
Debugging distributed systems and runtime failure modes
By the end of this book, readers will be able to design, optimize, and operate production-grade AI systems built on PyTorch, with a clear understanding of the tradeoffs that govern performance, scalability, and system reliability.
This is not an introductory guide to machine learning. It is a systems engineering manual for building and scaling modern AI infrastructure with PyTorch.
外文書商品之書封,為出版社提供之樣本。實際出貨商品,以出版社所提供之現有版本為主。部份書籍,因出版社供應狀況特殊,匯率將依實際狀況做調整。
無庫存之商品,在您完成訂單程序之後,將以空運的方式為你下單調貨。為了縮短等待的時間,建議您將外文書與其他商品分開下單,以獲得最快的取貨速度,平均調貨時間為1~2個月。
為了保護您的權益,「三民網路書店」提供會員七日商品鑑賞期(收到商品為起始日)。
若要辦理退貨,請在商品鑑賞期內寄回,且商品必須是全新狀態與完整包裝(商品、附件、發票、隨貨贈品等)否則恕不接受退貨。