Architecting AI Software Systems (Richard D. Availa, Imran Ahmad)(Z-Library)
,
Software
No Description
8
Views
Registered users can read the full content for free
Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.
Page
1
(This page has no text content)
Page
2
Architecting AI Software Systems Crafting robust and scalable AI systems for modern software development Richard D Avila Imran Ahmad
Page
3
Architecting AI Software Systems Copyright © 2025 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the authors, nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book. Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information. Portfolio Director: Kunal Chaudhari Relationship Lead: Denim Pinto Project Manager: K. Loganathan Content Engineer: Deepayan Bhattacharjee Technical Editor: Irfa Ansari Copy Editor: Safis Editing Indexer: Rekha Nair Proofreader: Deepayan Bhattacharjee Production Designer: Alishon Falcon Growth Lead: Mansi Shah First published: October 2025 Production reference: 1300925 Published by Packt Publishing Ltd. Grosvenor House 11 St Paul’s Square Birmingham B3 1RB, UK. ISBN 978-1-80461-597-3 www.packtpub.com
Page
4
Dedicated to my parents Mom, your love and support are the bedrock that I stand on. Dad, you were my first and most influential teacher on architecture. Fate took you from us – I can only imagine the conversations we would have had about what intelligence, software, and architecture are. Your presence was with me in writing this book. – Richard D Avila I dedicate this book to my beloved father, Inayatullah Khan. His wisdom, values, and unwavering support continue to inspire me every day. – Imran Ahmad
Page
5
Contributors About the authors Richard D Avila is a software and systems architect with over two decades of industry experience building complex software systems. He has architected and held leadership roles for building a wide array of software systems to include complex simulations, autonomy, and data analytic sys- tems. He has published in referred journals and industry publications on command-and-control theory, assurance architectures, multi-agent modeling, and machine learning. He was the first expert instructor on data analytics at the University of Maryland, Baltimore County – Training Centers. Before working as a software and systems architect, he served in the US Navy as a sub- marine officer. I would like to thank the Packt editors for their support and guidance, and their insights and recommendations. Special thanks to Deepayan, Loganathan, and Denim. Imran Ahmad, Ph.D, is an accomplished author and data scientist, widely recognized for his best-selling book 50 Algorithms Every Programmer Should Know. He currently lends his expertise to the Advanced Analytics Solution Center (A2SC) within the Canadian Federal Government, where he harnesses machine learning algorithms for mission-critical applications. In his 2010 doctoral thesis, he introduced a linear programming-based algorithm tailored for optimal resource assignment in expansive cloud computing landscapes. Later, in 2017, Dr. Ahmad pioneered the development of a real-time analytics framework, StreamSensing. This tool has become the cornerstone of several of his research papers, leveraging it to process multi- media data within various machine learning paradigms.
Page
6
Outside of his governmental role, Dr. Ahmad holds a visiting professorship at the University of Ottawa. He has also been recognized as an authorized instructor for both Google Cloud and Mi- crosoft. Currently, he is writing a forthcoming book on AI agents, scheduled for publication next year, and is actively engaged in research on large-scale AI agents, exploring how these systems can transform real-world applications. I’m deeply grateful to my wife, Naheed, my son, Omar, and my daughter, Anum, for their unwavering support. A special nod to my parents, notably my father, Inayatullah, for his relentless encouragement to continue learning. Further appreciation goes to Loganathan, Denim, and Deepayan from Packt for their invaluable contributions.
Page
7
About the reviewers Mohamed Osam Abouahmed is a principal architect and consultant providing a unique combination of technical and commercial expertise to resolve complex and business-critical issues through the design and delivery of innovative, technology-driven systems and solutions. Mohamed specializes in network automation solutions and smart systems development and deployment. Mohamed’s hands-on experience, underpinned by his strong project management and academic background, which includes a PMP Certification, Master of Global Management, Master of Busi- ness Administration (International Business), Master of Science in Computer Networking, and BSc in Electronics Engineering, has helped him develop and deliver robust solutions for multiple carriers, service providers, enterprises, and Fortune 200 clients including (among others) AT&T, Cisco Systems, and AWS. He is the author of Building Your AI Agents Army: A Hands-On Guide to Building Intelligent Autono- mous Systems with Open-Source Tools (ISBN 979-8283388939) and Machine Learning in Microservices: Productionizing microservices architecture for machine learning solutions (ISBN: 978-1804612149). Ajay Soni is the creator of the Verb-Oriented Middleware Architecture (VOMA) and the Verb-Object Graph Architecture (VOGA), paradigms established to integrate governance, ex- plainability, and auditable processes into complex AI workflows. With over two decades of ex- perience as a systems architect, AI researcher, and software engineer, his work has impacted high-stakes domains including quantitative finance, aerospace and defense, and enterprise AI. A strong proponent of Model-Based Systems Engineering (MBSE), Ajay uses SysML to bridge the gap between high-level architectural design and robust, practical implementation. His research focuses on enabling real-time, autonomous decision-making on resource-constrained edge de- vices, ensuring every action is both transparent and compliant.
Page
8
Through his company, Enjector Software, Ajay has developed a comprehensive platform for trust- ed autonomy. His expertise has been honed in demanding environments, having architected real-time fraud detection platforms at Barclays, developed large-scale pricing and risk systems at BNP Paribas, and designed distributed, safety-critical software for the Tempest fighter jet pro- gram at Leonardo. This background informs his perspective as a reviewer, bringing a meticulous focus on how governance, explainability, and real-time performance are integrated into complex systems. This is his first contribution as a book reviewer. I appreciate the opportunity to review this insightful book and thank the authors and publishing team. I am also grateful to my family, friends, and colleague Dr. Indu Bhalla for their support and for the valuable discussions that have shaped my perspective on autonomous systems. These conversations have reinforced the importance of ethical governance, which guides my evaluations and reflects the collaborative spirit of my work.
Page
9
(This page has no text content)
Page
10
Table of Contents Preface xix Part I: Architecting Fundamentals 1 Chapter 1: Fundamentals of AI System Architecture 3 Getting the most out of this book – get to know your free benefits 5 Next-gen reader • 5 Interactive AI assistant (beta) • 6 DRM-free PDF or ePub version • 6 Introduction to AI systems: architecting the future of intelligence 7 What is an AI system? • 9 The pervasive impact of AI infrastructure: powering intelligent solutions across industries • 11 Key components of AI system architectures • 12 Microservice architectures: a modular approach to building complex AI systems 14 Advantages of microservices for AI • 15 Challenges of microservice architectures • 15 Real-world example: conversational AI microservices implementation • 15 The four core microservices • 16 Role of the API gateway • 17 Conversation flow sequence • 18 Key aspects of microservice communication • 19 Implementation considerations for conversational AI microservices • 20 Why microservices for conversational AI? • 21 Considerations for an AI system 21 Scalability: handling growing data and model complexity • 22
Page
11
(This page has no text content)
Page
12
(This page has no text content)
Page
13
(This page has no text content)
Page
14
(This page has no text content)
Page
15
(This page has no text content)
Page
16
Table of Contents xv Chapter 6: Design, Integration, and Testing 119 Design fundamentals 119 Requirements • 120 Performance requirements • 120 Non-functional requirements • 120 Security requirements • 121 Compliance requirements • 121 Actors and use cases • 122 System modes • 123 Block definition diagrams 126 Data cleansing • 126 Data transformation • 126 Machine learning model • 127 Pipeline operations • 127 Results store • 128 System tactics and patterns 128 Key attributes • 128 Maintainability tactics and patterns • 128 Availability tactics and patterns • 129 Essential patterns for AI systems • 129 Integration and testing 132 Types of integrations • 132 Integration harness • 134 Testing types • 135 Requirements testing • 136 Use case and scenario testing • 136 Load testing • 137 Model prediction testing • 137 Data quality testing • 138 Error and fault recovery testing • 138
Page
17
(This page has no text content)
Page
18
(This page has no text content)
Page
19
Table of Contentsxviii Step 3 • 174 Need help? • 175 Other Books You May Enjoy 178 Index 181
Page
20
Preface The age of Artificial Intelligence (AI) is upon us. Every day, new applications, extensions, or im- provements in almost all aspects of life are being impacted by AI technologies. These technologies are almost entirely realized in complex software. Building complex software is a challenge that requires disciplined and methodical effort to en- gineer. Many times, when complex software systems fail, it is usually that the architecture of the system failed, rather than a specific algorithmic or implementation detail. There exist best practices and lessons learned for building complex software. There also exist plenty of references on the theory and implementation of AI technologies. There do not exist many references for how to build complex software that has AI technologies at its heart. The authors’ main tenet is that the application of architecting concepts and practices is a key en- abler to building complex AI software. In the pages that follow, we will discuss what some of the challenges facing the builder of a complex AI system are. You will learn how you can adapt and use the lessons from architecting to structure and guide the development of a software system. The book looks to balance theory and application: theory so that recommendations are grounded and can be understood, and application so that the book can be useful to you in the here and now. This book is the culmination of decades of experience of the authors with hard-earned lessons, both positive and negative. The age of AI is here; we hope this book will be another tool in your toolbox.
The above is a preview of the first 20 pages. Register to read the complete e-book.
AI Reading Assistant
Whole-book reading guide from stratified index samples; jump to passages in the text
AI guide
【One-Line Pitch】
A practical architecture guide for engineers and technical leads who need to move AI from notebook experiments into reliable, scalable production systems—covering the design decisions, deployment patterns, and organizational discipline that separate working demos from dependable software.
【Book Arc】
- **Opening (~0%–15%)**: Establishes why AI systems demand deliberate architecture, defines core components (models, data, infrastructure, frameworks), and frames the central tension between AI's unique requirements and traditional software engineering.
- **Early (~15%–35%)**: Moves into concrete structural patterns—microservice decomposition illustrated through a conversational AI example, data catalogs and ontologies for governance, and modern deployment paradigms including cloud-native containerization and edge AI.
- **Middle (~35%–55%)**: Shifts from components to process: the case for architecture as a discipline, the architect's role as vision-holder, the iterative analysis–synthesis–evaluation cycle, and the documentation artifacts (concepts of operations, use case diagrams, decompositions) that keep stakeholders aligned.
- **Late (~55%–80%)**: Dives into the ML development lifecycle—data quality checks, transforms, model building and tuning, configuration control, production pipelines, and operational monitoring—then connects these to architectural patterns and non-functional requirements like reliability and maintainability.
- **Ending (~80%–100%)**: Closes with exercises and references, reinforcing the book's hands-on, practitioner-oriented stance rather than offering a grand synthesis.
【Key Takeaways】
- **AI systems are exceptionally complex software, and architecture is the discipline that prevents predictable failures** (Middle): the book opens its architecture case with a thought experiment showing how seven common practices—undirected coordination, majority-vote design, treating testing as optional—guarantee unusable software. This matters because AI amplifies every one of these failure modes.
- **Microservices offer a genuine balance of flexibility and fault tolerance for AI workloads** (Early): the conversational AI example shows how splitting NLP, dialog management, and knowledge retrieval into independent services enables component-level iteration and isolated scaling—but the book is honest that inter-service hops add latency and complexity that must be actively managed.
- **Data governance infrastructure is architectural, not an afterthought** (Early): catalogs provide centralized metadata (location, schema, lineage, quality) while ontologies supply semantic context. Together they let data scientists and engineers understand their resources and ensure governance—critical when model behavior depends entirely on data provenance.
- **Cloud-native and edge deployments represent distinct architectural trade-offs, not a maturity ladder** (Early): containerization and orchestration (Docker, Kubernetes) enable consistency and elastic scaling, while edge AI addresses latency and locality. The book treats these as design choices to be matched to requirements rather than defaults.
- **The architect's role in AI projects extends beyond traditional software concerns** (Middle): architects must balance data pipeline management, model development workflows, system adaptability against output stability, and the integration of algorithmic components with infrastructure—plus define checks and balances for autonomous decision-making.
- **The architectural cycle is iterative: analysis, synthesis, evaluation** (Middle): decomposing functions and identifying non-functional requirements (analysis), creating first-order designs using patterns and tactics (synthesis), then testing concepts through modeling, prototyping, or decision matrices (evaluation)—with stakeholders making the final call.
- **Documentation artifacts are the architect's primary tool for maintaining vision** (Middle): concepts of operations documents, high-level use case diagrams, logical and functional decompositions, and support narratives keep stakeholders aligned and prevent component and interface divergence as requirements evolve.
- **The ML production pipeline has distinct architectural stages that each demand attention** (Late): data quality checks, transforms, model building and tuning, configuration control, code committal and DevOps, operational status monitoring, and model maintenance—each with its own reliability and maintainability implications.
【Reading Tips】
- **Deep-read Chapters 1–2 (roughly 10%–50%)**: this is where the book's core argument lives—the case for architecture, the architect's role, and the microservices pattern. Skim the cloud provider service catalogs (SageMaker, Bedrock, Azure AI) unless you're actively selecting a platform.
- **Treat the ML pipeline chapter as a checklist, not a narrative**: the sections on data quality, configuration control, and operational monitoring are dense with discrete concerns. Read with your own system in mind and note gaps.
- **Don't skip the exercises**: they appear at chapter ends and are the book's main mechanism for converting concepts into practice. They're short but force you to apply the architectural cycle to your own context.
- **Watch for the recurring tension between adaptability and stability**: the book returns to this repeatedly in AI contexts. Track how each chapter resolves it—that thread is the book's intellectual spine.
- **Skim the front matter and publisher boilerplate entirely**: the table of contents and conventions sections consume roughly the first 10% of the text and offer no architectural content.
【Coverage Limits】
The excerpts cover the book's framing, early architectural patterns, the architect's process, and the ML pipeline in reasonable depth, but the later chapters on specific architectural patterns, tactics, and non-functional requirements are only partially represented—the guide's treatment of the ending stages is therefore thinner than the opening.
Passage locations
Page 8
s been honed in demanding environments, having architected real-time fraud detection platforms at Barclays, developed large-scale pricing and risk systems at...
View in text
Excerpt 2
esigned to excel at specific tasks within a limited domain. Examples include image recognition software, spam filters, and recommendation engines. While they...
View in text
Excerpt 3
iner orchestration platforms such as Kubernetes manage the deployment, scaling, and operation of application containers across clusters of hosts. • Microserv...
View in text
Excerpt 4
s, ensuring documentation enables unified system operation. They identify non-functional requirements and architectural patterns for autonomous decision-maki...
View in text
Recommended for You
{{#thumbnailUrl}}
{{/thumbnailUrl}}
{{^thumbnailUrl}}
{{/thumbnailUrl}}
Loading recommended books...
Failed to load, please try again later
Tip the Site
Scan the WeChat Pay or Alipay code to tip. No login required.
WeChat Pay
Alipay