Share E-Book
Scan to open this page

Scan with your phone to open this page

Author: Ayo Adedeji, Lavi Nigam, Sarita Joshi, Stephanie Gervasi

Rating No ratings yet

In today's AI landscape, success depends not just on prompting large language models but on orchestrating them into intelligent systems that are scalable, compliant, and cost-effective. GenAI on Google Cloud is your hands-on guide to bridging that gap. Whether you're an ML engineer or an enterprise leader, this book offers a practical game plan for taking agentic systems from prototype to production. Written by practitioners with deep experience in AgentOps, data engineering, and GenAI infrastructure, this guide takes you through real-world workflows from data prep and deployment to orchestration and integration. With concrete examples, field-tested frameworks, and honest insights, you'll learn how to build agentic systems that deliver measurable business value. Bridge the production gap that stalls 90% of vertical AI initiatives using systematic deployment frameworks Navigate AgentOps complexities through practical guidance on orchestration, evaluation, and responsible AI practices Build robust multimodal systems for text, images, and video using proven agent architectures Optimize for scale with strategies for cost management, performance tuning, and production monitoring

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

AI guide
【One-Line Pitch】 A practitioner's field guide to turning large language models into production-grade agentic systems on Google Cloud, covering the unglamorous work—data readiness, orchestration, evaluation, governance, and cost control—that decides whether enterprise GenAI ships or stalls. Best for ML engineers, platform architects, and technical leaders who already understand prompting and now need to operate agents at scale. 【Book Arc】 - **Opening (~0%–10%)**: Frames the core problem—why building on LLMs differs from classic ML—and introduces the LLMOps/AgentOps lifecycle that the rest of the book elaborates. - **Early (~10%–23%)**: Defines LLMs, multimodal foundation models, context engineering, tools, and orchestration; surveys evaluation approaches (reference metrics, perplexity, A/B testing) and the platform landscape beyond Google Cloud. - **Early–Middle (~23%–40%)**: Shifts to data readiness and accessibility—discoverability, quality, format, governance, and security as one interconnected framework rather than isolated checkboxes. - **Middle (~40%–50%)**: Covers strategic data patterns: vector store choices (Cloud SQL/pgvector, BigQuery vector search, managed Vertex AI Search/RAG Engine), semantic layers, and the agentic RAG workflow bridging structured and unstructured data. - **Middle–Late (~50%+)**: Moves into governance, security, and compliance controls—policy tags, dynamic masking, model registry, audit logging, Assured Workloads, Dataplex, and threat detection. - **Late/Ending**: Excerpts do not cover the closing chapters in detail; the preface promises deeper treatment of AgentOps, multimodal systems, cost management, performance tuning, and production monitoring. 【Key Takeaways】 - **The production gap, not the model, is the real bottleneck** (Opening): most vertical AI initiatives stall on deployment, orchestration, and operations rather than on prompt quality—so the book treats AgentOps as the center of gravity. - **Context engineering is broader than prompt engineering** (Early): system instructions, RAG, and controlled generation are framed as one discipline for shaping model behavior, with fine-tuning as a separate lever. - **Agents are model + tools + orchestration** (Early): the orchestration layer holds memory and state and applies reasoning patterns like ReAct, CoT, and ToT to decide which tools to call and what context to retrieve. - **Evaluation must cover trajectories, not just outputs** (Early): for agents, correctness means reaching the right answer for the right reasons, so the sequence of reasoning steps and tool calls matters alongside text-similarity metrics. - **Data readiness is interconnected, not a checklist** (Early–Middle): quality, format, governance, discoverability, and security reinforce each other; fixing one in isolation lets problems reappear as fresh data flows in. - **A semantic layer is the governance linchpin** (Middle): centralizing business definitions lets access rules apply at the business-term level rather than across dozens of technical columns, simplifying audit and compliance. - **Vector store choice is an architectural trade-off** (Middle): DIY options like Cloud SQL with pgvector favor control and hybrid search, while managed services like Vertex AI Search and RAG Engine cut operational overhead. - **Agentic RAG is the production state of the art** (Middle): a coordinator orchestrating specialized agents across structured and unstructured sources moves RAG from a simple pipeline to an autonomous system. - **Governance and security are built from concrete GCP controls** (Middle–Late): policy tags, dynamic masking, model registry scanning, audit logs, Assured Workloads, Dataplex, and Security Command Center map directly to AI risk areas. 【Reading Tips】 - Read Chapter 1 closely for vocabulary and mental models; later chapters assume fluency with context engineering, tools, and orchestration. - Treat the data-readiness chapter as the highest-leverage section—skim platform comparisons if you're already committed to Google Cloud, but deep-read the interconnected framework and semantic layer discussion. - When you hit vector store and RAG architecture options, build a decision table for your own workload (latency, hybrid search needs, operational budget) rather than memorizing service names. - Use the governance and security material as a checklist against your compliance requirements (HIPAA, FedRAMP, ISO, data residency) before designing, not after. - Expect the excerpts to thin out after the governance section; plan to consult official Vertex AI and AgentOps documentation for the deployment, monitoring, and cost-tuning chapters. 【Coverage Limits】 This guide is synthesized from stratified excerpts covering roughly the first half of the book (through governance and security), so later chapters on AgentOps, multimodal systems, cost management, and production monitoring are only previewed via the preface and are not detailed here.
Page 6
ons are also available for most titles (http://oreilly.com). For more information, contact our corporate/institutional sales department: 800-998-9938 or corp...
View in text
Excerpt 2
directing the interaction between the model, the tools, and the environment, orchestration ensures that the agent executes tasks reliably, iteratively refini...
View in text
Excerpt 3
security reinforce each other, as illustrated in Figure 2-4. When the company implemented role-based access controls as part of its governance initiative, it...
View in text
Excerpt 4
ta Patterns: The Foundation for Reliable GenAI Systems | 55 their own agents, providing a scalable and consistent memory store. This mirrors how Google’s own...
View in text
Excerpt 5
scopes that solve these challenges. Let’s enhance our cus‐ tomer support agent with a shopping cart feature to see these scopes in action. Building a Statefu...
View in text
Excerpt 6
3-20 demonstrates implementing a manager approval workflow. Example 3-20. Implementing asynchronous manager approval with LongRunning FunctionTool import ran...
View in text
Excerpt 7
ed after installing a faulty thermostat,” the support agent needs to delegate a complex investigation—explain the full situation to a billing specialist, hav...
View in text
Excerpt 8
eams | 141 CHAPTER 5 Evaluation and Optimization Strategies We’ve now constructed our multimodal question-answering agent, a system capable of ingesting dive...
View in text
Tags
AI categories
Artificial IntelligenceCloud NativeData
ISBN: 8341623846
Publisher: O'Reilly Media
Publish Year: 2026
Language: English
Pages: 320
File Format: PDF
File Size: 4.5 MB
Text Preview (First 20 pages)
Registered users can read the full content for free

Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.

Generating text preview…