Share E-Book
Scan to open this page

Scan with your phone to open this page

Author: Balamurugan Balakreshnan, Sina Fakhraee, Jay Padhya, Minsoo Thigpen

Rating No ratings yet

No description

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

AI guide
【One-Line Pitch】 A practical, enterprise-focused guide to building intelligent copilots and autonomous agents on Microsoft Foundry, covering everything from environment setup and model selection to RAG, multi-agent orchestration, and responsible AI governance—ideal for developers, architects, and AI engineers working in Azure-centric organizations. 【Book Arc】 - **Opening (~0%–10%)**: Introduces the book's scope—building production-ready AI copilots and agents with Microsoft Foundry—and outlines the full journey: setup, model catalog, prompt engineering, fine-tuning, RAG, agent frameworks, multi-agent workflows, and responsible AI. Also covers the evolution from generative AI to agentic AI, defining agents as orchestration layers combining models, tools, memory, and execution context. - **Early (~10%–23%)**: Walks through hands-on environment setup: creating Azure resource groups, provisioning Foundry projects, configuring networking/identity/security, and deploying OpenAI models like GPT-4.1 via the portal. Emphasizes practical portal navigation and resource organization for dev, test, and production environments. - **Early (~23%–32%)**: Explains Foundry's core architecture and tools—project structures, resource management, security boundaries, prompt flow (visual authoring for LLM chains), and the agent service (managed runtime for autonomous, tool-using agents). Discusses shared vs. dedicated resource strategies, balancing cost, performance, and compliance needs. - **Middle (~32%–48%)**: Dives into security and model selection. Covers content safety (filters, prompt shields, groundedness detection), network security (private endpoints, virtual networks), and the Model Catalog—including deployment modes (serverless API vs. dedicated), model evaluation metrics, and context engineering strategies like extractive summarization to reduce token usage and latency. - **Middle (~48%–end of sample)**: Focuses on building agents with the Agent Framework: agent structure, core characteristics, the Foundry Agent Service (threads, runs, tool orchestration), and multi-agent systems with connected agents for delegation and specialization. Includes a sales automation use case, testing levels, observability, and production considerations. 【Key Takeaways】 - **Agentic AI is a paradigm shift from generation to action** (Early): Agents are not just models—they are managed orchestration layers combining instructions, tools, execution context, and conversation state to reason, plan, and act toward goals. This matters because enterprise value comes from completing tasks end-to-end, not just answering questions. - **Environment setup is the foundation for everything** (Early): Creating resource groups, provisioning Foundry projects, and deploying models like GPT-4.1 in the Azure portal are prerequisites for all later work. Proper organization by environment (dev/test/prod) simplifies governance and operations. - **Resource allocation is a strategic, not just technical, decision** (Early): Shared resources minimize cost for prototyping, while dedicated resources provide isolation and compliance for sensitive data (financial, healthcare). Foundry supports an evolutionary approach—start shared, move to dedicated as applications mature. - **Prompt flow turns AI logic into executable graphs** (Early): Visual authoring chains LLM calls, Python tools, retrieval steps, and evaluators, enabling rapid iteration, bulk testing, and CI/CD gating on quality metrics. This reduces glue code and accelerates prototyping to production. - **Security requires defense-in-depth** (Middle): Combine content safety (filters, prompt shields, groundedness detection) with network security (private endpoints, virtual networks) and identity-based access control (e.g., document-level permissions in Azure AI Search). This dual-layer approach satisfies both IT security and compliance mandates. - **Model selection is an architectural decision** (Middle): Foundry's Model Catalog supports serverless API and dedicated deployments, with trade-offs in cost, latency, and control. Choosing models based on performance, cost, and regulatory needs—not just capability—is critical for enterprise success. - **Context engineering reduces cost and latency** (Middle): Techniques like extractive summarization (compressing long documents before prompting) can cut token usage by 60–80% for document-grounded queries, preserving accuracy while improving performance and reducing per-call costs. - **Multi-agent orchestration enables specialization and scale** (Middle): Connected agents allow a primary controller to delegate tasks to specialized agents (retrieval, analysis, action) across projects, using standardized handoff protocols and identity. This pattern is essential for complex, real-world workflows. 【Reading Tips】 - **Skim the setup chapters (Early) if you're already familiar with Azure**: The resource group and deployment walkthroughs are detailed but procedural; focus on the architectural decisions (shared vs. dedicated resources) rather than every portal click. - **Deep-read the security and model selection sections (Middle)**: These are the most enterprise-critical—content safety, network isolation, and deployment modes have direct compliance and cost implications. Take notes on the dual-layer security approach. - **Pay special attention to the context engineering strategies (Middle)**: The extractive summarization example is a concrete, reusable pattern for reducing token usage—apply it to any RAG or document-heavy workload. - **Use the agent-building chapters (Middle) as a hands-on tutorial**: The sales automation use case and agent lifecycle (threads, runs) are best learned by doing. Follow along with the SDK and portal setup to internalize the concepts. - **Don't skip the evaluation and observability content**: Testing levels, metrics, and continuous refinement are what separate demos from production-ready agents—skim if short on time, but revisit before deployment. 【Coverage Limits】 The excerpts cover the book's first half (setup, architecture, security, model catalog, and context engineering) plus an overview of agent-building chapters, but do not include detailed code for multi-agent orchestration, fine-tuning workflows, or the final production deployment chapters. The guide reflects the sample's focus on foundations and early agent concepts.
Page 1
F of this book • Build copilots using GPT and OpenAI models • Apply prompt engineering and fine-tuning techniques • Implement retrieval-augmented generation...
View in text
Excerpt 2
memory and state • Executing actions toward a defined goal Together, these capabilities transform AI from a reactive assistant into a proactive system capabl...
View in text
Excerpt 3
quirements. Teams can begin with shared resource approaches for rapid prototyping and development, then transition to dedicated resources as applications mat...
View in text
Excerpt 4
s the compute, scaling, and availability SLA on your behalf. You never provision a VM, choose a SKU, or size a cluster — you just deploy the model and issue...
View in text
Excerpt 5
worse, the training data or hyperparameters need adjustment. Beyond accuracy, evaluate response consistency, adherence to formatting requirements, and domain...
View in text
Excerpt 6
, 'r', encoding='utf-8') as infile, open(output_path, 'w', encoding='utf-8') as outfile: for line in infile: try: data = json.loads(line) prompt = data.get('...
View in text
Excerpt 7
7d82process. Based on production implementations, here is a refinement cycle that works well. The five-step cycle illustrated in the figure below captures wh...
View in text
Excerpt 8
DING ) for msg in messages: if msg.role == "assistant": for content in msg.content: if isinstance(content, MessageTextContent): print(content.text.value) Thi...
View in text
Tags
AI categories
Cloud NativeAIBackend
Publisher: Packt Publishing
Publish Year: 2026
Language: English
File Format: PDF
File Size: 6.2 MB
Text Preview (First 20 pages)
Registered users can read the full content for free

Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.

Generating text preview…