Share E-Book
Scan to open this page

Scan with your phone to open this page

Author: Johan Ludvig Brattås, Frank Geisler

Rating No ratings yet

In today's hyper-connected world, many organizations are overwhelmed by the volume of data generated every second. Making timely decisions using this information remains a challenge for many. Real-time intelligence has transformed from a luxury to a necessity for businesses striving to stay ahead in a rapidly evolving marketplace. Enter Microsoft Fabric's Real-Time Intelligence: a new tool that not only analyzes data but also acts upon the results. If you're ready to unlock the power of immediate insights, this comprehensive primer offers an exploration into the capabilities of Real-Time Intelligence with Microsoft Fabric. Authors Johan Ludvig Brattås and Frank Geisler explain AI-driven insights and how to use them to drive business success. Whether you're a seasoned professional or an enthusiast, this guide is the key to understanding an exciting new platform. You'll discover: The core concepts of Real-Time Intelligence within Microsoft Fabric Challenges that can be solved with Real-Time Intelligence, enhancing efficiency Techniques for using KQL queries, including SQL knowledge to optimize these queries Practical applications including data analytic solutions, event streams, and more How to automatically trigger actions based on data conditions

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

AI guide
# Real-Time Intelligence with Microsoft Fabric ## 【One-Line Pitch】 A practical, hands-on guide for data professionals and business analysts who want to turn streaming data into immediate, actionable insights using Microsoft Fabric's Real-Time Intelligence suite—covering everything from core concepts to building complete event-driven solutions. ## 【Book Arc】 - **Opening (~0%–9%)**: Introduces the "digital impasse"—the gap between data creation and meaningful action—and positions Real-Time Intelligence as the solution. Sets up Microsoft Fabric as a unified platform that eliminates the need for brittle, multi-service pipelines and specialized data silos. - **Early (~9%–25%)**: Covers Fabric fundamentals: the lakehouse/warehouse/eventhouse storage trifecta, OneLake foundation, tenant and workspace models, licensing, and capacity planning. Establishes the architectural groundwork before diving into real-time specifics. - **Early–Middle (~25%–38%)**: Distinguishes business intelligence from real-time intelligence, clarifying what "real time" actually means in practice. Explores use cases across IT operations monitoring, environmental tracking, predictive maintenance, and fraud detection, then introduces Fabric's Real-Time Intelligence component architecture. - **Middle (~38%–47%)**: Transitions into hands-on application with KQL querysets, Real-Time Dashboards, and the medallion architecture (bronze/silver/gold layers). Introduces a coffee machine monitoring scenario as the book's running example. - **Middle–Late (~47%–end)**: Walks through building the complete solution: creating eventhouses and KQL databases, enabling OneLake availability, configuring eventstreams, setting up notebooks for data simulation, and implementing update policies for automated data transformation. ## 【Key Takeaways】 - **Real-time intelligence is now a necessity, not a luxury** (Opening): Organizations drowning in data still struggle to act on it quickly; the gap between data creation and action is where opportunities and customer trust are lost. This frames why the book matters for modern businesses. - **Fabric unifies what was previously fragmented** (Early): The old approach—stitching together a dozen services and maintaining separate silos for telemetry, streaming, and business data—was brittle, expensive, and out of reach for most teams. Fabric's integrated architecture collapses this complexity into a single lake-centric SaaS platform. - **Eventhouses complete the storage trifecta** (Early): Alongside warehouses and lakehouses, eventhouses serve as scalable containers for KQL databases, purpose-built for time-series data. They handle low-latency, high-volume ingestion (up to 200 Mb/s per node), support stream processing, and enable event-driven automation through update policies. - **"Real time" needs practical definition** (Early): The book distinguishes BI from real-time intelligence, grounding the concept in concrete scenarios—predictive maintenance shifts from scheduled to predictive approaches, fraud detection responds to red flags immediately, and environmental monitoring reacts to changes as they happen. - **KQL querysets are the query workhorse** (Middle): These provide user-friendly features like syntax highlighting, IntelliSense, automatic query saving, multiple export options (CSV, Excel), and independent tabs for managing multiple query contexts—similar to SQL Server Management Studio experience. - **Real-Time Dashboards enable low-latency visualization** (Middle): Backed by Fabric's compute engines, these dashboards support parameterized queries, letting users filter and rework visualizations without changing underlying queries—an operations manager can adjust time ranges or selections directly. - **The medallion architecture structures real-time data** (Middle): Bronze/silver/gold layering makes data progressively cleaner and more analysis-ready. In the book's scenario, eventstream data is automatically transformed to silver via KQL update policies, with shortcuts preventing data movement and disparities. - **OneLake availability bridges storage paradigms** (Middle): This option, off by default, continuously copies KQL database tables to Delta tables in OneLake, enabling access from lakehouses and other Fabric components—critical for unified data access and archiving. ## 【Reading Tips】 - **Skim the Fabric fundamentals if you're experienced** (Early): Chapters on tenant models, workspace types, and licensing tables are reference material—useful but skimmable if you already work with Microsoft data platforms. - **Deep-read the real-time use cases** (Early–Middle): The IT operations, environmental monitoring, predictive maintenance, and fraud detection scenarios give concrete mental models for where real-time intelligence applies—these will help you map concepts to your own problems. - **Follow the coffee machine project closely** (Middle–Late): The hands-on scenario is the book's backbone. Pay special attention to the data schema (BronzeCoffee, BronzeMaintenance, SilverCoffee tables) and how update policies automate the bronze-to-silver transformation. - **Watch for the "little lessons"** (Throughout): The authors explicitly aim to share hard-won quirks and details that separate prototypes from trustworthy systems—these practical insights are scattered throughout and worth flagging. - **Note the OneLake availability gotcha** (Middle): This setting is off by default and must be enabled for cross-component data access—a small detail that could cause significant confusion if missed. ## 【Coverage Limits】 Excerpts cover roughly the first half of the book (through ~47%), including Fabric fundamentals, real-time concepts, component architecture, and the early stages of the hands-on project. Later chapters on the Eventstream service, Eventhouse deep-dives, Real-Time Hub navigation, and Activator notifications are referenced but not detailed in this guide. ##
Excerpt 1
106 Time-Related Complexity 106 State Management ...
View in text
Page 20
of the traditional real-time intelligence friction and how integrating real-time dashboards with Power BI delivers the best of both worlds: instant signals w...
View in text
Excerpt 3
s and share content you Power BI (A SKUs) an Azure capacity. need a Pro, PPU, or Power BI individual trial license. Fabric You can create, share, To view Pow...
View in text
Excerpt 4
ich the eventstream will transfer all COFFEE events. In our scenario, we will use a Fabric notebook that simulates the data stream and pushes synthetic data ...
View in text
Excerpt 5
timestamp between (ago(1d) .. now() ) and user == "Elisa" | summarize Count = count() by coffee_type 94 | Chapter 4: A Hands-on Project d. To filt...
View in text
Excerpt 6
te ingestion after adding the data source” box previ‐ ously. So now that the topology is published and all destinations are ready to receive the data, click ...
View in text
Excerpt 7
table’s data. This is because data will be processed in the eventhouse when queried. Key Features of KQL Databases | 163 CHAPTER 7 The Real-Time Hub As organ...
View in text
Excerpt 8
crosoft, these events “can be used to trigger other actions or workflows, such as invoking a data pipeline or sending a notification via email.” For instance...
View in text
Tags
AI categories
Cloud NativeDataBackend
ISBN: 1098178580
Publisher: O'Reilly Media
Publish Year: 2026
Language: English
Pages: 370
File Format: PDF
File Size: 6.9 MB
Text Preview (First 20 pages)
Registered users can read the full content for free

Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.

Generating text preview…