Share E-Book
Scan to open this page

Scan with your phone to open this page

Author: Dylan Scott, Viktor Gamov, Dave Klein

Rating No ratings yet

Master the wicked-fast Apache Kafka streaming platform through hands-on examples and real-world projects. In Kafka in Action you will learn: • Understanding Apache Kafka concepts • Setting up and executing basic ETL tasks using Kafka Connect • Using Kafka as part of a large data project team • Performing administrative tasks • Producing and consuming event streams • Working with Kafka from Java applications • Implementing Kafka as a message queue Kafka in Action is a fast-paced introduction to every aspect of working with Apache Kafka. Starting with an overview of Kafka's core concepts, you'll immediately learn how to set up and execute basic data movement tasks and how to produce and consume streams of events. Advancing quickly, you’ll soon be ready to use Kafka in your day-to-day workflow, and start digging into even more advanced Kafka topics. About the reader For intermediate Java developers or data engineers. No prior knowledge of Kafka required. About the author Dylan Scott is a software developer in the insurance industry. Viktor Gamov is a Kafka-focused developer advocate. At Confluent, Dave Klein helps developers, teams, and enterprises harness the power of event streaming with Apache Kafka.

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

AI guide
【One-Line Pitch】 A hands-on, fast-paced tour of Apache Kafka for intermediate Java developers and data engineers who want to move from "what is a broker?" to producing, consuming, and wiring real event streams in their daily work. No prior Kafka knowledge required. 【Book Arc】 - **Opening (~0%–9%)**: Frames why event streaming matters — data volumes outgrowing nightly batch windows — and introduces Kafka's role as a decoupling middleman between producers and consumers. Sets up the reader's motivation before any code. - **Early (~9%–28%)**: Establishes the high-level architecture: brokers, topics, partitions, producers, consumers, and the coordination role of ZooKeeper (with a note that KRaft is coming). Ends with your first command-line producer/consumer exchange. - **Early–Middle (~28%–44%)**: Moves into client work — Java producer and consumer APIs, polling behavior, offsets, and the terminology of stream processing. This is where the book shifts from concepts to writing code. - **Middle (~44%–47%)**: Introduces Kafka Connect as the integration layer, contrasting source vs. sink connectors and walking through a standalone-mode file-to-topic pipeline as a first ETL exercise. - **Late (beyond ~47%)**: Excerpts do not cover the later chapters in detail, but the blurb indicates coverage of administrative tasks, Kafka Streams, message-queue patterns, and maturing your data model (referenced as chapter 11). 【Key Takeaways】 - **Kafka's core value is decoupling** (Early): producers and consumers work independently, so a payroll outage needn't take down forecasting tooling. This is the architectural argument the book returns to repeatedly. - **ZooKeeper is still worth understanding** (Early): the book targets version 2.7.1 and explains that even as KRaft replaces ZooKeeper, the underlying need for distributed coordination remains a valid concept. - **Start with the command line, then graduate to Java** (Early): the console producer/consumer using `--bootstrap-server` and a topic name is the fastest way to build intuition before touching client libraries. - **Connect is the low-friction on-ramp to ETL** (Middle): standalone mode with a properties file gets a file-to-topic pipeline running quickly; the same `bootstrap.servers` concepts from hand-written clients reappear underneath. - **Offsets and polling are foundational consumer mechanics** (Early–Middle): the book flags offsets as important early and notes that a single `poll` call may return multiple records — details that matter for correctness later. - **Java developers can lean on familiar idioms** (Early): Spring for Kafka and dependency injection are presented as bridges from known territory into streaming, lowering the adoption barrier. - **Kafka fits IoT and bursty workloads** (Early): devices reconnecting after network gaps produce firehose-style bursts, which is precisely the shape of traffic Kafka is built to absorb. - **Microservices gain a single interface** (Middle): replacing point-to-point service calls with Kafka topics loosens dependencies and lets each service process independently via Kafka Streams. 【Reading Tips】 - **Deep-read chapters 1–2**: the architecture and first-message walkthrough are the foundation everything else builds on; skimming here will cost you later. - **Type the commands yourself**: the console producer/consumer and Connect properties examples are short and reward hands-on repetition over passive reading. - **Skim the ZooKeeper discussion if you're on a modern cluster**, but read the coordination rationale — it transfers directly to KRaft. - **Java developers**: pay attention to the client configuration properties; they recur in Connect and Streams, so learning them once pays off three times. - **Keep the book's version (2.7.1) in mind** when comparing against your production cluster; API and tooling details may differ. 【Coverage Limits】 The excerpts sample roughly the first half of the book; later chapters on administration, Kafka Streams, and advanced data modeling are referenced but not detailed here, so this guide's late-stage coverage is inferred from the blurb rather than the source material.
Page 6
ement, nothing would have ever happened. I love you. Also, I would like to dedicate this book to (and thank) my children, Andrew and Michael, for being so na...
View in text
Excerpt 2
ious shared experiences or past pain points can help devel- opers see why Kafka could be an appealing step forward in their data architectures. One of the va...
View in text
Excerpt 3
sting 2.5 Kafka consumer command bin/kafka-console-consumer.sh --bootstrap-server localhost:9094 \ --topic kinaction_helloworld --from-beginning The followin...
View in text
Excerpt 4
s/con sumer/KafkaConsumer.html (accessed November 20, 2019). 16 “Streams Concepts.” Confluent documentation (n.d.). https://docs.confluent .io/platform/curre...
View in text
Excerpt 5
ld lead to a burden on the testing that we would need to do. Besides the growth in numbers alone, we might not even know all of the consumers of that data. 3...
View in text
Excerpt 6
ns when trying to work with custom objects. We’ll use seri- alization to translate data into a format that can be transmitted, stored, and then retrieved to...
View in text
Excerpt 7
to wait until a partition is replicated between brokers [9]. This is key to having in-sync replicas, and it is done before a message is available for deliver...
View in text
Excerpt 8
2017). https://medium.com/@anyili0928/what-i-have-learned- from-kafka-partition-assignment-strategy-799fdf15d3ab (accessed October 20, 2021). 18 “Release Pla...
View in text
Tags
AI categories
GoBackendData
ISBN: 161729523X
Publish Year: 2022
Language: English
Pages: 272
File Format: PDF
File Size: 15.1 MB
Text Preview (First 20 pages)
Registered users can read the full content for free

Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.

Generating text preview…