Advanced retrieval-augmented generation bridging large language models and knowledge graphs (Wendy Ran Wei, Huijun Wu) (z-library.sk, 1lib.sk, z-lib.sk)

【One-Line Pitch】 A practical bridge between large language models and structured knowledge, this book shows how to build retrieval-augmented generation systems that reason over graphs rather than flat text—accurate, explainable, and robust. Best for developers, data scientists, and graduate researchers ready to move from basic RAG to Graph-RAG. 【Book Arc】 - **Opening (~0%–10%)**: Sets the stage by framing RAG as the answer to LLM hallucinations and stale knowledge, then maps the four-part structure and tells each audience where to start. Establishes the "why" before any implementation. - **Early (~10%–35%)**: Builds the information-retrieval foundation—historical evolution, indexing (inverted/forward indexes, positional data, distributed and compression techniques), two-tower retrieval architectures, and query processing (expansion, enrichment, routing, decomposition). Solves the "how does retrieval actually work" problem. - **Middle (~35%–50%)**: Turns to LLMs themselves—tokenization granularities, the transformer and attention mechanics, model families (encoder-only, decoder-only, encoder-decoder), and training paradigms from pretraining through prompting. Grounds the "generation" half of RAG. - **Late (~50%–75%)**: Moves into graph-based knowledge representation and then fuses it with RAG—implementing Graph-RAG with popular frameworks and evaluating performance. This is the book's core bridge between the two halves. - **Ending (~75%–100%)**: Surveys state-of-the-art frameworks—RAPTOR, G-Retriever, Microsoft GraphRAG, and HippoRAG—comparing their distinct approaches and applications, reading like research-seminar material on where the field is heading. 【Key Takeaways】 - **RAG exists to fix two core LLM failures** (Opening): hallucinations and knowledge staleness are named as the central limitations, and dynamic knowledge integration is presented as the remedy—this framing justifies the entire book. - **Retrieval quality rests on indexing fundamentals** (Early): inverted indexes, posting lists, positional information, and distributed/compressed indexing are treated as the backbone of fast, scalable search—not skipped as background. - **Query processing is a multi-stage discipline** (Early): expansion, context enrichment, routing, and decomposition each address distinct failure modes (vocabulary mismatch, ambiguous intent, complex multi-part questions), and their sophistication directly shapes downstream retrieval quality. - **Tokenization choices carry real trade-offs** (Middle): word-, character-, subword-, and ML-based tokenizers differ in vocabulary size, OOV robustness, and semantic richness—practitioners are told these decisions affect performance and cross-language applicability. - **LLM families map to task fit** (Middle): encoder-only, encoder-decoder, and decoder-only architectures, plus proprietary vs. open-source and domain-specific models, are organized so readers can match architecture to use case. - **Training is a layered pipeline** (Middle): pretraining builds general language understanding, post-training specializes, and prompting (zero/few-shot, chain-of-thought, in-context learning) guides behavior—these paradigms are shown working together rather than in isolation. - **Graph-RAG is the book's payoff** (Late): combining RAG with structured graph knowledge enables contextualized reasoning, accurate referencing, and semantic understanding—the practical implementation gap the book claims to fill. - **SOTA frameworks diverge in approach** (Ending): RAPTOR, G-Retriever, Microsoft GraphRAG, and HippoRAG are compared as distinct strategies, useful for readers choosing a starting point or tracking research frontiers. 【Reading Tips】 - **Route yourself by background**: beginners take Parts I–II; RAG newcomers with IR/LLM experience jump to Chapter 3; advanced readers go straight to Part III; researchers and grad students focus on Part IV. - **Deep-read the indexing and query-processing chapters** if you're building retrieval infrastructure—these are dense but foundational, and skimming them undermines everything downstream. - **Treat the attention/tokenization math as reference, not memorization**: the worked attention example is illustrative; grasp the intuition and move on unless you're tuning models. - **Use the companion website alongside the text**: source code, Jupyter notebooks for RAG/Graph-RAG/KG integration, and sample datasets make the implementation chapters far more concrete. - **Prerequisites to line up first**: working Python knowledge and basic algorithms/data-structures familiarity; foundational AI/ML is helpful but the book introduces concepts as needed. 【Coverage Limits】 This guide is built from stratified excerpts covering the book's framing, IR fundamentals, LLM internals, and framework overview; the detailed Graph-RAG implementation and evaluation chapters (Part III) and the SOTA framework deep-dives (Part IV) are only summarized at the structural level, so specifics there are not covered.