AI guide
【One-Line Pitch】
A hands-on blueprint for developers who have outgrown rented, per-token AI and want to own small, domain-expert models they can fine-tune and run privately on a laptop, phone, or data center. Read it if you can write basic Python and want to move from fragile prompts to a model you control.
【Book Arc】
- **Opening (~0%–10%)**: Frames the shift from generalist to specialist models, argues why renting intelligence hits a wall (cost, latency, privacy, drift), and states the book's four-part structure and beginner-friendly prerequisites.
- **Early (~10%–35%)**: Builds the business and technical case — token-cost math for a document-processing app, the "agentic multiplier," the latency problem (TTFT/TPS), the data firewall and metadata leaks, compliance, and model drift.
- **Middle (~35%–55%)**: Turns toward the specialist revolution and the practical core loop of fine-tuning, including hardware realities such as calculating VRAM requirements and preparing data.
- **Late (beyond ~55%)**: Excerpts do not cover this stage in detail; the preface promises evaluation, quantization, optimization, and deployment as part of the engineering journey.
- **Ending**: Excerpts do not cover the closing chapters or any capstone project.
【Book Arc note】
The sampled excerpts are heavily front-loaded: they establish motivation and orientation far more than they demonstrate the fine-tuning workflow itself.
【Key Takeaways】
- **Rented intelligence has a ceiling** (Early): Per-token pricing turns from negligible in prototypes to punishing at automation scale; the book's contract-analyzer example shows daily costs ranging from tens to thousands of dollars depending on model choice.
- **Agents multiply the cost problem** (Early): Agentic workflows call models repeatedly, so token spend compounds — making the economics of hosted frontier models increasingly risky for thin-margin products.
- **Fine-tuning moves instructions from context to weights** (Early): Instead of paying to resend elaborate system prompts every call, behavior is baked into the model, avoiding context-window pollution and the "lost in the middle" degradation.
- **Latency is a UX problem, not just a bill** (Early): Time to first token and tokens per second matter acutely for autocomplete and voice; smaller local models avoid queueing behind other customers and round-tripping to the cloud.
- **Data ownership is a sales and compliance issue** (Middle): Sending customer data to third parties creates provenance gaps under regulations like GDPR; metadata alone can leak strategic intent, as in M&A research.
- **Model drift breaks prompt-dependent systems** (Middle): Providers update models constantly, so carefully engineered prompts can fail overnight; an owned model is a static artifact you version and regress deliberately.
- **Small, well-engineered models can outperform giants on narrow tasks** (Middle): The post-LLaMA wave of open models and optimizations (e.g., LoRA) lowered the barrier so a laptop plus a few hours of work is enough to start.
- **The book targets builders, not researchers** (Opening): Only simple Python is assumed, and all work is achievable on Google Colab's free tier — no special hardware required to follow along.
【Reading Tips】
- **Skim the cost and compliance arguments if you're already convinced**: Chapters 1–3 are persuasive setup; if you've felt the API wall, move quickly to the fine-tuning loop.
- **Deep-read the cost tables and latency metrics**: They give you concrete vocabulary (TTFT, TPS, per-million-token pricing) for justifying a local-model decision to stakeholders.
- **Do the VRAM and data-prep work hands-on**: The middle section's hardware math and dataset preparation are where theory becomes skill; run the Colab examples rather than reading them.
- **Treat the preface's four-part map as your syllabus**: It tells you where evaluation, quantization, and deployment sit, even though the excerpts don't reach them.
- **Keep a checklist of your own constraints**: privacy, latency tolerance, and volume — the book's arguments are strongest when mapped onto your specific application.
【Coverage Limits】
This guide is based on stratified excerpts concentrated in the opening and early chapters; the later fine-tuning, evaluation, quantization, and deployment material is only gestured at in the preface and is not covered here in detail.
Passage locations
Excerpt 1
ine-tuning approachable without sacrificing technical rigor. From LoRA to multimodal and diffusion models, it builds intuition first and equips readers with...
View in text
Excerpt 2
Acknowledgments It takes a village to ship a book like this. First of all, everyone on the O'Reilly team: Nicole Butterfield, who believed in my vision and h...
View in text
Excerpt 3
o search for Japanese restaurants near the current location. For each of these, it can then browse their websites to find their menus. It can then search the...
View in text
Excerpt 4
on was simple: API providers update their models constantly. So, all the effort that goes into prompt engineering (in particular, injecting commands into the...
View in text