AI guide
# Data Scientist Pocket Guide: Over 600 Concepts, Terminologies, and Processes of Machine Learning and Deep Learning
## 【One-Line Pitch】
A comprehensive A-Z dictionary of data science terminology covering machine learning, deep learning, mathematics, and statistics—ideal for data professionals, students, and newcomers who need quick, clear explanations of industry jargon. If you've ever felt lost in a data science meeting or wanted a reliable reference for everyday concepts, this pocket guide delivers concise definitions with practical context.
## 【Book Arc】
- **Opening (~0%–7%)**: The book opens with front matter, including a FAQ section addressing common practitioner questions—how to fine-tune algorithms, when to use deep learning versus traditional ML, bias-variance trade-offs, and handling imbalanced datasets. This sets expectations for a practical, question-driven reference.
- **Early (~7%–20%)**: The A-Z glossary begins with foundational concepts like active learning, artificial general intelligence (AGI), automation bias, and batch processing. Entries include worked examples (e.g., using active learning for legal document classification) and cross-references to related terms.
- **Early–Middle (~20%–40%)**: Coverage expands into statistical concepts (type I/II errors, bootstrapping), neural network architectures (bidirectional RNNs), and training techniques (candidate sampling, batch normalization). The book explains why deep learning took decades to gain traction, citing the vanishing gradient problem and limited computing resources.
- **Middle (~40%–60%)**: Entries move into core ML algorithms and infrastructure—classification problems, convergence, CUDA, Databricks, descriptive statistics, dropout regularization, and feature hashing. The book distinguishes between related concepts (e.g., epoch vs. batch, interpolation vs. extrapolation).
- **Late (~60%–100%)**: The glossary continues through L1 regularization, LSTM gates, Julia programming language, and beyond, covering advanced topics like reinforcement learning policies, loss functions, and academic conferences (ICML). The alphabetical structure ensures comprehensive coverage through Z.
## 【Key Takeaways】
- **Active learning saves labeling costs** (Early): The algorithm selects which data points to ask a teacher (human or machine) for labels, making it ideal when labeling is expensive—like a law firm classifying documents where only qualified lawyers can label. This differs from semi-supervised learning.
- **Type I and Type II errors have real-world consequences** (Early): Type I (false positive) rejects a true null hypothesis—like a test showing illness when none exists. Type II (false negative) fails to reject a false null—like a blood test missing a disease. Understanding both is critical for evaluating model performance.
- **Deep learning's late arrival was about hardware, not ideas** (Early): Neural networks existed in the 1960s and backpropagation in the 1970s, but vanishing gradients and lack of computing power made training impractical. Modern GPUs and parallel computing solved what theory alone couldn't.
- **Batch and epoch are distinct hyperparameters** (Early): A batch is the number of observations seen before parameter updates; an epoch is one full pass through the entire dataset. Confusing them leads to misconfigured training runs.
- **Convergence doesn't guarantee a good model** (Middle): A model can converge to a local minimum—a solution that isn't globally optimal. Reaching convergence means error stops decreasing, but you must verify you've found the best solution.
- **Dropout prevents overfitting by breaking weight patterns** (Middle): Randomly zeroing activation outputs stops the network from relying on a single weight pattern, forcing more robust feature learning.
- **Feature hashing encodes categorical variables efficiently** (Middle): Applying a hash function transforms features into index vectors, useful for encoding words or categories in NLP and data transformation pipelines.
- **Regularization adds penalties to fight overfitting** (Late): L1 regularization adds the sum of absolute weight values to the loss function, a technique that also promotes sparsity. This is a core tool for model generalization.
## 【Reading Tips】
- **Use as a reference, not a cover-to-cover read**: The alphabetical structure means you can jump directly to the term you need. Skim the FAQ section first for high-level answers to common questions.
- **Follow the "See also" cross-references**: Each entry links to related concepts (e.g., dropout → regularization, overfitting, neural network). Following these chains builds a mental map of how concepts connect.
- **Pay attention to worked examples**: Entries like active learning (legal documents) and type I/II errors (medical tests) ground abstract concepts in concrete scenarios—these are the most memorable parts.
- **Deep-read the statistical and neural network entries**: Concepts like bootstrapping, convergence, and LSTM gates benefit from careful reading since they underpin more advanced topics.
- **Skip entries you already know**: The book's value is in filling gaps, not reviewing familiar ground. Use the table of contents to target your weak areas.
## 【Coverage Limits】
This guide is based on a sample of the book's content (approximately 60% of the full text). The excerpts cover entries from A through L in detail, but later alphabet sections (M–Z) are only partially represented—some terms like MLOps, MNIST, and Naive Bayes appear in the FAQ/glossary listings but lack full definitions in the sampled material.
##
Passage locations
Excerpt 1
21. Chapter 21 : U 22. Chapter 22 : V 23. Chapter 23: W 24. Chapter 24: X 25. Chapter 25: Y 26. Chapter 26 : Z About the Authors Mohamed Sabri, the author of...
View in text
Excerpt 2
her that gives a hint to the learner can be a human user or another machine or system. This subdomain is close to but not the same as semi-supervised machine...
View in text
Excerpt 3
model which gives context to the information and increases the performance in specific cases. It is commonly used in speech recognition, handwritten recognit...
View in text
Excerpt 4
chine learning, it corresponds to the ability of a model to predict values based on an unseen situation. A visual representation of extrapolated and interpol...
View in text