Share E-Book
Scan to open this page

Scan with your phone to open this page

Authornasir ali mirza

Covers Data Science concepts, processes, and the real-world hands-on use cases. Key Features ● Covers the journey from a basic programmer to an effective Data Science developer. ● Applied use of Data Science native processes like CRISP-DM and Microsoft TDSP. ● Implementation of MLOps using Microsoft Azure DevOps. Description "How is the Data Science project to be implemented?" has never been more conceptually sounding, thanks to the work presented in this book. This book provides an in-depth look at the current state of the world's data and how Data Science plays a pivotal role in everything we do. This book explains and implements the entire Data Science lifecycle using well-known data science processes like CRISP-DM and Microsoft TDSP. The book explains the significance of these processes in connection with the high failure rate of Data Science projects. The book helps build a solid foundation in Data Science concepts and related frameworks. It teaches how to implement real-world use cases using data from the HMDA dataset. It explains Azure ML Service architecture, its capabilities, and implementation to the DS team, who will then be prepared to implement MLOps. The book also explains how to use Azure DevOps to make the process repeatable while we're at it. By the end of this book, you will learn strong Python coding skills, gain a firm grasp of concepts such as feature engineering, create insightful visualizations and become acquainted with techniques for building machine learning models. What you will learn ● Organize Data Science projects using CRISP-DM and Microsoft TDSP. ● Learn to acquire and explore data using Python visualizations. ● Get well versed with the implementation of data pre-processing and Feature Engineering. ● Understand algorithm selection, model development, and model evaluation. ● Hands-on with Azure ML Service, its architecture, and capabilities. ● Learn to use Azure ML SDK and MLOps for implementing real-world use cases.

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

AI guide
# Practitioner's Guide to Data Science — Reading Guide ## 【One-Line Pitch】 A practical, process-first guide for programmers transitioning into data science, showing how to run real-world ML projects using CRISP-DM and Microsoft TDSP methodologies, with hands-on implementation on the HMDA mortgage dataset using Python, Scikit-Learn, and Azure ML Service. Best for developers and data professionals who want to move beyond theory and learn how to structure, execute, and operationalize data science projects that actually deliver value. ## 【Book Arc】 - **Opening (~0%–9%)**: Establishes the "why" of data science — the explosive growth of data (150 billion connected devices, 90 ZB by 2025), the difference between Big Data, AI, ML, and Data Science, and the critical legal/ethical considerations around data collection, storage, and algorithmic fairness. Sets up the book's core argument: process discipline, not technology, is what separates successful from failed data science projects. - **Early (~9%–26%)**: Dives into the painful reality — only 27% of data science projects succeed, and the root cause is inadequate process understanding, not technical skill. Introduces and compares the major lifecycle frameworks: Domino's Data Science Life Cycle, Microsoft's Team Data Science Process (TDSP), and CRISP-DM, including how they differ from traditional software engineering in terms of code evaluation and behavior over time. - **Middle (~26%–43%)**: Focuses on business understanding — the most underrated phase. Walks through CRISP-DM's four business understanding areas (determining objectives, assessing situation, determining data mining goals, producing project plan) and introduces the book's central hands-on use case: predicting mortgage loan rate spreads using the HMDA dataset, aligned with TDSP methodology. Covers project charter, scope, team roles, evaluation metrics, and solution architecture. - **Middle (~43%–52%)**: Moves into practical implementation — setting up the Python development environment (Anaconda, Jupyter Notebooks, VS Code), TDSP folder structures and templates, data acquisition, and the critical skill of down-sampling large datasets using simple random vs. stratified random sampling to ensure statistical representativeness. Includes hands-on exploration and visualization of the HMDA data. - **Late (~52%–end)**: Continues with data exploration and visualization of categorical variables and their relationship to the target variable (rate_spread), then progresses into feature engineering, model development, evaluation, and finally Azure ML Service architecture and MLOps implementation using Azure DevOps. The excerpts cover through the visualization phase; later chapters on modeling and Azure deployment are not fully covered in this sample. ## 【Key Takeaways】 - **Process discipline is the #1 success factor in data science** (Early): With only 27% of projects succeeding and 8% generating value, the primary failure driver is inadequate process understanding, not technology or skills. Adopting frameworks like CRISP-DM or TDSP is non-negotiable for serious practitioners. - **Data science ≠ software engineering** (Early): The code you write, how you evaluate it, and how it behaves over time differ fundamentally between the two fields. Understanding these differences prevents applying wrong engineering practices to ML work. - **Legal and ethical frameworks are core, not peripheral** (Early): Data collection must be inclusive, authorized, and consented; storage must be secure; algorithms need regular auditing for accuracy, transparency, and fairness. Responsible data science requires a strong legal-ethical foundation. - **Business understanding is the most critical and most skipped phase** (Middle): CRISP-DM structures this into four areas — determining business objectives, assessing the situation, determining data mining goals, and producing a project plan. Getting stakeholders aligned on the problem, feasibility, and scope upfront prevents downstream failure. - **TDSP provides a complete project skeleton** (Middle): Microsoft's Team Data Science Process maps lifecycle stages to roles, tasks, and artifacts, and includes standardized folder structures and templates. The book provides full TDSP templates for the credit assessment use case — a practical starting point for your own projects. - **Down-sampling large datasets requires statistical care** (Middle): For large datasets like HMDA, simple random sampling risks bias; stratified random sampling by the variable most correlated with the target preserves representativeness. Ethical caution is needed — e.g., prefer housing area over ethnicity for stratification when correlations are similar. - **Anaconda + Jupyter is the standard data science stack** (Middle): Anaconda provides 1000+ packages, virtual environment management via conda, and seamless local/cloud workflow with Jupyter Notebooks — the most common and preferred setup for data science work. ## 【Reading Tips】 1. **Skim the early chapters (0–26%)** for the big-picture context and failure statistics, but don't skip the process framework comparisons — they're the conceptual foundation for everything that follows. The legal/ethical discussion is worth a careful read. 2. **Deep-read the middle chapters (26–52%)** on business understanding and data preparation — this is where the book's practical value lies. Pay special attention to the TDSP folder structure, project charter template, and the down-sampling discussion with HMDA data. 3. **Follow along with the code notebooks** — the book references specific Jupyter notebooks (e.g., Visualizing_Data_for_rate_spread.ipynb) and TDSP templates that accompany the text. Download these and run them as you read for maximum retention. 4. **Watch for the HMDA use case thread** — the mortgage rate spread prediction project runs through the entire book. If you understand how each chapter's concepts apply to this use case, you'll be able to transfer the pattern to your own projects. 5. **The final chapters on Azure ML and MLOps** are the payoff for the process-heavy early material — if you're primarily interested in cloud deployment, you can skim the early methodology chapters and focus on the Azure sections, but you'll miss the context for why MLOps matters. ## 【Coverage Limits】 This guide is based on excerpts covering approximately the first half of the book (through data visualization). The later chapters on feature engineering, model development/evaluation, Azure ML Service architecture, and MLOps with Azure DevOps are mentioned in the book's outline but not covered in detail in the available source material. ##
Excerpt 1
lgorithm selection, model development, and model evaluation. ● Hands-on with Azure ML Service, its architecture, and capabilities. ● Learn to use Azure ML SD...
View in text
Excerpt 2
e 1000 books where each book is of 1000 pages approximately. Hours of video uploaded to YouTube every minute have increased from 6 in 2007 to 500 in Automate...
View in text
Excerpt 3
etermining the business objective. Assessing the situation. Determine the data mining goals. Producing the project plan. CRISP-DM reference guide describes t...
View in text
Excerpt 4
ce data are very large. It can be computationally expensive to carry exploration and analysis with large data set. However, an appropriate sampling method mu...
View in text
Excerpt 5
a preparation activity and feature engineering. Answers D D C D D C D C D A CRISP-DM for data preparation CRISP-DM framework identifies the number of tasks a...
View in text
Excerpt 6
Table Table 6.2: Algorithm comparison on essential factors characteristic and area under curve curves come in, but for that to understand we need to know abo...
View in text
Excerpt 7
ol over the ML development workflow; Data Scientist can use the Jupyter notebooks on these cloud instances without worrying about the underlying infrastructu...
View in text
Excerpt 8
deployed web service as follows: MLOps with Azure Pipelines MLOps is DevOps for machine learning and on the Azure platform, MLOps is implemented using Azure...
View in text
Tags
AI categories
PythonArtificial IntelligenceCloud Native
ISBN: 9391392873
Publisher: BPB Online
Publish Year: 2022
Language: English
Pages: 428
File Format: PDF
File Size: 7.2 MB
Text Preview (First 20 pages)
Registered users can read the full content for free

Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.

Generating text preview…