Practitioner’s Guide to Data Science Streamlining Data Science Solutions using Python, Scikit-Learn, and Azure ML Service ()（Z-Library）
Author: nasir ali mirza
技术
Covers Data Science concepts, processes, and the real-world hands-on use cases. Key Features ● Covers the journey from a basic programmer to an effective Data Science developer. ● Applied use of Data Science native processes like CRISP-DM and Microsoft TDSP. ● Implementation of MLOps using Microsoft Azure DevOps. Description "How is the Data Science project to be implemented?" has never been more conceptually sounding, thanks to the work presented in this book. This book provides an in-depth look at the current state of the world's data and how Data Science plays a pivotal role in everything we do. This book explains and implements the entire Data Science lifecycle using well-known data science processes like CRISP-DM and Microsoft TDSP. The book explains the significance of these processes in connection with the high failure rate of Data Science projects. The book helps build a solid foundation in Data Science concepts and related frameworks. It teaches how to implement real-world use cases using data from the HMDA dataset. It explains Azure ML Service architecture, its capabilities, and implementation to the DS team, who will then be prepared to implement MLOps. The book also explains how to use Azure DevOps to make the process repeatable while we're at it. By the end of this book, you will learn strong Python coding skills, gain a firm grasp of concepts such as feature engineering, create insightful visualizations and become acquainted with techniques for building machine learning models. What you will learn ● Organize Data Science projects using CRISP-DM and Microsoft TDSP. ● Learn to acquire and explore data using Python visualizations. ● Get well versed with the implementation of data pre-processing and Feature Engineering. ● Understand algorithm selection, model development, and model evaluation. ● Hands-on with Azure ML Service, its architecture, and capabilities. ● Learn to use Azure ML SDK and MLOps for implementing real-world use cases.
📄 File Format:
PDF
💾 File Size:
7.2 MB
16
Views
0
Downloads
0.00
Total Donations
📄 Text Preview (First 20 pages)
ℹ️
Registered users can read the full content for free
Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.
📄 Page
1
(This page has no text content)
📄 Page
2
Practitioner’s Guide to Data Science Streamlining Data Science Solutions Using Python, Scikit-Learn, and Azure ML Service Platform Nasir Ali Mirza www.bpbonline.com
📄 Page
3
FIRST EDITION 2022 Copyright © BPB Publications, India ISBN: 978-93-91392-871 All Rights Reserved. No part of this publication may be reproduced, distributed or transmitted in any form or by any means or stored in a database or retrieval system, without the prior written permission of the publisher with the exception to the program listings which may be entered, stored and executed in a computer system, but they can not be reproduced by the means of publication, photocopy, recording, or by any electronic and mechanical means. LIMITS OF LIABILITY AND DISCLAIMER OF WARRANTY The information contained in this book is true to correct and the best of author’s and publisher’s knowledge. The author has made every effort to ensure the accuracy of these publications, but publisher cannot be held responsible for any loss or damage arising from any information in this book. All trademarks referred to in the book are acknowledged as properties of their respective owners but BPB Publications cannot guarantee the accuracy of this information.
📄 Page
4
www.bpbonline.com
📄 Page
5
Foreword Many of the modern applications these days have Data science models integrated to score and predict. In the journey to democratize data science, the methodology and ease of consumption of those models have evolved. Many of the popular Machine learning cloud services have seamless application integration capabilities to predict based on the context along with prescriptive capabilities. Application Integration with ML Model require Programmers to work closely with Machine learning engineers and data scientists to build consumption for models. In this book, Nasir Mirza first introduces the field of data science along with its process, methodologies, data analysis to make application programmers familiarize with the data science process. Subsequently, he takes the journey to preprocessing data and to train a machine learning model and the methodologies to evaluate the accuracy of the Model. Finally, he introduces how to use Azure Machine Learning services to train the model and then to deploy and manage the model. Thus, this book builds a great foundation for application programmers and data engineers to leap towards the discipline of Data science. I’m honored to have had the opportunity to work directly with Nasir in my previous roles and I will be recommending this book to my colleagues that wish to learn data science. Vijay Korapadi
📄 Page
6
Principal Data and Applied Scientist Microsoft
📄 Page
7
Dedicated to Most humbly to my beloved father (late) Alhajj Mirza Ali Mohammed for his resolute hopeful outlook and my beloved mother Alhajjah Hamida Khan for filling the void
📄 Page
8
About the Author Nasir Ali Mirza is a Data Architect and Data Science Professional with over 20 years of experience in data technologies. He has designed and implemented large scale data movement pipelines and data transformations for very large global organizations in private and public sector like Lehman Brothers, Caudwell Communications, Bell South, Museum of Science, Delaware State, Wells Fargo, Kennametal, GEICO utilizing big data and analytics platforms. He is currently a Data Architect at Applied Information Sciences, designing and implementing modern data analytics solutions. Prior to joining AIS, he served in the Database and BI practice at Microsoft Global Services. In this role, he architected data solutions for customers in the banking, insurance, and telecom industry. With a desire to share his expertise with others, Mr. Mirza has been a presenter at Microsoft TechReady and a contributor to other data communities. Over the course of his career, he has become a Microsoft Certified Professional, completed the Microsoft Professional Program for Data Science, and achieved numerous other Microsoft certifications. Outside his profession, Mr. Mirza takes keen interest in community education programs and spending time in natural landscapes. He lives with his mother, wife, and three lovely daughters at what is known in the literature as ‘Paradise on Earth’ - Kashmir.
📄 Page
9
Your Blog links: https://dosqlbi.azurewebsites.net/
📄 Page
10
About the Reviewer Rami Vemula is a technology consultant and author who has more than 11 years of experience in delivering scalable cloud solutions using Microsoft Azure. He holds a Master’s degree in Electrical Engineering from CSULB and he is a Microsoft Certified .Net and Azure Developer. He currently works for ThoughtWorks India. As part of his work, he architects, develops, and maintains various technical solutions targeting Microservices and Distributed Systems using Container technologies. He was a Microsoft Most Valuable Professional (MVP) in .NET from 2011 to 2014 and a Microsoft Community Contributor for 2011. In his free time, he enjoys answering questions at StackOverflow and forums.asp.net. He loves to share his technical experience through his blog at He is married and lives with his wife, children, and parents in Hyderabad, India. You can reach Rami at rami.ramilu@gmail.com or He holds below publications in collaboration with APress publishers. Real-Time Web Application Development with ASP.NET Core, SignalR, Docker and Azure Published on December, 2017
📄 Page
11
21K Downloads Integrating Serverless Architecture Using Azure Functions, Cosmos DB, and SignalR Service Published on May, 2019 5K Downloads
📄 Page
12
Acknowledgement It took one long year to complete the journey, writing a book was much harder than I had anticipated, at the same time greatly pleasing to have one done. I want to take this opportunity to express my gratitude to EVERYONE that helped me in small and big ways to get to this point in life. My uncles, Professor Dr. Mohammed Zaman Azurdah, an eminent author and Sahitya Akademi award winner. As a child I grew up seeing you write dozens of books. Mohi-ud-din Mirza for grooming and training us since childhood, Mirza Ghulam Hassan for your love of unique type, and Bashir Ahmed Khan for the little poetic entertainments. My brothers, Asif Ali Mirza for the values you inculcated in me, Niyaz Ali Mirza for being the moral and emotional support through the thick and thin of life. My sisters-in- law Sakina Misbah and Khusroojahan Khan for making a wonderful family, and you all lovely children Mujtaba, Amirah, Aliyah, Ali, Yusra, Arsalan, and Ayaan. Special gratitude to my mother Hamida Khan, my wife Aaminah, and three lovely daughters Zahra – very thoughtful and passionate girl, Maryam – you always surprise me with your acumen, and Zainab – our family chitter-chatter box and great thinking mind. You all supported me days and nights during this book journey while I would spend all my spare time, evenings and weekends in an isolation doing the writing work. You adjusted with my lifestyle for more than a year. THANK YOU.
📄 Page
13
Great appreciation for my publisher BPB for granting me an opportunity to write. I had an excellent experience with BPB team. My technical reviewer and friend Rami Vemula (Microsoft MVP), this book wouldn’t exist today without you motivating me for it. My co-worker Anirban (Microsoft Associate Data Scientist) your thoughtful feedbacks added great value. My colleague and friend at Microsoft Vijay Korapadi (Principal Data Scientist) for accepting the foreword writing request for my book. THANK YOU. Fred Elleman AIS Chairman and Tom O’Connell Chief Consulting Office for building AIS, an excellent place where we continue to enjoy working. Among my teacher and mentors Shakir B. Sayyad, you hand-held my start into the field of IT some 25 years ago. Professor Dr. Abdul Majid Khan for the mentoring blessing that you have been to me. Vishwas Lele CTO at AIS for the inspiration and guidance you always provided. Mohammed Maseehuddin and Parvez Mullah, your support at start with Microsoft was exceptional. THANK YOU. My well-wishers and family, Dr. Gul Ahmad for great memories we build and cherished over years, Altaf Gadoo for your dependable and enriching friendship, Shabir Mithai for all you have done for me, and Tahir Naqvi for wonderful time in your companionship. My managers, Vivek Jindgar at NIIT, Ramshanker Krishnan at Microsoft, Rajesh Agarwal at AIS. My friends and colleagues,
📄 Page
14
Kuldeep Chauhan, Vijay Korapadi, Ajay Bhandari at Microsoft; Amit Agisgekar, Sandeep Joshi, Brent Wodicka, Gautam Shah at AIS. I learnt a lot from each one of you. Thank You!
📄 Page
15
Preface Dear reader I have been contemplating to write a book since 2013 but office, family, and travel did not leave much room to take up any practical steps. It was finally in Aug 2020 when the proposal with BPB took a final shape. Time when all of us were impacted with COVID-19 pandemic and everyone had to live through weeks and months of heartfelt grief. A small ray of hope kept us moving. It is 20+ years that I am engaged with data technologies. During this time, I got to work with small, medium, and very large customers globally in domains like telecom, insurance, manufacturing, healthcare, banking etc. As Microsoft Certified Solution Developer, I got to design and develop vital business applications; as MCTS – Database Developer I got to work on designing databases, data ingestion pipelines and reporting systems, as MCTS – BI Developer and Data Science Professional I got to design and develop Data Science solutions, as MCITP – DBA I got to work on operational and infrastructure side of managing very large production databases. During these years I got to execute large number of data projects, covering the entire lifecycle of data from generation to storage, ingestion to transformation, retrieval to reporting, and finally archiving. I have started doing data mining type projects since 2004, and experienced both successful and failed projects closely. As part of the journey, I picked up new tools, technologies, and languages as required for implementing the Data Science solutions.
📄 Page
16
Couple decades of field experience led to the strong desire of sharing the learnings made on the way. Also, in my role I get an opportunity to mentor individuals of varied backgrounds and levels, fresh college graduates to very senior professionals. Over the years I learnt the power of self-driving towards one’s passion and the impact of leading by example. That is all what drove me to take up the challenge of writing this book. I wanted to write a book with few key goals, the book which ultimately serves the Data Science practitioner’s needs for delivering the successful solutions. The book that helps any experienced programmer to take on the Data Science developer journey. The book having a hands-on use case that mimics the real-world project development and delivery closely, not just a happy path type scenario. The book which focuses on the Data Science solution development lifecycle, not on just model development or a particular vendor technology. The approach taken in this book is driven by these key factors. The book in your hand starts with basic explanation of what is Data Science, its basic concepts and application in the context of challenges and opportunities brought forward by the world-data. It moves on to discuss importance of process frameworks in software engineering in general, and frameworks that are natively meant for Data Science projects like CRISP-DM and Microsoft TDSP. It references these frameworks throughout the book and implements the hands-on use case utilizing Microsoft TDSP framework. It is observed that less than 2% of the Data Science
📄 Page
17
projects realize their business value, and the reason for such low- level success is not technology. Throughout the journey of the book, great effort and attention has been given to building the contexts and concepts in a simple conversational way with focus on Data Science solution development lifecycle. Three-fourth of the book is not tied to any vendor technology; however, this version of the book utilizes Microsoft cloud based Azure ML Service platform for operationalizing the solution. Important challenge that I faced in writing this book was maintaining a thin balance among its key aspects which were simplification of content, concept building, technical completeness, and Data Science lifecycle processes discussion. Another challenge was managing my social commitments in the field of community education, office, family, and the book writing all at the same time. It was quite hard, and I end up spending long evenings and endless weekends in moving forward, and what kept me moving was this mindset to attempt hard to lead with example. It is my sincere hope that you find this book helpful to whatever little extent in accomplishing your Data Science solutioning journey!
📄 Page
18
Code Bundle and Coloured Images Please follow the link to download the Code Bundle and the Coloured Images of the book: https://rebrand.ly/269a55 The code bundle for the book is also hosted on GitHub at In case there's an update to the code, it will be updated on the existing GitHub repository. We have code bundles from our rich catalogue of books and videos available at Check them out! Errata We take immense pride in our work at BPB Publications and follow best practices to ensure the accuracy of our content to provide with an indulging reading experience to our subscribers. Our readers are our mirrors, and we use their inputs to reflect and improve upon human errors, if any, that may have occurred during the publishing processes involved. To let us maintain the quality and help us reach out to any readers who might be having difficulties due to any unforeseen errors, please write to us at : errata@bpbonline.com
📄 Page
19
Your support, suggestions and feedbacks are highly appreciated by the BPB Publications’ Family. Did you know that BPB offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.bpbonline.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at: business@bpbonline.com for more details. At you can also read a collection of free technical articles, sign up for a range of free newsletters, and receive exclusive discounts and offers on BPB books and eBooks.
📄 Page
20
Piracy If you come across any illegal copies of our works in any form on the internet, we would be grateful if you would provide us with the location address or website name. Please contact us at business@bpbonline.com with a link to the material. If you are interested in becoming an author If there is a topic that you have expertise in, and you are interested in either writing or contributing to a book, please visit We have worked with thousands of developers and tech professionals, just like you, to help them share their insights with the global tech community. You can make a general application, apply for a specific hot topic that we are recruiting an author for, or submit your own idea. Reviews Please leave a review. Once you have read and used this book, why not leave a review on the site that you purchased it from? Potential readers can then see and use your unbiased opinion to make purchase decisions. We at BPB can understand what you think about our products, and our authors can see your feedback on their book. Thank you! For more information about BPB, please visit
The above is a preview of the first 20 pages. Register to read the complete e-book.
Recommended for You
Loading recommended books...
Failed to load, please try again later