Implementing Amazon's DataWig in Python to impute missing values in tabular data — Missing values in real-world datasets is a common phenomenon that poses a key challenge for all data practitioners. This issue is even more challenging when the dataset contains heterogeneous data types. In this article, we look at how DataWig can help us perform the imputation of missing values in tabular…

Get up to speed with the various data missingness types and methods for imputation — Contents (1) Types of Missing Data (2) Imputation Techniques (3) Python Packages for Imputation (1) Types of Missing Data There are three general types of missing data, best explained with examples. (i) Missing completely at random (MCAR) The likelihood of missing values in a feature is unrelated to any other data features (observed or unobserved). In other words, the likelihood of a…

Concept and implementation of the global search algorithm to select the best features for machine learning — Feature selection is vital in machine learning as it boosts computational efficiency and predictive performance by keeping only the most relevant predictors. Beyond popular feature selection classes like filter and wrapper methods, global search methods like simulated annealing are powerful techniques at our disposal.

Exploring examples of data science applications across the insurance value chain — The insurance sector is one of the world’s largest industries based on the value of gross premiums, the scale of investments, and its ubiquitous societal role in covering personal and commercial risks. The sheer size of the industry brings a wealth of data and business opportunities, paving the way for…

An easy-to-follow guide to containerizing multi-service ML applications with Docker — Given Docker’s impressive capabilities of building, shipping, and running machine learning (ML) applications reliably, it is no surprise that its adoption has exploded and continues to surge within the data science field. This article explains how to utilize Docker to containerize a multi-service ML application built with H2O AutoML, MLflow…

Final insights (with lecture notes) from the Machine Learning Engineering for Production (MLOps) Course by DeepLearning.AI & Andrew Ng — Realizing the potential of machine learning (ML) in the real world goes beyond model training. By leveraging the best practices of MLOps, teams can better operationalize and manage the end-to-end lifecycles of ML models in a sustainable manner. In this final article of the 4-part MLOps Specialization series, I summarize…

Developing and managing a data science pipeline for detecting fraudulent credit card transactions — Data science promises to generate immense business value across all industries through the compelling capabilities of machine learning. However, a recent report by Gartner revealed that most data science projects fail to progress beyond experimentation despite having sufficient data and intent. To unlock the full potential of data science, machine…

Concepts and Python implementation of the regression technique based on principal component analysis (PCA) — Principal component analysis (PCA) is a well-known dimensionality reduction technique, but did you know that we can also apply the concepts behind PCA in regression analysis? This article provides a clear explanation of principal component regression (PCR), including its theoretical concept, benefits, caveats, and Python implementation.

A highly efficient approach to attaining the Amazon Web Services (AWS) machine learning specialty certification — I recently took and cleared the AWS Certified Machine Learning Specialty (MLS-C01) exam to validate my expertise in machine learning and competence in implementing it on the cloud. While many online learning paths are available, most are overly lengthy and laden with excessive options and resources. …