Human-in-the-Loop Machine Learning

  • 8h 40m
  • Robert (Munro) Monarch
  • Manning Publications
  • 2021

Human-in-the-Loop Machine Learning lays out methods for humans and machines to work together effectively.

Summary

Most machine learning systems that are deployed in the world today learn from human feedback. However, most machine learning courses focus almost exclusively on the algorithms, not the human-computer interaction part of the systems. This can leave a big knowledge gap for data scientists working in real-world machine learning, where data scientists spend more time on data management than on building algorithms. Human-in-the-Loop Machine Learning is a practical guide to optimizing the entire machine learning process, including techniques for annotation, active learning, transfer learning, and using machine learning to optimize every step of the process.

Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.

About the technology

Machine learning applications perform better with human feedback. Keeping the right people in the loop improves the accuracy of models, reduces errors in data, lowers costs, and helps you ship models faster.

About the book

Human-in-the-Loop Machine Learning lays out methods for humans and machines to work together effectively. You’ll find best practices on selecting sample data for human feedback, quality control for human annotations, and designing annotation interfaces. You’ll learn to create training data for labeling, object detection, and semantic segmentation, sequence labeling, and more. The book starts with the basics and progresses to advanced techniques like transfer learning and self-supervision within annotation workflows.

What's inside

  • Identifying the right training and evaluation data
  • Finding and managing people to annotate data
  • Selecting annotation quality control strategies
  • Designing interfaces to improve accuracy and efficiency

In this Book

  • Foreword
  • About This Book
  • Introduction to Human-in-the-Loop Machine Learning
  • Getting Started with Human-in-the-Loop Machine Learning
  • Uncertainty Sampling
  • Diversity Sampling
  • Advanced Active Learning
  • Applying Active Learning to Different Machine Learning Tasks
  • Working with the People Annotating Your Data
  • Quality Control for Data Annotation
  • Advanced Data Annotation and Augmentation
  • Annotation Quality for Different Machine Learning Tasks
  • Interfaces for Data Annotation
  • Human-in-the-Loop Machine Learning Products
SHOW MORE
FREE ACCESS