Machine Learning Logistics

by Ted Dunning and Ellen Friedman

Preface

Machine learning offers a rich potential for expanding the way we work with data and the value we can mine from it. To do this well in serious production settings, it’s essential to be able to manage the overall flow of data and work, not only in a single project, but also across organizations.

This book is for anyone who wants to know more about getting machine learning model management right in the real world, including data scientists, architects, developers, operations teams, and project managers. Topics we discuss and the solutions we propose should be helpful for readers who are highly experienced with machine learning or deep learning as well as for novices. You don’t need a background in statistics or mathematics to take advantage of most of the content, with the exception of evaluation and metrics analysis.

How This Book is Organized

Chapters Why Model Management? and What Matters in Model Management provide a fundamental view of why model management matters, what is involved in the logistics and what issues should be considered in designing and implementing an effective project.

Chapters The Rendezvous Architecture for Machine Learning through Meta Analytics provide a solution for the challenges of data and model management. We describe in detail a preferred architecture, the rendezvous architecture, that addresses the needs for working with multiple models, for evaluating and comparing models effectively, and for being able to deploy to production with a seamless hand-off into a predictable environment.

Lessons Learned draws final lessons. In ???, we offer a list of additional resources.

Finally, we hope that you come away with a better appreciation of the challenges of real-world machine learning and discover options that help you deal with managing data and models.

Acknowledgments

We offer a special thank you to data engineer Ian Downard and data scientist Joe Blue, both from MapR, for their valuable input and feedback, and our thanks to our editor, Shannon Cutt (O’Reilly) for all of her help.