Author: Paul Rissen
Publisher: Apress
ISBN: 1484255283
Category : Technology & Engineering
Languages : en
Pages : 133
Book Description
Improving your craft is a key skill for product and user experience professionals working in the digital era. There are many established methods of product development to inspire and focus teams—Sprint, Lean, Agile, Kanban—all of which focus on solutions to customer and business problems. Enter XDPD, or Experiment-Driven Product Development—a new approach that turns the spotlight on questions to be answered, rather than on solutions. Within XDPD, discovery is a mindset, not a project phase. In Experiment-Driven Product Development, author Paul Rissen introduces a philosophy of product development that will hone your skills in discovery, research and learning. By guiding you through a practical, immediately applicable framework, you can learn to ask, and answer, questions which will supercharge your product development, making teams smarter and better at developing products and services that deliver for users and businesses alike. When applying the XDPD framework within your organization, the concept of an experiment—a structured way of asking, and answering, questions—becomes the foundation of almost everything you do, instilling a constant sense of discovery that keeps your team inspired. All types of activities, from data analysis to writing software, are seen through the lens of research. Rather than treating research as a separate task from the rest of product development, this book approaches the entire practice as one of research and continuous discovery. Designing successful experiments takes practice. That’s where Rissen’s years of industry expertise come in. In this book, you are given step-by-step tools to ensure that meaningful, efficient progress is made with each experiment. This approach will prove beneficial to your team, your users, and most importantly, to your product’s lasting success. Experiment-Driven Product Development offers a greater appreciation of the craft of experimentation and helps you adapt it in your own context. In our modern age of innovation, XDPD can put you ahead. Go forth and experiment! What You Will LearnKnow how to approach product development in a leaner, more efficient wayUnderstand where and when experiments can be useful, and how they fit into pre-existing organization environments and processesRealize why you should be thinking about the simplest, useful thing rather than the minimum, viable productDiscover how to break down feature and design ideas into the assumptions and the premises that lie behind themAppreciate the importance of designing your experiments, and the statistical concepts that underpin their successMaster the art of communicating the results of experiments back to stakeholders, and help the results guide what happens next Who This Book is For Professionals working in digital product design and development, user experience, and service design. This book is best suited for those who work on digital products every day and want to adopt better approaches to gaining knowledge about their users, what works, and what does not work.
Experiment-Driven Product Development
Author: Paul Rissen
Publisher: Apress
ISBN: 1484255283
Category : Technology & Engineering
Languages : en
Pages : 133
Book Description
Improving your craft is a key skill for product and user experience professionals working in the digital era. There are many established methods of product development to inspire and focus teams—Sprint, Lean, Agile, Kanban—all of which focus on solutions to customer and business problems. Enter XDPD, or Experiment-Driven Product Development—a new approach that turns the spotlight on questions to be answered, rather than on solutions. Within XDPD, discovery is a mindset, not a project phase. In Experiment-Driven Product Development, author Paul Rissen introduces a philosophy of product development that will hone your skills in discovery, research and learning. By guiding you through a practical, immediately applicable framework, you can learn to ask, and answer, questions which will supercharge your product development, making teams smarter and better at developing products and services that deliver for users and businesses alike. When applying the XDPD framework within your organization, the concept of an experiment—a structured way of asking, and answering, questions—becomes the foundation of almost everything you do, instilling a constant sense of discovery that keeps your team inspired. All types of activities, from data analysis to writing software, are seen through the lens of research. Rather than treating research as a separate task from the rest of product development, this book approaches the entire practice as one of research and continuous discovery. Designing successful experiments takes practice. That’s where Rissen’s years of industry expertise come in. In this book, you are given step-by-step tools to ensure that meaningful, efficient progress is made with each experiment. This approach will prove beneficial to your team, your users, and most importantly, to your product’s lasting success. Experiment-Driven Product Development offers a greater appreciation of the craft of experimentation and helps you adapt it in your own context. In our modern age of innovation, XDPD can put you ahead. Go forth and experiment! What You Will LearnKnow how to approach product development in a leaner, more efficient wayUnderstand where and when experiments can be useful, and how they fit into pre-existing organization environments and processesRealize why you should be thinking about the simplest, useful thing rather than the minimum, viable productDiscover how to break down feature and design ideas into the assumptions and the premises that lie behind themAppreciate the importance of designing your experiments, and the statistical concepts that underpin their successMaster the art of communicating the results of experiments back to stakeholders, and help the results guide what happens next Who This Book is For Professionals working in digital product design and development, user experience, and service design. This book is best suited for those who work on digital products every day and want to adopt better approaches to gaining knowledge about their users, what works, and what does not work.
Publisher: Apress
ISBN: 1484255283
Category : Technology & Engineering
Languages : en
Pages : 133
Book Description
Improving your craft is a key skill for product and user experience professionals working in the digital era. There are many established methods of product development to inspire and focus teams—Sprint, Lean, Agile, Kanban—all of which focus on solutions to customer and business problems. Enter XDPD, or Experiment-Driven Product Development—a new approach that turns the spotlight on questions to be answered, rather than on solutions. Within XDPD, discovery is a mindset, not a project phase. In Experiment-Driven Product Development, author Paul Rissen introduces a philosophy of product development that will hone your skills in discovery, research and learning. By guiding you through a practical, immediately applicable framework, you can learn to ask, and answer, questions which will supercharge your product development, making teams smarter and better at developing products and services that deliver for users and businesses alike. When applying the XDPD framework within your organization, the concept of an experiment—a structured way of asking, and answering, questions—becomes the foundation of almost everything you do, instilling a constant sense of discovery that keeps your team inspired. All types of activities, from data analysis to writing software, are seen through the lens of research. Rather than treating research as a separate task from the rest of product development, this book approaches the entire practice as one of research and continuous discovery. Designing successful experiments takes practice. That’s where Rissen’s years of industry expertise come in. In this book, you are given step-by-step tools to ensure that meaningful, efficient progress is made with each experiment. This approach will prove beneficial to your team, your users, and most importantly, to your product’s lasting success. Experiment-Driven Product Development offers a greater appreciation of the craft of experimentation and helps you adapt it in your own context. In our modern age of innovation, XDPD can put you ahead. Go forth and experiment! What You Will LearnKnow how to approach product development in a leaner, more efficient wayUnderstand where and when experiments can be useful, and how they fit into pre-existing organization environments and processesRealize why you should be thinking about the simplest, useful thing rather than the minimum, viable productDiscover how to break down feature and design ideas into the assumptions and the premises that lie behind themAppreciate the importance of designing your experiments, and the statistical concepts that underpin their successMaster the art of communicating the results of experiments back to stakeholders, and help the results guide what happens next Who This Book is For Professionals working in digital product design and development, user experience, and service design. This book is best suited for those who work on digital products every day and want to adopt better approaches to gaining knowledge about their users, what works, and what does not work.
The Power of Experiments
Author: Michael Luca
Publisher: MIT Press
ISBN: 0262542277
Category : Business & Economics
Languages : en
Pages : 229
Book Description
How tech companies like Google, Airbnb, StubHub, and Facebook learn from experiments in our data-driven world—an excellent primer on experimental and behavioral economics Have you logged into Facebook recently? Searched for something on Google? Chosen a movie on Netflix? If so, you've probably been an unwitting participant in a variety of experiments—also known as randomized controlled trials—designed to test the impact of different online experiences. Once an esoteric tool for academic research, the randomized controlled trial has gone mainstream. No tech company worth its salt (or its share price) would dare make major changes to its platform without first running experiments to understand how they would influence user behavior. In this book, Michael Luca and Max Bazerman explain the importance of experiments for decision making in a data-driven world. Luca and Bazerman describe the central role experiments play in the tech sector, drawing lessons and best practices from the experiences of such companies as StubHub, Alibaba, and Uber. Successful experiments can save companies money—eBay, for example, discovered how to cut $50 million from its yearly advertising budget—or bring to light something previously ignored, as when Airbnb was forced to confront rampant discrimination by its hosts. Moving beyond tech, Luca and Bazerman consider experimenting for the social good—different ways that governments are using experiments to influence or “nudge” behavior ranging from voter apathy to school absenteeism. Experiments, they argue, are part of any leader's toolkit. With this book, readers can become part of “the experimental revolution.”
Publisher: MIT Press
ISBN: 0262542277
Category : Business & Economics
Languages : en
Pages : 229
Book Description
How tech companies like Google, Airbnb, StubHub, and Facebook learn from experiments in our data-driven world—an excellent primer on experimental and behavioral economics Have you logged into Facebook recently? Searched for something on Google? Chosen a movie on Netflix? If so, you've probably been an unwitting participant in a variety of experiments—also known as randomized controlled trials—designed to test the impact of different online experiences. Once an esoteric tool for academic research, the randomized controlled trial has gone mainstream. No tech company worth its salt (or its share price) would dare make major changes to its platform without first running experiments to understand how they would influence user behavior. In this book, Michael Luca and Max Bazerman explain the importance of experiments for decision making in a data-driven world. Luca and Bazerman describe the central role experiments play in the tech sector, drawing lessons and best practices from the experiences of such companies as StubHub, Alibaba, and Uber. Successful experiments can save companies money—eBay, for example, discovered how to cut $50 million from its yearly advertising budget—or bring to light something previously ignored, as when Airbnb was forced to confront rampant discrimination by its hosts. Moving beyond tech, Luca and Bazerman consider experimenting for the social good—different ways that governments are using experiments to influence or “nudge” behavior ranging from voter apathy to school absenteeism. Experiments, they argue, are part of any leader's toolkit. With this book, readers can become part of “the experimental revolution.”
Software Business
Author: Krzysztof Wnuk
Publisher: Springer
ISBN: 3030048403
Category : Business & Economics
Languages : en
Pages : 193
Book Description
This book constitutes the refereed proceedings of the 9th International Conference on Software Business, ICSOB 2018, held in Tallinn, Estonia, in June 2018. This year the conference theme was “How Digitalization Impacts Software Business” and focused on digitalization and its impact on the speed of business models and business modeling and the realization of these business models. The 11 full papers and 1 short paper presented in this volume were carefully reviewed and selected from 34 submissions. They were organized in topical sections named: software ecosystems; software product management and business models; and software start-ups.
Publisher: Springer
ISBN: 3030048403
Category : Business & Economics
Languages : en
Pages : 193
Book Description
This book constitutes the refereed proceedings of the 9th International Conference on Software Business, ICSOB 2018, held in Tallinn, Estonia, in June 2018. This year the conference theme was “How Digitalization Impacts Software Business” and focused on digitalization and its impact on the speed of business models and business modeling and the realization of these business models. The 11 full papers and 1 short paper presented in this volume were carefully reviewed and selected from 34 submissions. They were organized in topical sections named: software ecosystems; software product management and business models; and software start-ups.
Trustworthy Online Controlled Experiments
Author: Ron Kohavi
Publisher: Cambridge University Press
ISBN: 1108590098
Category : Computers
Languages : en
Pages : 291
Book Description
Getting numbers is easy; getting numbers you can trust is hard. This practical guide by experimentation leaders at Google, LinkedIn, and Microsoft will teach you how to accelerate innovation using trustworthy online controlled experiments, or A/B tests. Based on practical experiences at companies that each run more than 20,000 controlled experiments a year, the authors share examples, pitfalls, and advice for students and industry professionals getting started with experiments, plus deeper dives into advanced topics for practitioners who want to improve the way they make data-driven decisions. Learn how to • Use the scientific method to evaluate hypotheses using controlled experiments • Define key metrics and ideally an Overall Evaluation Criterion • Test for trustworthiness of the results and alert experimenters to violated assumptions • Build a scalable platform that lowers the marginal cost of experiments close to zero • Avoid pitfalls like carryover effects and Twyman's law • Understand how statistical issues play out in practice.
Publisher: Cambridge University Press
ISBN: 1108590098
Category : Computers
Languages : en
Pages : 291
Book Description
Getting numbers is easy; getting numbers you can trust is hard. This practical guide by experimentation leaders at Google, LinkedIn, and Microsoft will teach you how to accelerate innovation using trustworthy online controlled experiments, or A/B tests. Based on practical experiences at companies that each run more than 20,000 controlled experiments a year, the authors share examples, pitfalls, and advice for students and industry professionals getting started with experiments, plus deeper dives into advanced topics for practitioners who want to improve the way they make data-driven decisions. Learn how to • Use the scientific method to evaluate hypotheses using controlled experiments • Define key metrics and ideally an Overall Evaluation Criterion • Test for trustworthiness of the results and alert experimenters to violated assumptions • Build a scalable platform that lowers the marginal cost of experiments close to zero • Avoid pitfalls like carryover effects and Twyman's law • Understand how statistical issues play out in practice.
Escaping the Build Trap
Author: Melissa Perri
Publisher: O'Reilly Media
ISBN: 1491973765
Category : Business & Economics
Languages : en
Pages : 200
Book Description
To stay competitive in today’s market, organizations need to adopt a culture of customer-centric practices that focus on outcomes rather than outputs. Companies that live and die by outputs often fall into the "build trap," cranking out features to meet their schedule rather than the customer’s needs. In this book, Melissa Perri explains how laying the foundation for great product management can help companies solve real customer problems while achieving business goals. By understanding how to communicate and collaborate within a company structure, you can create a product culture that benefits both the business and the customer. You’ll learn product management principles that can be applied to any organization, big or small. In five parts, this book explores: Why organizations ship features rather than cultivate the value those features represent How to set up a product organization that scales How product strategy connects a company’s vision and economic outcomes back to the product activities How to identify and pursue the right opportunities for producing value through an iterative product framework How to build a culture focused on successful outcomes over outputs
Publisher: O'Reilly Media
ISBN: 1491973765
Category : Business & Economics
Languages : en
Pages : 200
Book Description
To stay competitive in today’s market, organizations need to adopt a culture of customer-centric practices that focus on outcomes rather than outputs. Companies that live and die by outputs often fall into the "build trap," cranking out features to meet their schedule rather than the customer’s needs. In this book, Melissa Perri explains how laying the foundation for great product management can help companies solve real customer problems while achieving business goals. By understanding how to communicate and collaborate within a company structure, you can create a product culture that benefits both the business and the customer. You’ll learn product management principles that can be applied to any organization, big or small. In five parts, this book explores: Why organizations ship features rather than cultivate the value those features represent How to set up a product organization that scales How product strategy connects a company’s vision and economic outcomes back to the product activities How to identify and pursue the right opportunities for producing value through an iterative product framework How to build a culture focused on successful outcomes over outputs
Experimentation Works
Author: Stefan H. Thomke
Publisher: Harvard Business Press
ISBN: 1633697118
Category : Business & Economics
Languages : en
Pages : 266
Book Description
Don't fly blind. See how the power of experiments works for you. When it comes to improving customer experiences, trying out new business models, or developing new products, even the most experienced managers often get it wrong. They discover that intuition, experience, and big data alone don't work. What does? Running disciplined business experiments. And what if companies roll out new products or introduce new customer experiences without running these experiments? They fly blind. That's what Harvard Business School professor Stefan Thomke shows in this rigorously researched and eye-opening book. It guides you through best practices in business experimentation, illustrates how these practices work at leading companies, and answers some fundamental questions: What makes a good experiment? How do you test in online and brick-and-mortar businesses? In B2B and B2C? How do you build an experimentation culture? Also, best practice means running many experiments. Indeed, some hugely successful companies, such as Amazon, Booking.com, and Microsoft, run tens of thousands of controlled experiments annually, engaging millions of users. Thomke shows us how these and many other organizations prove that experimentation provides significant competitive advantage. How can managers create this capability at their own companies? Essential is developing an experimentation organization that prizes the science of testing and puts the discipline of experimentation at the center of its innovation process. While it once took companies years to develop the tools for such large-scale experiments, advances in technology have put these tools at the fingertips of almost any business professional. By combining the power of software and the rigor of controlled experiments, today's managers can make better decisions, create magical customer experiences, and generate big financial returns. Experimentation Works is your guidebook to a truly new way of thinking and innovating.
Publisher: Harvard Business Press
ISBN: 1633697118
Category : Business & Economics
Languages : en
Pages : 266
Book Description
Don't fly blind. See how the power of experiments works for you. When it comes to improving customer experiences, trying out new business models, or developing new products, even the most experienced managers often get it wrong. They discover that intuition, experience, and big data alone don't work. What does? Running disciplined business experiments. And what if companies roll out new products or introduce new customer experiences without running these experiments? They fly blind. That's what Harvard Business School professor Stefan Thomke shows in this rigorously researched and eye-opening book. It guides you through best practices in business experimentation, illustrates how these practices work at leading companies, and answers some fundamental questions: What makes a good experiment? How do you test in online and brick-and-mortar businesses? In B2B and B2C? How do you build an experimentation culture? Also, best practice means running many experiments. Indeed, some hugely successful companies, such as Amazon, Booking.com, and Microsoft, run tens of thousands of controlled experiments annually, engaging millions of users. Thomke shows us how these and many other organizations prove that experimentation provides significant competitive advantage. How can managers create this capability at their own companies? Essential is developing an experimentation organization that prizes the science of testing and puts the discipline of experimentation at the center of its innovation process. While it once took companies years to develop the tools for such large-scale experiments, advances in technology have put these tools at the fingertips of almost any business professional. By combining the power of software and the rigor of controlled experiments, today's managers can make better decisions, create magical customer experiences, and generate big financial returns. Experimentation Works is your guidebook to a truly new way of thinking and innovating.
Product-Focused Software Process Improvement
Author: Pekka Abrahamsson
Publisher: Springer
ISBN: 331949094X
Category : Computers
Languages : en
Pages : 769
Book Description
This book constitutes the proceedings of the 17th International Conference on Product-Focused Software Process Improvement, PROFES 2016, held in Trondheim, Norway, in November 2016. The 24 revised full papers presented together with 21 short papers, 1 keynote, 3 invited papers, 5 workshop papers. 2 doctoral symposium papers, and 6 tutorials were carefully reviewed and selected from 82 submissions. The papers are organized in topical sections on Early Phases in Software Engineering; Organizational Models; Architecture; Methods and Tools; Verification and Validation; Process Improvement; Speed and Agility in System Engineering; Requirements and Quality; Process and Repository Mining; Business Value and Benefits; Emerging Research Topics; and Future of Computing.
Publisher: Springer
ISBN: 331949094X
Category : Computers
Languages : en
Pages : 769
Book Description
This book constitutes the proceedings of the 17th International Conference on Product-Focused Software Process Improvement, PROFES 2016, held in Trondheim, Norway, in November 2016. The 24 revised full papers presented together with 21 short papers, 1 keynote, 3 invited papers, 5 workshop papers. 2 doctoral symposium papers, and 6 tutorials were carefully reviewed and selected from 82 submissions. The papers are organized in topical sections on Early Phases in Software Engineering; Organizational Models; Architecture; Methods and Tools; Verification and Validation; Process Improvement; Speed and Agility in System Engineering; Requirements and Quality; Process and Repository Mining; Business Value and Benefits; Emerging Research Topics; and Future of Computing.
Optimal Design of Experiments
Author: Peter Goos
Publisher: John Wiley & Sons
ISBN: 1119976162
Category : Science
Languages : en
Pages : 249
Book Description
"This is an engaging and informative book on the modern practice of experimental design. The authors' writing style is entertaining, the consulting dialogs are extremely enjoyable, and the technical material is presented brilliantly but not overwhelmingly. The book is a joy to read. Everyone who practices or teaches DOE should read this book." - Douglas C. Montgomery, Regents Professor, Department of Industrial Engineering, Arizona State University "It's been said: 'Design for the experiment, don't experiment for the design.' This book ably demonstrates this notion by showing how tailor-made, optimal designs can be effectively employed to meet a client's actual needs. It should be required reading for anyone interested in using the design of experiments in industrial settings." —Christopher J. Nachtsheim, Frank A Donaldson Chair in Operations Management, Carlson School of Management, University of Minnesota This book demonstrates the utility of the computer-aided optimal design approach using real industrial examples. These examples address questions such as the following: How can I do screening inexpensively if I have dozens of factors to investigate? What can I do if I have day-to-day variability and I can only perform 3 runs a day? How can I do RSM cost effectively if I have categorical factors? How can I design and analyze experiments when there is a factor that can only be changed a few times over the study? How can I include both ingredients in a mixture and processing factors in the same study? How can I design an experiment if there are many factor combinations that are impossible to run? How can I make sure that a time trend due to warming up of equipment does not affect the conclusions from a study? How can I take into account batch information in when designing experiments involving multiple batches? How can I add runs to a botched experiment to resolve ambiguities? While answering these questions the book also shows how to evaluate and compare designs. This allows researchers to make sensible trade-offs between the cost of experimentation and the amount of information they obtain.
Publisher: John Wiley & Sons
ISBN: 1119976162
Category : Science
Languages : en
Pages : 249
Book Description
"This is an engaging and informative book on the modern practice of experimental design. The authors' writing style is entertaining, the consulting dialogs are extremely enjoyable, and the technical material is presented brilliantly but not overwhelmingly. The book is a joy to read. Everyone who practices or teaches DOE should read this book." - Douglas C. Montgomery, Regents Professor, Department of Industrial Engineering, Arizona State University "It's been said: 'Design for the experiment, don't experiment for the design.' This book ably demonstrates this notion by showing how tailor-made, optimal designs can be effectively employed to meet a client's actual needs. It should be required reading for anyone interested in using the design of experiments in industrial settings." —Christopher J. Nachtsheim, Frank A Donaldson Chair in Operations Management, Carlson School of Management, University of Minnesota This book demonstrates the utility of the computer-aided optimal design approach using real industrial examples. These examples address questions such as the following: How can I do screening inexpensively if I have dozens of factors to investigate? What can I do if I have day-to-day variability and I can only perform 3 runs a day? How can I do RSM cost effectively if I have categorical factors? How can I design and analyze experiments when there is a factor that can only be changed a few times over the study? How can I include both ingredients in a mixture and processing factors in the same study? How can I design an experiment if there are many factor combinations that are impossible to run? How can I make sure that a time trend due to warming up of equipment does not affect the conclusions from a study? How can I take into account batch information in when designing experiments involving multiple batches? How can I add runs to a botched experiment to resolve ambiguities? While answering these questions the book also shows how to evaluate and compare designs. This allows researchers to make sensible trade-offs between the cost of experimentation and the amount of information they obtain.
Experimentation for Engineers
Author: David Sweet
Publisher: Simon and Schuster
ISBN: 1638356904
Category : Computers
Languages : en
Pages : 246
Book Description
Optimize the performance of your systems with practical experiments used by engineers in the world’s most competitive industries. In Experimentation for Engineers: From A/B testing to Bayesian optimization you will learn how to: Design, run, and analyze an A/B test Break the "feedback loops" caused by periodic retraining of ML models Increase experimentation rate with multi-armed bandits Tune multiple parameters experimentally with Bayesian optimization Clearly define business metrics used for decision-making Identify and avoid the common pitfalls of experimentation Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You’ll start with a deep dive into methods like A/B testing, and then graduate to advanced techniques used to measure performance in industries such as finance and social media. Learn how to evaluate the changes you make to your system and ensure that your testing doesn’t undermine revenue or other business metrics. By the time you’re done, you’ll be able to seamlessly deploy experiments in production while avoiding common pitfalls. About the technology Does my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world’s most competitive industries that will help you enhance machine learning systems, software applications, and quantitative trading solutions. About the book Experimentation for Engineers: From A/B testing to Bayesian optimization delivers a toolbox of processes for optimizing software systems. You’ll start by learning the limits of A/B testing, and then graduate to advanced experimentation strategies that take advantage of machine learning and probabilistic methods. The skills you’ll master in this practical guide will help you minimize the costs of experimentation and quickly reveal which approaches and features deliver the best business results. What's inside Design, run, and analyze an A/B test Break the “feedback loops” caused by periodic retraining of ML models Increase experimentation rate with multi-armed bandits Tune multiple parameters experimentally with Bayesian optimization About the reader For ML and software engineers looking to extract the most value from their systems. Examples in Python and NumPy. About the author David Sweet has worked as a quantitative trader at GETCO and a machine learning engineer at Instagram. He teaches in the AI and Data Science master's programs at Yeshiva University. Table of Contents 1 Optimizing systems by experiment 2 A/B testing: Evaluating a modification to your system 3 Multi-armed bandits: Maximizing business metrics while experimenting 4 Response surface methodology: Optimizing continuous parameters 5 Contextual bandits: Making targeted decisions 6 Bayesian optimization: Automating experimental optimization 7 Managing business metrics 8 Practical considerations
Publisher: Simon and Schuster
ISBN: 1638356904
Category : Computers
Languages : en
Pages : 246
Book Description
Optimize the performance of your systems with practical experiments used by engineers in the world’s most competitive industries. In Experimentation for Engineers: From A/B testing to Bayesian optimization you will learn how to: Design, run, and analyze an A/B test Break the "feedback loops" caused by periodic retraining of ML models Increase experimentation rate with multi-armed bandits Tune multiple parameters experimentally with Bayesian optimization Clearly define business metrics used for decision-making Identify and avoid the common pitfalls of experimentation Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You’ll start with a deep dive into methods like A/B testing, and then graduate to advanced techniques used to measure performance in industries such as finance and social media. Learn how to evaluate the changes you make to your system and ensure that your testing doesn’t undermine revenue or other business metrics. By the time you’re done, you’ll be able to seamlessly deploy experiments in production while avoiding common pitfalls. About the technology Does my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world’s most competitive industries that will help you enhance machine learning systems, software applications, and quantitative trading solutions. About the book Experimentation for Engineers: From A/B testing to Bayesian optimization delivers a toolbox of processes for optimizing software systems. You’ll start by learning the limits of A/B testing, and then graduate to advanced experimentation strategies that take advantage of machine learning and probabilistic methods. The skills you’ll master in this practical guide will help you minimize the costs of experimentation and quickly reveal which approaches and features deliver the best business results. What's inside Design, run, and analyze an A/B test Break the “feedback loops” caused by periodic retraining of ML models Increase experimentation rate with multi-armed bandits Tune multiple parameters experimentally with Bayesian optimization About the reader For ML and software engineers looking to extract the most value from their systems. Examples in Python and NumPy. About the author David Sweet has worked as a quantitative trader at GETCO and a machine learning engineer at Instagram. He teaches in the AI and Data Science master's programs at Yeshiva University. Table of Contents 1 Optimizing systems by experiment 2 A/B testing: Evaluating a modification to your system 3 Multi-armed bandits: Maximizing business metrics while experimenting 4 Response surface methodology: Optimizing continuous parameters 5 Contextual bandits: Making targeted decisions 6 Bayesian optimization: Automating experimental optimization 7 Managing business metrics 8 Practical considerations
The Customer-Driven Playbook
Author: Travis Lowdermilk
Publisher: "O'Reilly Media, Inc."
ISBN: 1491981229
Category : Business & Economics
Languages : en
Pages : 234
Book Description
Despite the wide acceptance of Lean approaches and customer-development strategies, many product teams still have difficulty putting these principles into meaningful action. That’s where The Customer-Driven Playbook comes in. This practical guide provides a complete end-to-end process that will help you understand customers, identify their problems, conceptualize new ideas, and create fantastic products they’ll love. To build successful products, you need to continually test your assumptions about your customers and the products you build. This book shows team leads, researchers, designers, and managers how to use the Hypothesis Progression Framework (HPF) to formulate, experiment with, and make sense of critical customer and product assumptions at every stage. With helpful tips, real-world examples, and complete guides, you’ll quickly learn how to turn Lean theory into action. Collect and formulate your assumptions into hypotheses that can be tested to unlock meaningful insights Conduct experiments to create a continual cadence of learning Derive patterns and meaning from the feedback you’ve collected from customers Improve your confidence when making strategic business and product decisions Track the progression of your assumptions, hypotheses, early ideas, concepts, and product features with step-by-step playbooks Improve customer satisfaction by creating a consistent feedback loop
Publisher: "O'Reilly Media, Inc."
ISBN: 1491981229
Category : Business & Economics
Languages : en
Pages : 234
Book Description
Despite the wide acceptance of Lean approaches and customer-development strategies, many product teams still have difficulty putting these principles into meaningful action. That’s where The Customer-Driven Playbook comes in. This practical guide provides a complete end-to-end process that will help you understand customers, identify their problems, conceptualize new ideas, and create fantastic products they’ll love. To build successful products, you need to continually test your assumptions about your customers and the products you build. This book shows team leads, researchers, designers, and managers how to use the Hypothesis Progression Framework (HPF) to formulate, experiment with, and make sense of critical customer and product assumptions at every stage. With helpful tips, real-world examples, and complete guides, you’ll quickly learn how to turn Lean theory into action. Collect and formulate your assumptions into hypotheses that can be tested to unlock meaningful insights Conduct experiments to create a continual cadence of learning Derive patterns and meaning from the feedback you’ve collected from customers Improve your confidence when making strategic business and product decisions Track the progression of your assumptions, hypotheses, early ideas, concepts, and product features with step-by-step playbooks Improve customer satisfaction by creating a consistent feedback loop