Sequential Machine Learning for Decision-Making in Mechanical Systems

Sequential Machine Learning for Decision-Making in Mechanical Systems PDF Author: Najah Ghalyan
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description
Sequential machine learning for anomaly detection is critical in applications where fast control action is required to avoid failure of the system. Example is thermoacoustic instabilities (TAI) in combustion systems, which may lead to damage in mechanical structures if the resulting pressure oscillations match one of the natural frequencies of the system. TAI typically develop on the order of milliseconds, which must be mitigated by sufficiently fast actuation of control signals. Likewise, fatigue damage is one of the most common source of failure in structural materials. Initiation and evolution of this type of damage are critically dependent on the microstructural initial defects that are usually distributed in a highly random fashion. Therefore, fatigue damage is a stochastic process, for which early detection is required for condition-based maintenance and life extension of the system. The current PhD dissertation considers the problem of sequential machine learning for anomaly detection and decision-making in mechanical systems with an emphasize on the aforementioned two applications. In particular, the dissertation develops several novel data-driven algorithms that utilize the theory of Symbolic Time Series Analysis (STSA) and Hidden Markov Models (HMMs) for anomaly detection by learning sequential patterns from observed time series. While standard partitions in STSA symbolize each observation in a time series individually, the dissertation proposes two novel algorithms that jointly symbolize the entire time series. The first algorithm amounts to a novel type of sliding block lossy source coding, which can be used to estimate a finite generator from observed time series. The second algorithm utilizes the Viterbi (dynamic programming) algorithm to jointly convert the time series to a symbol string with maximum posterior probability conditioned on the observed time series. Both algorithms induce sequence space partitions which are particularly important for data-drive modeling of dynamical systems using short-length time series measurements. Moreover, an HMM-based algorithm is developed for feature extraction. From the STSA perspective, this algorithm generates soft symbolization of the time series, retaining information associated with all possible symbol strings. Furthermore, the dissertation presents a novel framework in STSA for anomaly detection in dynamical systems using the ergodic theory of measure-preserving transformations (MPTs). Unlike a standard STSA that generates time-homogeneous Markov chains, the proposed MPT-based STSA generates time-inhomogeneous Markov chains that can greatly facilitate modeling of the dynamical system using short-length time series of measurements. The dissertation also introduces a novel detection criterion well-matched to low-delay, narrowly localized change point detection, and develops an HMM-based algorithm that can efficiently make change point detection and narrowly identify an interval within which the change point occurred using the joint likelihood of a sliding block conditioned on the block's entire past. All the algorithms developed in this work have been experimentally validated and compared with other standard detection techniques using experimental data generated from the two aforementioned applications. The results consistently show superior performance of the proposed detection algorithms. Moreover, from the perspectives of health monitoring and life extension of structural materials, the dissertation also addresses the problem of early detection of fatigue cracks in metallic alloys. To this end, optical images have been collected from an ensemble of test specimens to construct computationally efficient models of crack evolution; these images are segmented into two major categories. The first category comprises images of (structurally) healthy specimens, while the second category contains images of specimens with cracks, including those in early stages of crack evolution. Based on this information, algorithms for early detection of crack formation are formulated in the setting of image classification, where the bag-of-words (BoW) technique has been used to develop models of the sensed images from a microscope, resulting in computationally efficient crack detection algorithms. To evaluate the performance of these crack detection algorithms, experiments have been conducted on a special-purpose fatigue testing apparatus, equipped with a computer-controlled and computer-instrumented confocal microscope system. The results of experimentation with multiple test specimens show excellent crack detection capabilities when the proposed BoW-based feature extraction is combined with quadratic support vector machine (QSVM) for pattern classification. Comparative evaluation with other classification tools establishes superiority of the proposed BoW/QSVM technique.

Sequential Machine Learning for Decision-Making in Mechanical Systems

Sequential Machine Learning for Decision-Making in Mechanical Systems PDF Author: Najah Ghalyan
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description
Sequential machine learning for anomaly detection is critical in applications where fast control action is required to avoid failure of the system. Example is thermoacoustic instabilities (TAI) in combustion systems, which may lead to damage in mechanical structures if the resulting pressure oscillations match one of the natural frequencies of the system. TAI typically develop on the order of milliseconds, which must be mitigated by sufficiently fast actuation of control signals. Likewise, fatigue damage is one of the most common source of failure in structural materials. Initiation and evolution of this type of damage are critically dependent on the microstructural initial defects that are usually distributed in a highly random fashion. Therefore, fatigue damage is a stochastic process, for which early detection is required for condition-based maintenance and life extension of the system. The current PhD dissertation considers the problem of sequential machine learning for anomaly detection and decision-making in mechanical systems with an emphasize on the aforementioned two applications. In particular, the dissertation develops several novel data-driven algorithms that utilize the theory of Symbolic Time Series Analysis (STSA) and Hidden Markov Models (HMMs) for anomaly detection by learning sequential patterns from observed time series. While standard partitions in STSA symbolize each observation in a time series individually, the dissertation proposes two novel algorithms that jointly symbolize the entire time series. The first algorithm amounts to a novel type of sliding block lossy source coding, which can be used to estimate a finite generator from observed time series. The second algorithm utilizes the Viterbi (dynamic programming) algorithm to jointly convert the time series to a symbol string with maximum posterior probability conditioned on the observed time series. Both algorithms induce sequence space partitions which are particularly important for data-drive modeling of dynamical systems using short-length time series measurements. Moreover, an HMM-based algorithm is developed for feature extraction. From the STSA perspective, this algorithm generates soft symbolization of the time series, retaining information associated with all possible symbol strings. Furthermore, the dissertation presents a novel framework in STSA for anomaly detection in dynamical systems using the ergodic theory of measure-preserving transformations (MPTs). Unlike a standard STSA that generates time-homogeneous Markov chains, the proposed MPT-based STSA generates time-inhomogeneous Markov chains that can greatly facilitate modeling of the dynamical system using short-length time series of measurements. The dissertation also introduces a novel detection criterion well-matched to low-delay, narrowly localized change point detection, and develops an HMM-based algorithm that can efficiently make change point detection and narrowly identify an interval within which the change point occurred using the joint likelihood of a sliding block conditioned on the block's entire past. All the algorithms developed in this work have been experimentally validated and compared with other standard detection techniques using experimental data generated from the two aforementioned applications. The results consistently show superior performance of the proposed detection algorithms. Moreover, from the perspectives of health monitoring and life extension of structural materials, the dissertation also addresses the problem of early detection of fatigue cracks in metallic alloys. To this end, optical images have been collected from an ensemble of test specimens to construct computationally efficient models of crack evolution; these images are segmented into two major categories. The first category comprises images of (structurally) healthy specimens, while the second category contains images of specimens with cracks, including those in early stages of crack evolution. Based on this information, algorithms for early detection of crack formation are formulated in the setting of image classification, where the bag-of-words (BoW) technique has been used to develop models of the sensed images from a microscope, resulting in computationally efficient crack detection algorithms. To evaluate the performance of these crack detection algorithms, experiments have been conducted on a special-purpose fatigue testing apparatus, equipped with a computer-controlled and computer-instrumented confocal microscope system. The results of experimentation with multiple test specimens show excellent crack detection capabilities when the proposed BoW-based feature extraction is combined with quadratic support vector machine (QSVM) for pattern classification. Comparative evaluation with other classification tools establishes superiority of the proposed BoW/QSVM technique.

Handbook of Dynamic Data Driven Applications Systems

Handbook of Dynamic Data Driven Applications Systems PDF Author: Frederica Darema
Publisher: Springer Nature
ISBN: 3031279867
Category : Computers
Languages : en
Pages : 937

Get Book Here

Book Description
This Second Volume in the series Handbook of Dynamic Data Driven Applications Systems (DDDAS) expands the scope of the methods and the application areas presented in the first Volume and aims to provide additional and extended content of the increasing set of science and engineering advances for new capabilities enabled through DDDAS. The methods and examples of breakthroughs presented in the book series capture the DDDAS paradigm and its scientific and technological impact and benefits. The DDDAS paradigm and the ensuing DDDAS-based frameworks for systems’ analysis and design have been shown to engender new and advanced capabilities for understanding, analysis, and management of engineered, natural, and societal systems (“applications systems”), and for the commensurate wide set of scientific and engineering fields and applications, as well as foundational areas. The DDDAS book series aims to be a reference source of many of the important research and development efforts conducted under the rubric of DDDAS, and to also inspire the broader communities of researchers and developers about the potential in their respective areas of interest, of the application and the exploitation of the DDDAS paradigm and the ensuing frameworks, through the examples and case studies presented, either within their own field or other fields of study. As in the first volume, the chapters in this book reflect research work conducted over the years starting in the 1990’s to the present. Here, the theory and application content are considered for: Foundational Methods Materials Systems Structural Systems Energy Systems Environmental Systems: Domain Assessment & Adverse Conditions/Wildfires Surveillance Systems Space Awareness Systems Healthcare Systems Decision Support Systems Cyber Security Systems Design of Computer Systems The readers of this book series will benefit from DDDAS theory advances such as object estimation, information fusion, and sensor management. The increased interest in Artificial Intelligence (AI), Machine Learning and Neural Networks (NN) provides opportunities for DDDAS-based methods to show the key role DDDAS plays in enabling AI capabilities; address challenges that ML-alone does not, and also show how ML in combination with DDDAS-based methods can deliver the advanced capabilities sought; likewise, infusion of DDDAS-like approaches in NN-methods strengthens such methods. Moreover, the “DDDAS-based Digital Twin” or “Dynamic Digital Twin”, goes beyond the traditional DT notion where the model and the physical system are viewed side-by-side in a static way, to a paradigm where the model dynamically interacts with the physical system through its instrumentation, (per the DDDAS feed-back control loop between model and instrumentation).

Design and Modeling of Mechanical Systems - V

Design and Modeling of Mechanical Systems - V PDF Author: Lassaad Walha
Publisher: Springer Nature
ISBN: 3031146158
Category : Technology & Engineering
Languages : en
Pages : 929

Get Book Here

Book Description
This book offers a collection of original peer-reviewed contributions presented at the 9th International Congress on Design and Modeling of Mechanical Systems (CMSM’2021), held on December 20-22, 2021, in Hammamet, Tunisia. It reports on research findings, advanced methods and industrial applications relating to mechanical systems, materials and structures, and machining. It covers vibration analysis, CFD modeling and simulation, intelligent monitoring and control, including applications related to industry 4.0 and additive manufacturing. Continuing on the tradition of the previous editions, and with a good balance of theory and practice, the book offers a timely snapshot, and a useful resource for both researchers and professionals in the field of design and modeling of mechanical systems.

Machine Learning for Intelligent Decision Science

Machine Learning for Intelligent Decision Science PDF Author: Jitendra Kumar Rout
Publisher: Springer Nature
ISBN: 9811536899
Category : Technology & Engineering
Languages : en
Pages : 219

Get Book Here

Book Description
The book discusses machine learning-based decision-making models, and presents intelligent, hybrid and adaptive methods and tools for solving complex learning and decision-making problems under conditions of uncertainty. Featuring contributions from data scientists, practitioners and educators, the book covers a range of topics relating to intelligent systems for decision science, and examines recent innovations, trends, and practical challenges in the field. The book is a valuable resource for academics, students, researchers and professionals wanting to gain insights into decision-making.

Modularity and Coordination for Planning and Reinforcement Learning

Modularity and Coordination for Planning and Reinforcement Learning PDF Author: Jayesh Kumar Gupta
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description
The foundational objective of the field of artificial intelligence is to build autonomous systems that can perceive their environment and take actions that maximize their ability to achieve their goals. Decision making under uncertainty is a fundamental requirement for such intelligent behavior. Various real world problems of interest like autonomous driving, virtual assistants, and disaster response are sequential decision making problems. Planning and reinforcement learning are abstractions for studying optimal sequential decision making in natural and artificial systems. Combining these ideas with deep neural network function approximation (*"deep reinforcement learning"*) has allowed scaling these abstractions to a variety of complex problems and has led to super-human performance, especially in game playing. These successes are still limited to virtual worlds with fast simulators where massive amounts of training data can be generated given enough computational resources. However, decision making in the real world requires solutions that are data efficient, capable of utilizing domain knowledge when available, and generalize to related problems. Moreover, often decision making requires decentralized execution for scalability. The concept of modularity has proven effective in a large number of fields to deal with complex systems. The key ideas driving a modular system are 1) information encapsulation and 2) coordination for integrated function. Modularity allows breaking down a complex problem into manageable units. This dissertation explores how, as designers of complex decision making systems, the principles of modular design can allow us to provide structural inductive biases and define appropriate coordination mechanisms. In the first part, we explore the concept of functional modularity in the form of agents, and how they can inform the design of large multi-agent decision making systems. In the second part, we explore the concept of temporal modularity in the form of subtasks in complicated tasks and how we can learn decomposed solutions that show improved transfer performance to related tasks. Finally, in the last part, we explore the concept of architectural modularity; how known physics can inform our neural network models of mechanical systems allowing reliable planning and efficient reinforcement learning. We find that these design principles lead to enormous data efficiency improvements and lower costs for learning and inference. Moreover, we find solutions that generalize better to related problems.

Smart Electrical and Mechanical Systems

Smart Electrical and Mechanical Systems PDF Author: Rakesh Sehgal
Publisher: Academic Press
ISBN: 0323914411
Category : Technology & Engineering
Languages : en
Pages : 316

Get Book Here

Book Description
Smart Electrical and Mechanical Systems: An Application of Artificial Intelligence and Machine Learning is an international contributed work with the most up-to-date fundamentals and conventional methods used in smart electrical and mechanical systems. Detailing methods and procedures for the application of ML and AI, it is supported with illustrations of the systems, process diagrams visuals of the systems and/or their components, and supportive data and results leading to the benefits and challenges of the relevant applications. The multidisciplinary theme of the book will help researchers build a synergy between electrical and mechanical engineering systems. The book guides readers on not only how to effectively solve problems but also provide high accuracy needed for successful implementation. Interdisciplinary in nature, the book caters to the needs of the electrical and mechanical engineering industry by offering details on the application of AI and ML in robotics, design and manufacturing, image processing, power system operation and forecasting with suitable examples. - Includes significant case studies related to application of Artificial Intelligence and Machine Learning in Energy and Power, Mechanical Design and Manufacturing - Contains supporting illustrations and tables, along with a valuable set of references at the end of each chapter - Provides original, state-of-the-art research material written by international and national respected contributors

Towards a Theory for Designing Machine Learning Systems for Complex Decision Making Problems

Towards a Theory for Designing Machine Learning Systems for Complex Decision Making Problems PDF Author: Schahin Tofangchi
Publisher:
ISBN: 9783736972001
Category :
Languages : en
Pages : 202

Get Book Here

Book Description
The ubiquitousness of data and the emergence of data-driven machine learning approaches provide new means of creating insights. However, coping with the great volume, velocity, and variety of data requires improved data analysis methods. This dissertation contributes a nascent design theory, named the Division-of-Labor framework, for developing complex machine learning systems that can not only address the challenges of big data but also leverage their characteristics to perform more sophisticated analyses. I evaluate the proposed design principles in three practical settings, in which I apply the principles to design machine learning systems that (i) support treatment decision making for cancer patients, (ii) provide consumers with recommendations on two-sided platforms, and (iii) address a trade-off between efficiency and comfort in the context of autonomous vehicles. The evaluations partially validate the proposed theory, but also show that some principles require further attention in order to be practicable.

Artificial Intelligence in Industrial Decision Making, Control and Automation

Artificial Intelligence in Industrial Decision Making, Control and Automation PDF Author: S.G. Tzafestas
Publisher: Springer Science & Business Media
ISBN: 9401103054
Category : Computers
Languages : en
Pages : 778

Get Book Here

Book Description
This book is concerned with Artificial Intelligence (AI) concepts and techniques as applied to industrial decision making, control and automation problems. The field of AI has been expanded enormously during the last years due to that solid theoretical and application results have accumulated. During the first stage of AI development most workers in the field were content with illustrations showing ideas at work on simple problems. Later, as the field matured, emphasis was turned to demonstrations that showed the capability of AI techniques to handle problems of practical value. Now, we arrived at the stage where researchers and practitioners are actually building AI systems that face real-world and industrial problems. This volume provides a set of twenty four well-selected contributions that deal with the application of AI to such real-life and industrial problems. These contributions are grouped and presented in five parts as follows: Part 1: General Issues Part 2: Intelligent Systems Part 3: Neural Networks in Modelling, Control and Scheduling Part 4: System Diagnostics Part 5: Industrial Robotic, Manufacturing and Organizational Systems Part 1 involves four chapters providing background material and dealing with general issues such as the conceptual integration of qualitative and quantitative models, the treatment of timing problems at system integration, and the investigation of correct reasoning in interactive man-robot systems.

Understanding Machine Learning

Understanding Machine Learning PDF Author: Shai Shalev-Shwartz
Publisher: Cambridge University Press
ISBN: 1107057132
Category : Computers
Languages : en
Pages : 415

Get Book Here

Book Description
Introduces machine learning and its algorithmic paradigms, explaining the principles behind automated learning approaches and the considerations underlying their usage.

Machine learning in clinical decision-making

Machine learning in clinical decision-making PDF Author: Tyler John Loftus
Publisher: Frontiers Media SA
ISBN: 2832533256
Category : Medical
Languages : en
Pages : 121

Get Book Here

Book Description