Fault Tolerant and Energy Efficient One-sided Matrix Decompositions on Heterogeneous Systems with GPUs

Fault Tolerant and Energy Efficient One-sided Matrix Decompositions on Heterogeneous Systems with GPUs PDF Author: Jieyang Chen
Publisher:
ISBN: 9781392170687
Category : Fault-tolerant computing
Languages : en
Pages : 163

Get Book Here

Book Description
Heterogeneous computing system with both CPUs and GPUs has become a class of widely used hardware architecture in supercomputers. As heterogeneous systems delivering higher computational performance, they are being built with an increasing number of complex components. This is anticipated that these systems will be more susceptible to hardware faults with higher power consumption. Numerical linear algebra libraries are used in a wide spectrum of high-performance scientific applications. Among numerical linear algebra operations, one-sided matrix decompositions can sometimes take a large portion of execution time or even dominate the whole scientific application execution. Due to the computational characteristic of one-sided matrix decompositions, they are very suitable for computation platforms such as heterogeneous systems with CPUs and GPUs. Many works have been done to implement and optimize one-sided matrix decompositions on heterogeneous systems with CPUs and GPUs. However, it is challenging to enable stable and high performance one-sided matrix decompositions running on computing platforms that are unreliable and high energy consumption. So, in this thesis, we aim to develop novel fault tolerance and energy efficiency optimizations for one-sided matrix decompositions on heterogeneous systems with CPUs and GPUs.

Fault Tolerant and Energy Efficient One-sided Matrix Decompositions on Heterogeneous Systems with GPUs

Fault Tolerant and Energy Efficient One-sided Matrix Decompositions on Heterogeneous Systems with GPUs PDF Author: Jieyang Chen
Publisher:
ISBN: 9781392170687
Category : Fault-tolerant computing
Languages : en
Pages : 163

Get Book Here

Book Description
Heterogeneous computing system with both CPUs and GPUs has become a class of widely used hardware architecture in supercomputers. As heterogeneous systems delivering higher computational performance, they are being built with an increasing number of complex components. This is anticipated that these systems will be more susceptible to hardware faults with higher power consumption. Numerical linear algebra libraries are used in a wide spectrum of high-performance scientific applications. Among numerical linear algebra operations, one-sided matrix decompositions can sometimes take a large portion of execution time or even dominate the whole scientific application execution. Due to the computational characteristic of one-sided matrix decompositions, they are very suitable for computation platforms such as heterogeneous systems with CPUs and GPUs. Many works have been done to implement and optimize one-sided matrix decompositions on heterogeneous systems with CPUs and GPUs. However, it is challenging to enable stable and high performance one-sided matrix decompositions running on computing platforms that are unreliable and high energy consumption. So, in this thesis, we aim to develop novel fault tolerance and energy efficiency optimizations for one-sided matrix decompositions on heterogeneous systems with CPUs and GPUs.

Numerical Computations with GPUs

Numerical Computations with GPUs PDF Author: Volodymyr Kindratenko
Publisher: Springer
ISBN: 3319065483
Category : Computers
Languages : en
Pages : 404

Get Book Here

Book Description
This book brings together research on numerical methods adapted for Graphics Processing Units (GPUs). It explains recent efforts to adapt classic numerical methods, including solution of linear equations and FFT, for massively parallel GPU architectures. This volume consolidates recent research and adaptations, covering widely used methods that are at the core of many scientific and engineering computations. Each chapter is written by authors working on a specific group of methods; these leading experts provide mathematical background, parallel algorithms and implementation details leading to reusable, adaptable and scalable code fragments. This book also serves as a GPU implementation manual for many numerical algorithms, sharing tips on GPUs that can increase application efficiency. The valuable insights into parallelization strategies for GPUs are supplemented by ready-to-use code fragments. Numerical Computations with GPUs targets professionals and researchers working in high performance computing and GPU programming. Advanced-level students focused on computer science and mathematics will also find this book useful as secondary text book or reference.

Software for Exascale Computing - SPPEXA 2016-2019

Software for Exascale Computing - SPPEXA 2016-2019 PDF Author: Hans-Joachim Bungartz
Publisher: Springer Nature
ISBN: 3030479560
Category : Computers
Languages : en
Pages : 624

Get Book Here

Book Description
This open access book summarizes the research done and results obtained in the second funding phase of the Priority Program 1648 "Software for Exascale Computing" (SPPEXA) of the German Research Foundation (DFG) presented at the SPPEXA Symposium in Dresden during October 21-23, 2019. In that respect, it both represents a continuation of Vol. 113 in Springer’s series Lecture Notes in Computational Science and Engineering, the corresponding report of SPPEXA’s first funding phase, and provides an overview of SPPEXA’s contributions towards exascale computing in today's sumpercomputer technology. The individual chapters address one or more of the research directions (1) computational algorithms, (2) system software, (3) application software, (4) data management and exploration, (5) programming, and (6) software tools. The book has an interdisciplinary appeal: scholars from computational sub-fields in computer science, mathematics, physics, or engineering will find it of particular interest.

Programming Massively Parallel Processors

Programming Massively Parallel Processors PDF Author: David B. Kirk
Publisher: Newnes
ISBN: 0123914183
Category : Computers
Languages : en
Pages : 519

Get Book Here

Book Description
Programming Massively Parallel Processors: A Hands-on Approach, Second Edition, teaches students how to program massively parallel processors. It offers a detailed discussion of various techniques for constructing parallel programs. Case studies are used to demonstrate the development process, which begins with computational thinking and ends with effective and efficient parallel programs. This guide shows both student and professional alike the basic concepts of parallel programming and GPU architecture. Topics of performance, floating-point format, parallel patterns, and dynamic parallelism are covered in depth. This revised edition contains more parallel programming examples, commonly-used libraries such as Thrust, and explanations of the latest tools. It also provides new coverage of CUDA 5.0, improved performance, enhanced development tools, increased hardware support, and more; increased coverage of related technology, OpenCL and new material on algorithm patterns, GPU clusters, host programming, and data parallelism; and two new case studies (on MRI reconstruction and molecular visualization) that explore the latest applications of CUDA and GPUs for scientific research and high-performance computing. This book should be a valuable resource for advanced students, software engineers, programmers, and hardware engineers. New coverage of CUDA 5.0, improved performance, enhanced development tools, increased hardware support, and more Increased coverage of related technology, OpenCL and new material on algorithm patterns, GPU clusters, host programming, and data parallelism Two new case studies (on MRI reconstruction and molecular visualization) explore the latest applications of CUDA and GPUs for scientific research and high-performance computing

Hardware Accelerators in Data Centers

Hardware Accelerators in Data Centers PDF Author: Christoforos Kachris
Publisher: Springer
ISBN: 3319927922
Category : Technology & Engineering
Languages : en
Pages : 280

Get Book Here

Book Description
This book provides readers with an overview of the architectures, programming frameworks, and hardware accelerators for typical cloud computing applications in data centers. The authors present the most recent and promising solutions, using hardware accelerators to provide high throughput, reduced latency and higher energy efficiency compared to current servers based on commodity processors. Readers will benefit from state-of-the-art information regarding application requirements in contemporary data centers, computational complexity of typical tasks in cloud computing, and a programming framework for the efficient utilization of the hardware accelerators.

Direct Methods for Sparse Linear Systems

Direct Methods for Sparse Linear Systems PDF Author: Timothy A. Davis
Publisher: SIAM
ISBN: 0898716136
Category : Computers
Languages : en
Pages : 228

Get Book Here

Book Description
The sparse backslash book. Everything you wanted to know but never dared to ask about modern direct linear solvers. Chen Greif, Assistant Professor, Department of Computer Science, University of British Columbia.Overall, the book is magnificent. It fills a long-felt need for an accessible textbook on modern sparse direct methods. Its choice of scope is excellent John Gilbert, Professor, Department of Computer Science, University of California, Santa Barbara.Computational scientists often encounter problems requiring the solution of sparse systems of linear equations. Attacking these problems efficiently requires an in-depth knowledge of the underlying theory, algorithms, and data structures found in sparse matrix software libraries. Here, Davis presents the fundamentals of sparse matrix algorithms to provide the requisite background. The book includes CSparse, a concise downloadable sparse matrix package that illustrates the algorithms and theorems presented in the book and equips readers with the tools necessary to understand larger and more complex software packages.With a strong emphasis on MATLAB and the C programming language, Direct Methods for Sparse Linear Systems equips readers with the working knowledge required to use sparse solver packages and write code to interface applications to those packages. The book also explains how MATLAB performs its sparse matrix computations.Audience This invaluable book is essential to computational scientists and software developers who want to understand the theory and algorithms behind modern techniques used to solve large sparse linear systems. The book also serves as an excellent practical resource for students with an interest in combinatorial scientific computing.Preface; Chapter 1: Introduction; Chapter 2: Basic algorithms; Chapter 3: Solving triangular systems; Chapter 4: Cholesky factorization; Chapter 5: Orthogonal methods; Chapter 6: LU factorization; Chapter 7: Fill-reducing orderings; Chapter 8: Solving sparse linear systems; Chapter 9: CSparse; Chapter 10: Sparse matrices in MATLAB; Appendix: Basics of the C programming language; Bibliography; Index.

Heterogeneous Computing with OpenCL 2.0

Heterogeneous Computing with OpenCL 2.0 PDF Author: David R. Kaeli
Publisher: Morgan Kaufmann
ISBN: 0128016493
Category : Computers
Languages : en
Pages : 330

Get Book Here

Book Description
Heterogeneous Computing with OpenCL 2.0 teaches OpenCL and parallel programming for complex systems that may include a variety of device architectures: multi-core CPUs, GPUs, and fully-integrated Accelerated Processing Units (APUs). This fully-revised edition includes the latest enhancements in OpenCL 2.0 including: • Shared virtual memory to increase programming flexibility and reduce data transfers that consume resources • Dynamic parallelism which reduces processor load and avoids bottlenecks • Improved imaging support and integration with OpenGL Designed to work on multiple platforms, OpenCL will help you more effectively program for a heterogeneous future. Written by leaders in the parallel computing and OpenCL communities, this book explores memory spaces, optimization techniques, extensions, debugging and profiling. Multiple case studies and examples illustrate high-performance algorithms, distributing work across heterogeneous systems, embedded domain-specific languages, and will give you hands-on OpenCL experience to address a range of fundamental parallel algorithms. Updated content to cover the latest developments in OpenCL 2.0, including improvements in memory handling, parallelism, and imaging support Explanations of principles and strategies to learn parallel programming with OpenCL, from understanding the abstraction models to thoroughly testing and debugging complete applications Example code covering image analytics, web plugins, particle simulations, video editing, performance optimization, and more

Weibull Models

Weibull Models PDF Author: D. N. Prabhakar Murthy
Publisher: John Wiley & Sons
ISBN: 0471473278
Category : Mathematics
Languages : en
Pages : 409

Get Book Here

Book Description
A comprehensive perspective on Weibull models The literature on Weibull models is vast, disjointed, andscattered across many different journals. Weibull Models is acomprehensive guide that integrates all the different facets ofWeibull models in a single volume. This book will be of great help to practitioners in reliabilityand other disciplines in the context of modeling data sets usingWeibull models. For researchers interested in these modelingtechniques, exercises at the end of each chapter define potentialtopics for future research. Organized into seven distinct parts, Weibull Models: * Covers model analysis, parameter estimation, model validation,and application * Serves as both a handbook and a research monograph. As ahandbook, it classifies the different models and presents theirproperties. As a research monograph, it unifies the literature andpresents the results in an integrated manner * Intertwines theory and application * Focuses on model identification prior to model parameterestimation * Discusses the usefulness of the Weibull Probability plot (WPP)in the model selection to model a given data set * Highlights the use of Weibull models in reliability theory Filled with in-depth analysis, Weibull Models pulls together themost relevant information on this topic to give everyone fromreliability engineers to applied statisticians involved withreliability and survival analysis a clear look at what Weibullmodels can offer.

Applied Parallel Computing

Applied Parallel Computing PDF Author: Yuefan Deng
Publisher: World Scientific
ISBN: 9814307602
Category : Computers
Languages : en
Pages : 218

Get Book Here

Book Description
The book provides a practical guide to computational scientists and engineers to help advance their research by exploiting the superpower of supercomputers with many processors and complex networks. This book focuses on the design and analysis of basic parallel algorithms, the key components for composing larger packages for a wide range of applications.

Introduction to High Performance Scientific Computing

Introduction to High Performance Scientific Computing PDF Author: Victor Eijkhout
Publisher: Lulu.com
ISBN: 1257992546
Category : Computers
Languages : en
Pages : 536

Get Book Here

Book Description
This is a textbook that teaches the bridging topics between numerical analysis, parallel computing, code performance, large scale applications.