A Software Shared Virtual Memory System with Three Way Coherence Protocols on the Intel Single-chip Cloud Computer

A Software Shared Virtual Memory System with Three Way Coherence Protocols on the Intel Single-chip Cloud Computer PDF Author: 熊哲皓
Publisher:
ISBN:
Category : Cloud computing
Languages : en
Pages : 0

Get Book Here

Book Description

SOFTWARE SHARED VIRTUAL MEMORY

SOFTWARE SHARED VIRTUAL MEMORY PDF Author: Chit-Ho Dominic Hung
Publisher: Open Dissertation Press
ISBN: 9781361009215
Category : Computers
Languages : en
Pages : 174

Get Book Here

Book Description
This dissertation, "A Software Shared Virtual Memory System With Three Way Coherence Protocols on the Intel Single-chip Cloud Computer" by Chit-ho, Dominic, Hung, 熊哲皓, was obtained from The University of Hong Kong (Pokfulam, Hong Kong) and is being sold pursuant to Creative Commons: Attribution 3.0 Hong Kong License. The content of this dissertation has not been altered in any way. We have altered the formatting in order to facilitate the ease of printing and reading of the dissertation. All rights not granted by the above license are retained by the author. Abstract: With the advancement of design and fabrication of high-performance integrated circuits technology, it is foreseeable that processors with more than 1,000 cores per die will appear in the near future. However, these many-core architectures have introduced a lot of challenges at the memory system level, such as complicated cache coherence and limited memory access speed, to name a few. This thesis focuses on one prominent many-core prototype - the Intel's Single-chip Cloud Computer (SCC). The SCC architecture does not provide hardware cache coherency. Instead, it relies on on-chip programmable memory. The baseline coherence protocol for the SCC is the Software Managed Coherence (SMC) layer. To achieve memory consistency, it accesses shared memory without part of the typical cache hierarchy for efficient invalidation and flushing. We found that performance provided by this coherence layer in this manner is sub-optimal because accesses of shared memory would all turn into data update messages within the network mesh. As cache locality could not be exploited to its full potential, the execution pipelines stall much often for memory fetches from outside the chip. This research is to address the performance problem of shared virtual memory consistency for this cache in-coherent architecture. Oriented at sitting data on-chip as much as possible to reduce memory accesses external to the chip, we propose two techniques to leverage the cache hierarchy to full and reside data in the on-chip scratchpad memory. First, targeted at the architectural specificity of the hardware, we redesigned traditional software distributed shared memory (SDSM) to allow shared data be treated transparently like private memory so the cache hierarchy can be fully utilised without sacrificing memory consistency. Second, we propose a distance-aware page allocation scheme that samples access frequencies and select the most frequently-recently used pages to be stored on the on-chip scratchpad memory. Our experimental results show that our first technique, the ordinary SDSM outperforms the current SMC approach by 5 times. Moreover, in some cases, with the second technique that is based on scratchpad memory, our proposed system outperforms further by an additional 1.57 times. Our experiments also demonstrated that the SMC approach is not scalable due to congestion of the network mesh by coherence traffic generated while the two new approaches continued to scale well. The main contribution of this research is the implementation of a cache coherence software library system built for an architecture that comes with non-coherent cache hardware and just relies on software-defined cache. This new cache hierarchy has evidently opened the door for smarter and faster inter-processor-core data sharing without the need of complicated cache coherence hardware. Subjects: Distributed shared memory Cloud computing

A Software Shared Virtual Memory System with Three Way Coherence Protocols on the Intel Single-chip Cloud Computer

A Software Shared Virtual Memory System with Three Way Coherence Protocols on the Intel Single-chip Cloud Computer PDF Author: 熊哲皓
Publisher:
ISBN:
Category : Cloud computing
Languages : en
Pages : 0

Get Book Here

Book Description


Distributed Shared Memory

Distributed Shared Memory PDF Author: Jelica Protic
Publisher: John Wiley & Sons
ISBN: 9780818677373
Category : Computers
Languages : en
Pages : 384

Get Book Here

Book Description
The papers present in this text survey both distributed shared memory (DSM) efforts and commercial DSM systems. The book discusses relevant issues that make the concept of DSM one of the most attractive approaches for building large-scale, high-performance multiprocessor systems. The authors provide a general introduction to the DSM field as well as a broad survey of the basic DSM concepts, mechanisms, design issues, and systems. The book concentrates on basic DSM algorithms, their enhancements, and their performance evaluation. In addition, it details implementations that employ DSM solutions at the software and the hardware level. This guide is a research and development reference that provides state-of-the art information that will be useful to architects, designers, and programmers of DSM systems.

A Shared (virtual) Memory Environment for the NCUBE-2 Hypercube Multicomputer

A Shared (virtual) Memory Environment for the NCUBE-2 Hypercube Multicomputer PDF Author: Chita R. Das
Publisher:
ISBN:
Category : Computer storage devices
Languages : en
Pages : 80

Get Book Here

Book Description
Abstract: "We have designed and implemented a Shared Virtual Memory (SVM) system on an nCUBE 2 hypercube multicomputer. By injecting some function calls (called SVM system calls) into an existing programming environment (namely, C programming language), the traditional message passing environment on the nCUBE 2 multicomputer is converted into a (simulated) shared memory environment. Shared memory is simulated through implicit message passing, transparent to the user. Simple shared-memory based parallel programs can be written using these SVM system calls. The focus of this report is on the use of this software bases system. (For a discussion on SVM systems in general and the design of this system in particular, refer to [1].) Detailed description of the above mentioned SVM system calls is provided. A sample program is presented to illustrate the use of shared memory."

Architectural and Operating System Support for Virtual Memory

Architectural and Operating System Support for Virtual Memory PDF Author: Abhishek Bhattacharjee
Publisher: Springer Nature
ISBN: 3031017579
Category : Technology & Engineering
Languages : en
Pages : 168

Get Book Here

Book Description
This book provides computer engineers, academic researchers, new graduate students, and seasoned practitioners an end-to-end overview of virtual memory. We begin with a recap of foundational concepts and discuss not only state-of-the-art virtual memory hardware and software support available today, but also emerging research trends in this space. The span of topics covers processor microarchitecture, memory systems, operating system design, and memory allocation. We show how efficient virtual memory implementations hinge on careful hardware and software cooperation, and we discuss new research directions aimed at addressing emerging problems in this space. Virtual memory is a classic computer science abstraction and one of the pillars of the computing revolution. It has long enabled hardware flexibility, software portability, and overall better security, to name just a few of its powerful benefits. Nearly all user-level programs today take for granted that they will have been freed from the burden of physical memory management by the hardware, the operating system, device drivers, and system libraries. However, despite its ubiquity in systems ranging from warehouse-scale datacenters to embedded Internet of Things (IoT) devices, the overheads of virtual memory are becoming a critical performance bottleneck today. Virtual memory architectures designed for individual CPUs or even individual cores are in many cases struggling to scale up and scale out to today's systems which now increasingly include exotic hardware accelerators (such as GPUs, FPGAs, or DSPs) and emerging memory technologies (such as non-volatile memory), and which run increasingly intensive workloads (such as virtualized and/or "big data" applications). As such, many of the fundamental abstractions and implementation approaches for virtual memory are being augmented, extended, or entirely rebuilt in order to ensure that virtual memory remains viable and performant in the years to come.

Support for Software Distributed Shared Memory on Clusters of Heterogeneous Workstations

Support for Software Distributed Shared Memory on Clusters of Heterogeneous Workstations PDF Author: Subhabrata Saha
Publisher:
ISBN:
Category :
Languages : en
Pages : 40

Get Book Here

Book Description


Software Techniques for Customizable Distributed Shared Memory

Software Techniques for Customizable Distributed Shared Memory PDF Author: Satish Chandra
Publisher:
ISBN:
Category :
Languages : en
Pages : 278

Get Book Here

Book Description


Software-oriented Memory-management Design

Software-oriented Memory-management Design PDF Author: Bruce Ledley Jacob
Publisher:
ISBN:
Category :
Languages : en
Pages : 596

Get Book Here

Book Description


Virtual Shared Memory for Distributed Architectures

Virtual Shared Memory for Distributed Architectures PDF Author: Eva Kühn
Publisher: Nova Publishers
ISBN: 9781590331019
Category : Architecture
Languages : en
Pages : 138

Get Book Here

Book Description
Virtual Shared Memory for Distributed Architecture

Program Behavior and Virtual Memory Management in Time-shared Computer Systems

Program Behavior and Virtual Memory Management in Time-shared Computer Systems PDF Author: James Boyle
Publisher:
ISBN:
Category :
Languages : en
Pages : 390

Get Book Here

Book Description