Distributed Shared Memory


Book Description

The papers present in this text survey both distributed shared memory (DSM) efforts and commercial DSM systems. The book discusses relevant issues that make the concept of DSM one of the most attractive approaches for building large-scale, high-performance multiprocessor systems. The authors provide a general introduction to the DSM field as well as a broad survey of the basic DSM concepts, mechanisms, design issues, and systems. The book concentrates on basic DSM algorithms, their enhancements, and their performance evaluation. In addition, it details implementations that employ DSM solutions at the software and the hardware level. This guide is a research and development reference that provides state-of-the art information that will be useful to architects, designers, and programmers of DSM systems.




A Primer on Memory Consistency and Cache Coherence


Book Description

Many modern computer systems, including homogeneous and heterogeneous architectures, support shared memory in hardware. In a shared memory system, each of the processor cores may read and write to a single shared address space. For a shared memory machine, the memory consistency model defines the architecturally visible behavior of its memory system. Consistency definitions provide rules about loads and stores (or memory reads and writes) and how they act upon memory. As part of supporting a memory consistency model, many machines also provide cache coherence protocols that ensure that multiple cached copies of data are kept up-to-date. The goal of this primer is to provide readers with a basic understanding of consistency and coherence. This understanding includes both the issues that must be solved as well as a variety of solutions. We present both high-level concepts as well as specific, concrete examples from real-world systems. This second edition reflects a decade of advancements since the first edition and includes, among other more modest changes, two new chapters: one on consistency and coherence for non-CPU accelerators (with a focus on GPUs) and one that points to formal work and tools on consistency and coherence.










Network-Based Parallel Computing Communication, Architecture, and Applications


Book Description

Clusters of workstations/PCs connected by o?-the-shelf networks have become popular as a platform for cost-e?ective parallel computing. Hardware and so- ware technological advances have made this network-based parallel computing platform feasible. A large number of research groups from academia and industry are working to enhance the capabilities of such a platform, thereby improving its cost-e?ectiveness and usability. These developments are facilitating the mig- tion of many existing applications as well as the development of new applications on this platform. Continuing in the tradition of the two previously successful workshops, this 3rd Workshop on Communication, Architecture and Applications for Netwo- based Parallel Computing (CANPC’99) has brought together researchers and practitioners working in architecture, system software, applications and perf- mance evaluation to discuss state-of-the-art solutions for network-based parallel computing systems. This workshop has become an excellent forum for timely dissemination of ideas and healthy interaction on topics at the cutting edge in cluster computing technology. Each submitted paper underwent a rigorous review process, and was assigned to at least 3 reviewers, including at least 2 program committee members. Each paper received at least 2 reviews, most received 3 and some even had 4 reviews.




Parallel Computer Routing and Communication


Book Description

This workshop was a continuation of the PCRCW ’94 workshop that focused on issues in parallel communication and routing in support of parallel processing. The workshop series provides a forum for researchers and designers to exchange ideas with respect to challenges and issues in supporting communication for high-performance parallel computing. Within the last few years we have seen the scope of interconnection network technology expand beyond traditional multiprocessor systems to include high-availability clusters and the emerging class of system area networks. New application domains are creating new requirements for interconnection network services, e.g., real-time video, on-line data mining, etc. The emergence of quality-of-service guarantees within these domains challenges existing approaches to interconnection network design. In the recent past we have seen the emphasis on low-latency software layers, the application of multicomputer interconnection technology to distributed shared-memory multiprocessors and LAN interconnects, and the shift toward the use of commodity clusters and standard components. There is a continuing evolution toward powerful and inexpensive network interfaces, and low-cost, high-speed routers and switches from commercial vendors. The goal is to address the above issues in the context of networks of workstations, multicomputers, distributed shared-memory multiprocessors, and traditional tightly-coupled multiprocessor interconnects. The PCRCW ’97 workshop presented 20 regular papers and two short papers covering a range of topics dealing with modern interconnection networks. It was hosted by the Georgia Institute of Technology and sponsored by the Atlanta Chapter of the IEEE Computer Society.




Parallel and Distributed Computing: Applications and Technologies


Book Description

The 2004 International Conference on Parallel and Distributed Computing, - plications and Technologies (PDCAT 2004) was the ?fth annual conference, and was held at the Marina Mandarin Hotel, Singapore on December 8–10, 2004. Since the inaugural PDCAT held in Hong Kong in 2000, the conference has - come a major forum for scientists, engineers, and practitioners throughout the world to present the latest research, results, ideas, developments, techniques, and applications in all areas of parallel and distributed computing. The technical program was comprehensive and featured keynote speeches, te- nical paper presentations, and exhibitions showcased by industry vendors. The technical program committee was overwhelmed with submissions of papers for presentation, from countries worldwide. We received 242 papers and after - viewing them, based on stringent selection criteria, we accepted 173 papers. The papers in the proceedings focus on parallel and distributed computing viewed from the three perspectives of networking and architectures, software systems and technologies, and algorithms and applications. We acknowledge the great contribution from all of our local and international committee members and - perreviewerswhodevotedtheirtimeinthereviewprocessandprovidedvaluable feedback for the authors. PDCAT 2004 could never have been successful without the support and ass- tance of several institutions and many people. We sincerely appreciate the s- port from the National Grid O?ce and IEEE, Singapore for technical co-sponsorship.The?nancialsponsorshipsfromtheindustrialsponsors,Hewlett- Packard Singapore; IBM Singapore; Sun Microsystems; SANDZ Solutions; S- icon Graphics, and Advanced Digital Information Corporation, are gratefully acknowledged.




Parallel Computing: Fundamentals And Applications - Proceedings Of The International Conference Parco99


Book Description

This millennium will see the increased use of parallel computing technologies at all levels of mainstream computing. Most computer hardware will use these technologies to achieve higher computing speeds, high speed access to very large distributed databases and greater flexibility through heterogeneous computing. These developments can be expected to result in the extended use of all types of parallel computers in virtually all areas of human endeavour. Compute-intensive problems in emerging areas such as financial modelling and multimedia systems, in addition to traditional application areas of parallel computing such as scientific computing and simulation, will stimulate the developments. Parallel computing as a field of scientific research and development will move from a niche concentrating on solving compute-intensive scientific and engineering problems to become one of the fundamental computing technologies.This book gives a retrospective view of what has been achieved in the parallel computing field during the past three decades, as well as a prospective view of expected future developments./a




Parallel Computer Architecture


Book Description

The most exciting development in parallel computer architecture is the convergence of traditionally disparate approaches on a common machine structure. This book explains the forces behind this convergence of shared-memory, message-passing, data parallel, and data-driven computing architectures. It then examines the design issues that are critical to all parallel architecture across the full range of modern design, covering data access, communication performance, coordination of cooperative work, and correct implementation of useful semantics. It not only describes the hardware and software techniques for addressing each of these issues but also explores how these techniques interact in the same system. Examining architecture from an application-driven perspective, it provides comprehensive discussions of parallel programming for high performance and of workload-driven evaluation, based on understanding hardware-software interactions. - synthesizes a decade of research and development for practicing engineers, graduate students, and researchers in parallel computer architecture, system software, and applications development - presents in-depth application case studies from computer graphics, computational science and engineering, and data mining to demonstrate sound quantitative evaluation of design trade-offs - describes the process of programming for performance, including both the architecture-independent and architecture-dependent aspects, with examples and case-studies - illustrates bus-based and network-based parallel systems with case studies of more than a dozen important commercial designs




Emphasizing Distributed Systems


Book Description

As the computer industry moves into the 21st century, the long-running Advances in Computers is ready to tackle the challenges of the new century with insightful articles on new technology, just as it has since 1960 in chronicling the advances in computer technology from the last century. As the longest-running continuing series on computers, Advances in Computers presents those technologies that will affect the industry in the years to come. In this volume, the 53rd in the series, we present 8 relevant topics. The first three represent a common theme on distributed computing systems -using more than one processor to allow for parallel execution, and hence completion of a complex computing task in a minimal amount of time. The other 5 chapters describe other relevant advances from the late 1990s with an emphasis on software development, topics of vital importance to developers today- process improvement, measurement and legal liabilities. - Longest running series on computers - Contains eight insightful chapters on new technology - Gives comprehensive treatment of distributed systems - Shows how to evaluate measurements - Details how to evaluate software process improvement models - Examines how to expand e-commerce on the Web - Discusses legal liabilities in developing software—a must-read for developers