Performance Evaluation of Main Memory Database Systems


Book Description

In this paper we present the results of a comprehensive benchmark of the relational Main Memory Database System (MMDBS), that is the foundation of the interactive office system. Office-By-Example (OBE). Based on this case study, we identify issues that must be considered in the design and implementation of MMDBS's. We determine relevant performance metrics and describe techniques for benchmarking MMDBS's.







Main Memory Database Systems


Book Description

With growing memory sizes and memory prices dropping by a factor of 10 every 5 years, data having a "primary home" in memory is now a reality. Main-memory databases eschew many of the traditional architectural pillars of relational database systems that optimized for disk-resident data. The result of these memory-optimized designs are systems that feature several innovative approaches to fundamental issues (e.g., concurrency control, query processing) that achieve orders of magnitude performance improvements over traditional designs. This monograph provides an overview of recent developments in main-memory database systems. It covers five main issues and architectural choices that need to be made when building a high performance main-memory optimized database: data organization and storage, indexing, concurrency control, durability and recovery techniques, and query processing and compilation. The monograph focuses on four commercial and research systems: H-Store/VoltDB, Hekaton, HyPer, and SAPHANA. These systems are diverse in their design choices and form a representative sample of the state of the art in main-memory database systems. It also covers other commercial and academic systems, along with current and future research trends.




Topics in Performance Evaluation, Measurement and Characterization


Book Description

This book constitutes the proceedings of the Third Technology Conference on Performance Evaluation and Benchmarking, TPCTC 2011, held in conjunction with the 37th International Conference on Very Large Data Bases, VLDB 2011, in Seattle, August/September 2011. The 12 full papers and 2 keynote papers were carefully selected and reviewed from numerous submissions. The papers present novel ideas and methodologies in performance evaluation, measurement, and characterization.




Performance Evaluation and Benchmarking: Traditional to Big Data to Internet of Things


Book Description

This book constitutes the thoroughly refereed post-conference proceedings of the 7th TPC Technology Conference on Performance Evaluation and Benchmarking, TPSTC 2015, held in conjunction with the 40th International Conference on Very Large Databases (VLDB 2015) in Kohala Coast, Hawaii, USA, in August/September 2015. The 8 papers presented together with 1 keynote, and 1 vision paper were carefully reviewed and selected from 24 submissions. Many buyers use TPC benchmark results as points of comparison when purchasing new computing systems. The information technology landscape is evolving at a rapid pace, challenging industry experts and researchers to develop innovative techniques for evaluation, measurement and characterization of complex systems. The TPC remains committed to developing new benchmark standards to keep pace, and one vehicle for achieving this objective is the sponsorship of the Technology Conference on Performance Evaluation and Benchmarking (TPCTC).




Main Memory Databases


Book Description

"The declining cost of main memory coupled with higher performance expectations has inspired researchers and developers to look into systems with massive amounts of memory, especially for systems with databases. When memory is large enough, an entire database can permanently reside in main memory. These database systems are known as memory resident database or Main Memory DataBase (MMDB) systems. When a database is a main memory resident, systems can achieve significant performance improvements over traditional disk-based database systems by eliminating the overhead required to perform Input/Output operations. However, the problem of crash recovery becomes by far the most challenging issue in MMDB systems, since it can occur frequently and cause a drastic crisis by wiping out the entire content of the database. The kind of crisis that can be encountered due to memory failures, the way to prevent them from occuring in the first place, methods of dealing with them upon their occurance, strategies to make the system more reliable to avoid them in the future, and several other issues like these must be well understood. Approaches to deal with crash recoveries must be sound, well designed, and correctly implemented. The objective of this thesis is to study some of the pioneering works of researchers and developers in the area of MMDB recovery and to perform an in-depth analysis of MMDB recovery issues and approaches taken by several major recovery techniques. The analysis examines the reasons for these techniques, design and architecture, and their benefits and limitations over one another. My independent evaluation of the relative benefits and limitations of each technique coupled with marketablitiy analysis is also presented. The approach used in this study is different from that of other studies that have been published so far in this area. In this study, the reader is given a basic introduction to the topic and then gradually taken through the final stages of analysis and comparison of several recovery techniques."--Author's abstract.




Performance Evaluation and Benchmarking


Book Description

This book constitutes the refereed post-conference proceedings of the 13th TPC Technology Conference on Performance Evaluation and Benchmarking, TPCTC 2021, held in August 2021. The 9 papers presented were carefully reviewed and selected from numerous submissions. The TPC encourages researchers and industry experts to present and debate novel ideas and methodologies in performance evaluation, measurement, and characterization.




Non-Volatile Memory Database Management Systems


Book Description

This book explores the implications of non-volatile memory (NVM) for database management systems (DBMSs). The advent of NVM will fundamentally change the dichotomy between volatile memory and durable storage in DBMSs. These new NVM devices are almost as fast as volatile memory, but all writes to them are persistent even after power loss. Existing DBMSs are unable to take full advantage of this technology because their internal architectures are predicated on the assumption that memory is volatile. With NVM, many of the components of legacy DBMSs are unnecessary and will degrade the performance of data-intensive applications. We present the design and implementation of DBMS architectures that are explicitly tailored for NVM. The book focuses on three aspects of a DBMS: (1) logging and recovery, (2) storage and buffer management, and (3) indexing. First, we present a logging and recovery protocol that enables the DBMS to support near-instantaneous recovery. Second, we propose a storage engine architecture and buffer management policy that leverages the durability and byte-addressability properties of NVM to reduce data duplication and data migration. Third, the book presents the design of a range index tailored for NVM that is latch-free yet simple to implement. All together, the work described in this book illustrates that rethinking the fundamental algorithms and data structures employed in a DBMS for NVM improves performance and availability, reduces operational cost, and simplifies software development.




Database Machines


Book Description

This volume contains 24 papers presented at the Sixth International Workshop on Database Machines. The papers cover a wide spectrum of topics including: system architectures, storage structures, associative memory architectures, memory resident systems, deduction and retrospectives on maturing projects. The nature of the papers is highly technical and presumes knowledge of database management systems and familiarity with database machines. The book is representative of the dual trend in the field towards (1) search for new functionability and (2) attention to detail, completeness and performance of prototype implementations.




Selected Topics in Performance Evaluation and Benchmarking


Book Description

This book constitutes the refereed proceedings of the 4th TPC Technology Conference, TPCTC 2012, held in Istanbul, Turkey, in August 2012. It contains 10 selected peer-reviewed papers, 2 invited talks, a report from the TPC Public Relations Committee, and a report from the workshop on Big Data Benchmarking, WBDB 2012. The papers present novel ideas and methodologies in performance evaluation, measurement, and characterization.