High-Performance Modelling and Simulation for Big Data Applications


Book Description

This open access book was prepared as a Final Publication of the COST Action IC1406 “High-Performance Modelling and Simulation for Big Data Applications (cHiPSet)“ project. Long considered important pillars of the scientific method, Modelling and Simulation have evolved from traditional discrete numerical methods to complex data-intensive continuous analytical optimisations. Resolution, scale, and accuracy have become essential to predict and analyse natural and complex systems in science and engineering. When their level of abstraction raises to have a better discernment of the domain at hand, their representation gets increasingly demanding for computational and data resources. On the other hand, High Performance Computing typically entails the effective use of parallel and distributed processing units coupled with efficient storage, communication and visualisation systems to underpin complex data-intensive applications in distinct scientific and technical domains. It is then arguably required to have a seamless interaction of High Performance Computing with Modelling and Simulation in order to store, compute, analyse, and visualise large data sets in science and engineering. Funded by the European Commission, cHiPSet has provided a dynamic trans-European forum for their members and distinguished guests to openly discuss novel perspectives and topics of interests for these two communities. This cHiPSet compendium presents a set of selected case studies related to healthcare, biological data, computational advertising, multimedia, finance, bioinformatics, and telecommunications.




Modeling and Simulation in HPC and Cloud Systems


Book Description

This book consists of eight chapters, five of which provide a summary of the tutorials and workshops organised as part of the cHiPSet Summer School: High-Performance Modelling and Simulation for Big Data Applications Cost Action on “New Trends in Modelling and Simulation in HPC Systems,” which was held in Bucharest (Romania) on September 21–23, 2016. As such it offers a solid foundation for the development of new-generation data-intensive intelligent systems. Modelling and simulation (MS) in the big data era is widely considered the essential tool in science and engineering to substantiate the prediction and analysis of complex systems and natural phenomena. MS offers suitable abstractions to manage the complexity of analysing big data in various scientific and engineering domains. Unfortunately, big data problems are not always easily amenable to efficient MS over HPC (high performance computing). Further, MS communities may lack the detailed expertise required to exploit the full potential of HPC solutions, and HPC architects may not be fully aware of specific MS requirements. The main goal of the Summer School was to improve the participants’ practical skills and knowledge of the novel HPC-driven models and technologies for big data applications. The trainers, who are also the authors of this book, explained how to design, construct, and utilise the complex MS tools that capture many of the HPC modelling needs, from scalability to fault tolerance and beyond. In the final three chapters, the book presents the first outcomes of the school: new ideas and novel results of the research on security aspects in clouds, first prototypes of the complex virtual models of data in big data streams and a data-intensive computing framework for opportunistic networks. It is a valuable reference resource for those wanting to start working in HPC and big data systems, as well as for advanced researchers and practitioners.




Big Data Platforms and Applications


Book Description

This book provides a review of advanced topics relating to the theory, research, analysis and implementation in the context of big data platforms and their applications, with a focus on methods, techniques, and performance evaluation. The explosive growth in the volume, speed, and variety of data being produced every day requires a continuous increase in the processing speeds of servers and of entire network infrastructures, as well as new resource management models. This poses significant challenges (and provides striking development opportunities) for data intensive and high-performance computing, i.e., how to efficiently turn extremely large datasets into valuable information and meaningful knowledge. The task of context data management is further complicated by the variety of sources such data derives from, resulting in different data formats, with varying storage, transformation, delivery, and archiving requirements. At the same time rapid responses are needed for real-time applications. With the emergence of cloud infrastructures, achieving highly scalable data management in such contexts is a critical problem, as the overall application performance is highly dependent on the properties of the data management service.




Resource Management for Big Data Platforms


Book Description

Serving as a flagship driver towards advance research in the area of Big Data platforms and applications, this book provides a platform for the dissemination of advanced topics of theory, research efforts and analysis, and implementation oriented on methods, techniques and performance evaluation. In 23 chapters, several important formulations of the architecture design, optimization techniques, advanced analytics methods, biological, medical and social media applications are presented. These chapters discuss the research of members from the ICT COST Action IC1406 High-Performance Modelling and Simulation for Big Data Applications (cHiPSet). This volume is ideal as a reference for students, researchers and industry practitioners working in or interested in joining interdisciplinary works in the areas of intelligent decision systems using emergent distributed computing paradigms. It will also allow newcomers to grasp the key concerns and their potential solutions.




Systems Simulation and Modeling for Cloud Computing and Big Data Applications


Book Description

Systems Simulation and Modelling for Cloud Computing and Big Data Applications provides readers with the most current approaches to solving problems through the use of models and simulations, presenting SSM based approaches to performance testing and benchmarking that offer significant advantages. For example, multiple big data and cloud application developers and researchers can perform tests in a controllable and repeatable manner. Inspired by the need to analyze the performance of different big data processing and cloud frameworks, researchers have introduced several benchmarks, including BigDataBench, BigBench, HiBench, PigMix, CloudSuite and GridMix, which are all covered in this book. Despite the substantial progress, the research community still needs a holistic, comprehensive big data SSM to use in almost every scientific and engineering discipline involving multidisciplinary research. SSM develops frameworks that are applicable across disciplines to develop benchmarking tools that are useful in solutions development.




Advances in Mobile Cloud Computing and Big Data in the 5G Era


Book Description

This book reports on the latest advances on the theories, practices, standards and strategies that are related to the modern technology paradigms, the Mobile Cloud computing (MCC) and Big Data, as the pillars and their association with the emerging 5G mobile networks. The book includes 15 rigorously refereed chapters written by leading international researchers, providing the readers with technical and scientific information about various aspects of Big Data and Mobile Cloud Computing, from basic concepts to advanced findings, reporting the state-of-the-art on Big Data management. It demonstrates and discusses methods and practices to improve multi-source Big Data manipulation techniques, as well as the integration of resources availability through the 3As (Anywhere, Anything, Anytime) paradigm, using the 5G access technologies.




Mobile Big Data


Book Description

This book reports on the latest advances in mobile technologies for collecting, storing and processing mobile big data in connection with wireless communications. It presents novel approaches and applications in which mobile big data is being applied from an engineering standpoint and addresses future theoretical and practical challenges related to the big data field from a mobility perspective. Further, it provides an overview of new methodologies designed to take mobile big data to the Cloud, enable the processing of real-time streaming events on-the-move and enhance the integration of resource availability through the ‘Anywhere, Anything, Anytime’ paradigm. By providing both academia and industry researchers and professionals with a timely snapshot of emerging mobile big data-centric systems and highlighting related pitfalls, as well as potential solutions, the book fills an important gap in the literature and fosters the further development in the area of mobile technologies for exploiting mobile big data.




Process Safety and Big Data


Book Description

Process Safety and Big Data discusses the principles of process safety and advanced information technologies. It explains how these principles are applied to the process industry and provides examples of applications in process safety control and decision support systems.This book helps to address problems that researchers face in industry that are the result of increased process complexity and that have an impact on safety issues. It shows ways to tackle these safety issues by implementing modern information technologies, such as big data analysis and artificial intelligence. It provides an integrated approach to modern information technologies used in control and management of process safety in industry. The book also considers indicators and criteria in effective safety decisions, and addresses the issue of how big data would provide support for improved, autonomous, data-driven decisions. - Paves the way for the digital transformation of safety science and safety management - Takes a system approach to advanced information technologies used in process safety - Applies big data technologies to process safety - Includes multiple pertinent case studies




Advances in Mathematical Methods and High Performance Computing


Book Description

This special volume of the conference will be of immense use to the researchers and academicians. In this conference, academicians, technocrats and researchers will get an opportunity to interact with eminent persons in the field of Applied Mathematics and Scientific Computing. The topics to be covered in this International Conference are comprehensive and will be adequate for developing and understanding about new developments and emerging trends in this area. High-Performance Computing (HPC) systems have gone through many changes during the past two decades in their architectural design to satisfy the increasingly large-scale scientific computing demand. Accurate, fast, and scalable performance models and simulation tools are essential for evaluating alternative architecture design decisions for the massive-scale computing systems. This conference recounts some of the influential work in modeling and simulation for HPC systems and applications, identifies some of the major challenges, and outlines future research directions which we believe are critical to the HPC modeling and simulation community.




Bioinformatics and Medical Applications


Book Description

BIOINFORMATICS AND MEDICAL APPLICATIONS The main topics addressed in this book are big data analytics problems in bioinformatics research such as microarray data analysis, sequence analysis, genomics-based analytics, disease network analysis, techniques for big data analytics, and health information technology. Bioinformatics and Medical Applications: Big Data Using Deep Learning Algorithms analyses massive biological datasets using computational approaches and the latest cutting-edge technologies to capture and interpret biological data. The book delivers various bioinformatics computational methods used to identify diseases at an early stage by assembling cutting-edge resources into a single collection designed to enlighten the reader on topics focusing on computer science, mathematics, and biology. In modern biology and medicine, bioinformatics is critical for data management. This book explains the bioinformatician’s important tools and examines how they are used to evaluate biological data and advance disease knowledge. The editors have curated a distinguished group of perceptive and concise chapters that presents the current state of medical treatments and systems and offers emerging solutions for a more personalized approach to healthcare. Applying deep learning techniques for data-driven solutions in health information allows automated analysis whose method can be more advantageous in supporting the problems arising from medical and health-related information. Audience The primary audience for the book includes specialists, researchers, postgraduates, designers, experts, and engineers, who are occupied with biometric research and security-related issues.