› › Big Data Frameworks

Privacy, Big Data, and the Public Good

Author : Julia Lane

Publisher : Cambridge University Press

Page : 343 pages

File Size : 42,91 MB

Release : 2014-06-09

Category : Mathematics

ISBN : 1316094456

Get eBook

Book Description

Massive amounts of data on human beings can now be analyzed. Pragmatic purposes abound, including selling goods and services, winning political campaigns, and identifying possible terrorists. Yet 'big data' can also be harnessed to serve the public good: scientists can use big data to do research that improves the lives of human beings, improves government services, and reduces taxpayer costs. In order to achieve this goal, researchers must have access to this data - raising important privacy questions. What are the ethical and legal requirements? What are the rules of engagement? What are the best ways to provide access while also protecting confidentiality? Are there reasonable mechanisms to compensate citizens for privacy loss? The goal of this book is to answer some of these questions. The book's authors paint an intellectual landscape that includes legal, economic, and statistical frameworks. The authors also identify new practical approaches that simultaneously maximize the utility of data access while minimizing information risk.



Big Data Application in Power Systems

Author : Reza Arghandeh

Publisher : Elsevier

Page : 450 pages

File Size : 38,25 MB

Release : 2024-07-01

Category : Technology & Engineering

ISBN : 0443219516

Get eBook

Book Description

Big Data Application in Power Systems, Second Edition presents a thorough update of the previous volume, providing readers with step-by-step guidance in big data analytics utilization for power system diagnostics, operation, and control. Bringing back a team of global experts and drawing on fresh, emerging perspectives, this book provides cutting-edge advice for meeting today's challenges in this rapidly accelerating area of power engineering. Divided into three parts, this book begins by breaking down the big picture for electric utilities, before zooming in to examine theoretical problems and solutions in detail. Finally, the third section provides case studies and applications, demonstrating solution troubleshooting and design from a variety of perspectives and for a range of technologies. Readers will develop new strategies and techniques for leveraging data towards real-world outcomes. Including five brand new chapters on emerging technological solutions, Big Data Application in Power Systems, Second Edition remains an essential resource for the reader aiming to utilize the potential of big data in the power systems of the future. - Provides a total refresh to include the most up-to-date research, developments, and challenges - Focuses on practical techniques, including rapidly modernizing monitoring systems, measurement data availability, big data handling and machine learning approaches for processing high dimensional, heterogeneous, and spatiotemporal data - Engages with cross-disciplinary lessons, drawing on the impact of intersectional technology including statistics, computer science, and bioinformatics - Includes five brand new chapters on hot topics, ranging from uncertainty decision-making to features, selection methods, and the opportunities provided by social network data



Big Data Frameworks

Author : Dr. Tamaro J. Green

Publisher : TJG Web Services, LLC

Page : 48 pages

File Size : 28,47 MB

Release :

Category : Computers

ISBN :

Get eBook

Book Description



Big Data 2.0 Processing Systems

Author : Sherif Sakr

Publisher : Springer

Page : 111 pages

File Size : 42,47 MB

Release : 2016-08-24

Category : Computers

ISBN : 3319387766

Get eBook

Book Description

This book provides readers the “big picture” and a comprehensive survey of the domain of big data processing systems. For the past decade, the Hadoop framework has dominated the world of big data processing, yet recently academia and industry have started to recognize its limitations in several application domains and big data processing scenarios such as the large-scale processing of structured data, graph data and streaming data. Thus, it is now gradually being replaced by a collection of engines that are dedicated to specific verticals (e.g. structured data, graph data, and streaming data). The book explores this new wave of systems, which it refers to as Big Data 2.0 processing systems. After Chapter 1 presents the general background of the big data phenomena, Chapter 2 provides an overview of various general-purpose big data processing systems that allow their users to develop various big data processing jobs for different application domains. In turn, Chapter 3 examines various systems that have been introduced to support the SQL flavor on top of the Hadoop infrastructure and provide competing and scalable performance in the processing of large-scale structured data. Chapter 4 discusses several systems that have been designed to tackle the problem of large-scale graph processing, while the main focus of Chapter 5 is on several systems that have been designed to provide scalable solutions for processing big data streams, and on other sets of systems that have been introduced to support the development of data pipelines between various types of big data processing jobs and systems. Lastly, Chapter 6 shares conclusions and an outlook on future research challenges. Overall, the book offers a valuable reference guide for students, researchers and professionals in the domain of big data processing systems. Further, its comprehensive content will hopefully encourage readers to pursue further research on the subject.



The Enterprise Big Data Framework

Author : Jan-Willem Middelburg

Publisher : Kogan Page Publishers

Page : 497 pages

File Size : 20,23 MB

Release : 2023-11-03

Category : Business & Economics

ISBN : 1398601721

Get eBook

Book Description

Businesses who can make sense of the huge influx and complexity of data will be the big winners in the information economy. This comprehensive guide covers all the aspects of transforming enterprise data into value, from the initial set-up of a big data strategy, towards algorithms, architecture and data governance processes. Using a vendor-independent approach, The Enterprise Big Data Framework offers practical advice on how to develop data-driven decision making, detailed data analysis and data engineering techniques. With a focus on business implementation, The Enterprise Big Data Framework includes sections on analysis, engineering, algorithm design and big data architecture, and covers topics such as data preparation and presentation, data modelling, data science, programming languages and machine learning algorithms. Endorsed by leading accreditation and examination institute AMPG International, this book is required reading for the Enterprise Big Data Certifications, which aim to develop excellence in big data practices across the globe. Online resources include sample data for practice purposes.



Knowledge Graphs and Big Data Processing

Author : Valentina Janev

Publisher : Springer Nature

Page : 212 pages

File Size : 23,70 MB

Release : 2020-07-15

Category : Computers

ISBN : 3030531996

Get eBook

Book Description

This open access book is part of the LAMBDA Project (Learning, Applying, Multiplying Big Data Analytics), funded by the European Union, GA No. 809965. Data Analytics involves applying algorithmic processes to derive insights. Nowadays it is used in many industries to allow organizations and companies to make better decisions as well as to verify or disprove existing theories or models. The term data analytics is often used interchangeably with intelligence, statistics, reasoning, data mining, knowledge discovery, and others. The goal of this book is to introduce some of the definitions, methods, tools, frameworks, and solutions for big data processing, starting from the process of information extraction and knowledge representation, via knowledge processing and analytics to visualization, sense-making, and practical applications. Each chapter in this book addresses some pertinent aspect of the data processing chain, with a specific focus on understanding Enterprise Knowledge Graphs, Semantic Big Data Architectures, and Smart Data Analytics solutions. This book is addressed to graduate students from technical disciplines, to professional audiences following continuous education short courses, and to researchers from diverse areas following self-study courses. Basic skills in computer science, mathematics, and statistics are required.



Nature-Inspired Algorithms for Big Data Frameworks

Author : Banati, Hema

Publisher : IGI Global

Page : 435 pages

File Size : 24,61 MB

Release : 2018-09-28

Category : Computers

ISBN : 1522558535

Get eBook

Book Description

As technology continues to become more sophisticated, mimicking natural processes and phenomena becomes more of a reality. Continued research in the field of natural computing enables an understanding of the world around us, in addition to opportunities for manmade computing to mirror the natural processes and systems that have existed for centuries. Nature-Inspired Algorithms for Big Data Frameworks is a collection of innovative research on the methods and applications of extracting meaningful information from data using algorithms that are capable of handling the constraints of processing time, memory usage, and the dynamic and unstructured nature of data. Highlighting a range of topics including genetic algorithms, data classification, and wireless sensor networks, this book is ideally designed for computer engineers, software developers, IT professionals, academicians, researchers, and upper-level students seeking current research on the application of nature and biologically inspired algorithms for handling challenges posed by big data in diverse environments.



Supercomputing Frontiers

Author : Rio Yokota

Publisher : Springer

Page : 301 pages

File Size : 28,87 MB

Release : 2018-03-20

Category : Computers

ISBN : 3319699539

Get eBook

Book Description

It constitutes the refereed proceedings of the 4th Asian Supercomputing Conference, SCFA 2018, held in Singapore in March 2018. Supercomputing Frontiers will be rebranded as Supercomputing Frontiers Asia (SCFA), which serves as the technical programme for SCA18. The technical programme for SCA18 consists of four tracks: Application, Algorithms & Libraries Programming System Software Architecture, Network/Communications & Management Data, Storage & Visualisation The 20 papers presented in this volume were carefully reviewed nd selected from 60 submissions.



Big Data Processing with Apache Spark

Author : Srini Penchikala

Publisher : Lulu.com

Page : 106 pages

File Size : 37,63 MB

Release : 2018-03-13

Category : Computers

ISBN : 1387659952

Get eBook

Book Description

Apache Spark is a popular open-source big-data processing framework thatÕs built around speed, ease of use, and unified distributed computing architecture. Not only it supports developing applications in different languages like Java, Scala, Python, and R, itÕs also hundred times faster in memory and ten times faster even when running on disk compared to traditional data processing frameworks. Whether you are currently working on a big data project or interested in learning more about topics like machine learning, streaming data processing, and graph data analytics, this book is for you. You can learn about Apache Spark and develop Spark programs for various use cases in big data analytics using the code examples provided. This book covers all the libraries in Spark ecosystem: Spark Core, Spark SQL, Spark Streaming, Spark ML, and Spark GraphX.



New Horizons for a Data-Driven Economy

Author : José María Cavanillas

Publisher : Springer

Page : 312 pages

File Size : 25,96 MB

Release : 2016-04-04

Category : Computers

ISBN : 3319215698

Get eBook

Book Description

In this book readers will find technological discussions on the existing and emerging technologies across the different stages of the big data value chain. They will learn about legal aspects of big data, the social impact, and about education needs and requirements. And they will discover the business perspective and how big data technology can be exploited to deliver value within different sectors of the economy. The book is structured in four parts: Part I “The Big Data Opportunity” explores the value potential of big data with a particular focus on the European context. It also describes the legal, business and social dimensions that need to be addressed, and briefly introduces the European Commission’s BIG project. Part II “The Big Data Value Chain” details the complete big data lifecycle from a technical point of view, ranging from data acquisition, analysis, curation and storage, to data usage and exploitation. Next, Part III “Usage and Exploitation of Big Data” illustrates the value creation possibilities of big data applications in various sectors, including industry, healthcare, finance, energy, media and public services. Finally, Part IV “A Roadmap for Big Data Research” identifies and prioritizes the cross-sectorial requirements for big data research, and outlines the most urgent and challenging technological, economic, political and societal issues for big data in Europe. This compendium summarizes more than two years of work performed by a leading group of major European research centers and industries in the context of the BIG project. It brings together research findings, forecasts and estimates related to this challenging technological context that is becoming the major axis of the new digitally transformed business environment.