Big Data in Astronomy


Book Description

Big Data in Radio Astronomy: Scientific Data Processing for Advanced Radio Telescopes provides the latest research developments in big data methods and techniques for radio astronomy. Providing examples from such projects as the Square Kilometer Array (SKA), the world's largest radio telescope that generates over an Exabyte of data every day, the book offers solutions for coping with the challenges and opportunities presented by the exponential growth of astronomical data. Presenting state-of-the-art results and research, this book is a timely reference for both practitioners and researchers working in radio astronomy, as well as students looking for a basic understanding of big data in astronomy. - Bridges the gap between radio astronomy and computer science - Includes coverage of the observation lifecycle as well as data collection, processing and analysis - Presents state-of-the-art research and techniques in big data related to radio astronomy - Utilizes real-world examples, such as Square Kilometer Array (SKA) and Five-hundred-meter Aperture Spherical radio Telescope (FAST)




Knowledge Discovery in Big Data from Astronomy and Earth Observation


Book Description

Knowledge Discovery in Big Data from Astronomy and Earth Observation: Astrogeoinformatics bridges the gap between astronomy and geoscience in the context of applications, techniques and key principles of big data. Machine learning and parallel computing are increasingly becoming cross-disciplinary as the phenomena of Big Data is becoming common place. This book provides insight into the common workflows and data science tools used for big data in astronomy and geoscience. After establishing similarity in data gathering, pre-processing and handling, the data science aspects are illustrated in the context of both fields. Software, hardware and algorithms of big data are addressed. Finally, the book offers insight into the emerging science which combines data and expertise from both fields in studying the effect of cosmos on the earth and its inhabitants. - Addresses both astronomy and geosciences in parallel, from a big data perspective - Includes introductory information, key principles, applications and the latest techniques - Well-supported by computing and information science-oriented chapters to introduce the necessary knowledge in these fields




Big Data


Book Description

A exploration of the latest trend in technology and the impact it will have on the economy, science, and society at large.




Big-Data-Analytics in Astronomy, Science, and Engineering


Book Description

This book constitutes the proceedings of the 9th International Conference on Big Data Analytics, BDA 2021, which took place virtually during December 7–9, 2021. The 15 full papers and 1 short paper included in this volume were carefully reviewed and selected from 60 submissions. They were organized in topical sections as follows: Data science: systems; data science: architectures; big data analytics in healthcare support systems, information interchange of web data resources; and business analytics.




Astronomy and Big Data


Book Description

With the onset of massive cosmological data collection through media such as the Sloan Digital Sky Survey (SDSS), galaxy classification has been accomplished for the most part with the help of citizen science communities like Galaxy Zoo. Seeking the wisdom of the crowd for such Big Data processing has proved extremely beneficial. However, an analysis of one of the Galaxy Zoo morphological classification data sets has shown that a significant majority of all classified galaxies are labelled as “Uncertain”. This book reports on how to use data mining, more specifically clustering, to identify galaxies that the public has shown some degree of uncertainty for as to whether they belong to one morphology type or another. The book shows the importance of transitions between different data mining techniques in an insightful workflow. It demonstrates that Clustering enables to identify discriminating features in the analysed data sets, adopting a novel feature selection algorithms called Incremental Feature Selection (IFS). The book shows the use of state-of-the-art classification techniques, Random Forests and Support Vector Machines to validate the acquired results. It is concluded that a vast majority of these galaxies are, in fact, of spiral morphology with a small subset potentially consisting of stars, elliptical galaxies or galaxies of other morphological variants.




Statistics, Data Mining, and Machine Learning in Astronomy


Book Description

As telescopes, detectors, and computers grow ever more powerful, the volume of data at the disposal of astronomers and astrophysicists will enter the petabyte domain, providing accurate measurements for billions of celestial objects. This book provides a comprehensive and accessible introduction to the cutting-edge statistical methods needed to efficiently analyze complex data sets from astronomical surveys such as the Panoramic Survey Telescope and Rapid Response System, the Dark Energy Survey, and the upcoming Large Synoptic Survey Telescope. It serves as a practical handbook for graduate students and advanced undergraduates in physics and astronomy, and as an indispensable reference for researchers. Statistics, Data Mining, and Machine Learning in Astronomy presents a wealth of practical analysis problems, evaluates techniques for solving them, and explains how to use various approaches for different types and sizes of data sets. For all applications described in the book, Python code and example data sets are provided. The supporting data sets have been carefully selected from contemporary astronomical surveys (for example, the Sloan Digital Sky Survey) and are easy to download and use. The accompanying Python code is publicly available, well documented, and follows uniform coding standards. Together, the data sets and code enable readers to reproduce all the figures and examples, evaluate the methods, and adapt them to their own fields of interest. Describes the most useful statistical and data-mining methods for extracting knowledge from huge and complex astronomical data sets Features real-world data sets from contemporary astronomical surveys Uses a freely available Python codebase throughout Ideal for students and working astronomers




Data Analysis in Astronomy


Book Description

The international Workshop on "Data Analysis in Astronomy" was in tended to give a presentation of experiences that have been acqui red in data analysis and image processing, developments and appli cations that are steadly growing up in Astronomy. The quality and the quantity of ground and satellite observations require more so phisticated data analysis methods and better computational tools. The Workshop has reviewed the present state of the art, explored new methods and discussed a wide range of applications. The topics which have been selected have covered the main fields of interest for data analysis in Astronomy. The Workshop has been focused on the methods used and their significant applications. Results which gave a major contribution to the physical interpre tation of the data have been stressed in the presentations. Atten tion has been devoted to the description of operational system for data analysis in astronomy. The success of the meeting has been the results of the coordinated effort of several people from the organizers to those who presen ted a contribution and/or took part in the discussion. We wish to thank the members of the Workshop scientific committee Prof. M. Ca paccioli, Prof. G. De Biase, Prof. G. Sedmak, Prof. A. Zichichi and of the local organizing committee Dr. R. Buccheri and Dr. M.C. Macca rone together with Miss P. Savalli and Dr. A. Gabriele of the E. Majo rana Center for their support and the unvaluable part in arranging the Workshop.







Big Data, Little Data, No Data


Book Description

An examination of the uses of data within a changing knowledge infrastructure, offering analysis and case studies from the sciences, social sciences, and humanities. “Big Data” is on the covers of Science, Nature, the Economist, and Wired magazines, on the front pages of the Wall Street Journal and the New York Times. But despite the media hyperbole, as Christine Borgman points out in this examination of data and scholarly research, having the right data is usually better than having more data; little data can be just as valuable as big data. In many cases, there are no data—because relevant data don't exist, cannot be found, or are not available. Moreover, data sharing is difficult, incentives to do so are minimal, and data practices vary widely across disciplines. Borgman, an often-cited authority on scholarly communication, argues that data have no value or meaning in isolation; they exist within a knowledge infrastructure—an ecology of people, practices, technologies, institutions, material objects, and relationships. After laying out the premises of her investigation—six “provocations” meant to inspire discussion about the uses of data in scholarship—Borgman offers case studies of data practices in the sciences, the social sciences, and the humanities, and then considers the implications of her findings for scholarly practice and research policy. To manage and exploit data over the long term, Borgman argues, requires massive investment in knowledge infrastructures; at stake is the future of scholarship.




Big Data Analytics in Chemoinformatics and Bioinformatics


Book Description

Big Data Analytics in Chemoinformatics and Bioinformatics: With Applications to Computer-Aided Drug Design, Cancer Biology, Emerging Pathogens and Computational Toxicology provides an up-to-date presentation of big data analytics methods and their applications in diverse fields. The proper management of big data for decision-making in scientific and social issues is of paramount importance. This book gives researchers the tools they need to solve big data problems in these fields. It begins with a section on general topics that all readers will find useful and continues with specific sections covering a range of interdisciplinary applications. Here, an international team of leading experts review their respective fields and present their latest research findings, with case studies used throughout to analyze and present key information. - Brings together the current knowledge on the most important aspects of big data, including analysis using deep learning and fuzzy logic, transparency and data protection, disparate data analytics, and scalability of the big data domain - Covers many applications of big data analysis in diverse fields such as chemistry, chemoinformatics, bioinformatics, computer-assisted drug/vaccine design, characterization of emerging pathogens, and environmental protection - Highlights the considerable benefits offered by big data analytics to science, in biomedical fields and in industry