The State of Open Data


Book Description

It’s been ten years since open data first broke onto the global stage. Over the past decade, thousands of programmes and projects around the world have worked to open data and use it to address a myriad of social and economic challenges. Meanwhile, issues related to data rights and privacy have moved to the centre of public and political discourse. As the open data movement enters a new phase in its evolution, shifting to target real-world problems and embed open data thinking into other existing or emerging communities of practice, big questions still remain. How will open data initiatives respond to new concerns about privacy, inclusion, and artificial intelligence? And what can we learn from the last decade in order to deliver impact where it is most needed? The State of Open Data brings together over 60 authors from around the world to address these questions and to take stock of the real progress made to date across sectors and around the world, uncovering the issues that will shape the future of open data in the years to come.




The Future of Open Data


Book Description

The Future of Open Data flows from a multi-year Social Sciences and Humanities Research Council (SSHRC) Partnership Grant project that set out to explore open government geospatial data from an interdisciplinary perspective. Researchers on the grant adopted a critical social science perspective grounded in the imperative that the research should be relevant to government and civil society partners in the field. This book builds on the knowledge developed during the course of the grant and asks the question, “What is the future of open data?” The contributors’ insights into the future of open data combine observations from five years of research about the Canadian open data community with a critical perspective on what could and should happen as open data efforts evolve. Each of the chapters in this book addresses different issues and each is grounded in distinct disciplinary or interdisciplinary perspectives. The opening chapter reflects on the origins of open data in Canada and how it has progressed to the present date, taking into account how the Indigenous data sovereignty movement intersects with open data. A series of chapters address some of the pitfalls and opportunities of open data and consider how the changing data context may impact sources of open data, limits on open data, and even liability for open data. Another group of chapters considers new landscapes for open data, including open data in the global South, the data priorities of local governments, and the emerging context for rural open data.




Beyond Transparency


Book Description

The rise of open data in the public sector has sparked innovation, driven efficiency, and fueled economic development. While still emerging, we are seeing evidence of the transformative potential of open data in shaping the future of our civic life, and the opportunity to use open data to reimagine the relationship between residents and government, especially at the local level. As we look ahead, what have we learned so far from open data in practice and how we can apply those lessons to realize a more promising future for America's cities and communities? Edited by Brett Goldstein, former Chief Data Officer for the City of Chicago, with Code for America, this book features essays from over twenty of the world's leading experts in a first-of-its-kind instructive anthology about how open data is changing the face of our public institutions. Contributors include: Michael Flowers, Chief Analytics Officer, New York City Beth Blauer, former director of Maryland StateStat Jonathan Feldman, CIO, City of Asheville Tim O'Reilly, founder & CEO, O'Reilly Media Eric Gordon, Director of Engagement Game Lab, Emerson College Beth Niblock, CIO, Louisville Metro Government Ryan & Mike Alfred, Co-Founders, Brightscope Emer Coleman, former director of the London Datastore Mark Headd, Chief Data Officer, City of Philadelphia "As an essential volume for anyone interested in the future of governance, urban policy, design, data-driven policymaking, journalism, or civic engagement, "Beyond Transparency" combines the inspirational glow and political grit of Profiles in Courage with the clarity of an engineer's calm explanation of how something technical actually works. Here are the detailed how-to stories of many members of the first generation of open government pioneers, written in a generous, accessible style; this compilation presents us with a great deal to admire, ample provocation, and wise guidance from a group of remarkable individuals." -Susan Crawford, author of Captive Audience "Just as he did during his time in my administration, Goldstein has brought together industry leaders to discuss issues of relevance in the open data movement and the practical implications of implementing these policies... This book will help continue the work to make open government a reality across the country." - Mayor Rahm Emanuel, City of Chicago "A must-read for anyone who is passionate about what open data can do to transform city living." - Boris Johnson, Mayor of London




Openness in Practice


Book Description

This book looks at open data practices historically and from the perspective of those currently involved in advocating for making government data freely available. Based on interviews with practitioners, users and evangelists across three Australian-based case studies illustrating contemporary open data practices, this book discusses how open data has evolved, why certain barriers to openness exist and what the future of open data might look like. It highlights both the challenges and approaches to ‘best practice’ in government departments and agencies as they adapt to changing data ecosystems and public expectations around access, transparency, risk and responsible stewardship.




Open Data in Developing Economies


Book Description

Recent years have witnessed considerable speculation about the potential of open data to bring about wide-scale transformation. The bulk of existing evidence about the impact of open data, however, focuses on high-income countries. Much less is known about open data’s role and value in low- and middle-income countries, and more generally about its possible contributions to economic and social development. Open Data for Developing Economies features in-depth case studies on how open data is having an impact across the developing world-from an agriculture initiative in Colombia to data-driven healthcare projects in Uganda and South Africa to crisis response in Nepal. The analysis built on these case studies aims to create actionable intelligence regarding: (a) the conditions under which open data is most (and least) effective in development, presented in the form of a Periodic Table of Open Data; (b) strategies to maximize the positive contributions of open data to development; and (c) the means for limiting open data’s harms on developing countries.




Open Government


Book Description

In a world where web services can make real-time data accessible to anyone, how can the government leverage this openness to improve its operations and increase citizen participation and awareness? Through a collection of essays and case studies, leading visionaries and practitioners both inside and outside of government share their ideas on how to achieve and direct this emerging world of online collaboration, transparency, and participation. Contributions and topics include: Beth Simone Noveck, U.S. Deputy Chief Technology Officer for open government, "The Single Point of Failure" Jerry Brito, senior research fellow at the Mercatus Center at George Mason University, "All Your Data Are Belong to Us: Liberating Government Data" Aaron Swartz, cofounder of reddit.com, OpenLibrary.org, and BoldProgressives.org, "When Is Transparency Useful?" Ellen S. Miller, executive director of the Sunlight Foundation, "Disrupting Washington's Golden Rule" Carl Malamud, founder of Public.Resource.Org, "By the People" Douglas Schuler, president of the Public Sphere Project, "Online Deliberation and Civic Intelligence" Howard Dierking, program manager on Microsoft's MSDN and TechNet Web platform team, "Engineering Good Government" Matthew Burton, Web entrepreneur and former intelligence analyst at the Defense Intelligence Agency, "A Peace Corps for Programmers" Gary D. Bass and Sean Moulton, OMB Watch, "Bringing the Web 2.0 Revolution to Government" Tim O'Reilly, founder and CEO of O'Reilly Media, "Defining Government 2.0: Lessons Learned from the Success of Computer Platforms" Open Government editors: Daniel Lathrop is a former investigative projects reporter with the Seattle Post Intelligencer who's covered politics in Washington state, Iowa, Florida, and Washington D.C. He's a specialist in campaign finance and "computer-assisted reporting" -- the practice of using data analysis to report the news. Laurel Ruma is the Gov 2.0 Evangelist at O'Reilly Media. She is also co-chair for the Gov 2.0 Expo.




Open Data Structures


Book Description

Introduction -- Array-based lists -- Linked lists -- Skiplists -- Hash tables -- Binary trees -- Random binary search trees -- Scapegoat trees -- Red-black trees -- Heaps -- Sorting algorithms -- Graphs -- Data structures for integers -- External memory searching.




Using Open Data to Detect Organized Crime Threats


Book Description

This work provides an innovative look at the use of open data for extracting information to detect and prevent crime, and also explores the link between terrorism and organized crime. In counter-terrorism and other forms of crime prevention, foresight about potential threats is vitally important and this information is increasingly available via electronic data sources such as social media communications. However, the amount and quality of these sources is varied, and researchers and law enforcement need guidance about when and how to extract useful information from them. The emergence of these crime threats, such as communication between organized crime networks and radicalization towards terrorism, is driven by a combination of political, economic, social, technological, legal and environmental factors. The contributions to this volume represent a major step by researchers to systematically collect, filter, interpret, and use the information available. For the purposes of this book, the only data sources used are publicly available sources which can be accessed legally and ethically. This work will be of interest to researchers in criminology and criminal justice, particularly in police science, organized crime, counter-terrorism and crime science. It will also be of interest to those in related fields such as applications of computer science and data mining, public policy, and business intelligence.




Open Heritage Data


Book Description

Digital heritage can mean many things, from building a database on Egyptian textiles to interacting with family historians over Facebook. However, it is rare to see professionals with a heritage background working practically with the heritage datasets in their charge. Many institutions who have the resources to do so, leave this work to computer programmers, missing the opportunity to share their knowledge and passion for heritage through innovative technology. Open Heritage Data: An introduction to research, publishing and programming with open data in the heritage sector has been written for practitioners, researchers and students working in the GLAM (Galleries, Libraries, Archives and Museums) sector who do not have a computer science background, but who want to work more confidently with heritage data. It combines current research in open data with the author’s extensive experience in coding and teaching coding to provide a step-by-step guide to working actively with the increasing amounts of data available. Coverage includes: • an introduction to open data as a next step in heritage mediation • an overview of the laws most relevant to open heritage data • an Open Heritage Data Model and examples of how institutions publish heritage data • an exploration of use and reuse of heritage data • tutorials on visualising and combining heritage datasets and on using heritage data for research. Featuring sample code, case examples from around the world and step-by-step technical tutorials, this book will be a valuable resource for anyone in the GLAM sector involved in, or who wants to be involved in creating, publishing, using and reusing open heritage data.




Open Scientific Data


Book Description

Public science is critical to the economy and to society. However, much of the beneficial impact of scientific research only occurs when scientific knowledge is disseminated broadly and is used by others. This book examines the emerging policy, law and practice of facilitating open access to scientific research data. One particular focus is to examine the open data policies recently introduced by research funders and publishers, and the potential in these for driving the practice of open scientific data into the future. This study identifies five major stumbling blocks to sustainable open scientific data. Firstly, it is the prevailing mindset that facilitating open access to data is analogous to facilitating open access to publications and, therefore, research data can easily be shared, with research funders and librarians effectively leading the process. Secondly, it is the unclear meaning of the term data which causes confusion among stakeholders. Thirdly, it is the misunderstood incentives for data sharing and the additional inputs required from researchers. Fourthly, data privacy—an issue that only applies to selected research datasets, and yet appears to dominate the discussion about open research data. Finally, there is a copyright law, which poses challenges at different stages of data release and reuse. In this book, it is argued that the above problems can be addressed using a staged model for open scientific data. I draw specifically on the practice with open scientific data at CERN (the European Organization for Nuclear Research) and the practice of sharing clinical trial data to argue that open data can be shared at various stages of processing and diversification. This model is supplemented by recommendations proposing changes to existing open data mandates and the introduction of a text and data mining exemption into Australian copyright law.