Managing Data in Motion


Book Description

Managing Data in Motion describes techniques that have been developed for significantly reducing the complexity of managing system interfaces and enabling scalable architectures. Author April Reeve brings over two decades of experience to present a vendor-neutral approach to moving data between computing environments and systems. Readers will learn the techniques, technologies, and best practices for managing the passage of data between computer systems and integrating disparate data together in an enterprise environment. The average enterprise's computing environment is comprised of hundreds to thousands computer systems that have been built, purchased, and acquired over time. The data from these various systems needs to be integrated for reporting and analysis, shared for business transaction processing, and converted from one format to another when old systems are replaced and new systems are acquired. The management of the "data in motion" in organizations is rapidly becoming one of the biggest concerns for business and IT management. Data warehousing and conversion, real-time data integration, and cloud and "big data" applications are just a few of the challenges facing organizations and businesses today. Managing Data in Motion tackles these and other topics in a style easily understood by business and IT managers as well as programmers and architects. - Presents a vendor-neutral overview of the different technologies and techniques for moving data between computer systems including the emerging solutions for unstructured as well as structured data types - Explains, in non-technical terms, the architecture and components required to perform data integration - Describes how to reduce the complexity of managing system interfaces and enable a scalable data architecture that can handle the dimensions of "Big Data"




IBM InfoSphere Streams Harnessing Data in Motion


Book Description

In this IBM® Redbooks® publication, we discuss and describe the positioning, functions, capabilities, and advanced programming techniques for IBM InfoSphereTM Streams (V1). See: http://www.redbooks.ibm.com/abstracts/sg247970.html for the newer InfoSphere Streams (V2) release. Stream computing is a new paradigm. In traditional processing, queries are typically run against relatively static sources of data to provide a query result set for analysis. With stream computing, a process that can be thought of as a continuous query, that is, the results are continuously updated as the data sources are refreshed. So, traditional queries seek and access static data, but with stream computing, a continuous stream of data flows to the application and is continuously evaluated by static queries. However, with IBM InfoSphere Streams, those queries can be modified over time as requirements change. IBM InfoSphere Streams takes a fundamentally different approach to continuous processing and differentiates itself with its distributed runtime platform, programming model, and tools for developing continuous processing applications. The data streams consumable by IBM InfoSphere Streams can originate from sensors, cameras, news feeds, stock tickers, and a variety of other sources, including traditional databases. It provides an execution platform and services for applications that ingest, filter, analyze, and correlate potentially massive volumes of continuous data streams.




Data Management courseware based on CDMP Fundamentals


Book Description

Besides the courseware publication (ISBN: 9789401807999), you are advised to obtain the DAMA DMBOK publication (ISBN: 9781634622349). Optionally, you can use the publication Data management: a gentle introduction (ISBN: 9789401805506) as inspiration for examples and quotes about the field of data management. This material is intended to prepare participants for the CDMP exam by DAMA International. The courseware can only be ordered by partners and is based on the current version of the DAMA DMBOK. The material will be updated when new versions of DMBOK are published. DAMA DMBOK is the industry reference for data management. It is published by DAMA International and is currently in its second version. The DMBOK is developed by professionals and can be seen as a collection of best practices. The domain of data management is divided into functional areas which are discussed in terms of definitions (what is it), goals (what are we trying to achieve), steps (what are typical activities), inputs/outputs, and participating roles. Developing and sustaining an effective data management function is far from an easy task. The DMBOK framework is adopted by many organizations as the foundation for their data management function: standardized language and good practices speed up the learning process. After the training, you have an overview of the field of data management, its terminology, and current best practices.




Big Data For Dummies


Book Description

Find the right big data solution for your business or organization Big data management is one of the major challenges facing business, industry, and not-for-profit organizations. Data sets such as customer transactions for a mega-retailer, weather patterns monitored by meteorologists, or social network activity can quickly outpace the capacity of traditional data management tools. If you need to develop or manage big data solutions, you'll appreciate how these four experts define, explain, and guide you through this new and often confusing concept. You'll learn what it is, why it matters, and how to choose and implement solutions that work. Effectively managing big data is an issue of growing importance to businesses, not-for-profit organizations, government, and IT professionals Authors are experts in information management, big data, and a variety of solutions Explains big data in detail and discusses how to select and implement a solution, security concerns to consider, data storage and presentation issues, analytics, and much more Provides essential information in a no-nonsense, easy-to-understand style that is empowering Big Data For Dummies cuts through the confusion and helps you take charge of big data solutions for your organization.




Hands-On Big Data Modeling


Book Description

Solve all big data problems by learning how to create efficient data models Key FeaturesCreate effective models that get the most out of big dataApply your knowledge to datasets from Twitter and weather data to learn big dataTackle different data modeling challenges with expert techniques presented in this bookBook Description Modeling and managing data is a central focus of all big data projects. In fact, a database is considered to be effective only if you have a logical and sophisticated data model. This book will help you develop practical skills in modeling your own big data projects and improve the performance of analytical queries for your specific business requirements. To start with, you’ll get a quick introduction to big data and understand the different data modeling and data management platforms for big data. Then you’ll work with structured and semi-structured data with the help of real-life examples. Once you’ve got to grips with the basics, you’ll use the SQL Developer Data Modeler to create your own data models containing different file types such as CSV, XML, and JSON. You’ll also learn to create graph data models and explore data modeling with streaming data using real-world datasets. By the end of this book, you’ll be able to design and develop efficient data models for varying data sizes easily and efficiently. What you will learnGet insights into big data and discover various data modelsExplore conceptual, logical, and big data modelsUnderstand how to model data containing different file typesRun through data modeling with examples of Twitter, Bitcoin, IMDB and weather data modelingCreate data models such as Graph Data and Vector SpaceModel structured and unstructured data using Python and RWho this book is for This book is great for programmers, geologists, biologists, and every professional who deals with spatial data. If you want to learn how to handle GIS, GPS, and remote sensing data, then this book is for you. Basic knowledge of R and QGIS would be helpful.




Executing Data Quality Projects


Book Description

Executing Data Quality Projects, Second Edition presents a structured yet flexible approach for creating, improving, sustaining and managing the quality of data and information within any organization. Studies show that data quality problems are costing businesses billions of dollars each year, with poor data linked to waste and inefficiency, damaged credibility among customers and suppliers, and an organizational inability to make sound decisions. Help is here! This book describes a proven Ten Step approach that combines a conceptual framework for understanding information quality with techniques, tools, and instructions for practically putting the approach to work – with the end result of high-quality trusted data and information, so critical to today's data-dependent organizations. The Ten Steps approach applies to all types of data and all types of organizations – for-profit in any industry, non-profit, government, education, healthcare, science, research, and medicine. This book includes numerous templates, detailed examples, and practical advice for executing every step. At the same time, readers are advised on how to select relevant steps and apply them in different ways to best address the many situations they will face. The layout allows for quick reference with an easy-to-use format highlighting key concepts and definitions, important checkpoints, communication activities, best practices, and warnings. The experience of actual clients and users of the Ten Steps provide real examples of outputs for the steps plus highlighted, sidebar case studies called Ten Steps in Action. This book uses projects as the vehicle for data quality work and the word broadly to include: 1) focused data quality improvement projects, such as improving data used in supply chain management, 2) data quality activities in other projects such as building new applications and migrating data from legacy systems, integrating data because of mergers and acquisitions, or untangling data due to organizational breakups, and 3) ad hoc use of data quality steps, techniques, or activities in the course of daily work. The Ten Steps approach can also be used to enrich an organization's standard SDLC (whether sequential or Agile) and it complements general improvement methodologies such as six sigma or lean. No two data quality projects are the same but the flexible nature of the Ten Steps means the methodology can be applied to all. The new Second Edition highlights topics such as artificial intelligence and machine learning, Internet of Things, security and privacy, analytics, legal and regulatory requirements, data science, big data, data lakes, and cloud computing, among others, to show their dependence on data and information and why data quality is more relevant and critical now than ever before. - Includes concrete instructions, numerous templates, and practical advice for executing every step of The Ten Steps approach - Contains real examples from around the world, gleaned from the author's consulting practice and from those who implemented based on her training courses and the earlier edition of the book - Allows for quick reference with an easy-to-use format highlighting key concepts and definitions, important checkpoints, communication activities, and best practices - A companion Web site includes links to numerous data quality resources, including many of the templates featured in the text, quick summaries of key ideas from the Ten Steps methodology, and other tools and information that are available online




Big Data


Book Description

Striking a balance between the technical characteristics of the subject and the practical aspects of decision making, spanning from fraud analytics in claims management, to customer analytics, to risk analytics in solvency, the comprehensive coverage presented makes Big Data an invaluable resource for any insurance professional.




Data Quality


Book Description

Good data is a source of myriad opportunities, while bad data is a tremendous burden. Companies that manage their data effectively are able to achieve a competitive advantage in the marketplace, while bad data, like cancer, can weaken and kill an organization. In this comprehensive book, Rupa Mahanti provides guidance on the different aspects of data quality with the aim to be able to improve data quality. Specifically, the book addresses: Causes of bad data quality, bad data quality impacts, and importance of data quality to justify the case for data quality Butterfly effect of data quality A detailed description of data quality dimensions and their measurement Data quality strategy approach Six Sigma - DMAIC approach to data quality Data quality management techniques Data quality in relation to data initiatives like data migration, MDM, data governance, etc. Data quality myths, challenges, and critical success factors Students, academicians, professionals, and researchers can all use the content in this book to further their knowledge and get guidance on their own specific projects. It balances technical details (for example, SQL statements, relational database components, data quality dimensions measurements) and higher-level qualitative discussions (cost of data quality, data quality strategy, data quality maturity, the case made for data quality, and so on) with case studies, illustrations, and real-world examples throughout. About the Author Rupa Mahanti, Ph.D. is a Business and Information Management consultant and has worked in different solution environments and industry sectors in the United States, United Kingdom, India, and Australia. She helps clients with activities such as business process mapping, information management, data quality, and strategy. Having a work experience (academic, industry, and research) of more than a decade and half, Rupa has guided a doctoral dissertation and published a large number of research articles. She is an associate editor with the journal Software Quality Professional and a reviewer for several international journals. "This is not the kind of book that you'll read one time and be done with. So scan it quickly the first time through to get an idea of its breadth. Then dig in on one topic of special importance to your work. Finally, use it as a reference to guide your next steps, learn details, and broaden your perspective." from the foreword by Thomas C. Redman, Ph.D., the Data Doc Dr. Mahanti provides a very detailed and thorough coverage of all aspects of data quality management that would suit all ranges of expertise from a beginner to an advanced practitioner. With plenty of examples, diagrams, etc. the book is easy to follow and will deepen your knowledge in the data domain. I will certainly keep this handy as my go-to reference. I can't imagine the level of effort and passion that Dr. Mahanti has put into this book that captures so much knowledge and experience for the benefit of the reader. I would highly recommend this book for its comprehensiveness, depth, and detail. A must-have for a data practitioner at any level. Clint D'Souza, CEO and Director, CDZM Consulting




Customer Data Platforms


Book Description

Master the hottest technology around to drive marketing success Marketers are faced with a stark and challenging dilemma: customers demand deep personalization, but they are increasingly leery of offering the type of personal data required to make it happen. As a solution to this problem, Customer Data Platforms have come to the fore, offering companies a way to capture, unify, activate, and analyze customer data. CDPs are the hottest marketing technology around today, but are they worthy of the hype? Customer Data Platforms takes a deep dive into everything CDP so you can learn how to steer your firm toward the future of personalization. Over the years, many of us have built byzantine “stacks” of various marketing and advertising technology in an attempt to deliver the fabled “right person, right message, right time” experience. This can lead to siloed systems, disconnected processes, and legacy technical debt. CDPs offer a way to simplify the stack and deliver a balanced and engaging customer experience. Customer Data Platforms breaks down the fundamentals, including how to: Understand the problems of managing customer data Understand what CDPs are and what they do (and don't do) Organize and harmonize customer data for use in marketing Build a safe, compliant first-party data asset that your brand can use as fuel Create a data-driven culture that puts customers at the center of everything you do Understand how to use AI and machine learning to drive the future of personalization Orchestrate modern customer journeys that react to customers in real-time Power analytics with customer data to get closer to true attribution In this book, you’ll discover how to build 1:1 engagement that scales at the speed of today’s customers.




Microsoft Cybersecurity Architect Exam Ref SC-100


Book Description

Unlock your potential to pass the SC-100 exam by mastering advanced cloud security strategies, designing zero-trust architectures, and evaluating cybersecurity frameworks with this latest exam guide Purchase of this book unlocks access to web-based exam prep resources such as mock exams, flashcards, exam tips, the eBook PDF Key Features Gain a deep understanding of all topics covered in the latest SC-100 exam Advance your knowledge of architecting and evaluating cybersecurity services to tackle day-to-day challenges Get certified with ease through mock tests with exam-level difficulty Benefit from practical examples that will help you put your new knowledge to work Book DescriptionThis Second Edition of Microsoft Cybersecurity Architect Exam Ref SC-100 is a comprehensive guide that will help cybersecurity professionals design and evaluate the cybersecurity architecture of Microsoft cloud services. Packed with practice questions, mock exams, interactive flashcards, and invaluable exam tips, this comprehensive resource gives you everything you need to conquer the SC-100 exam with confidence. This book will take you through designing a strategy for a cybersecurity architecture and evaluating the governance, risk, and compliance (GRC) of the architecture of both cloud-only and hybrid infrastructures. You'll discover how to implement zero trust principles, enhance security operations, and elevate your organization's security posture. By the end of this book, you'll be fully equipped to plan, design, and assess cybersecurity frameworks for Microsoft cloud environments—and pass the SC-100 exam with flying colors. Ready to take your cybersecurity expertise to the next level? This guide is your key to success.What you will learn Design a zero-trust strategy and architecture Evaluate GRC technical and security operation strategies Apply encryption standards for data protection Utilize Microsoft Defender tools to assess and enhance security posture Translate business goals into actionable security requirements Assess and mitigate security risks using industry benchmarks and threat intelligence Optimize security operations using SIEM and SOAR technologies Securely manage secrets, keys, and certificates in cloud environments Who this book is for This book targets is for IT professionals pursuing the Microsoft Cybersecurity Architect Expert SC-100 certification. Familiarity with the principles of administering core features and services within Microsoft Azure, Microsoft 365 and on-premises related technologies (server, active directory, networks) are needed. Prior knowledge of integration of these technologies with each other will also be beneficial.