Microsoft HoloLens Developer's Guide


Book Description

Transform the ways you communicate, create, collaborate, and explore using Microsoft HoloLens About This Book Create immersive augmented reality apps for Microsoft HoloLens from scratch Leverage the powerful HoloLens sensors to interact with real-world motions and gestures and make your app life-like Explore the powerful Unity 5 SDK along with the Windows Unified platform to get the most out of your HoloLens app Who This Book Is For If you are a developer who wants to create augmented reality apps for the Microsoft HoloLens platform, then this is the book for you. Coding experience with C# is assumed. What You Will Learn Design an app for HoloLens that is feasible and attractive to use Add gestures and interact with them Create sounds in the app and place them in a 3D space Use voice generation and voice recognition to make your apps more lifelike Interact with the physical environment to place holograms on top of physical objects Compare HoloLens with the other products and know how to use its strengths Use assets from third parties to enrich our app In Detail HoloLens, Microsoft's innovative augmented reality headset, overlaps holograms into a user's vision of their environment. Your ideas are closer to becoming real when you can create and work with holograms in relation to the world around you. If you are dreaming beyond virtual worlds, beyond screens, beyond pixels, and want to take a big leap in the world of augmented reality, then this is the book you want. Starting off with brainstorming and the design process, you will take your first steps in creating your application for HoloLens. You will learn to add gestures and write an app that responds to verbal commands before gradually moving on creating sounds in the app and placing them in a 3D space. You will then communicate between devices in the boundaries of the UWP model. Style and approach This book takes a step-by-step, practical, tutorial-style approach where you will dive deep into HoloLens app development. You will work with the API and write your own complex scripts that would interact with the powerful HoloLens sensors and with realistic examples, you will be able to create immersive 3D apps for HoloLens.




Microsoft HoloLens By Example


Book Description

Get to grips with HoloLens development as you create mixed reality apps from scratch About This Book Create awesome Augmented Reality (AR) apps for the Microsoft HoloLens platform Unleash the power of Unity SDK for HoloLens to create next generation AR apps Explore the exciting world of gesture control, visual mapping, voice command for apps, and many more cutting edge possibilities with HoloLens Who This Book Is For This book is for developers who have some experience with programming in any of the major languages such as C#, C++, and so on. You do need any knowledge of Augmented Reality development. What You Will Learn Extend the computing experience beyond the flat glass screen by placing and embedding virtual objects holograms) into the physical world Interact with the holograms using gaze, gestures, and voice Enhance the experience with spatial sound Allow multiple users to naturally collaborate with each other Integrate voice commands into your own HoloLens projects Experiment with techniques to better understand the real world Implement a user interface in Mixed Reality Blend the virtual and physical world by making the holograms interact and react to the physical environment In Detail Are you a developer who is fascinated with Microsoft HoloLens and its capabilities? Do you want to learn the intricacies of working with the HoloLens SDK and create your own apps? If so, this is the book for you. This book introduces and demystifies the HoloLens platform and introduces new ways you can interact with computers (Mixed Reality). It will teach you the important concepts, get you excited about the possibilities, and give you the tools to continue exploring and experimenting. You will go through the journey of creating four independent examples throughout the book, two using DirectX and two using Unity. You will learn to implement spatial mapping and gesture control, incorporate spatial sound, and work with different types of input and gaze. You will also learn to use the Unity 5 SDK for HoloLens and create apps with it. Collectively, the apps explore the major concepts of HoloLens, but each app is independent, giving you the flexibility to choose where to start (and end). Style and approach This book takes an example-based approach where you'll build AR apps with increasing difficulty. You will learn more about HoloLens platform as well as AR app development in general.




Programming for Mixed Reality with Windows 10, Unity, Vuforia, and UrhoSharp


Book Description

Develop AI-powered apps and games for HoloLens and mixed reality headsets This is a complete guide to programming AI-powered mixed reality apps with the Windows Mixed Reality platform. Step by step, Dawid Borycki guides you through every type of mixed reality development, from simple 2D to cutting-edge apps for Microsoft HoloLens and immersive headsets. First, you’ll learn to write UWP 2D apps that adapt for any Windows 10 device, transfer camera images to machine learning services, and use mobile sensor readings to control headset content. Then, building on these skills, you’ll master every facet of building cross-platform 3D apps that link augmented reality content to real objects. Advanced Microsoft technology expert Dawid Borycki shows how to: Set up a mixed reality development environment with all the tools you’ll need, including HoloLens and Mixed Reality simulators Write Universal Windows 2D apps for all Windows 10 devices, and adjust their views and capabilities to specific hardware Render media streams, acquire video from world-facing cameras, and detect human faces in those images Generate descriptions of what the user sees, and present them via text or speech Build AI-powered voice-controlled apps with Microsoft Cognitive Services (MCS) Master core concepts and techniques for building 3D mixed reality apps with Unity Format 3D objects with materials to create holograms Add interactions to holograms based on user input Integrate HoloLens capabilities, including air gestures, spatial sound, and mapping




HoloLens Blueprints


Book Description

Unveil the world of mixed reality with HoloLens About This Book Bring holographic insights to existing line-of-business applications, tools, and workflows Focus on developing end-to-end realistic holographic application. Build interactive model scripts and test them in Unity3D and holographic emulators Who This Book Is For This book is targeted at developers and designers working on mixed-reality developments for complex integrated scenarios using HoloLens. What You Will Learn Interact with holograms using different interaction models Develop your first holographic app Integrate holographic applications with cloud systems Visualize data feeds coming from the cloud through holograms Manage the application distribution of enterprise-enabled HoloLens Integrate HoloLens applications with services deployed on Azure Identify and create 3D Assets and Scenes Use HoloLens to explore the Internet of Things In Detail Do you want to create stunning applications with HoloLens? Are you a developer who is fascinated with Microsoft HoloLens and its capabilities? If so, this is the book for you. This book introduces and demystifies the HoloLens platform and shows you different ways of interaction with computers (mixed-reality). You will start your mixed-reality journey by understanding different types of digital reality. You will learn to build your first holographic app. Also, you will understand holographic application integration possibilities within Line of Business Applications using Azure. Moving ahead, you will create Integrated Solutions using IoT with HoloLens. Gradually you'll learn how to create and deploy apps on a device. You will learn to publish application to the store; if you are an enterprise developer, you will also manage and distribute applications for enterprise-enabled or domain-joined HoloLens. Finally, you will develop an end-to-end realistic holographic app, ranging from scenario identification to sketching, development, deployment, and, finally, production. Style and approach The book is a project-based guide to help you to create some really astonishing mixed-reality applications. It will provide end-to-end solutions and enable you to build stunning applications for HoloLens.




HoloLens Beginner's Guide


Book Description

Create interactive and intuitiveness HoloLens applications with ease About This Book Start developing immersive and interactive apps for Microsoft HoloLens Explore the Windows Universal Development platform for HoloLens development Leverage the full set of HoloLens sensors to create mesmerizing apps Who This Book Is For If you are a developer new to Windows Universal development platform and want to get started with HoloLens development, then this is the book for you. No prior experience of C# programming or of the .NET framework is needed to get started with this book. What You Will Learn Write an app that responds to verbal commands Communicate between devices in the boundaries of the UWP model Create sounds in the app and place them in a 3D space Build simple apps that display holograms Interact with the physical environment while taking physical boundaries into account In Detail HoloLens revolutionizes the way we work and interact with the virtual world. HoloLens brings you the amazing world of augmented reality and provides an opportunity to explore it like never before. This is the best book for developers who want to start creating interactive and intuitive augmented reality apps for the HoloLens platform. You will start with a walkthrough of the HoloLens hardware before creating your first app. Next you will be introduced to the various HoloLens sensors and find out how to program them efficiently so that they can interact with the real world seamlessly. Moving on, you will learn how to create smart animations and add video overlay that implements real-time tracking and motion-sensing abilities to your HoloLens app. Finally, you will learn how to test your app effectively.




Beginning Windows Mixed Reality Programming


Book Description

Develop applications and experiences for Microsoft’s HoloLens 2 and other Windows mixed reality devices. This easy-to-follow guide removes the mystery behind creating amazing augmented reality and virtual reality experiences. Mixed reality development tools and resources are provided. Beginning Windows Mixed Reality Programming, 2nd edition clearly explains all the nuances of mixed reality software development. You will learn how to create 3D objects and holograms, interact with holograms using voice commands and hand gestures, use spatial mapping and 3D spatial sound, build with toolkits such as Microsoft's Mixed Reality Toolkit and Unity’s AR Foundation and XR Platform, create intuitive user interfaces, and make truly awe-inspiring mixed reality experiences. This newly revised edition also includes updated content for HoloLens 2 development, including tutorials for new interactions such as hand tracking and eye tracking. What You Will Learn Prototype ideas quickly for the HoloLens 2 and Windows mixed reality devices Get started with Unity, the preferred tool for developing 3D experiences Locate and import 3D models for your project, or make your own Use spatial sound, voice commands, gestures, hand tracking, and eye tracking Build with Microsoft's Mixed Reality Toolkit and other toolkits to make apps the easy way Publish to the Windows Store and make money from your app Who This Book Is For Programmers looking to quickly learn how to create experiences for HoloLens 2. Also for programmers interested in building applications for the growing crop of virtual reality devices that support the Windows Mixed Reality platform.




Augmented Reality for Developers


Book Description

Build exciting AR applications on mobile and wearable devices with Unity 3D, Vuforia, ARToolKit, Microsoft Mixed Reality HoloLens, Apple ARKit, and Google ARCore About This Book Create unique AR applications from scratch, from beginning to end, with step-by-step tutorials Use Unity 3D to efficiently create AR apps for Android, iOS, and Windows platforms Use Vuforia, ARTookKit, Windows Mixed Reality, and Apple ARKit to build AR projects for a variety of markets Learn best practices in AR user experience, software design patterns, and 3D graphics Who This Book Is For The ideal target audience for this book is developers who have some experience in mobile development, either Android or iOS. Some broad web development experience would also be beneficial. What You Will Learn Build Augmented Reality applications through a step-by-step, tutorial-style project approach Use the Unity 3D game engine with the Vuforia AR platform, open source ARToolKit, Microsoft's Mixed Reality Toolkit, Apple ARKit, and Google ARCore, via the C# programming language Implement practical demo applications of AR including education, games, business marketing, and industrial training Employ a variety of AR recognition modes, including target images, markers, objects, and spatial mapping Target a variety of AR devices including phones, tablets, and wearable smartglasses, for Android, iOS, and Windows HoloLens Develop expertise with Unity 3D graphics, UIs, physics, and event systems Explore and utilize AR best practices and software design patterns In Detail Augmented Reality brings with it a set of challenges that are unseen and unheard of for traditional web and mobile developers. This book is your gateway to Augmented Reality development—not a theoretical showpiece for your bookshelf, but a handbook you will keep by your desk while coding and architecting your first AR app and for years to come. The book opens with an introduction to Augmented Reality, including markets, technologies, and development tools. You will begin by setting up your development machine for Android, iOS, and Windows development, learning the basics of using Unity and the Vuforia AR platform as well as the open source ARToolKit and Microsoft Mixed Reality Toolkit. You will also receive an introduction to Apple's ARKit and Google's ARCore! You will then focus on building AR applications, exploring a variety of recognition targeting methods. You will go through multiple complete projects illustrating key market sectors including business marketing, education, industrial training, and gaming. By the end of the book, you will have gained the necessary knowledge to make quality content appropriate for a range of AR devices, platforms, and intended uses. Style and approach This book adopts a practical, step-by-step, tutorial-style approach. The design principles and methodology will be explained by creating different modules of the AR app.




Develop Microsoft HoloLens Apps Now


Book Description

This is the first book to describe the Microsoft HoloLens wearable augmented reality device and provide step-by-step instructions on how developers can use the HoloLens SDK to create Windows 10 applications that merge holographic virtual reality with the wearer’s actual environment. Best-selling author Allen G. Taylor explains how to develop and deliver HoloLens applications via Microsoft’s ecosystem for third party apps. Readers will also learn how HoloLens differs from other virtual and augmented reality devices and how to create compelling applications to fully utilize its capabilities. What You Will Learn: The features and capabilities of HoloLens How to build a simple Windows 10 app optimized for HoloLens The tools and resources contained in the HoloLens SDK How to build several HoloLens apps, using the SDK tools




Introducing Windows 10 for IT Professionals


Book Description

Get a head start evaluating Windows 10--with technical insights from award-winning journalist and Windows expert Ed Bott. This guide introduces new features and capabilities, providing a practical, high-level overview for IT professionals ready to begin deployment planning now. This edition was written after the release of Windows 10 version 1511 in November 2015 and includes all of its enterprise-focused features. The goal of this book is to help you sort out what’s new in Windows 10, with a special emphasis on features that are different from the Windows versions you and your organization are using today, starting with an overview of the operating system, describing the many changes to the user experience, and diving deep into deployment and management tools where it’s necessary.




Robust Automatic Speech Recognition


Book Description

Robust Automatic Speech Recognition: A Bridge to Practical Applications establishes a solid foundation for automatic speech recognition that is robust against acoustic environmental distortion. It provides a thorough overview of classical and modern noise-and reverberation robust techniques that have been developed over the past thirty years, with an emphasis on practical methods that have been proven to be successful and which are likely to be further developed for future applications.The strengths and weaknesses of robustness-enhancing speech recognition techniques are carefully analyzed. The book covers noise-robust techniques designed for acoustic models which are based on both Gaussian mixture models and deep neural networks. In addition, a guide to selecting the best methods for practical applications is provided.The reader will: - Gain a unified, deep and systematic understanding of the state-of-the-art technologies for robust speech recognition - Learn the links and relationship between alternative technologies for robust speech recognition - Be able to use the technology analysis and categorization detailed in the book to guide future technology development - Be able to develop new noise-robust methods in the current era of deep learning for acoustic modeling in speech recognition - The first book that provides a comprehensive review on noise and reverberation robust speech recognition methods in the era of deep neural networks - Connects robust speech recognition techniques to machine learning paradigms with rigorous mathematical treatment - Provides elegant and structural ways to categorize and analyze noise-robust speech recognition techniques - Written by leading researchers who have been actively working on the subject matter in both industrial and academic organizations for many years