Demonstration of a Virtual Reality Driving Simulation Platform


Book Description

"Modern autonomous driving is undergoing a period of rapid evolution. Image processing, computer vision, and remote sensing, among others, have played crucial roles in the creation of safe and reliable robotic automobiles. However, some robotic vehicles still have difficulties in their driving mechanisms even though the current mainstream autonomous driving approaches seem to be effective in fulfilling driving duties. There have been several high-profile incidents in the early years of testing that have prompted some to question whether or not all relevant domains have been explored in order to attain human-like driving. The current sensor technique based on machine learning needs training miles logged while actually driving. The public's safety is at risk, however, during on-road testing. Furthermore, sensor data is not as effective as a vigilant human driver who has intelligent gaze behavior to promote safe driving over extended distances. The use of human-inspired algorithms to decide when and where to sample the visual world may allow autonomous cars to digest data more efficiently. Thus, I believe that a driving simulation platform strikes a good middle ground between the need of data collection on human drivers and the ethical considerations inherent in collecting data when people are really driving. The combination of human perception and autonomous driving may be studied with the use of an integrated eye-tracker in the platform. The goal of this dissertation is to build a VR driving simulation platform that can be used to investigate a wide range of issues. This environment is a virtual reality 3D engine Unity for HTC Vive head-mounted display (HMD), providing a realistic driving experience. I created a simulated driving environment similar to a tunnel to evaluate the fidelity of this platform in real-world conditions. The platform's data was compared to previously published on-road studies, such as driving speed and lateral lane position. To prove our platform's use as a research tool, I compare the results of this driving simulator with those of real-world road testing. In addition, a Tobii eye-tracker has been included in the HMD to record the drivers' eye movements, including their 3D gaze point of regard (POR), during the evaluation. The data set were assessed for the correlations with driving behaviors. Contributions of this study consist of the following parts: 1) developed an affordable, modular, and realistic simulation platform that is capable of being utilized and extended to multiple research fields, such as perception, psychology, animation, game design, computer science; 2) built the connection between driving behaviors and the gaze database; 3) established component models that benefit researchers for future usage."--Abstract.




Driving in Virtual Reality


Book Description

In the last decades, there has been a substantial increase in the development of complex active safety systems for automotive vehicles. These systems need to be tested for verification and validation to ensure that the system intervenes in the correct situations using the correct measures. There are multiple methods available to perform such testing. Software-in-the-loop and hardware-in-the-loop testing offer effective driverless testing. Other methods increase the fidelity by including human drivers, such as driving simulators and experiments performed at test tracks. This thesis examines vehicle-in-the-loop testing, an innovative method where the driver of a real vehicle wears a head-mounted display that displays virtual targets. This method combines the benefits of driving simulators with the benefits of using a real vehicle on a test track. Driving simulators offer repeatability, safety, and the possibility of complex interactions between actors. In contrast, the real vehicle provides the correct vehicle dynamics and motion feedback. There is a need to know how the technology behind the method might influence the results from vehicle-in-the-loop testing. Two techniques for vehicle-in-the-loop systems are studied. The first involves video-see through head-mounted displays, where the focus of the research is on the effects of visual latency on driving behavior. The results show that lateral driving behavior changes with added latency, but longitudinal behavior appears unaffected. The second system uses an opaque head-mounted display in an entirely virtual world. The research shows that this solution changes speed perception and results in a significant degradation in performance of tasks dependent on visual acuity. This research presents results that are relevant to consider when developing vehicle-in-the-loop platforms. The results are also applicable when choosing scenarios for this test method. Dagens fordon innehåller fler och fler säkerhetssystem. Vissa av dessa system ger varningar i potentiellt kritiska trafiksituationer. Det finns också mer komplexa system som tillfälligt kan ta kontroll över fordonet för att förhindra en olycka eller åtminstone mildra effekterna. Komplexiteten hos dessa system innebär att man måste genomföra omfattande tester. Både för att se att systemen reagerar vid rätt tidpunkt, men också för att se att valet av åtgärd är korrekt. Det finns många olika sätt att testa dessa system. Man börjar vanligtvis med simuleringar av programvara och hårdvara. Därefter kan systemet introduceras i ett fordon för att se vilka effekter systemet har när det interagerar med en riktig förare. Att utföra tester med förare ställer dock höga säkerhetskrav, och det är ofta svårt att samordna komplexa trafiksituationer på en testbana. Traditionellt har körsimulatorer varit ett naturligt alternativ eftersom de kan utföra komplexa scenarier i en säker miljö. Denna avhandling undersöker en testmetod där man utrustar föraren med en virtual reality-display. Genom att presentera omvärlden med hjälp av virtual reality, så kan man genomföra scenarion som tidigare varit omöjliga på en testbana. Det kan dock finnas inbyggda begränsningar i virtual reality tekniken som kan påverka körbeteendet. Det är därför viktigt att hitta och kvantifiera dessa effekter för att kunna lita på resultaten från testmetoden. Att känna till dessa effekter på körbeteendet dessutom kan hjälpa till att avgöra vilka typer av scenarier som är lämpade för denna testmetod. Det är också viktig information för att avgöra var man bör fokusera den tekniska utvecklingen av testutrustningen.




Distributed Moving Base Driving Simulators


Book Description

Development of new functionality and smart systems for different types of vehicles is accelerating with the advent of new emerging technologies such as connected and autonomous vehicles. To ensure that these new systems and functions work as intended, flexible and credible evaluation tools are necessary. One example of this type of tool is a driving simulator, which can be used for testing new and existing vehicle concepts and driver support systems. When a driver in a driving simulator operates it in the same way as they would in actual traffic, you get a realistic evaluation of what you want to investigate. Two advantages of a driving simulator are (1.) that you can repeat the same situation several times over a short period of time, and (2.) you can study driver reactions during dangerous situations that could result in serious injuries if they occurred in the real world. An important component of a driving simulator is the vehicle model, i.e., the model that describes how the vehicle reacts to its surroundings and driver inputs. To increase the simulator realism or the computational performance, it is possible to divide the vehicle model into subsystems that run on different computers that are connected in a network. A subsystem can also be replaced with hardware using so-called hardware-in-the-loop simulation, and can then be connected to the rest of the vehicle model using a specified interface. The technique of dividing a model into smaller subsystems running on separate nodes that communicate through a network is called distributed simulation. This thesis investigates if and how a distributed simulator design might facilitate the maintenance and new development required for a driving simulator to be able to keep up with the increasing pace of vehicle development. For this purpose, three different distributed simulator solutions have been designed, built, and analyzed with the aim of constructing distributed simulators, including external hardware, where the simulation achieves the same degree of realism as with a traditional driving simulator. One of these simulator solutions has been used to create a parameterized powertrain model that can be configured to represent any of a number of different vehicles. Furthermore, the driver's driving task is combined with the powertrain model to monitor deviations. After the powertrain model was created, subsystems from a simulator solution and the powertrain model have been transferred to a Modelica environment. The goal is to create a framework for requirement testing that guarantees sufficient realism, also for a distributed driving simulation. The results show that the distributed simulators we have developed work well overall with satisfactory performance. It is important to manage the vehicle model and how it is connected to a distributed system. In the distributed driveline simulator setup, the network delays were so small that they could be ignored, i.e., they did not affect the driving experience. However, if one gradually increases the delays, a driver in the distributed simulator will change his/her behavior. The impact of communication latency on a distributed simulator also depends on the simulator application, where different usages of the simulator, i.e., different simulator studies, will have different demands. We believe that many simulator studies could be performed using a distributed setup. One issue is how modifications to the system affect the vehicle model and the desired behavior. This leads to the need for methodology for managing model requirements. In order to detect model deviations in the simulator environment, a monitoring aid has been implemented to help notify test managers when a model behaves strangely or is driven outside of its validated region. Since the availability of distributed laboratory equipment can be limited, the possibility of using Modelica (which is an equation-based and object-oriented programming language) for simulating subsystems is also examined. Implementation of the model in Modelica has also been extended with requirements management, and in this work a framework is proposed for automatically evaluating the model in a tool.




Extensions for Distributed Moving Base Driving Simulators


Book Description

Modern vehicles are complex systems. Different design stages for such a complex system include evaluation using models and submodels, hardware-in-the-loop systems and complete vehicles. Once a vehicle is delivered to the market evaluation continues by the public. One kind of tool that can be used during many stages of a vehicle lifecycle is driving simulators. The use of driving simulators with a human driver is commonly focused on driver behavior. In a high fidelity moving base driving simulator it is possible to provide realistic and repetitive driving situations using distinctive features such as: physical modelling of driven vehicle, a moving base, a physical cabin interface and an audio and visual representation of the driving environment. A desired but difficult goal to achieve using a moving base driving simulator is to have behavioral validity. In other words, A driver in a moving base driving simulator should have the same driving behavior as he or she would have during the same driving task in a real vehicle.". In this thesis the focus is on high fidelity moving base driving simulators. The main target is to improve the behavior validity or to maintain behavior validity while adding complexity to the simulator. One main assumption in this thesis is that systems closer to the final product provide better accuracy and are perceived better if properly integrated. Thus, the approach in this thesis is to try to ease incorporation of such systems using combinations of the methods hardware-in-the-loop and distributed simulation. Hardware-in-the-loop is a method where hardware is interfaced into a software controlled environment/simulation. Distributed simulation is a method where parts of a simulation at physically different locations are connected together. For some simulator laboratories distributed simulation is the only feasible option since some hardware cannot be moved in an easy way. Results presented in this thesis show that a complete vehicle or hardware-in-the-loop test laboratory can successfully be connected to a moving base driving simulator. Further, it is demonstrated that using a framework for distributed simulation eases communication and integration due to standardized interfaces. One identified potential problem is complexity in interface wrappers when integrating hardware-in-the-loop in a distributed simulation framework. From this aspect, it is important to consider the model design and the intersections between software and hardware models. Another important issue discussed is the increased delay in overhead time when using a framework for distributed simulation.




Virtual, Augmented and Mixed Reality: Interaction, Navigation, Visualization, Embodiment, and Simulation


Book Description

This two-volume set LNCS 10909 and 10910 constitutes the refereed proceedings of the 10th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2018, held as part of HCI International 2018 in Las Vegas, NV, USA. HCII 2018 received a total of 4346 submissions, of which 1171 papers and 160 posters were accepted for publication after a careful reviewing process. The 65 papers presented in this volume were organized in topical sections named: interaction, navigation, and visualization in VAMR; embodiment, communication, and collaboration in VAMR; education, training, and simulation; VAMR in psychotherapy, exercising, and health; virtual reality for cultural heritage, entertainment, and games; industrial and military applications.




Autonomous Vehicles and Virtual Reality


Book Description

This book concisely describes the technologies, human perception, and cognition issues relevant to autonomous vehicles. It also gives an insight in the changes bring about our future everyday lives. Autonomous vehicles are the future of the automobile industry. Automated driving (AD), also called self-driving, raises however several multiple questions, among them those of user safety and acceptation. Comprehensive HMI system design, with windshield display technics, will be necessary to deal with driving task delegations, bringing the use of VR or augmented reality (AR) technologies. In addition, the use of VR for all the vehicle interiors will progressively be proposed for entertainment, online business activities and for modified visual motion perception to alleviate car sickness, a form of motion sickness. Indeed, car sickness is already well known for many passengers, especially when reading or operating smartphones or other display devices. It is called to increase significantly with the introduction of autonomous vehicles where all users will be for long periods in various sitting positions. These two new trends, AD and VR, are already modifying our relationship with the world and the society. All together, they will change our way of life forever. The book will be of interest to professionals in the auto industry, researchers in automotive engineering and computer science and all those interested in the future of transport.




Honors Thesis


Book Description

The primary way to test safety-critical driver vehicle systems is via driving simulators and this is particularly true for multi-vehicle Connected and Autonomous Vehicle (CAV) systems. Currently, it is difficult to implement a virtual reality environment to incorporate virtual traffic that can accurately identify and respond to a human-controlled virtual car. Moreover, the update time of the virtual traffic and human controlled car is often different between typical traffic-simulation software versus the software used to display driver situations within simulators, making it difficult to study the simulations simultaneously. To address these issues, this project enables two simulators based on two different software to interact with each other. The goal is to develop an algorithm to create a bridge between a virtual car simulator and a traffic simulator developed in AIMSUN such that both the simulators can interact with each other in a time-synchronized manner. Each simulator will be able to see the other simulator and react based on the input it receives. The goal of this thesis is to develop algorithms that will allow a simultaneous and smooth co simulation of these two simulators as described above. The thesis will focus on developing these algorithms, comparing them and analyzing their accuracy. This interaction will enhance the working of the simulators and provide a new dimension to virtual reality simulators.




Vehicle Simulation


Book Description

This book covers the problem of fidelity in the design of virtual environments with specific reference to the design of vehicle simulators. The default design goal has been on the physical replication of a given real-world environment and, in the case of vehicles, the specific appearance and function of vehicle components. This book discusses that perceptual, rather than physical, fidelity of a virtual environment, should be the design goal and the principal purpose is to produce human behavior. This book provides the rationale and design guidance to maximize perceptual fidelity in the development of virtual environments, and therefore maximize the costeffectiveness as well.




Virtual Reality Headsets - A Theoretical and Pragmatic Approach


Book Description

The purpose of virtual reality is to make possible a sensorimotor and cognitive activity for a user in a digitally created artificial world. Recent advances in computer technology have led to a new generation of VR devices such as VR headsets. Accordingly, virtual reality poses many new scientific challenges for researchers and professionals. The aim of this book, a manual meant for both designers and users of virtual reality, is to present the current state of knowledge on the use of VR headsets in the most complete way possible. The book is divided into 13 chapters. The objective of the first chapter is to give an introduction to VR and clarify its scope. The next chapter presents a theoretical approach to virtual reality through our Immersion and Interaction methodology also known as "3I2 model’’. Then, a chapter about human senses is necessary to understand the sensorimotor immersion, especially vision. These chapters are followed by several chapters which present the different visual interfaces and the VR headsets currently available on the market. These devices can impart comfort and health problems due to sensorimotor discrepancies. A chapter is devoted to these problems, followed by a chapter that gives a detailed discussion of methods and 32 solutions to dispel, or at least to decrease, VR sickness. The following three chapters present different VR applications that use VR headsets (behavioural sciences, industrial uses and Digital Art) and the final chapter provides conclusions and discusses future VR challenges.




Virtual Reality Software & Technology


Book Description

Few technologies in recent years have attracted as much scientific, media and public attention as Virtual Reality. By providing a profoundly new paradigm for human-computer interaction, it is fundamentally changing the way people use and think about computers. Despite being in its infancy, Virtual Reality has found applications in such varied fields as entertainment, interactive arts, medicine, architecture, security, education, and financial analysis.The articles collected here were selected after thorough review and describe the state-of-the-art in Virtual Reality software and technology. Included are the latest results in software architectures, interaction techniques and devices, modeling techniques, and applications.