The demand for Advanced Driver Assistance System (ADAS) applications is increasing day by day and their development requires efficient prototyping and real time testing. ADTF (Automotive Data and Time Triggered Framework) is a software tool from Elektrobit which is used for Development, Validation and Visualization of Vision based applications, mainly for ADAS and Autonomous driving. With the help of ADTF tool, Image or Video data can be recorded and visualized and also the testing of data can be processed both on-line and off-line. The development of ADAS applications needs image and video processing and the algorithm has to be highly efficient and must satisfy Real-time requirements. The main objective of this research would be to integrate OpenCV library with ADTF cross platform. OpenCV libraries provide efficient image processing algorithms which can be used with ADTF for quick benchmarking and testing. An ADTF filter framework has been developed where the OpenCV algorithms can be directly used and the testing of the framework is carried out with .DAT and image files with a modular approach. CMake is also explained in this thesis to build the system with ease of use. The ADTF filters are developed in Microsoft Visual Studio 2010 in C++ and OpenMP API are used for Parallel programming approach.

Over the past decades, congestion and emission problems has increased remarkablywhich escalates the demands on vehicles. The advancements withinthe eld of information and communication systems gives the opportunity todeal with the aforementioned problems. The concept of platooning shows tobe an attractive way of reducing both congestion and emissions by having ashort inter-vehicle spacing. The ndings in studies show that fuel reductionpotentials of 5-20 % are viable as a result of the lowered air drag by drivingin platoon. This thesis investigates the state of the art within the areaof intelligent transport systems (ITS) along with advanced driver assistancesystems (ADAS). Furthermore, the prosecuted work results in a proposedcontrol design for a longitudinal control in a platoon of vehicles. The platoonconsists of two homogeneous radio controlled vehicles (RCV) which aremodelled by taking advantage of system identication methods. The identi-ed plant models are implemented into a Simulink model where the controlsystem is developed. Moreover, the developed control system is implementedinto a real-time demonstrator for experimental evaluation. The results showsthat the modelled dynamics corresponds reasonably well with the real dynamicsof the system. The developed control system proves to work well andagree with the expectations of its performance obtained from simulations.The performance of the proposed controller has been evaluated by means ofsimulations and real experiments. The resulting control system consists ofPID controllers for both speed and spacing control. / Under de senaste decennierna har mangden trakstockningar och problemmed utslapp okat - darmed aven kraven pa vara fordon. Samtidigt skaparframstegen inom informations- och kommunikationssystem mojligheter foratt hantera ovannamnda problem. Kolonnkorning, eller platooning har visatsig vara en eektiv metod for att minska saval trakstockningar som utslappsom en foljd av kortare avstand mellan fordon. Resultat fran studier visarhur en branslereduktion runt 5-20 % ar mojlig till foljd av det sankta luftmotstandet vid kolonnkorning. Avhandlingen undersoker teknikens standpunktinom intelligenta transportsystem (ITS) tillsammans med avancerade drivhjalpsystem(ADAS). Vidare resulterar arbetet i ett forslag till regleringsdesignfor en longitudinell kontroll i en kolonn av fordon. Kolonnen bestar av tvahomogena radiostyrda fordon (RCV) som modelleras genom att utnyttjametoder for systemidentiering. De identierade systemmodellerna implementerasi en Simulink-modell dar styrsystemet utvecklas. Dessutom implementerasdet utvecklade styrsystemet i en realtids-demonstration for experimentellutvardering. Resultaten visar att den modellerade dynamikenstammer bra overens med systemets verkliga dynamik. Det utvecklade styrsystemetvisar sig fungera bra och overensstammer med forvantningarna pa dessprestanda som erhallits genom simuleringar. Den foreslagna regulatorns prestandahar utvarderats med hjalp av simuleringar och verkliga experiment.Det resulterande styrsystemet bestar av PID regulatorer for bade hastighetsochavstandskontroll.

This thesis consists of two projects focusing on how 5G can be used to make vehicles safer. The first project focuses on conceptualizing near-future use cases of how Advanced Driver Assistance Systems (ADAS) can be enhanced through 5G technology. Four concepts were developed in collaboration with various industry partners. These concepts were successfully demonstrated in a proof-of-concept at the 5G Automotive Association (5GAA) “The 5G Path of Vehicle-to-Everything Communication: From Local to Global” conference in Turin, Italy. This proof-of-concept was the world’s first demonstration of such a system. The second project focuses on a futuristic use case, namely remote operation of semi-autonomous vehicles (sAVs). As part of this work, it was explored if augmented reality (AR) can be used to warn remote operators of dangerous events. It was explored if such augmentations can be used to compensate during critical events. These events are defined as occurrences in which the network conditions are suboptimal, and information provided to the operator is limited. To evaluate this, a simulator environment was developed that uses eye- tracking technology to study the impact of such scenarios through user studies. The simulator establishes an extendable platform for future work. Through experiments, it was found that AR can be beneficial in spotting danger. However, it can also be used to directly affect the scanning patterns at which the operator views the scene and directly affect their visual scanning behavior. / Denna avhandling består av två projekt med fokus på hur 5G kan användas för att göra fordon säkrare. Det första projektet fokuserar på att konceptualisera användningsfall i närmaste framtid av hur Advanced Driver Assistance Systems (ADAS) kan förbättras genom 5G-teknik. Fyra koncept utvecklades i samarbete med olika branschpartner. Dessa koncept demonstrerade i ett proof-of- concept på 5G Automotive Association (5GAA) “5G Path of Vehicle to to Everything Communication: From Local to Global” -konferensen i Turin, Italien. Detta bevis-of-concept var världens första demonstration av ett sådant system. Det andra projektet fokuserar på ett långt futuristiskt användningsfall, nämligen fjärrstyrning av semi-autonoma fordon (sAVs). Som en del av detta arbete undersöktes det om augmented reality (AR) kan användas för att varna fjärroperatörer om farliga händelser. Det undersöktes om sådana förstärkningar kan användas för att kompensera under kritiska händelser. Dessa händelser definieras som händelser där nätverksförhållandena är suboptimala och information som tillhandahålls till operatören är begränsad. För att utvärdera detta utvecklades en simulatormiljö som använder ögonspårningsteknologi för att studera effekterna av sådana scenarier genom en användarstudie. Simulatorn bildar en utdragbar plattform för framtida arbete. Genom experiment fann man att AR kan vara fördelaktigt när det gäller att upptäcka fara. Men det kan också användas för att direkt påverka skanningsmönstret där operatören tittar på scenen och direkt påverka deras visuella skanningsbeteende.

Models based on micro-simulation of traffic flows have proven to be useful tools in the study of various traffic systems. Today, there is a wealth of traffic microsimulation models developed for freeway and urban street networks. The road mileage is however in many countries dominated by rural highways. Hence, there is a need for rural road traffic simulation models capable of assessing the performance of such road environments. This thesis introduces a versatile traffic micro-simulation model for the rural roads of today and of the future. The developed model system considers all common types of rural roads including effects of intersections and roundabouts on the main road traffic. The model is calibrated and validated through a simulation study comparing a two-lane highway to rural road designs with separated oncoming traffic lanes. A good general agreement between the simulation results and the field data is established. The interest in road safety and the environmental impact of traffic is growing. Recent research has indicated that traffic simulation can be of use in these areas as well as in traditional capacity and level-of-service studies. In the road safety area more attention is turning towards active safety improving countermeasures designed to improve road safety by reducing the number of driver errors and the accident risks. One important example is Advanced Driver Assistance Systems (ADAS). The potential to use traffic simulation to evaluate the road safety effects of ADAS is investigated in the last part of this thesis. A car-following model for simulation of traffic including ADAS-equipped vehicles is proposed and the developed simulation framework is used to study important properties of a traffic simulation model to be used for safety evaluation of ADAS. Driver behavior for ADAS-equipped vehicles has usually not been considered in simulation studies including ADAS-equipped vehicles. The work in this thesis does however indicate that modeling of the behavior of drivers in ADAS-equipped vehicles is essential for reliable conclusions on the road safety effects of ADAS. / <p>Report code: LiU-Tek-Lic-2005:60.</p>

Advanced Vehicle Systems promise improved safety and comfort for drivers. Steady advancements in technology are resulting in increasing levels of vehicle automation capabilities, furthering safety benefits. In fact, some of these vehicle automation systems are already deployed and available, but with promised benefits, such systems can potentially change driving behaviors. There is evidence that drivers have increased secondary task engagements while driving with automated vehicle systems, but there is a need for a clearer scientific understanding of any potential correlations between the use of automated vehicle systems and potentially negative driver behaviors. Therefore, this thesis aims to understand the state of knowledge on automated vehicle systems and their possible impact on drivers’ distraction behaviors. I have conducted two systematic literature reviews to examine this question. This thesis reports these reviews and examines the effects of secondary task engagement on driving behaviors such as take-over times, visual attention, trust, and workload, and discusses the implications on driver safety.

No description available.

In the field of modern automotive engineering, many researchers are focusing on the development of advanced vehicle control systems such as autonomous vehicle systems and Advanced Driver Assistance Systems (ADAS). Furthermore, Driver Assistance Systems (DAS) such as cruise control, Anti-Lock Braking Systems (ABS), and Electronic Stability Control (ESC) have become widely popular in the automotive industry. Therefore, vehicle control research attracts attention from both academia and industry, and has been an active area of vehicle research for over 30 years, resulting in impressive DAS contributions. Although current vehicle control systems have improved vehicle safety and performance, there is room for improvement for dealing with various situations. The objective of the research is to develop a predictive vehicle control system for improving vehicle safety and performance for autonomous vehicles and ADAS. In order to improve the vehicle control system, the proposed system utilizes information about the upcoming local driving environment such as terrain roughness, elevation grade, bank angle, curvature, and friction. The local driving environment is measured in advance with a terrain measurement system to provide terrain data. Furthermore, in order to obtain the information about road conditions that cannot be measured in advance, this work begins by analyzing the response measurements of a preceding vehicle. The response measurements of a preceding vehicle are acquired through Vehicle-to-Vehicle (V2V) or Vehicle-to-Infrastructure (V2I) communication. The identification method analyzes the response measurements of a preceding vehicle to estimate road data. The estimated road data or the pre-measured road data is used as the upcoming driving environment information for the developed vehicle control system. The metric that objectively quantifies vehicle performance, the Performance Margin, is developed to accomplish the control objectives in an efficient manner. The metric is used as a control reference input and continuously estimated to predict current and future vehicle performance. Next, the predictive control algorithm is developed based on the upcoming driving environment and the performance metric. The developed system predicts future vehicle dynamics states using the upcoming driving environment and the Performance Margin. If the algorithm detects the risks of future vehicle dynamics, the control system intervenes between the driver's input commands based on estimated future vehicle states. The developed control system maintains vehicle handling capabilities based on the results of the prediction by regulating the metric into an acceptable range. By these processes, the developed control system ensures that the vehicle maintains stability consistently, and improves vehicle performance for the near future even if there are undesirable and unexpected driving circumstances. To implement and evaluate the integrated systems of this work, the real-time driving simulator, which uses precise real-world driving environment data, has been developed for advanced high computational vehicle control systems. The developed vehicle control system is implemented in the driving simulator, and the results show that the proposed system is a clear improvement on autonomous vehicle systems and ADAS. / Ph. D. / In the field of modern automotive engineering, many researchers are focusing on the development of advanced vehicle control systems such as autonomous vehicle systems and Advanced Driver Assistance Systems (ADAS). Furthermore, cruise control, Anti-Lock Braking Systems, and Electronic Stability Controls have become widely popular in the automotive industry. Although vehicle control systems have improved vehicle safety and performance, there is still room for improvement for dealing with various situations. The objective of the research is to develop a predictive vehicle control system for improving vehicle safety and performance for autonomous vehicles and ADAS. In order to improve the vehicle control system, the proposed system utilizes information about the upcoming driving conditions such as road roughness, elevation grade, bank angle, and curvature. The driving environment is measured in advance with a terrain measurement system. Furthermore, in order to obtain the information about road conditions that cannot be measured in advance, this work begins by analyzing a preceding vehicle’s response to the road. The combined road data is used as the upcoming driving environment information. The measurement that indicates vehicle performance, the Performance Margin, is developed to accomplish the research objectives. It is used in the developed control system, which predicts future vehicle performance. If the system detects future risks, the control system will intervene to correct the driver’s input commands. By these processes, the developed system ensures that the vehicle maintains stability, and improves vehicle performance regardless of the upcoming and unexpected driving conditions. To implement and evaluate the proposed systems, a driving simulator has been developed. The results show that the proposed system is a clear improvement on autonomous vehicle systems and ADAS.

Scenario-based testing will help to validate automated driving systems (ADS) and establish safer road traffic. To date, most data-driven test scenario generation methods rely primarily on one data source such as police accident data (PD), naturalistic driving studies, or video-based traffic observations (VOs). However, none of these data sources perfectly satisfies all the layers of the six-layer model for the description of test scenarios. Moreover, not all available data sources cover the same location and period of time. Therefore, we fused information from 1,648 scenarios extracted from a German VO with information from 74 scenarios extracted from German PD into a comprehensive new PD* database. Finally, PD* consisted of 74 accident scenarios extended, for example, by variables containing the dynamic information of the VO scenarios. Thus, PD* contained more than 350 variables, whereas PD contained only 269 and VO only 122 variables. For fusion, we followed the Find-Unify-Synthesize-Evaluation (FUSE) for Representativity (FUSE4Rep) process model using statistical matching. Subsequently, we derived three logical scenarios from PD* to test an autonomous emergency braking system (AEB) in a stochastic traffic simulation incorporating driver-behavior models. The quality of the fusion itself was satisfactory, and we propose improving the VO data collection process and observation time to obtain even better results.

The development of driver assistance and automated vehicle control is in process and finds its way more and more into urban traffic environments. Here, the complexity of traffic situations is highly challenging and requires system approaches to comprehend such situations. The key element is the process of situation assessment to identify critical situations in advance and derive adequate warning and intervention strategies. This thesis introduces a system approach to establish a situation assessment process with the focus on the prediction of the driver intention. The system design is based on the Situation Awareness model by Endsley. Further, a prediction algorithm is created using Hidden Markov Models. To define the parameters of the models, an existing database is used and previously analyzed to identify reasonable variables that indicate an intended driving direction while approaching the intersection. Here, vehicle dynamics are used instead of driver inputs to enable a further extension of the prediction, i.e.\\ to predict the driving intention of other vehicles detected by sensors. High prediction rates at temporal distances of several seconds before entering the intersection are accomplished. The prediction is integrated in a system for situation assessment including an intersection model. A Matlab tool is created with an interface to the vehicle CAN bus and the intersection modeling which uses digital map data to establish a representation of the intersection. To identify differences and similarities in the process of approaching an intersection dependent on the intersection shape and regulation, a naturalistic driving study is conducted. Here, the distance to the intersection and velocity is observed on driver inputs related to the upcoming intersection (leaving the gas pedal, pushing the brake, using the turn signal). The findings are used to determine separate prediction models dependent on shape and regulation of the upcoming intersection. The system runs in real-time and is tested in a real traffic environment. / Die Entwicklung von Fahrerassistenz und automatisiertem Fahren ist in vollem Gange und entwickelt sich zunehmend in Richtung urbanen Verkehrsraum. Hier stellen besonders komplexe Verkehrssituationen sowohl für den Fahrer als auch für Assistenzsysteme eine Herausforderung dar. Zur Bewältigung dieser Situationen sind neue Systemansätze notwendig, die eine Situationsanalyse und -bewertung beinhalten. Dieser Prozess der Situationseinschätzung ist der Schlüssel zum Erkennen von kritischen Situationen und daraus abgeleiteten Warnungs- und Eingriffsstrategien. Diese Arbeit stellt einen Systemansatz vor, welcher den Prozess der Situationseinschätzung abbildet mit einem Fokus auf die Prädiktion der Fahrerintention. Das Systemdesign basiert dabei auf dem Situation Awareness Model von Endsley. Der Prädiktionsalgorithmus ist mit Hilfe von Hidden Markov Modellen umgesetzt. Zur Bestimmung der Modellparameter wurde eine existierende Datenbasis genutzt und zur Bestimmung von relevanten Variablen für die Prädiktion der Fahrtrichtung während der Kreuzungsannäherung analysiert. Dabei wurden Daten zur Fahrdynamik ausgewählt anstelle von Fahrereingaben um die Prädiktion später auf externe Fahrzeuge mittels Sensorinformationen zu erweitern. Es wurden hohe Prädiktionsraten bei zeitlichen Abständen von mehreren Sekunden bis zum Kreuzungseintritt erzielt. Die Prädiktion wurde in das System zur Situationseinschätzung integriert. Weiterhin beinhaltet das System eine statische Kreuzungsmodellierung. Dabei werden digitale Kartendaten genutzt um eine Repräsentation der Kreuzung und ihrer statischen Attribute zu erzeugen und die der Kreuzungsform entsprechenden Prädiktionsmodelle auszuwählen. Das Gesamtsystem ist als Matlab Tool mit einer Schnittstelle zum CAN Bus implementiert. Weiterhin wurde eine Fahrstudie zum natürlichen Fahrverhalten durchgeführt um mögliche Unterschiede und Gemeinsamkeiten bei der Annäherung an Kreuzungen in Abhängigkeit der Form und Regulierung zu identifizieren. Hierbei wurde die Distanz zur Kreuzung und die Geschwindigkeit bei Fahrereingaben im Bezug zur folgenden Kreuzung gemessen (Gaspedalverlassen, Bremspedalbetätigung, Blinkeraktivierung). Die Ergebnisse der Studie wurden genutzt um die Notwendigkeit verschiedener Prädiktionsmodelle in Abhängigkeit von Form der Kreuzung zu bestimmen. Das System läuft in Echtzeit und wurde im realen Straßenverkehr getestet.

This research project took part in the SENA project (Autonomous Embedded Navigation System), which was developed at the Mobile Robotics Lab of the Mechatronics Group at the Engineering School of São Carlos, University of São Paulo (EESC - USP) in collaboration with the São Carlos Institute of Physics. Aiming for an autonomous behavior in the prototype vehicle this dissertation focused on deploying some machine learning algorithms to support its perception. These algorithms enabled the vehicle to execute articial-intelligence tasks, such as prediction and memory retrieval for object classication. Even though in autonomous navigation there are several perception, cognition and actuation tasks, this dissertation focused only on perception, which provides the vehicle control system with information about the environment around it. The most basic information to be provided is the existence of objects (obstacles) around the vehicle. In formation about the sort of object it is also provided, i.e., its classication among cars, pedestrians, stakes, the road, as well as the scale of such an object and its position in front of the vehicle. The environmental data was acquired by using a camera and a Velodyne LiDAR. A ceiling analysis of the object detection pipeline was used to simulate the proposed methodology. As a result, this analysis estimated that processing specic regions in the PDF Compressor Pro xii image (i.e., Regions of Interest, or RoIs), where it is more likely to nd an object, would be the best way of improving our recognition system, a process called image normalization. Consequently, experimental results in a data-fusion approach using laser data and images, in which RoIs were found using the LiDAR data, showed that the fusion approach can provide better object detection and classication compared with the use of either camera or LiDAR alone. Deploying a data-fusion classication using RoI method can be executed at 6 Hz and with 100% precision in pedestrians and 92.3% in cars. The fusion also enabled road estimation even when there were shadows and colored road markers in the image. Vision-based classier supported by LiDAR data provided a good solution for multi-scale object detection and even for the non-uniform illumination problem. / Este projeto de pesquisa fez parte do projeto SENA (Sistema Embarcado de Navegação Autônoma), ele foi realizado no Laboratório de Robótica Móvel do Grupo de Mecatrônica da Escola de Engenharia de São Carlos (EESC), em colaboração com o Instituto de Física de São Carlos (IFSC). A grande motivação do projeto SENA é o desenvolvimento de tecnologias assistidas e autônomas que possam atender às necessidades de diferentes tipos de motoristas (inexperientes, idosos, portadores de limitações, etc.). Vislumbra-se que a aplicação em larga escala desse tipo de tecnologia, em um futuro próximo, certamente reduzirá drasticamente a quantidade de pessoas feridas e mortas em acidentes automobilísticos em estradas e em ambientes urbanos. Nesse contexto, este projeto de pesquisa teve como objetivo proporcionar informações relativas ao ambiente ao redor do veículo, ao sistema de controle e de tomada de decisão embarcado no veículo autônomo. As informações mais básicas fornecidas são as posições dos objetos (obstáculos) ao redor do veículo; além disso, informações como o tipo de objeto (ou seja, sua classificação em carros, pedestres, postes e a própria rua mesma), assim como o tamanho deles. Os dados do ambiente são adquiridos através do emprego de uma câmera e um Velodyne LiDAR. Um estudo do tipo ceiling foi usado para simular a metodologia da detecção dos obstáculos. Estima-se que , após realizar o estudo, que analisar regiões especificas da imagem, chamadas de regiões de interesse, onde é mais provável encontrar um obstáculo, é o melhor jeito de melhorar o sistema de reconhecimento. Observou-se na implementação da fusão dos sensores que encontrar regiões de interesse usando LiDAR, e classificá-las usando visão artificial fornece um melhor resultado na hora de compará-lo com os resultados ao usar apenas câmera ou LiDAR. Obteve-se uma classificação com precisão de 100% para pedestres e 92,3% para carros, rodando em uma frequência de 6 Hz. A fusão dos sensores também forneceu um método para estimar a estrada mesmo quando esta tinha sombra ou faixas de cor. Em geral, a classificação baseada em visão artificial e LiDAR mostrou uma solução para detecção de objetos em várias escalas e mesmo para o problema da iluminação não uniforme do ambiente.