The success of recent 3-D stereoscopic movies such as Avatar has created a lot of attention for 3-D in the home. Almost all major consumer electronics (CE) manufacturers have launched their 3-D stereoscopic displays in the market. A problem with those solutions is that viewers have to wear glasses. Glasses-free autostereoscopic 3-D displays typically use lenticular lenses or barriers to create multiple views. However these displays suffer from a number of issues: inverted views at viewing cone transitions, cross-talk between views, and need for multi-view content.  As Philips Electronics research group, we believe that some of these issues can be reduced by using pupil tracking. In the research process, we began with an extensive literature study on people detection and tracking techniques that helped us to understand the benefits and the shortcomings of different applications. Addition to literature studies, we greatly benefited from constant experimentation with prototypes and the hands-on experience with variety of digital and optical components under different conditions. As a result, we designed a multi-person infrared pupil tracker and multi-view renderer for 3D display to adapt the view rendering in real-time according to viewer’s position. Together with the integration of these two applications, the integrated 3D TV successfully adapts the center view according to position of the viewer and able to provide a smooth transition while the viewer actively changes her position from a notable distance under ambient illumination. However, even though the pupil tracker is implemented for multiple people, because of the time limitation and the complexity of the problem regarding multi-view renderer, the integrated system functions only for one person.   Exploring the employed technique, in-depth description and detailed illustration of designed applications and the conclusions drawn from the implemented system; we believe that this paper forms a substantial guidance and show-how source for further research in the field of 3D display and people tracking methods.

This project consists of a prototype of a stereo camera rig where you can mount two DSLR cameras, and a multithreaded software application, written in C++, that can move the cameras, change camera settings and take pictures. The resulting 3D-images can be viewed with a 2-view autostereoscopic display. Camera position is controlled by a step engine which is controlled by a PIC microcontroller. All communication with the PIC and the computer is made over USB. The camera shutters are synchronized so it is possible to take pictures of moving objects at a distance of 2.5 m or more. The results shows that there are several things to do before the prototype can be considered a product ready for the market, most of all the camera callback functionality. / Detta projekt består av en stereokamerarigg som kan bestyckas med två DSLR-kameror, samt en applikation indelad i flera trådar (multithreaded) , skriven i C++, som kan förflytta kamerorna på riggen, ändra fotoinställningar och ra bilder. Resultatet blir 3D-bilder som kan ses på en autostereoskopisk skärm. Kamerornas position kontrolleras med en stegmotor, som i sin tur styrs av en PIC-mikrokontroller. Kommunikationen mellan PIC-enheten och datorn sker via USB. Slutarna på kamerorna är synkroniserade så det är möjligt att ta bilder på objekt i rörelse på ett avstånd av 2,5 m eller mer. Resultaten visar att det är flera punkter som måste åtgärdas på prototypen innan den kan anses vara redo för marknaden. Den viktigaste punkten är att kunna få fungerande respons (callback) från kamerorna.

The main goal of this master’s thesis was get up used methods for observation the stereoscopic scene with one couple of cameras and find out good solving for processing these resulting pictures for two-view and multiple-view autostereoscopic displays for three-dimensional perception. For methods for acquisition video was introduced two methods. They were method “Off-axis” with parallel camera axis and method “Toe in” with intersections axis. For fit method was choice the method named as “Off-axis“. It was not produces the vertical parallax and in detail was in this work described principle of this method. Further were describe principles off used methods for three-dimensional perception namely from the oldest method named anaglyph after methods for viewing at autostereoscopic displays. The Autostereoscopic displays were main goal of this thesis and so their principles were described in details. For production the result image for autostereoscopic displays was used generation intermediate images between left and right camera. Resulting videos were acquisition for testing scene in created in 3D studio Blender, where was possible setting system of cameras exactly parallel axis. Then were introduce principles processing video where was extract from the couple of cameras where were connected to PC for help digitizing card and next time with two web cameras. Here is not guaranteed exact parallel axis system. Therefore this work try for real cameras achieve exactly parallel axis system by the help of transformations of frames with stereo rectification. Stereo rectification was solving with OpenCV libraries and was used two methods. Both methods work from principles epipolar geometry that was described in this work also in detail. First method rectifies pictures on the basis fundamental matrix and found correspondences points in two images of the scene and second method rectifies pictures from knowledge intrinsic and extrinsic parameters of stereoscopic system of cameras. In the end of this work was described application for implementation introduced methods.

Táto práca sa zaoberá návrhom a implementáciou nástroja, ktorý umožní používať klasické 3D OpenGL aplikácie na tzv. autostereoskopických displayoch s plným využitím ich hĺbkových možností a s minimálnym zásahom od užívateľa. Nástrojom je konverzná vrstva, ktorá umožní transparentne beh OpenGL aplikácií s interným rozšírením o vykreslenie z viacerých pohľadov vo formáte, vhodnom pre 3D display. Motiváciou tejto diplomovej práce je potenciálne rozšírenie tzv. autostereskopických displayov, ktoré je v súčasnosti závislé na cene a dostupnosti špecializovaných aplikácií pre tieto displaye. Text práce sa zaoberá dizajnom takejto vrstvy z pohľadu nutných API volaní, ktoré je potrebné korektne prepísať, aby aplikácie, vytvorené pomocou jednotlivých verzii štandardu OpenGL, pracovali správne, ako aj popisom problémov, ktoré vznikajú použitím rôznych vykreslovacích techník, a ktoré sú motiváciou pre komplexnejšie chovanie nástroja. Na záver práce sú ukážky konverzie programov, dopad na výkonnosť, ako aj identifikácia nedostatkov konverznej vrstvy s návrhmi možných riešení pre ďalší vývoj.

In dieser Arbeit wurden nutzbringende Anwendungsmöglichkeiten für monoskopische und (auto)stereoskopische 3D-Anzeigen in Fahrzeugen theoretisch hergeleitet und empirisch überprüft. Zur Ableitung der Hypothesen wurde für jede Teilaufgabe anhand eines Fragenkatalogs zu den Vor- und Nachteilen von 3D-Anzeigen untersucht, inwieweit deren Bearbeitung davon profitiert, dass Informationen räumlich abgebildet werden. Die erwiesenen 3D-Vorteile wurden zu fünf Kategorien zusammengefasst: Integration, räumliche Kompatibilität, Aufmerksamkeitslenkung, Bildhaftigkeit und Attraktivität. Da der wesentliche 3D-Vorteil für Anzeigen in Fahrzeugen in einer räumlich kompatiblen Informationsdarstellung aus der Fahrerperspektive gesehen wurde, lag der Schwerpunkt der empirischen Arbeit auf 3D-Anzeigen für Fahrerassistenzsysteme (FAS). Am Beispiel einer 3D-Anzeige des Abstandsregeltempomaten (ART) wurde nachgewiesen, dass die Vorteile von 3D-Anzeigen für FAS in einer Erhöhung der Attraktivität und Akzeptanz sowie in einer Verbesserung des unmittelbaren Verständnisses im Vergleich zu 2D-Anzeigen liegen. Gleichzeitig wurden mit optimal gestalteten 3D-Anzeigen keine Nachteile in der Wahrnehmungssicherheit und Ablenkungswirkung festgestellt. Anhand der Literaturanalyse und der empirischen Ergebnisse wurden Gestaltungshinweise für 3D-Anzeigen in Fahrzeugen formuliert. Der erwartete 3D-Vorteil einer kompatiblen Darstellung stellte sich bei einer konstanten Anordnung der Informationen nicht ein, bleibt aber für Aufgaben mit einem kontinuierlichen Abgleich (z.B. Navigation) zu überprüfen. Die stereoskopische Darbietung erbrachte keinen besonderen Nutzen. Das fahrzeugtaugliche ASD erhöhte sogar die Reaktionszeiten. Insgesamt sprechen die Ergebnisse für eine gezielte Verwendung bildhafter monoskopischer 3D-Anzeigen für FAS und ausgewählte räumliche Funktionen, welche sich anhand von Begriffen und abstrakten Symbolen nur schwer erläutern lassen. / This thesis consists of the theoretical deduction and empirical evaluation of useful applications for monoscopic and (auto)stereoscopic 3D-displays in vehicles. For deducting hypotheses concerning the benefits and limits of 3D-displays, each subtask was tested for its potential benefits from a 3D-information presentation using a catalogue of confirmed advantages and disadvantages of 3D-displays. The proven 3D-advantages were summarized in five categories: integration, spatial compatibility, direction of attention, concreteness and attractiveness. Because it was presumed, that 3D-displays in vehicles are especially favorable for representing information about the vehicle surrounding in a 3D-perspective compatible to the drivers view, the empirical part was mainly focused on the application of 3D-displays for driver assistance systems. Using a 3D-display for adaptive cruise control (ACC), a general increase of attractiveness, acceptance and immediate comprehension for 3D-displays in comparison to conventional 2D-displays was confirmed. Simultaneously, well designed 3D-displays did not compromise perceptional safety and driver distraction. Design guidelines for 3D-displays in vehicles were concluded from the evaluation results and from literature analysis. Even though the expected 3D-benefit of spatially compatible information displays from the driver’s perspective was not confirmed for driver assistance systems like ACC with a constant layout of information, it still remains to be tested for continuous matching tasks like navigational checking in cars. The stereoscopic presentation of 3D-displays did not show advantages. On the contrary, an in-vehicle ASD even increased reaction times. In summery, the results suggest a distinctive application of well designed concrete and monoscopic 3D-displays for driver assistance systems and selected spatial functions which are difficult to explain using abstract notions or symbols.