We present investigation and designing of a system that interacts with big audience, sitting in a dimmed theater environment. The goal is to automatically detect audiences and some of their actions. Test results indicate that because of low light condition we can’t rely on RGB camera footage in a dimmed environment. We use Microsoft Kinect Sensor to collect data from environment. Kinect is designed to be used with Microsoft Xbox 360 for gaming purposes. It has both RGB and Infrared depth camera. Change in amount of visible light doesn’t affect data from depth camera. Kinect is not a strong camera so it has limitations that we should deal with. Viewing angles of both cameras and depth range of Infrared camera are limited. Viewing angles of depth camera are 43° vertical and 57° horizontal. Most accurate range of depth camera is 1 meter to 4 meters from camera. Non-infrared reflective surfaces cause gaps in depth data. We evaluate possibility of using Kinect camera in a large environment with big audience. “Dome 3D theater” in Norrkoping Visualization Center C, is selected as environment to investigate and test the system. We ran some tests to find the best place and best height for camera to have most coverage. Our system works with optimized image processing algorithms that use 3D depth data instead of regular RGB or Grayscale image. We use “libfreenect”, Open Kinect library to get Kinect sensor up and running. C++ and OpenGL are used as programing languages and graphics interface, respectively. Open GLUT (OpenGL Utility Toolkit) is used for system’s user interface. It was not possible to use Dome environment for every test during the programming period so we recorded some depth footage and used for later tests. While evaluating the possibility of using Kinect in Dome environment, we realized that implementing a voting system would make a good demonstration and test application. Our system counts votes after audiences raise their hands to vote for something.

<p>The progression of technical development has yielded practicable camera systems for the acquisition of so called depth maps, images with depth information. </p><p>Images and movies with depth information open the door for new types of applications in the area of computer graphics and vision. That implies that they will need to be processed in all increasing volumes.</p><p>Increased depth image processing puts forth the demand for a standardized data format for the exchange of image data with depth information, both still and animated. Software to convert acquired depth data to such videoformats is highly necessary. </p><p>This diploma thesis sheds light on many of the issues that come with this new task group. It spans from data acquisition over readily available software for the data encoding to possible future applications. </p><p>Further, a software architecture fulfilling all of the mentioned demands is presented. </p><p>The encoder is comprised of a collection of UNIX programs that generate MPEG Z/Alpha, an MPEG2 based video format. MPEG Z/Alpha contains beside MPEG2's standard data streams one extra data stream to store image depth information (and transparency). </p><p>The decoder suite, called TexMPEG, is a C library for the in-memory decompression of MPEG Z/Alpha. Much effort has been put into video decoder parallelization, and TexMPEG is now capable of decoding multiple video streams, not only in parallel internally, but also with inherent frame synchronization between parallely decoded MPEG videos.</p>

The progression of technical development has yielded practicable camera systems for the acquisition of so called depth maps, images with depth information. Images and movies with depth information open the door for new types of applications in the area of computer graphics and vision. That implies that they will need to be processed in all increasing volumes. Increased depth image processing puts forth the demand for a standardized data format for the exchange of image data with depth information, both still and animated. Software to convert acquired depth data to such videoformats is highly necessary. This diploma thesis sheds light on many of the issues that come with this new task group. It spans from data acquisition over readily available software for the data encoding to possible future applications. Further, a software architecture fulfilling all of the mentioned demands is presented. The encoder is comprised of a collection of UNIX programs that generate MPEG Z/Alpha, an MPEG2 based video format. MPEG Z/Alpha contains beside MPEG2's standard data streams one extra data stream to store image depth information (and transparency). The decoder suite, called TexMPEG, is a C library for the in-memory decompression of MPEG Z/Alpha. Much effort has been put into video decoder parallelization, and TexMPEG is now capable of decoding multiple video streams, not only in parallel internally, but also with inherent frame synchronization between parallely decoded MPEG videos.