Goal of this project is to use the information of a 2D/3D camera for video surveillance. First, an appropriate camera platform has to be built using a high resolution CCD sensor and a low resolution Infrared-Time-of-Flight sensor for the third dimension. Then, we plan to merge the two sensors and analyze the data on the camera itself. Instead of merging the sensors by simply overlaying the values, we want to use the information from both sensors to solve typical and novel surveillance tasks. These tasks could be for example reliable detection of objects of interest, exact tracking of moving objects, or the measurement of distance, length, and velocity without complex calibration. With this approach, it should be possible to solve the task of video surveillance without a human actively watching the video.