Capstone Project

Back to listing
Group 2016-9 Status completed
Title Mobile and Online Tracking of Video Object
Supervisor Dr. Maria A. Amer
Description Good but fast methods for tracking (following) objects in video sequences are on high demand in many applications such as augmented reality (AR), virtual reality (VR), e-toys, or even commerce. Robust object tracking methods are computational expensive and cannot be run as is in online systems (networks) or on mobile devices. The first major problem with mobile devices (online systems) is that visual data provided are often noisy, of low resolution, have strong compression artifacts, degraded due to lighting and other adverse effects. The second major problem is limited computing capabilities, memory, and power. On the other side, diverse input sensors such as cameras, GPS, IMU, or orientation sensors, enable the fusion of data, which in turn support video processing algorithms under these challenging visual conditions. One solution to the first problem is parameter optimization of the tracking method so to achieve good QoS/QoE (Quality of Service/Quality of Experience) at a low cost. A second solution is cloud computing where tracking is to perform on the cloud and communicate results to the cell phone. Another solution is to use other input sensors than the camera to support object tracking. The objective of this project is to implement a video tracking method on a simplified online network or/and a mobile device so it runs on real-time using either parameter optimization (tracker configuration), cloud/server computing, and/or depth and orientation data. What objects to track for what application is an option to be selected based on the student interest and creativity, for example, they may select video tracking of children in schools, or of tourist attractions, etc.
Requirement Solid background in DSP (Elec442 DSP course).
Tools Solid background in C++ and in cloud & mobile programming
Number of Students 3
Students
Comments: [1] https://www.youtube.com/watch?v=_yz3kjMj5i4 [2] http://ieeexplore.ieee.org/document/6166663/ [3] http://www.robots.ox.ac.uk/~olaf/bib/prisacariu15mobilephone.pdf [4] https://www.intorobotics.com/how-to-detect-and-track-object-with-opencv/ [5] Struck tracker, http://www.robots.ox.ac.uk/~tvg/publications/2015/struck-author.pdf [6] “Mobile visual computing in C++ on Android”, ACM SIGGRAPH, 2013. [7] www.nttdocomo.co.jp/english/binary/pdf/corporate/technology/rd/technical_journal/bn/vol9_3/vol9_3_028en.pdf
Links: