| Group |
2022-18 |
Status |
completed |
| Title |
A real-time system for building construction inspection using Mixed Reality and Computer Vision |
| Supervisor |
M. Amer, P.H. Chen (BCEE) |
| Description |
During the inspection of a construction project, architects and engineers need to identify, track, resolve, and record the state and progress of several work items that are being executed at the same time. This generates big amounts of information and data that need to be carefully recorded and then used to track progress in order to start actions and other processes required to fix or finish certain work. In that context, the necessity of adopting and developing technology to make the construction inspection process automated and more efficient, becomes of great significance for the construction industry. This project aims to tackle this problem by integrating mixed reality (MR) technology and object detection algorithms in the construction inspection process. The objective is to create a system that can use consumer-grade cameras and available image processing techniques to recognize construction defects, as well as record and track the construction process in real time.
The capstone team will be required to develop a user interface (UI) for the Microsoft HoloLens that is able make a holographic mark-up of the construction site, detect cracks on walls by using object detection algorithms and other annotations such as drawings by taking advantage of the hand tracking capabilities of the head mounted display.
|
| Requirement |
1. Programming (C#, Python)
2. Image processing
3. Object Detection
4. Deep learning
|
| Tools |
Microsoft HoloLens 2
1. Windows OS
2. Unity
3. Visual studio
4. Linux
|
| Number of Students |
6 |
| Students |
A. Ihdene, R. Hong, B. Grant, W. Chen, J.R. Monegro, J. Perlman |
| Comments: |
|
| Links: |
|