COMP1812 Programming and Scripting

'Ghost' Detector: Anomalous Event Trigger for MS Kinect Point-cloud Recorder

An interesting feature of the Microsoft Kinect depth sensor is the occasional/spurious appearance of 'orbs' in the infra-red camera output.  A number of reports have been made about this, and we have seen them a few times ourselves when working with the device.  Setting aside the heated discussion as to what these 'orbs' are (as they cannot be normally seen by the naked eye), it would be interesting to see how the depth sensor component of the Kinect interprets these anomalies (ie in terms of the resulting point-cloud data).

To this end, we would like you to Design-Build-Test an application that detects orbs in the infra-red camera image, and upon detection, it triggers a recorder, so that the Kinect's point-cloud data output and infra-red video output is captured to disk.

Although the artefact (ie your software) will be a key deliverable, we will also need to see:

  • a requirements specification and plan, developed through background research/study and discussions with your supervisor
  • a detailed and reasoned software design
  • a development plan/log based on the above design
  • a test strategy and log, showing the planned approach to verification and the results of your tests.  As a part of this, you will need to include a method for 'cheating' the Kinect sensor using an infra-red element of a scene that is not in the visible spectrum.

Please make contact with Marc Price if you are interested in this project.


Detecting Physical Misuse of Mobile Devices

damaged phone

Due to the ubiquitous and pervasive nature of mobile devices they are prone to being exposed to a wide variety of potentially hazardous environments and situations. There is a growing interest in being able to monitor and detect exposure to such environments. An example of this is the inclusion of water ingress detectors in many mobile devices that change colour when exposed to water. 

This project aims to extend the kinds of hazards that can be detected by mobile devices. In particular it should look at impact forces and generate notifications of potentially harmful forces. The project would consist of development and evaluation of potential detection techniques using existing sensors and to develop a working prototype logging and notification application.