GARY NG


Spatial Gamification Toolkit

Role: Sole Developer (MyDesignLab)
Duration: February 2017 - June 2017
Technology: Unity (C#), HoloLens

The Spatial Gamification Toolkit is an augmented reality level editor that can be used to create interactive games and narratives for the HoloLens. Using a 3D situated trigger-action programming interface, basic logic can be applied to game objects to create interactive scenarios. The Spatial Gamification Toolkit was presented at ISUVR 2017.

  • Designed and implemented a first-person, spatial trigger-action programming interface
  • Conducted user studies to evaluate and determine the usability of the application

ShareDesign

Role: Project Leader and Lead Programmer (MyDesignLab)
Duration: March 2016 - February 2017
Technology: Unity (C#), Project Tango

ShareDesign is an augmented reality application for couples designing their living room. Using Project Tango technology, the application provides users with virtual workspaces and multiple view modes in a synchronized 3D environment. ShareDesign was presented at ISUVR 2017.

  • Combined Project Tango spatial technology with the Unity networking system to create a realtime synchronized environment
  • Lead usability workshops and user studies to refine and analyze the application

Tip Tap Mat

Role: Industrial Designer and Programmer
Duration: April 2016 - October 2016
Technology: Arduino

Tip Tap Mat is a smart door mat which allows you to open locked doors with your feet. By using your feet to tap the correct combination on the mat, a wireless signal is sent to the unlocker which unlocks a digital lock. Tip Tap Mat was invited to demo at the Global Grad Show of Dubai Design Week 2016.

  • Designed, assembled, and programmed the core Arduino components
  • 3D printed and laser cut materials to build the console and unlocking components
Website

Gesture Based Interface for Remote Inspection Tasks with UAVs

Role: Programmer (MyDesignLab)
Duration: November 2015 - December 2015
Technology: Unity (C#)

This is a multi-device interface that utilizes touch and gesture based inputs to control virtual UAVs in an inspection task. This was published and presented at the 2016 KSDS Spring Conference.

  • Integrated an Oculus Rift, Intel RealSense F200 Camera, and a Nexio Touch Frame into a single system
  • Combined familiar 2D surface gestures for map navigation with in-air gestures for 3D tasks in virtual reality
Paper

MaXit Education

Role: Software Developer Intern (BeaconWall)
Duration: June 2012 - September 2012
Technology: Windows MFC (C++), Web (HTML, CSS, JavaScript, PHP), Databases (SQL)

MaXit Education is an educational tool that gives opportunites to instructors to evaluate and assess students using videos and comments.

  • Successfully took over an existing code base and expanded it to add network, web, and mobile features
  • Demonstrated the product to the client, Hong Kong Baptist University, to obtain feedback on usability and functionality

Select Academic Publications


Kapralos, B., Shewaga, R., & Ng, G. (2014). Serious games: Customizing the audio-visual interface. Lecture Notes in Computer Science, 8526 LNCS(PART 2), 190–199. [doi]

Shewaga, R., Knox, A., Ng, G., Kapralos, B., & Dubrowski, A. (2013). Z-DOC: A serious game for z-plasty procedure training. Studies in Health Technology and Informatics, 184, 404–406. [doi]

For a full list of my publications please see my Google Scholar page.