MotionPro Team 2 Delphine Mweze, Elizabeth Cole, Jinbang Fu, May Oo Advisor: Professor Bardin Preliminary Design Review 1
Project Description Our team is going to design and build a gaming machine that projects a game on any flat surface The machine detects motion of a finger to control the game We will be using a microcontroller and pico-projector to display the video game and detect motion using a camera and sensors 2
Significance and Societal Impacts Affordable and portable Implementation of augmented reality Step toward hologram gaming Less expensive than other gaming devices Educational purpose 3
Requirements-Specifications Negligible delay during gameplay: Camera + Projector resolution 10,692,096 pixels Frames to find hand locations, interpret locations, update game state, output image 4 bytes per pixel (RGBA) 3,072,000 bytes per frame Processing speed of at least 460MHz required Small compact size and energy efficiency High resolution game with multiple options Bright and visible in normal room lighting 4
High Level Block Diagram Raspberry Pi Raspbian OS Camera (Hand Motion) Speaker Image Processing Coordinate Detection Class Interfaces + Ultrasonic Sensors (Hand Location) Main() Game Program Projector Power Supply 5
Distribution of Responsibilities Delphine Class Interfaces Data Processing Game code to graphics Elizabeth Coordinates detection PCB design Projection optics May Fu Power supply Ultrasonic sensor circuits Game programming Edge detection Motion detection Pi Camera 6
Pi Camera - May 5 MegaPixel Camera Ability to detect motion accurately in real time Camera resolution: 2592 x 1944 pixel Video resolution: 720p 60 fps, 480p 60fps Low power consumption Support Raspberry Pi Operating system Requirement: 30 frames/ second Approx. $25 https://www.amazon.com/gp/product/b00e1gge40/ref=ox_sc_act_title_1?ie=utf8&psc=1&smid=a20u1p78vrgmgr 7
Motion Detection - May Using C++ and OpenCV Image Processing Edge Detection Edge Detection Motion Detection Motion Detection filter() outline() getedgedetection() framedifference() threshold() gethanddirection() 8
Motion Detection - May http://www.entangler.in/uploads/2/5/5/1/25517561/6413877_orig.png http://www.entangler.in/uploads/2/5/5/1/25517561/1685908_orig.png 9
Ultrasonic Sensors - Elizabeth Ultrasonic sensors Operate at 40 khz Sends out sound Times how long it takes for reflection to come back Positioned at base of system facing projection https://www.teachengineering.org/lessons/view/umo_sensorswork_lesson0 6 10
Coordinate Detection - Elizabeth Coordinate Detection Finger localization Convert P(x,y) in projection to P (x,y) in the game Using ultrasonic sensors 11
Ultrasonic Sensors Circuit - Fu Based on the circuit of ultrasonic sensor HC-SR04 http://s1367.photobucket.com/ user/monica_jing/media/4e0b 8F7D_zpsc74db897.jpg.html https://electrosome.com/wp-content/uploads/2014/08/h C-SR04-Ultrasonic-Sensor.jpg 12
Ultrasonic Sensors Circuit - Fu Reasons to rebuild the circuit: Need at least 10 sensors to detect the coordinates of the hand For HC-SR04, each sensor has 4 pins, which means the microcontroller needs to have at least 40 I/O pins Our microcontroller does not have enough pins Need the transmitter and the receiver to be more compact 13
Microprocessor - Delphine Raspberry Pi 3 Model B Power efficient HDMI out capability Compatible with IR camera Image data processing Output of game data to projector http://www.mcmelectronics.com/product/raspberry-pi-raspberrypi-modb -1GB-/83-17300 14
Microprocessor - Delphine Camera to Pi configuration Multi-threading Game data to video conversion Class Interfaces between image algorithms, sensor signals and game Main () Code to Graphics Algorithm Image Data Sensor Data 15
Game Programming - Fu Program with C++ Snake(accompany with background music) Users only move left, right, up and down User can choose different difficulties and modes Snake can only go left, right, up and down http://www.igyaan.in/wp-content/uploads/20 15/10/snake-game.jpg http://mobile.my-symbia n.com/s60v3 /grafika/sna ke.png 16
Projector - Elizabeth Challenges: Height needed in projection Projection brightness vs room ambiance Fixing optical distortion of angled projection Projector Specifications: Resolution of at least 480p HDMI connection Portable (pocket-sized) Less than 2 pounds Under $150 17
Power Supply - Fu Battery (12V) Low Pass Filter Linear Regulator 12V rechargeable battery Sallen-key low-pass filter LM 1117 For the linear regulator 5V 12V http://www.getfpv.com/lum enier-1300mah-3s-35c-lipo -battery.html? Low Pass Filter http://datasheetcafe.databank.netdna-cdn.com/ wp-content/uploads/2015/09/lm1117-image. gif https://en.wikipedia.org/wiki/ Sallen%E2%80%93Key_top ology 18
Budget Component Cost Projector $120 Camera $25 Microprocessor Power Supply $36 $90 PCB $33 Total $304 19
Alternative Approaches Custom built microcontroller Advantages Disadvantages IR camera for coordinate detection Less components Faster processing speed Less expensive Less space occupied Compatibility issues Higher risk of failure Less drivers Need high resolution 20
MDR Deliverables Functioning edge detection and motion detection without noisy background (May) Raspberry Pi receiving game input and sending game output (Delphine) Successful projection of game and detection of hand coordinates (Elizabeth) Programmed snake game and power supply design (Fu) 21
Questions? 22