1. Track Ball, Paddle and Count How Many Times Ball Hits Paddle in Video Game

Size: px

Start display at page:

Download "1. Track Ball, Paddle and Count How Many Times Ball Hits Paddle in Video Game"

Leona Oliver
5 years ago
Views:

1. Track Ball, Paddle and Count How Many Times Ball Hits Paddle in Video Game Your program needs to track the ball (or balls) and the paddle in each of the video game frame sequences below.

g., a green rectangle) is drawn around each ball in each frame of the video where they are present.

A ZIP file with individual frame JPEG files that constitute the sequence is provided. The frame rate of each sequence is 60 frames per second. A frame sequence should serve as input for your program.

1 1. Track Ball, Paddle and Count How Many Times Ball Hits Paddle in Video Game Your program needs to track the ball (or balls) and the paddle in each of the video game frame sequences below. The program also needs to count how many times a ball hits the paddle. It is up to you if the count starts from zero or from one. Your program should produce a video where a mask (e.g., a red rectangle) is drawn around the paddle and a mask of a different color (e.g., a green rectangle) is drawn around each ball in each frame of the video where they are present. The number of times the ball or balls hit the paddle should be visible in each frame where the paddle is present. For instance, you can put this number above the paddle. A ZIP file with individual frame JPEG files that constitute the sequence is provided. The frame rate of each sequence is 60 frames per second. A frame sequence should serve as input for your program. The frame sequences were generated using a free video game SDL-BALL [ The number of frames and the duration of your video should match the number of frames and duration in the input frame sequence. To simplify grading your submission, you may upload your videos into Youtube and embed them in this wiki as described in this tutorial. Embedding your videos is optional. Even if you embed the videos, you still must attach the video file into the wiki. Attaching your output videos is MANDATORY. Sequence Name Input Video (embed) Frame JPEGs (ZIP file) Example Output Fram SDL-BALL-1 sdl-ball-1.zip 1 of 6 2/21/12 11:49 AM

Please make sure that the code is formatted properly and the instructions for reproducing the output videos are provided together with the

2 SDL-BALL-2 sdl-ball-2.zip SDL-BALL-3 sdl-ball-3.zip Code You only need to solve this problem in one language. Please use the correct code block and delete the other one that you won't use. Please make sure that the code is formatted properly and the instructions for reproducing the output videos are provided together with the code. If you use third-party libraries other than OpenCV and MATLAB, then make sure that the code is referenced and that it is possible to obtain it to reproduce your results. Insert C or C++ code OR Insert MATLAB code 2 of 6 2/21/12 11:49 AM

2. Track Wrist, Block, and Object during Manipulation Your program has to track the robot or human wrist, the block (i.e., a brick or a ball that the robot grasps first), and the object (i.e., the basket that the robot grasps second) in each manipulation video frame sequence below.

Your program should produce a video where the center of each tracked feature is clearly indicated (e.g., using circles of different colors).

Once the feature re-appears, its tracking should be restored. A ZIP file with JPEG files for each frame in the sequence is provided. The robot recorded video at 15 frames per second.

3 2. Track Wrist, Block, and Object during Manipulation Your program has to track the robot or human wrist, the block (i.e., a brick or a ball that the robot grasps first), and the object (i.e., the basket that the robot grasps second) in each manipulation video frame sequence below. The program also needs to draw the path of the robot's wrist, the container, and the object through the manipulation sequence. Your program should produce a video where the center of each tracked feature is clearly indicated (e.g., using circles of different colors). The path of the tracked features should through the video should be also shown. If a feature is occluded or leaves the frame, then it should not be tracked during that frame. Once the feature re-appears, its tracking should be restored. A ZIP file with JPEG files for each frame in the sequence is provided. The robot recorded video at 15 frames per second. Please use 30 or 60 frames per second for your video with tracking to speed up play back, which will simplify grading. It is advised to put a label in your video that gives the speedup factor (e.g., 2x if your video is generated at 30fps or 4x if it is generated at 60fps). To simplify grading of your submission, you may upload your videos with tracking into Youtube and embed them in this wiki as described in this tutorial. Embedding your videos is optional. Even if you embed the videos, you still must attach the video files into the wiki. Attaching your output videos is MANDATORY. Sequence Name Input Video (embed) Frame JPEGs (ZIP file) Example Output Frame Trial 185 trial- 185.zip 3 of 6 2/21/12 11:49 AM

4 Trial 1 trial-1.zip Trial 91 trial- 91.zip Code You only need to solve this problem in one language. Please use the correct code block and delete the other one that you won't use. Please make sure that the code is formatted properly and the instructions for reproducing the output videos are provided together with the code. If you use third-party libraries other than OpenCV and MATLAB, then make sure that the code is referenced and that it is possible to obtain it to reproduce your results. Insert C or C++ code OR Insert MATLAB code 4 of 6 2/21/12 11:49 AM

5 3. EXTRA CREDIT: Track Mouse Cursor Write a program to track the mouse cursor hovering over Google home page. Your program should draw a mask (e.g., a green rectangle) over the tracked location of the mouse pointer. In addition, your program should also draw the path of mouse through the sequence of frames. The color model may change abruptly through the video. A ZIP file with JPEG file for each frame in the sequence is provided. Please use 30 or 60 frames per second for your video with tracking to speed up play back. To simplify grading of your submission, you may upload your videos with tracking into Youtube and embed them in this wiki as described in this tutorial. Embedding your videos is optional. Even if you embed the videos, you still must attach the video files into the wiki. Attaching your output videos is MANDATORY. Sequence Name Input Video (embed) Frame JPEGs (ZIP file) Output Video (attachment) Output Video (embed) Mouse 1 mouse-1.zip Link your output video attachment Embed your output video 5 of 6 2/21/12 11:49 AM

6 Mouse 2 mouse-2.zip Link your output video attachment Embed your output video Code You only need to solve this problem in one language. Please use the correct code block and delete the other one that you won't use. Please make sure that the code is formatted properly and the instructions for reproducing the output videos are provided together with the code. If you use third-party libraries other than OpenCV and MATLAB, then make sure that the code is referenced and that it is possible to obtain it to reproduce your results. Insert C or C++ code OR Insert MATLAB code hw3_template.txt Last modified: 2012/02/05 23:53 by sukhoy 6 of 6 2/21/12 11:49 AM

Students with perfect pitch are not exempt from solving this problem. The note must be detected by the program and not by the programmer.

Students with perfect pitch are not exempt from solving this problem. The note must be detected by the program and not by the programmer. List of Audio Libraries and References The following list of C libraries and references for audio processing is provided for convenience only. You are not required to use any of these libraries or to browse