Upload
leon-milton-french
View
218
Download
0
Tags:
Embed Size (px)
Citation preview
Live Action First Person Shooter Game
Patrick Judd
Ian Katsuno
Bao Le
Inspiration
Inspired by the “Real Time Color Replacement” Project (2009)
Wanted to combine their invisibility effect with a Duck Hunt style game
http://en.wikipedia.org/wiki/Duck_Hunt http://www.eecg.toronto.edu/~pc/courses/432/2009/projects/colorreplacement.pdf
How our game works
Camera captures the game stage and displays it on a monitor
People/objects which enter the stage become targets
User shoots targets on the monitor with a gun controller
When a target is hit, it disappears (invisibility effect)
Revised Project Goal
Two foreseen difficulties1. Custom HW interface for gun controller
2. Tracking multiple targets Revised project goals
1. Use a mouse instead of a gun controller
2. Restrict number of supported targets to one
Initial System Block DiagramCamera
Video Decoder
Mouse
Serial Port Driver
RAM-live image
-reference image
MicroBlaze Processor
Target Locator
RAM-Modified image
Target Drawer
Draw B/W Image*
Video Encoder
Monitor
Light gun
Optional
Target Manager
Hit/Miss Analyzer
Analog
Digital
Video_to_ram
Target Locator
Compares reference image to live image
A difference in color indicated a target
Encodes targets location as:
(x min, y min)
(x max, y max)
Memory
Microblaze
Reference Image Live Image
(x min, y min) (x max, y max)
Target Locator
Reference Image
Live Image
Target Location
PS/2 Mouse
FPS requires: High Precision Quick Response Time
Replaced Light Gun as input.
No ECE532 project has used it!
Mouse Operation
Xilinx IP: XPS_Ps2 v1.00a Communicates with Microblaze over PLB SW Initialization: predefined sequence of
byte codes Interrupts on action (move or click) Receives info packets in ISR
Software – Target Manger
Tracks movement of target based on coordinates from the target locator Needs to distinguish an old target from a new
target Compares target location to mouse
coordinates to detect “hits” Remembers if a target has be hit
Target Remover Gets coordinates of box to
remove from microblaze(x min, y min) (x max, y max)
If (pixel is in box)read from reference image
Elseread from live image
Memory
Microblaze
Reference Image Live Image
(x min, y min) (x max, y max)
Target Remover
Output Image
Video Encoder
Design Flow - Hardware
Start with simple custom core to read and write to memory
Create verilog testbench and simulate core Compare output waveforms with spec Test core in hardware Incrementally add functionality
Design Flow - Software
Wrote algorithms and data structures in Linux Integrated into microblaze code Debugged microblaze software using xps gdb
Problem - Mouse Initialization
Initialization: Send and receive a sequence of byte-codes
Problem: Mouse wouldn’t follow script!Debug:
Tried to isolate the problem:Tried mouse on other PCRead Registers using XMD
Solution: Get another mouse!
Problem - Mouse Buffer Overflow
Problem: Buffer overflow interrupt occur
Debug: Decrease sample rate Receive more than one packet in ISR?
Solution: Printf too slow, Remove it!
Problem – Custom Logic
Target Locator core worked correctly in simulation
However the core did not function in hardware
Tried a variety of debug methods but could not isolate the cause of the problem LEDs and switches Chipscope XPS hdl simulator
Problem – Custom Logic
Solution: Use mem_to_ip/ip_to_mem core from “Real Time
Color Replacement” Project Used their FSMs to perform memory reads and
writes Added our own target locator logic Also move target remover functionality to software
Problem - Integration
the ps2 core caused erroneous target detection when it was added to the project
possibly due to bus read errors We are currently unable to find a solution
For the demo
Two demos too show functionality of parts of the design before integration, in lieu of the ps2 – detection issue
For the demo
1. Target locator reading the video signal and sending target information to microblaze
Video Decoder
RAM- live image
-reference image
MicroBlaze Processor
Target Locator
Video Encoder
For the demo
2. Mouse to video interface and target remover functionality
Video Decoder
Mouse
Serial Port Driver
RAM
-live image-reference image
MicroBlaze Processor
Video Encoder
Target Manager
Hit or Miss Analyzer
Lessons learned
Don’t try to reinvent the wheel We spend a lot of timing trying to recreate what
other group had already done instead of focusing on the “new” aspects of our project
Lessons learned
Our approach to hardware debugging was less than ideal We had
multiple group members debugging independently used different methods
Should have decided on the best method concentrated our efforts
Conclusion
Could not produce a fully functioning project However
Learned valuable lessons in project management Were the first group to use a ps2 mouse with their
project Will add this to the ece532 knowledge base