Upload
claudia-rivera
View
25
Download
0
Tags:
Embed Size (px)
DESCRIPTION
a general approach to Environment Design. Haoqi Zhang David Parkes Yiling Chen Krzysztof Gajos Eric Huang. Harvard University School of Engineering and Applied Sciences. Interested Party. Environment. Agent. I like couch. Interested Party. Environment. Agent. - PowerPoint PPT Presentation
Citation preview
a general approach to Environment Design
Haoqi ZhangDavid Parkes Yiling Chen Krzysztof Gajos Eric Huang
Harvard UniversitySchool of Engineering and Applied Sciences
Interested Party Environment Agent
I like couch
http://www.courier-journal.com/blogs/
poore/uploaded_images/
homer_running-754097.jpg
http://www.courier-journal.com/blogs/
poore/uploaded_images/
homer_running-754097.jpg
Interested Party Environment Agent
DONUTS!?
design environment desired behavior
design environment
actions
agent function
design environment
goal
actions
agent function
design environment
goal
?? ?
change environment
observe behavior
θtrue
environment actions
actionsenvironment
θtrue
θ'
desired actionsenvironment
θtrue
θ'environment
actual actionsenvironment
actions
θtrue
environment
actual actionsenvironment
actions
θtrue
environment
actual actionsenvironment
actions
Application to Amazon Mechanical Turk
# images
# tags
reward
time allotted expiration date
# of HITS
approval process
Design task Observe results
Automatic Task Design
Worker model
View Model Accept Model Effort model
post position,site activity
rateofviews
reward, work amount
% of accepts
reward, 1 / work amount
unit outputquality
Project is currently in pilot
θtrue
Environment Design in the real world
senselearn
modeloptimize
knowadapt
enhance
thanks!