15
BusyB A data collection system created for Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012

A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

  • Upload
    others

  • View
    16

  • Download
    0

Embed Size (px)

Citation preview

Page 1: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

BusyBA data collection system created for

Pixar Animation Studios.

Iris CheungAdvisor: Kimiko Ryokai

Friday, May 4, 2012

Page 2: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

the scene

✦ Pixar uses proprietary, developed-in-house digital animation software

✦ Software gets new features and improvements for each upcoming movie

✦ It is critical that the software perform quickly and without error

Friday, May 4, 2012

Page 3: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

measuring so!ware performance

✦ People don’t like slow software.

✦ When an artist or group of artists starts to experience slow or unresponsive software, happiness level at Pixar goes down.

✦ It is important for the software support team at Pixar to quickly diagnose slowness issues, for the sake of everyone’s happiness... that’s where the busylog comes into play...

Friday, May 4, 2012

Page 4: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

busylog✦ A new log is generated and saved to a user’s

local machine every time the user opens a new instance of the software.

✦ Which operations are logged? The operations that have been tagged in the software and that exceed .5 second of execution time.

✦ The log is a text file, but it is not human readable.

Friday, May 4, 2012

Page 5: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

problem

✦ Busylogs are scattered across the studio on individual user’s local machines.

✦ Busylogs are not stored in a centralized location.

✦ There is no way to easily browse and view log files.

Friday, May 4, 2012

Page 6: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

solution! BusyB!

✦ File Crawler

- Collects the busylogs

- Stores them in a centralized location

- Stores a record of each log in a database

✦ Busylog Viewer

- GUI application for searching and viewing logs

Friday, May 4, 2012

Page 7: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

File Crawler

<busybinput><user>irischeung</user><alias>brave-anim</alias>

</busybinput>

Input File

dB

dB/depts/tools/busylogs/...

User Machines

Archive Location+

input

check get

store

Friday, May 4, 2012

Page 8: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

Busylog Viewer

Friday, May 4, 2012

Page 9: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

Friday, May 4, 2012

Page 10: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

Friday, May 4, 2012

Page 11: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

Friday, May 4, 2012

Page 12: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

the result

✦ Approx 50,000 logs were collected across 1,000 machines

✦ This system was deployed and being used by Pixar today.

Friday, May 4, 2012

Page 13: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

future work

✦ Associate busylog files with other software log files to determine correlation or causation of slowness.

Friday, May 4, 2012

Page 14: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

tying it together

ComputerScience

Design

Computer Graphics +Animation

Data mining

User Interface

DesignData Viz

before

a!er

Final Project

Friday, May 4, 2012

Page 15: A data collection system created for Pixar Animation Studios. · Pixar Animation Studios. Iris Cheung Advisor: Kimiko Ryokai Friday, May 4, 2012. the scene ... Pixar to quickly diagnose

Special thanks to the supportive people at Pixar that helped make this project happen:

Ian BuonoKitt HirasakiEthan KarsonMckay Farley

Jason WilliamsSowmya Natarajan

Friday, May 4, 2012