Demonstration Study for Applying AVED to Demonstration Study for Applying AVED to Still Images from Station M Still Images from Station M

MBARI Internal Project 900905

Kick-off MeetingKick-off Meeting

Danelle ClineDanelle Cline

MBARI February 3rd, 2009MBARI February 3rd, 2009 22

AgendaAgenda

Project description and purposeProject description and purpose

Goals and deliverablesGoals and deliverables

Roles and responsibilities for each Roles and responsibilities for each membermember

Communication plans for status and Communication plans for status and meeting frequencymeeting frequency

MBARI February 3rd, 2009MBARI February 3rd, 2009 33

Project Description and PurposeProject Description and Purpose

““This project proposes to apply existing This project proposes to apply existing AVED software to demonstrate how AVED software to demonstrate how computer aided vision can be used to computer aided vision can be used to analyze Station M images…” - analyze Station M images…” - fromfrom

internal MBARI proposal document 900905internal MBARI proposal document 900905

MBARI February 3rd, 2009MBARI February 3rd, 2009 44

Project MotivationProject Motivation Station M still images are very good Station M still images are very good

quality. They are captured near the quality. They are captured near the same site, with good lighting, and same site, with good lighting, and have a have a discrete biological communitydiscrete biological community. .

We know the AVED classifier works We know the AVED classifier works well on benthic images with good well on benthic images with good lighting: lighting:

• 7250 images analyzed7250 images analyzed• 90 % recognition of Rathbunaster 90 % recognition of Rathbunaster

californicus*californicus*

If 1 person spent 1 hour analyzing If 1 person spent 1 hour analyzing each image, it would take each image, it would take 3232 years years to to analyze all 67000analyze all 67000****

AVED helps reduces this labor, by AVED helps reduces this labor, by finding, and classifying events for finding, and classifying events for further analysis, in essence further analysis, in essence filtering by machine, rather than by filtering by machine, rather than by human.human.

**Edgington, D.R., Cline, D.E., Davis, D., Kerkez, I., and Mariette, J., Edgington, D.R., Cline, D.E., Davis, D., Kerkez, I., and Mariette, J., Detecting, Tracking and Classifying Animals in Underwater Video Detecting, Tracking and Classifying Animals in Underwater Video (060331-207). MTS/IEEE Oceans 2006 Conference Proceedings, Boston, MA (060331-207). MTS/IEEE Oceans 2006 Conference Proceedings, Boston, MA September 2006. IEEE Press. (PDF) September 2006. IEEE Press. (PDF)

**Assumes 40 hour work week**Assumes 40 hour work week

Rathbunaster californicusVentana Dive 2344, 200 meters

Station M, 4100 meters

MBARI February 3rd, 2009MBARI February 3rd, 2009 55

Project Goals Project Goals TTransfer this work to the Smith lab as a tool that they will ransfer this work to the Smith lab as a tool that they will

continue to use in their researchcontinue to use in their research

Make the work available to other MBARI scientists and Make the work available to other MBARI scientists and to the general public to the general public

Advance the AVED project by:Advance the AVED project by:• Adding the capability to process still framesAdding the capability to process still frames• Providing a strong use case to help develop a workflow for Providing a strong use case to help develop a workflow for

automated classification automated classification

MBARI February 3rd, 2009MBARI February 3rd, 2009 66

Project Deliverables Project Deliverables

• A working demonstration of the AVED A working demonstration of the AVED detection and classification system detection and classification system processing digital Station M time-lapse still processing digital Station M time-lapse still sequences at full resolutionsequences at full resolution

• Publish results (e.g. MTS/IEEE Oceans Publish results (e.g. MTS/IEEE Oceans Conference, AGU, or CVPR)Conference, AGU, or CVPR)

• Publish AVED classifier package to external Publish AVED classifier package to external MBARI web for outside use. MBARI web for outside use.

MBARI February 3rd, 2009MBARI February 3rd, 2009 77

Roles and ResponsibilitiesRoles and Responsibilities

Danelle Cline - Danelle Cline - schedule, budget, engineering, and publishing technology schedule, budget, engineering, and publishing technology papers papers

Ken Smith Ken Smith - guide the science behind the project demonstration and - guide the science behind the project demonstration and publish science results publish science results

Jacob Ellena - Jacob Ellena - responsible for digitizing the Station M reels into a digital responsible for digitizing the Station M reels into a digital format suitable for this project, assisting in classifier libraries format suitable for this project, assisting in classifier libraries development and analyzing results from AVED. development and analyzing results from AVED.

Duane Edgington - Duane Edgington - assisting with project requirements and contributing to assisting with project requirements and contributing to technology papers that result from this work. technology papers that result from this work.

Linda Kuhnz - Linda Kuhnz - develop classifier libraries, help analyze and publish the develop classifier libraries, help analyze and publish the science results. science results.

MBARI February 3rd, 2009MBARI February 3rd, 2009 88

Communication Plans and Communication Plans and MeetingsMeetings

Relevant project information (meeting Relevant project information (meeting notes, presentations, engineering/science notes, presentations, engineering/science results), to be posted to internal wiki results), to be posted to internal wiki page:page:• 900905 Demo Study Wiki Page900905 Demo Study Wiki Page

Danelle will be requesting weekly email Danelle will be requesting weekly email updates for the EC notes updates for the EC notes

Brief bi-weekly meetings to discuss Brief bi-weekly meetings to discuss updates, questions, problems, etc. updates, questions, problems, etc.

MBARI February 3rd, 2009MBARI February 3rd, 2009 99

Q&AQ&A Project #900905Project #900905

Project wiki: Project wiki: https://oceana.mbari.org/confluence/display/AVEDSTILL/