San Diego –Q2 2017 - Amazon Web Services · taking place June 12 through the end of fall. Relativity Specialist Exams Discount ... Thank you for attending! Title: San Diego 2017

© kCura LLC. All rights reserved.

San Diego – Q2 2017

Relativity Assisted Review WorkflowsPutting the RAWR back in RAR


• Christine Milliron

– Robbins Geller

• Mariana Diaz

– Procopio

• Matt Krengel

– Cooley LLP

The San Diego Steering Committee


• You, the community, drive the user group’s topics and conversation

• kCura is here to moderate the conversation

• The more you put into the meetings the more you get out

• Surveys will go out at the end of each meeting, please fill them out!

How does a user group work


• What is Relativity Assisted Review?

– Overview

– Why use RAR?

– Your use cases

• RAR Project Setup Ideas

– Project Checklist

– Creating an Analytics Index

– Identifying your Project Population

• Project Completion Ideas

– When is your RAR Project Complete?

– Life after RAR

Agenda


What is Relativity Assisted Review?


• Computer-assisted review is a workflow tied to a text analytics system.

• The analytics technology leverages the expertise of humans to suggest coding decisions on a larger document universe, basing its decisions off of a seed set of documents selected and coded by expert reviewers and lawyers.

• Results are validated by statistical analysis. ◊

What is Relativity Assisted Review?


Computer-assisted Review Workflow


Phase1– SetupIndexandProjectCreated

2,199,761

Phase2– TrainCodeExampleDocuments

2,547

RelevantItemsCategorized

99,904

NotRelevantItemsCategorized

1,659,716

Phase3– QCQCCategorizedDocuments

1,536

RelevantItemsCategorized

75,799

NotRelevantItemsCategorized

1,848,578Uncategorized

275,384

Uncategorized

440,141

Trainingcanconsistof:• Precoded items• StratifiedSample• RandomSample

QCisaStatisticallyvalidsampleacrossalldocumentswhichthe

systemprovidedavalue

=Human-PerformedAction

Sample Project:


• Large Volume of Documents

• Short Time Period

• Minimal Amount of Staff

Why have you used Assisted Review?

Why Use Relativity Assisted Review?


RAR Project Setup IdeasSet your project up for success!


RAR Case Checklist Meets Criteria

Most useful on project with at least 50,000 records with text üConcept-rich files, e.g. emails, word documents, limited excel files, or graphic images üIssue or privilege coding in separate field not part of Assisted Review workflow ü

Is this previously reviewed data? If so, how were families reviewed? üExpected timelines given üExpected process given üNumber of reviewers üLevel of reviewers üLevel of accuracy ü

Project Setup: Assisted Review Checklist

Recipe: RAR Checklist


• Recipe: Creating an Optimized Relativity Analytics Index

– Create a saved search of documents to index

– Add repeated content filters

– Index settings

• Recipe: Sampling for Repeated Content

– For populations over 100,000 documents

– Use sampling to reduce the time to identify boilerplate content

Project Setup: Creating an Analytics Index


• Culling

– Date Range

– Custodians

– Keyword STRs

• Remove Unclustered Documents

– Cluster potential population

– Remove any documents that are in the UNCLUSTERED cluster

• These documents will not categorize and can be sent for linear review

Project Setup: Identify Your RAR Project Population


Project Completion IdeasWhen to move on and what’s next!


• Loop back to your planning conversations, what goals were set?

• Metrics

– Categorization

– Precision and Recall

– Overturns

• Stabilization

– What will it take to move the metrics?

When is Your RAR Project Complete?


• Uncategorized Docs should be sent to linear review

• Review Prioritization

– Include family

– Send Responsive + Family to linear review

• Production

– Include family

– Privilege review

– Production

Life After RAWRLife After RAR


What are your questions or ideas?

Save 30% on Relativity Project Management, Infrastructure, and Processing exams taking place June 12 through the end of fall.

Relativity Specialist Exams Discount


Thank you for attending!