7
Mero: Co-Designing an Object Store for Extreme Scale Presented at PDSW’2016(SC’16) Presented by Sai Narasimhamurthy Co-authors: Nikita Danilov, Nathan Rutman [All Seagate] John Bent[Seagate Government Solutions]

Mero: Co-Designing an Object Store for Extreme ScaleStorage Software for BDEC. 23/6/2015 2. Exascale. Computing. Big (Massive!) Data Analysis. Exascale Data Centric Computing (Big

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Mero: Co-Designing an Object Store for Extreme ScaleStorage Software for BDEC. 23/6/2015 2. Exascale. Computing. Big (Massive!) Data Analysis. Exascale Data Centric Computing (Big

Mero: Co-Designing an Object Store for Extreme Scale

Presented at PDSW’2016(SC’16)Presented by

Sai NarasimhamurthyCo-authors: Nikita Danilov, Nathan Rutman [All Seagate]

John Bent[Seagate Government Solutions]

Page 2: Mero: Co-Designing an Object Store for Extreme ScaleStorage Software for BDEC. 23/6/2015 2. Exascale. Computing. Big (Massive!) Data Analysis. Exascale Data Centric Computing (Big

Storage Software for BDEC

23/6/2015 2

ExascaleComputing

Big (Massive!) Data Analysis

Exascale Data Centric Computing(Big Data Extreme Computing, or BDEC)

Mero: Object Storage Software Build from the ground up to cater to BDEC Involved co-design with the community

Page 3: Mero: Co-Designing an Object Store for Extreme ScaleStorage Software for BDEC. 23/6/2015 2. Exascale. Computing. Big (Massive!) Data Analysis. Exascale Data Centric Computing (Big

Mero Simplicity

Page 4: Mero: Co-Designing an Object Store for Extreme ScaleStorage Software for BDEC. 23/6/2015 2. Exascale. Computing. Big (Massive!) Data Analysis. Exascale Data Centric Computing (Big

MeroCo-Design Timeline

Page 5: Mero: Co-Designing an Object Store for Extreme ScaleStorage Software for BDEC. 23/6/2015 2. Exascale. Computing. Big (Massive!) Data Analysis. Exascale Data Centric Computing (Big

MeroResulting Architecture

Page 6: Mero: Co-Designing an Object Store for Extreme ScaleStorage Software for BDEC. 23/6/2015 2. Exascale. Computing. Big (Massive!) Data Analysis. Exascale Data Centric Computing (Big

Everything you’d expect in an Exascale Object Store ..PLUS

Complex Layouts

In-Storage Compute

Peer-Peer Caching

PGAS and MPI One sided Comms

Analytics

Event Log Subscription & Diagnostics

Expect More!

Page 7: Mero: Co-Designing an Object Store for Extreme ScaleStorage Software for BDEC. 23/6/2015 2. Exascale. Computing. Big (Massive!) Data Analysis. Exascale Data Centric Computing (Big

Ongoing Work & Next Steps

7

http://sagestorage.eu/

http://www.seagate.com/files/www-content/product-content/xyratex-branded/clustered-file-systems/_shared/datasheets/seagate-clusterstor-a200-datasheet.pdf

http://www.sagestorage.eu/content/public-deliverables