44
Arjun Suresh S7, R College of Engineering Trivandrum

MEMS Based Storage Architecture for Relational Databases

  • Upload
    greta

  • View
    64

  • Download
    0

Embed Size (px)

DESCRIPTION

MEMS Based Storage Architecture for Relational Databases. Arjun Suresh S7, R College of Engineering Trivandrum. Outline. MEMS-based storage Relational database layout FRM (Flexible Retrieval Model) Query Processing on FRM Evaluation Conclusion. Building Storage on MEMS. - PowerPoint PPT Presentation

Citation preview

Page 1: MEMS Based Storage Architecture for Relational Databases

Arjun SureshS7, R

College of Engineering Trivandrum

Page 2: MEMS Based Storage Architecture for Relational Databases

MEMS-based storageRelational database layoutFRM (Flexible Retrieval Model) Query Processing on FRMEvaluationConclusion

Outline

Page 3: MEMS Based Storage Architecture for Relational Databases

Building Storage on MEMSMEMS are Micro Electrical Mechanical Systems.

Basic functions: sensors and actuators

Built by standard silicon processing

Combine mechanical and electrical components

Enable “systems-on-a-chip”

Page 4: MEMS Based Storage Architecture for Relational Databases

Why need MEMS-based storage? Huge gaps between disks and RAM

1000,000 latency gap (10ms vs 50 ns), widening 50% yearly.

1000 price gap per byte 1000 life gap

MEMS narrows gaps 10X smaller latency than disk 100X cheaper than RAM in the range 1 – 10 GB 100 MB - 1 GB/s bandwidth 10 GB capacity with a penny size

Desired for energy and volume critical systems

Page 5: MEMS Based Storage Architecture for Relational Databases

EEPROM/Flash

DRAM

Hard Disk

Latency

Cos

t p

er B

yte

MEMS-based Storage

Technology Trends

Page 6: MEMS Based Storage Architecture for Relational Databases

Using pits in the polymers made by tip heating to store data

IBM Millipede

Page 7: MEMS Based Storage Architecture for Relational Databases

MEMS Storage Architecture

Read/writetips

Read/writetips

MediaMedia

Bits storedunderneatheach tip

Bits storedunderneatheach tip

side view

Page 8: MEMS Based Storage Architecture for Relational Databases

MEMS Storage Architecture

Media Sled

X

Y

Page 9: MEMS Based Storage Architecture for Relational Databases

Springs Springs

SpringsSprings

MEMS Storage Architecture

Page 10: MEMS Based Storage Architecture for Relational Databases

Anchors attachthe springs tothe chip.

Anchors attachthe springs tothe chip.

Anchor Anchor

AnchorAnchor

X

Y

MEMS Storage Architecture

Page 11: MEMS Based Storage Architecture for Relational Databases

Sled is freeto move

Sled is freeto move

X

Y

MEMS Storage Architecture

Page 12: MEMS Based Storage Architecture for Relational Databases

Sled is freeto move

Sled is freeto move

X

Y

MEMS Storage Architecture

Page 13: MEMS Based Storage Architecture for Relational Databases

Springs pullsled towardcenter

Springs pullsled towardcenter

X

Y

MEMS Storage Architecture

Page 14: MEMS Based Storage Architecture for Relational Databases

X

Y

Springs pullsled towardcenter

Springs pullsled towardcenter

MEMS Storage Architecture

Page 15: MEMS Based Storage Architecture for Relational Databases

Actuators pullsled in bothdimensions

Actuators pullsled in bothdimensions

Actuator

Actuator

Actuator

X

Y

MEMS Storage Architecture

Page 16: MEMS Based Storage Architecture for Relational Databases

Actuators pullsled in bothdimensions

Actuators pullsled in bothdimensions

X

Y

MEMS Storage Architecture

Page 17: MEMS Based Storage Architecture for Relational Databases

Actuators pullsled in bothdimensions

Actuators pullsled in bothdimensions

X

Y

MEMS Storage Architecture

Page 18: MEMS Based Storage Architecture for Relational Databases

Actuators pullsled in bothdimensions

Actuators pullsled in bothdimensions

X

Y

MEMS Storage Architecture

Page 19: MEMS Based Storage Architecture for Relational Databases

Actuators pullsled in bothdimensions

Actuators pullsled in bothdimensions

X

Y

MEMS Storage Architecture

Page 20: MEMS Based Storage Architecture for Relational Databases

Probe tipsare fixed

Probe tipsare fixed

Probe tip

Probe tip

X

Y

MEMS Storage Architecture

Page 21: MEMS Based Storage Architecture for Relational Databases

X

Y

Probe tipsare fixed

Probe tipsare fixed

MEMS Storage Architecture

Page 22: MEMS Based Storage Architecture for Relational Databases

X

Y

Sled onlymoves overthe area of asingle rectangle

Sled onlymoves overthe area of asingle rectangle

One probe tipper rectangle

One probe tipper rectangle

Each tipaccesses dataat the samerelative position

Each tipaccesses dataat the samerelative position

MEMS Storage Architecture

Page 23: MEMS Based Storage Architecture for Relational Databases

Properties of MEMS Storage

Sweep area of

One probe tip

Page 24: MEMS Based Storage Architecture for Relational Databases

Properties of MEMS Storage

N bits

M b

its

One tip region

One tip sector

Page 25: MEMS Based Storage Architecture for Relational Databases

Physical Parameters

Number of tips 6400

Max number of active tips 1280

Tip sector size 8 bytes

Bits per tip region 2000X2000

X axis settle time 0.125ms

Average turnaround time 0.06ms

Page 26: MEMS Based Storage Architecture for Relational Databases

Existing Work on Integration of MEMS StorageSolution proposed by CMU researchers

Mapping MEMS storage into conventional diskAdapt I/O scheduling and data placement to

MEMS

Preliminary study showsReduce the I/O stall times by 4 to 74 times over

disksImprove the overall application run times by

1.9 to 4.4Reduce the energy consumption by 10-54 times

Page 27: MEMS Based Storage Architecture for Relational Databases

Better solutions??The approach of mapping MEMS into disk

Simplify the procedure of integration of MEMSDoes not consider the physical properties of

MEMS

Page 28: MEMS Based Storage Architecture for Relational Databases

Relational Data Placement

StudentGrade

recordIDname

char(16)

perm ID

int(8)

age

int(8)

grade

int(8)

record1 Mary 572 19 86

record2 John 582 18 90

record3 Bob 511 18 80

record4 Jane 537 20 91

Page 29: MEMS Based Storage Architecture for Relational Databases

N-ary Storage Model (NSM)

Store records in a relation in slotted disk pages

Organize records sequentially on the disk pages

Page Header Mary 572

19 86 John 582

18 90 Bob 511

18 80 Jane 537

20 91

P4 P3 P2 p1

Page 30: MEMS Based Storage Architecture for Relational Databases

Decomposition Storage Model(DSM)

Divide a relation into sub-relations based on the number of attributes

Each sub-relation corresponds to each attribute

Each sub-relation is organized into pages in the same way as NSM

Page Header 1 Mary 2

John 3 Bob 4 Jane

P4 P3 P2 P1

Page Header 1 572 2

582 3 511 4 537

P4 P3 P2 P1

Page Header 1 19 2

18 3 18 4 20

P4 P3 P2 P1

Page Header 1 86 2

90 3 80 4 91

P4 P3 P2 P1

grade

name perm ID

age

A disk page A disk page

A disk page A disk page

Page 31: MEMS Based Storage Architecture for Relational Databases

Partition Attributes Across (PAX)Within each page, PAX

groups all values of each attribute into a mini-page

A page is divided into mini-pages based on the number of attributes

It stores the same data as NSM in each page

Page Header Mary John

Bob Jane

P4 P3 P2 P1

572 582 511 537

P4 P3 P2 P1

19 18 18 20

P4 P3 P2 P1

81 90 80 91

P4 P3 P2 P1

A disk page

Page 32: MEMS Based Storage Architecture for Relational Databases

Common Workload RequirementsRelational data should be compatible with

OLTP workloads Due to the update characteristics, relations need to

be accessed in a row-wise mannerOLAP workloads

Only a subset of attributes is of interest, data placement should facilitate data retrieval on a column-wise fashion

Page 33: MEMS Based Storage Architecture for Relational Databases

Flexible Retrieval Model (FRM)

Facilitates data retrieval in both row-wise and column-wise mannerRetrieves the relevant subsets of the relationsUses two dimensional layout of MEMS storage

Improves the I/O utilizationMaximize the concurrent tips to only retrieve the

necessary data

It is also cache-friendlyUse intra-record locality

Page 34: MEMS Based Storage Architecture for Relational Databases

FRM Data Placement and Retrieval

Given a relation with three attributes, the size of each attribute is 8 bytes

Placing this relation in 4x4 MEMS-based storage

4 concurrent tips

(0, 0)

(0, 1)

(0, 0)

(0, 1)

Attr1 Attr2 Attr3

(0, 0)

(0, 0)

(0, 1)

(0, 1)

(0, 2)

(0, 2)

(0, 2)

(0, 2)

(1, 2)

Page 35: MEMS Based Storage Architecture for Relational Databases

Query Processing on FRMSelection and projection without index

Two-dimensional table scanSelection and projection with index

Encode data position as 4-tuple (tip-x, tip-y, offset-x, offset-y)

JoinsIndex-based or hash

Page 36: MEMS Based Storage Architecture for Relational Databases

Experiment SetupMEMS storage: 1280 concurrent tips out of

6400 total tipsPentium II Celeron 433X2 processorsL1 cache:16KB, 32-byte cache line, 20 ns

delayL2 cache:128KB, 32-byte cache line, 200

ns delayA relation R with 1.28 million recordsSixteen 8-byte attributes in each recordQueries:

SELECT A1, A2,…, An

FROM R WHERE A1 > Bound;

Page 37: MEMS Based Storage Architecture for Relational Databases

Memory utilization

The selected attributes in queries

Con

sum

ed m

emor

y(M

B)

Page 38: MEMS Based Storage Architecture for Relational Databases

I/O performance

NSM and PAX have the same I/O time

I/O time of FRM is proportional to the size of retrieved attributes

Page 39: MEMS Based Storage Architecture for Relational Databases

Selection Queries (2 attributes)

Cache Utilization

Page 40: MEMS Based Storage Architecture for Relational Databases

Selection Queries (13 attributes)

Page 41: MEMS Based Storage Architecture for Relational Databases

Selectivity = 50%

Page 42: MEMS Based Storage Architecture for Relational Databases

Projection Queries

Selectivity =10%

Page 43: MEMS Based Storage Architecture for Relational Databases

Conclusion and Future Work

Proposed a relational data placement scheme for MEMS-based storageTake advantage of two-dimensional MEMS access

featureArrange MEMS rows and columns to relational

attributes and recordsSave IO cost and improve cache performance

Other cache friendly techniques for MEMS-based storage devices are to be explored

Page 44: MEMS Based Storage Architecture for Relational Databases

Thank You……