41
1

IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

1

Page 2: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

2

Page 3: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

3

Page 4: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

4

Page 5: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

5

Page 6: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

http://pic.dhe.ibm.com/infocenter/db2luw/v9r7/index.jsp?topic=%2Fcom.ibm.db2.luw.admin.perf.doc%2Fdoc%2Fc0005424.html

6

Page 7: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

7

Page 8: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

8

Page 9: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

9

Page 10: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

10

Page 11: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

11

Page 12: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Netezza_under_the_hood Feinsmith (page 8)

What we see here is how we increased the scan speeds. Basically about each drive in the N2001 is capable of delivering about 130 megabytes per second of throughput (compared to approximately 120 MB/sec in the N1001).

What we had before with the 1 to 1 to 1 ratio, one drive to one FPGA core to one CPU core, the speed of the drive was the limiting factor as far as how fast the FPGA core could process the data - because the FPGA core could handle way more than that and the CPU core even more than the FPGA core. So the speed of the drive was a limiting factor.

So we now have more than one drive per FPGA core and per CPU core. Using basic math, we have about 2 1/2 drives per FPGA core and per CPU core. So that drives up the speed that data can be scanned and delivered to the FPGA for processing up to about 325 megabytes per second. If you add in the 4x compression that’s going to get up to around 1300 megabytes per second.

IN the N2001 we now have faster FPGA cores that can process about 1000 megabytes p g yper second. So we are no longer I/O starved.

So we’re now delivering both 2 1/2 times as much data, you know, per second to the FPGA , to the CPU core and that is how we fundamentally and how we increased the scan speed and how we increase the performance of this system. 12

Page 13: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

13

Page 14: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Netezza Bootcamp (page 62).

14

Page 15: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Netezza Bootcamp (page 133).

15

Page 16: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Netezza Bootcamp (page 227).

16

Page 17: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Netezza Bootcamp (page 228).

17

Page 18: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

18

Page 19: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

IZAS_zEnterprise_Analytics Favero, et al (page 21)

19

Page 20: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Favero, et al (page 69)

20

Page 21: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

21

Page 22: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

22

Page 23: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Schiefer (page 4)

23

Page 24: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Schiefer (page 10)

24

Page 25: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Schiefer (page 16)

25

Page 26: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Schiefer (page 14)

26

Page 27: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

Schiefer (page 18)

27

Page 28: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

28

Page 29: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

29

Page 30: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

30

Page 31: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

31

Page 32: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

DW611 (page 2‐7)

32

Page 33: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

DW611 (chapter 3)

33

Page 34: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

DW611 (chapter 3)

34

Page 35: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

DW611 (chapter 3)

35

Page 36: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

DW611 (chapter 3)

36

Page 37: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

37

Page 38: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

38

Page 39: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

39

Page 40: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

40

Page 41: IDUG EMEA 2014 E7 - IBM Data Retrieval Technologies

41