23
FirebirdJapanUsersAssociation TsutomuHayashi Firebird2.5 BenchMarks - Performance VS MySQL / PostgreSQL -

Firebird2.5 Benchmarks(English)20091031

Embed Size (px)

DESCRIPTION

Benchmark tests for Firebird against MySQL and PostgreSQL usgin DbBench. DbBench is a TPC-B port running on Windows with GUI.

Citation preview

Page 1: Firebird2.5 Benchmarks(English)20091031

FirebirdJapanUsersAssociation TsutomuHayashi

Firebird2.5 BenchMarks- Performance VS MySQL / PostgreSQL -

Page 2: Firebird2.5 Benchmarks(English)20091031

DBBench

Copyright(c) 2009 Tsutomu Hayashi All rights reserved.

pgbench(PostgreSQL) port for Firebird/MySQLDelphi + dbExpress Mutli Thread implimentChange dbExpress drivers enables for other

RDBMSsSame code/Same binary testing for

Firebird/MySQL/PostgreSQLUsing GUI for easy useMost easiest Database Benchmark

2

Page 3: Firebird2.5 Benchmarks(English)20091031

TPC-B

Copyright(c) 2009 Tsutomu Hayashi All rights reserved.

TPC is the benchmark tests definition by "Transaction Processing Performanc Counsil"

TPC-B is defined at 1990, deplicated 1995This test assume batch operation with many parallel transactions. Simulation dealing account between branches in bank.

3

Page 4: Firebird2.5 Benchmarks(English)20091031

TPC-B

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.4

Usin 4 tablescreate table branches(bid int not

null,bbalance int,filler char(88));create table tellers(tid int not null,bid

int,tbalance int,filler char(84));create table accounts(aid int not null,bid

int,abalance int,filler char(84));create table history(tid int,bid int,aid int,delta

int,mtime timestamp,filler char(22))

Copyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 5: Firebird2.5 Benchmarks(English)20091031

TPC-B

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.5

Processing isupdate accounts set abalance = abalance

+ :delta where aid = :aid;select abalance from accounts where aid

= :aid; update tellers set tbalance = tbalance

+ :delta where tid = :tid; update branches set bbalance = bbalance +

:delta where bid = :bid;insert into history(tid,bid,aid,delta)

values(:tid,:bid,:aid,:delta);

Copyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 6: Firebird2.5 Benchmarks(English)20091031

Scaling Factor

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.6

Scaling factor is test scaleScaling factor affects

Branch count equals scaling factorTeller count is scaling factor * 10Account count is scaling factor * 100,000

So I use scaling factor 100Branch is 100, Teller is 1000, Accounts is 10,000,000Firebird database almost 600MB, MySQL is almost

1.2GB

Copyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 7: Firebird2.5 Benchmarks(English)20091031

Copyright(c) 2009 Tsutomu Hayashi All rights reserved.

Benchmark Environment

HP ML115G5

AMD AthlonTM 1640B ( 2.7GHz )

AMD PhenomTM 9350e ( 2.0GHz )

ECC512MB DDR2-6400

Non-ECC4GB DDR2-6400

HDD is standard SATA160GB

7

Page 8: Firebird2.5 Benchmarks(English)20091031

Firebird 2.1SS vs Firebird 2.5SS

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.8

Firebird2.1 vs Firebird2.5

@WindowsCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 9: Firebird2.5 Benchmarks(English)20091031

Firebird 2.1CS vs Firebird 2.5CS

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.9

Firebird2.1 vs Firebird2.5

@WindowsCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 10: Firebird2.5 Benchmarks(English)20091031

Firebird 2.1SS vs Firebird 2.5 SC

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.10

Firebird2.1 vs Firebird2.5

@WindowsCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 11: Firebird2.5 Benchmarks(English)20091031

Firebird 2.1SS vs Firebird 2.5SS

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.11

Firebird2.1 vs Firebird2.5

@Linux

drawdraw

Copyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 12: Firebird2.5 Benchmarks(English)20091031

Firebird 2.1CS vs Firebird 2.5CS

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.12

Firebird2.1 vs Firebird2.5

@LinuxCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 13: Firebird2.5 Benchmarks(English)20091031

Firebird 2.1SS vs Firebird 2.5SC

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.13

Firebird2.1 vs Firebird2.5

@LinuxCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 14: Firebird2.5 Benchmarks(English)20091031

MySQL 5.1 vs Firebird 2.5SC

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.14

MySQL5.1 vs Firebird2.5

@WindowsCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 15: Firebird2.5 Benchmarks(English)20091031

MySQL 5.1 vs Firebird 2.5SC

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.15

MySQL5.1 vs Firebird2.5

@LinuxCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 16: Firebird2.5 Benchmarks(English)20091031

MySQL 5.1 vs Firebird 1.5SS

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.16

MySQL5.1 vs Firebird2.5

@Linux

drawdraw

Copyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 17: Firebird2.5 Benchmarks(English)20091031

PostgreSQL 8.4.1 vs Firebird 2.5CS

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.17

PostgreSQL8.4 vs Firebird2.5

@WindowsCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 18: Firebird2.5 Benchmarks(English)20091031

PostgreSQL 8.4.1 vs Firebird 2.5CS

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.18

PostgreSQL8.4 vs Firebird2.5

@LinuxCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 19: Firebird2.5 Benchmarks(English)20091031

on Linux, Firebird is very slow!!

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.19

@LinuxCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 20: Firebird2.5 Benchmarks(English)20091031

Ext3 vs XFS

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.20

I assume Filesystem? Using Fire bird2.5SC

@LinuxCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 21: Firebird2.5 Benchmarks(English)20091031

Linux+XFS is very Fast!

Copyright(c) 2008 Tsutomu Hayashi All rights reserved.21

Test with XFS for many clients

@LinuxCopyright(c) 2009 Tsutomu Hayashi All rights reserved.

Page 22: Firebird2.5 Benchmarks(English)20091031

Results Benchmarks are rough estimation at all.

Firebird2.5 is very fast than other RDBMSs.

Normaly running many clients over 500 .

Copyright(c) 2009 Tsutomu Hayashi All rights reserved.22

Page 23: Firebird2.5 Benchmarks(English)20091031

Coming Soon

Japanese publisher "Shoei-sya" will publish new Firebird book in Japan at December 2009.

Copyright(c) 2009 Tsutomu Hayashi All rights reserved.23