TPC Benchmarks

- Chidananda (Chidu) SridharCSCI 5707

Relationship with 5707: Transaction Processing, Chapter 21

TPC-C Latest Results

Benchmarks

Standard for comparison of various systems performing similar operations

Set of programs that simulate a typical workload on a given system

Used to measure system performance- speed, performance, price etc.

TPC: Transaction Processing and Performance Council

TPC Benchmark ™ A

Measure performance of update-intensive database environments

Transaction ProfileRead 100 bytes including Aid, Tid, Bid, Delta from terminalBEGIN TRANSACTION

Update Account where Account_ID = Aid:Read Account_Balance from AccountSet Account_Balance = Account_Balance + DeltaWrite Account_Balance to Account

Update Teller where Teller_ID = Tid:Set Teller_Balance = Teller_Balance + DeltaWrite Teller_Balance to Teller

COMMIT TRANSACTIONWrite 200 bytes including Aid, Tid, Bid, Delta, Account_Balance to terminal

TPC-A and TPC-C

TPC-AThroughput of system in units of transactions per second (tpsA). Cost is given as price/tpsAReleased in 1988. Obsolete in 95!

Moore’s law: the number of transistors on integrated circuits doubles approximately every two years

TPC-CDesigned for moderately complex OLTP (Wholesale supplier managing orders)Metrics: Throughput: tpmC (transactions per minute) Price: $/tpmC

TPS: What does it mean?

TPS: Peak Debit-Card transaction performance where 95% of all transactions with 1 second or less of response time (arrival of last bit, sending of first bit)

Debit-Credit Scalability: size of account, branch, teller, history function of throughput

TPS Number of ATMs Account-file size

10 1,000 0.1 GB

100 10,000 1.0 GB

1,000 100,000 10.0 GB

10,000 1,000,000 100.0 GB Each input TPS =>100,000 account records, 10 branches, 100 ATMs

TPC-C Latest Results

What's cooking?

As of Nov 2013: Released TPC-VMS specification Starting work on TPC-Big Data Carrying out revisions on TPC-E, and H

References [1] Jim Gray: Database and Transaction Processing Performance Handbook.

The Benchmark Handbook 1993. Online edition. http://www.benchmarkresources.com/handbook/index.html

[2] Transaction Processing Performnance Council, http://www.tpc.org [3] Anon, et al, “A Measure of Transaction Processing Power”, Datamation,

V. 31.7, April 1985, pp. 112-118. [4] Gray, J.N., Reuter, A., “Transaction Processing: Concepts and

Techniques, Morgan Kaufmann, San Mateo, CA, 1993, pp. 11-12, 168.