The TPFDF Experience The TPFDF Experience at American Expressat American Express

October 05, 2004October 05, 2004 by:by:

Tim RyanTim RyanTim P Ryan@aexp.comTim P Ryan@aexp.com

October, 2004October, 2004 American ExpressAmerican Express 22

Historical InformationHistorical Information

ACPDB was Installed around 1986ACPDB was Installed around 1986• Several smaller databases developed Several smaller databases developed

and installed. Databases were removed and installed. Databases were removed due to performance or design issues.due to performance or design issues.

• No further development was done using No further development was done using ACPDB.ACPDB.

October, 2004October, 2004 American ExpressAmerican Express 33

TPFDF ExperienceTPFDF Experience

Installed 1992Installed 1992• No applications controls were in place.No applications controls were in place.• No DBMA group was formed.No DBMA group was formed.• No DF Standards in place.No DF Standards in place.• No trained TPFDF AdministratorsNo trained TPFDF Administrators

October, 2004October, 2004 American ExpressAmerican Express 44

TPFDF Learning CurveTPFDF Learning Curve

Again programmers were allowed to Again programmers were allowed to develop several small non-critical develop several small non-critical databases using TPFDF.databases using TPFDF.• These included Blocked Index files and These included Blocked Index files and

Basic Index files. Basic Index files. • No major development was completed.No major development was completed.

October, 2004October, 2004 American ExpressAmerican Express 55

TPFDF AdministrationsTPFDF Administrations

19941994• DBMA Group Setup.DBMA Group Setup.• Development of Applications Standards.Development of Applications Standards.• Rollout of smaller databases.Rollout of smaller databases.

Block Indexes.Block Indexes. Simple structures.Simple structures.

October, 2004October, 2004 American ExpressAmerican Express 66

Side Tracked (OF Course)Side Tracked (OF Course)

Home grown database software was Home grown database software was developed.developed.

October, 2004October, 2004 American ExpressAmerican Express 77

TPFDF the AwakeningTPFDF the Awakening

19981998• Management decided that TPFDF would Management decided that TPFDF would

be used for the development of all be used for the development of all future databases where appropriate.future databases where appropriate.

• Applications Standards were DefinedApplications Standards were Defined Data VersioningData Versioning Data Formats.Data Formats. Database ManagersDatabase Managers Established Performance GoalsEstablished Performance Goals

October, 2004October, 2004 American ExpressAmerican Express 88

Baby Steps No WayBaby Steps No Way

• Account/Customer Database Rollout Account/Customer Database Rollout BegunBegun

Dual Indexed with multiple sub-files per Dual Indexed with multiple sub-files per index.index.

Allowed access to account or customer Allowed access to account or customer information using either the account number information using either the account number or the customer number.or the customer number.

October, 2004October, 2004 American ExpressAmerican Express 99

Account/Customer DatabaseAccount/Customer Database

Account Index Customer Index

90 Million Accounts90 Million Accounts

25 Million Customers25 Million Customers

60 Separate LRECs60 Separate LRECs

197 Million 4K Pool 197 Million 4K Pool RecordsRecords

October, 2004October, 2004 American ExpressAmerican Express 1010

Where Did We Go From ThereWhere Did We Go From There

Conversion Efforts Began for Existing Conversion Efforts Began for Existing Databases in 2000Databases in 2000• 25 Existing Databases targeted for 25 Existing Databases targeted for

conversion.conversion.• Last database Targeted this weekLast database Targeted this week

Over 40 new LRECs were defined for Over 40 new LRECs were defined for inclusion in the new structure. inclusion in the new structure.

October, 2004October, 2004 American ExpressAmerican Express 1111

B+ Tree ImplementationB+ Tree Implementation

First B+ Tree Implementation First B+ Tree Implementation 10/26/200410/26/2004• Information for 20,000 BanksInformation for 20,000 Banks• Anywhere from 1 to 1,000,000 accounts Anywhere from 1 to 1,000,000 accounts

per bank.per bank.

October, 2004October, 2004 American ExpressAmerican Express 1212

C/C++ TPFDF ExperienceC/C++ TPFDF Experience

One Database Manager has been One Database Manager has been developed using C/C++ interface.developed using C/C++ interface.

• No Performance Issues were noted.No Performance Issues were noted.• Documentation was easy to understandDocumentation was easy to understand• Direction provided by IBM Consultant Direction provided by IBM Consultant

October, 2004October, 2004 American ExpressAmerican Express 1313

Where Are We TodayWhere Are We Today

Every Applications Critical Database Every Applications Critical Database uses or will use TPFDF.uses or will use TPFDF.

Database managers are being rolled Database managers are being rolled out for all databases. out for all databases.

New TPFDF Recoup Installed. New TPFDF Recoup Installed. Significant performance Significant performance improvements were realized. improvements were realized.

October, 2004October, 2004 American ExpressAmerican Express 1414

TPFDF BenefitsTPFDF Benefits

Reduced Development CostsReduced Development Costs• No Capture/Restore Software Required.No Capture/Restore Software Required.• Database interface software does not Database interface software does not

have to be developed.have to be developed.• LREC expansion does not require a LREC expansion does not require a

conversion. conversion.

October, 2004October, 2004 American ExpressAmerican Express 1515

QuestionsQuestions??

October, 2004October, 2004 American ExpressAmerican Express 1616

Thank you for you time.Thank you for you time.

Please forward any comments and/or Please forward any comments and/or suggestions to:suggestions to:

Tim P Ryan@aexp.comTim P Ryan@aexp.com