16
DATA Management with Blackbaud CRM PRESENTED BY DAVID TUNESI, BLACKBAUD ALAN HARRISON & CLYDE JARVIS ALSAC / ST. JUDE CHILDREN’S RESEARCH HOSPITAL

Big Data Management with Blackbaud CRM

Embed Size (px)

DESCRIPTION

By David Tunesi

Citation preview

Page 1: Big Data Management with Blackbaud CRM

DATA Management with Blackbaud CRMPRESENTED BY

DAVID TUNESI, BLACKBAUD

ALAN HARRISON & CLYDE JARVIS

ALSAC / ST. JUDE CHILDREN’S RESEARCH HOSPITAL

Page 2: Big Data Management with Blackbaud CRM

Data and Blackbaud CRMDavid Tunesi

2 #bbcon

Page 3: Big Data Management with Blackbaud CRM

Introducing ALSAC / St. JudeAlan Harrison

3 #bbcon

Page 4: Big Data Management with Blackbaud CRM

Challenges we Face• Migrating from Team Approach to BBCRM

• Migrating into existing BBCRM – (Contact Center)• Load large data with active users• Initial loader and Iterative loader will be the same logic• Close to 40 million Individual accounts in Team Approach• 2 Billion Interactions• 800 Million Transactions• 700 TA Users• Phased User Rollout by division– No Big Bang cutover• Minimize BBCRM extensions• Data Mappings must be configurable

4 #bbcon

Page 5: Big Data Management with Blackbaud CRM

ImplementationClyde Jarvis

5 #bbcon

Page 6: Big Data Management with Blackbaud CRM

Keys to our Success• Business and Resources

• Supplemented mapping and development resources from Blackbaud Professional Services

• Set up Data Governance Council to help make data decisions• Set up Data Stewardship group to research and fix data• Brought in a Change Enablement expert to help with User Onboarding

6 #bbcon

Page 7: Big Data Management with Blackbaud CRM

Important Considerations for All• Purged and Cleaned as much data as possible before migration

• Removed 800 million interactions• Ideally delete duplicate constituents if possible

• We were not able to do this because of slow deletes• We chose to compress the database

• After compression, the database size was cut in half to 3.2 Terabytes• Constituent Deletes were very slow after we loaded large amounts of data

• We put in a custom trigger on database to turn hard deletes to soft deletes• Blackbaud Product is working on a long-time solution.

• We had performance issues around revenue rollup• Worked with Blackbaud Support and they provided patches to fix some of these• Try to stay upgraded on the latest version if possible.

• Some of these performance gains were in the new release.

7 #bbcon

Page 8: Big Data Management with Blackbaud CRM

Not for the Faint of Heart• For large systems, consider only migrating constituents that are

“needed”• Filter based on Constituent Ranking (RFM or some other formula)• On-Demand loader

• Will Show some slides on this later• Service integration to pull over constituent data from TA when requested.• New accounts in TA get automatically migrated

• BI system has all history and constituents for campaigns and analysis• Replicating large volumes between Local and DR site created

challenges• We had to slow down our initial loads to allow replication to stay up-to-date.

• TA and DMS are both up at the same time with data syncing between each

• Necessary for us because of slow user rollout• Extremely difficult to maintain • This can create extra volume for Replication to DR Site saturating network

8 #bbcon

Page 9: Big Data Management with Blackbaud CRM

Not for the Faint of Heart - Services• Stand up Master Data Management solution to help facilitate

integration• MDM has all system constituent keys and attribute keys• MDM controls constituent matching and merge• MDM makes On-Demand Loader possible using exposed service layer.

• Service layer on top of BBCRM API using BBCRM Framework• 3 methods that handle all constituent requests

• editConstituent• createConstituent• mergeConstituent

• Loaded all constituents via Service API. • 17 threads max running in parallel with users on the system.

• At 17 we started having some concurrency issues.• We stabilized at 10 to 12 threads

9 #bbcon

Page 10: Big Data Management with Blackbaud CRM

MDM Constituent Search and CopySearch MDM and BBCRM and merge results

Page 11: Big Data Management with Blackbaud CRM

MDM Constituent Search and CopyPreview the Constituent from MDM before and press Copy

Page 12: Big Data Management with Blackbaud CRM

MDM Constituent Search and CopyConstituent is saved in BBCRM

Page 13: Big Data Management with Blackbaud CRM

MDM Constituent Search and CopyAll other constituent attribution flows over to BBCRM

Page 14: Big Data Management with Blackbaud CRM

In conclusion

14 #bbcon

Page 15: Big Data Management with Blackbaud CRM

Summary

• Future Considerations• Would like to consider archiving solutions in BBCRM• Convert Constituents to another type (underway/delivered)• Bulk deletion of Constituents• More direct MDM integration with BBCRM and less batch (Hydra)

• Working with Blackbaud• ALSAC and Services meeting regularly (Tech Summits)• Coordinating across groups and departments at Blackbaud• Informing product needs and highlighting performance bottlenecks• Data conversion considerations and strategy

15 #bbcon

Page 16: Big Data Management with Blackbaud CRM

16 #bbcon

Don’t forget to complete a session survey! Each completed survey enters you into a drawing to win a complimentary registration to bbcon 2015 in Austin, Texas*. 

*Blackbaud reserves the right to change or withdraw this promotion at any time, without advance notice. Promotion has no cash value and may not be exchanged, applied to, or combined with any other offer.

Did this session give you the jolt you needed?