26
1 The Need for an Intelligent Data Platform William McKnight McKnight Consulting Group Global Services

The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

1

TheNeedforanIntelligentDataPlatformWilliamMcKnight

McKnightConsultingGroupGlobalServices

Page 2: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

2

TableofContents

We’reAllintheBusinessofInformation.....................................................................3TheBusinessofData................................................................................................3PlatformingData......................................................................................................4

HowModernBusinessChallengesareDataChallenges...............................................7InsuranceandTelematics.........................................................................................7RetailCustomer360.................................................................................................8

DataMaturityMeansBusinessMaturity...................................................................10

InformationArchitectureisKeytoBusinessViability.................................................12DiverseDataIngestandIntegration.......................................................................13DataUnderManagement......................................................................................13360˚Views.............................................................................................................14ArtificialIntelligenceEnablement..........................................................................14

TheIntelligentDataPlatformResponse.....................................................................16

SequencingInitiativesUtilizinganIDP.......................................................................19

KeystoIntelligentDataPlatformSuccess..................................................................21

TheInformaticaIntelligentDataPlatform.................................................................23

AbouttheAuthor......................................................................................................25

AboutInformatica.....................................................................................................26

Page 3: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

3

We’reAllintheBusinessofInformationIncreasinglyadvancedamountsofinformationneedtobeincorporatedintobusinessoperationsforthosecompanieswhoaspiretobeindustryleaderstoday.Leaderscontinuetofinetunebusinessbasedondata,allocatingresourcesselectivelyacrosstheorganizationanditsinitiatives.Toaccedetothisstrategyrequiresanunprecedentedamountofaccessibleinformation.Whilehumanjudgmentremainsvital,thenatureofbusinessjudgmentischanging.Itmustgrowtoutilizemoreinformationanditmustutilizethatinformationmoredeeply.We’reallinthebusinessofinformation.Itisthewayabusinessutilizesitsinformationtodaythatwillsetitapart.Businessesneedmoreinformation,cleanerinformation,andmoreaccessibleinformationonbetterperformingplatformsthantheircompetitorstosurviveandthrive.Atthesametime,thecompetitivebattlefieldisquicklymovingfromtraditional,alphanumericdatatoallpossibledatawhichincludesastepuptotheunstructuredhigh-volumedatathatisbigdata.Whenyouaddinthird-partydata,thebodyofdataavailabletoeachcompanytogetundermanagementismind-boggling.Information–thevalueassociatedwithdata–canbeyetanotherstory.Informationshouldhaveallofthecharacteristicsofcomprehensive,clean,accessibleandwell-performing.Informationisdataundermanagementthatcanbeutilizedbythecompanytoachievegoals.Themainissuesinbridgingthedividetoinformationandtocompetitiveadvantageiswherethiswhitepapercomesin.Inthispaper,Iwillreviewinformation’simportancetobusiness,connectdataarchitecturetobusinesssuccess,definedatamaturityanddiscusshowtoarchitectinformationandimprovedatamaturityefficientlywithanIntelligentDataPlatform.

TheBusinessofDataTheearthgeneratedabout4zettabytesofdigitaldatain2013.IDCforecaststhatwewillgenerate40zettabytes(ZB)by2020.Now,allthatdataisn’tused,butincreasingly,moreofitis.Andit’snotjuststoredonce.Datawithvalueisbranchedoffinto

Page 4: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

4

numerousdatabasesacrossmultiplecompanies.Inonlythelastfewyears,asmuchdatahasbeengeneratedashadpreviouslyeverexisted.Manyindustriesdonotshipproductsorbuyrawmaterials.Theproductsandrawmaterialsaredata.Dataistheassetproducedbyinsurance,financial,healthcareandotherserviceindustries,butfurthermoreallindustriesproducedataandneedtoanalyzeitforitscompetitiveadvantage.Informationdifferentiatesallfromcompetitors.Informationqualityimpactsallstakeholders,internalandexternal.Informationisusedandreused.Inshort,informationisakeybusinessasset.

PlatformingDataPlatformingandarchitectingdatahasneverbeensodifficultandyetsocrucial.Therecipeforsuccessbeginswithagood,well-roundedandcompletearchitecturalapproach.Architectureisimmenselyimportanttoinformationsuccess.Youcanarchitecttheenvironmentinawaythatencouragesdatausebymakingitwell-performing,puttingupthearchitecturequicklyandhavingminimalimpactonusersandbudgetsforchangeoryoucanincurusagelossandinefficiencies.InastudybyKPMG1,60%ofCEOsseedisruptionasanopportunity.Weshouldseedatadisruptionthesame.Thebigchallengefacinganybodytryingtodrivenewbusinessinitiativesisdeliveringdataatthespeedthebusinessrequireswhiledealingwith:• Datavolumegrowth• Datacomplexitygrowth• Technologychange,newanalyticstechnologies,newapplications,newdatastorage

technologies,newcloudsystems

1U.S.CEOOutlook2017:DisruptandGrow.June13,2017.

Page 5: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

5

Usersofinformationareincreasinglygettinginvolvedininformationarchitecture.Theyarecontributingtoweighingthetradeoffs,assessingtheirworkloadsindeepways,selectingmethodsofdatamovementandlevelsofredundancy,determiningwhatconstitutesdataqualityandselectingtools.ItistheresponsibilityofthosewhoareawareofthepossibilitiesforinformationintheorganizationtocoachtheorganizationinthosepossibilitiesinhowtoUSEtheinformationwisely.Ifyou’rewaitingforthecurrentstateofaffairstogetmoresettled,knowthatisunlikelytohappen.Thetimeisnowtotakeinformationarchitecturetothenextlevel.Architecturecomponentsofdataintegration,dataquality,masterdatamanagement,datasecurity,cloudservicesandbigdatawillanchorthesuccessfulorganization.Informationmustcometogetherinameaningfulfashionortherewillbeunneededredundancy,wasteandopportunitiesmissed.Everymeasureofoptimizingtheinformationassetgoesdirectlytotheorganization’sbottomline.Theremustbea“truenorth”forthisenterpriseinformationarchitecture.Thereisno“onesizefitsall”referencearchitecture.Therearedifferentstartingpointsanddifferenttargetinterimendingpointsforarchitecture.Itneverreallyends.Eachcompanyisatadifferentlevelofmaturityandwillwishtoadvanceatadifferentpaceandmanycompaniesarenotgoingtobeabletomoveatthespeeddesiredwithoutnewskillsinplace.Duetothevolumeofpossibledatastoresandnecessarycomponentsofthemodernsuccessfulinformationarchitecture,leadingvendorsarerespondingwithabundlingofcomponentstofast-trackplatformingdecisionsandefficientlytakeonawiderexpanseoftheinformationarchitecture.ThisistheessenceofanIntelligentDataPlatform.Evenorganizationleaderscantakeatacticalapproachtotheexecutionoftherequirements.However,itdoesnotnecessarilytakelongertosatisfyinformationrequirementsinanarchitectedfashion.Ifarchitectureprinciplesandtechnologypossibilitiesarenotconsideredbeforehand,themeanstosatisfythecurrentrequirementmaybeinappropriatelydefaultedtothemeanstosatisfythelastrequirement.

Page 6: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

6

Theapproachtoinformationarchitectureis:1. Havea“truenorth”inmindfora5-yearinformationarchitecture,understanding

thatitissubjecttochange2. CommittoanIntelligentDataPlatformaspartofthearchitecture3. Organizenewinformationrequirementsintoworkloads4. Pursuethearchitectureonaworkload-by-workloadbasis,optimizingtheworkload

andsettinguptheenvironmentforefficientfutureinitiativesupport5. Performallworkwithaneyetowardsdeliveringreturnoninvestment(ROI)tothe

businessatthelowesttotalcostofownership(TCO)6. AddlotsofjudgmenttotheprocessthroughoutROIcanhappenthroughshort-termfinancialbottom-lineimpactorthroughinformation-borneinnovationthatyieldsROIlater.Thatiswhatinformationmanagementshouldbeallabout–notspeculation,funexplorationorabookstandard.It’saboutbusiness.Oncewehaveestablished,asabusiness,thataworkloadhashigh,positiveROI(relativetootherpossibilitiesfortheinvestment),weestablishthearchitectureforitthatmeetstheperformance,agilityandscalabilityrequirementswiththelowestTCO.Assuch,someofthispaperisfocusedonconveyingthecapabilitiesofeachplatformtohelpyouallocateworkloadsappropriately–withthelowestTCO!

Page 7: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

7

HowModernBusinessChallengesareDataChallengesHereareacoupleexamplesofmodernusecasesthatmustbedoneintheirrespectiveindustriesandareoverwhelminglydata-firstinitiatives.

InsuranceandTelematicsConsidertheopportunityoftelematics.Theseareautomobilesystemsthatcombineglobalpositioningsatellite(GPS)trackingandotherwirelesscommunicationsforvariouspurposes:automaticroadsideassistance,remotediagnostics,etc.).Telematicshaveserioustractionintheautoinsuranceindustry,mostfamouslybyProgressiveInsurance.Ifaconsumeroptsinbyplacingasensordeviceintheircar,whichfeedsitsdatatotheinsurancecompany,theycansavemoneyontheirinsuranceifcertainsafedrivingparametersaremet.Thesedevicescapturefinemovementsofthecarandthecar’slocation,bothofwhichdecreasetheoddstoveryminimalthattheinsurancepackagewouldbelessthanprofitabletotheinsurancecompany.Telematicspresentsopportunitiestomonitorandadjustpremiumsforindividualswithpersonalautopoliciesaswellascommercialfleets.ThebigopportunityistoencouragesaferbehaviorsthatbenefitboththeInsurancecompanyandcustomers,potentiallysavinglivesbyincentingsaferdrivinghabits.Thepresenceofadeviceinthevehicle,likeamobilephone,providesdriverbehavioraldata.Combinedwithweather,geographic,andtrafficinformation,itprovidesacontinuousflowonthestateofthevehicleandthesafetyofthepassengersandcargo.Telematicsanalysisstreamlinesvehicleandfleetriskscoring,providingvaluableinputintounderwritingdecisionsandopportunitiestoreviewpremiumsfornecessaryadjustmentsbasedonactualdrivingbehavior.Byintegratingtelematicsanalysisintotheenterprisedataarchitecture,asopposedtotreatingitasanisolatedcapability,addanewdimensiontothecomprehensiveunderstandingofacustomerandthevalueoftherelationshipwiththatcustomer.Inaddition,enterprisecapabilitiessuchasdatavisualizationandcustomerexperienceportalscanmakethemostofthetelematicsinsights.Thearchitectureresponsetothetelematicschallengeistorouteallmobilephone,EnhancedGPSandGPSdataintoadatalakewherevehiclescoringisdoneandfedtoa

Page 8: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

8

datawarehouse.Theinsightandactionfromtheanalysisthereisusedinpricing,productandunderwritingdecisions.Thismodernusecaseisalmostallaboutharnessingthisdataandlisteningtowhatthisnewclassofdataistryingtotellthecompany.

RetailCustomer360Theconceptofcustomerdataasacompetitiveadvantageisrelativelynewtomanyretailorganizations.Astheretailerbeginstobetterunderstandcustomersandhowtomaximizethevalueofcustomerrelationships,theCustomer360dataassetincreasesinimportance.Withcustomerdatainhand,thefirmcanpursueCRM/1-1strategiesmorequicklyandatlowercostinanintegrateddataandanalyticsenvironment.Becomingmorecustomer-centricisacriticalsuccessfactorbothtoincreasesatisfactionandtoup-sellandcross-sellduringmanycustomerinteractions,includingsales,especiallyatacompletionwhereacustomermaybeawareofrelatedproductsorsatisfiedwiththecompanyandwithpropensitytoexpandtheirrelationshiptoadditionalproducts.Formanytoday,thereisnotasmoothintegratedexperience.Opportunitiesforupsellandcross-sellarenotsoughtouteffectivelyduringthesale.Nextbestoffersarenotpartoftheinteractions.Telechannel,chat,web,andpersonalcontactexperiencesarenotintegratedacrossmostretailers.Thisgapmustbefilledtoremaincompetitiveandtomaximizethevalueofeachcustomerrelationship.Muchofthisgaprequirescustomerrelationshipmanagement(CRM)strategyandapplications,butotherkeydata&analyticsarchitecturalcomponentsplayakeyrole.Thisinitiativecreatesadefinitive,robust,andauthoritativecustomermaster,becomingarobustsourceofrecordfortheenterprise.Byusingamasterdatamanagement(MDM)system,datastewardsmanagingcustomerinformationanddataabouttherolesthatcustomersplayhaveasingleplacetomanagedata.Managementofcustomerdataalsoincludesrobustnameandaddresshygienecapabilitiestokeepcustomeraddressesup-to-dateandaccurate.Customer360alsoprovidesameansfortakingthisdataacrosstheenterprise.Variousgroupsgainextensiveaccesstoinformationaboutcustomerlocations,behaviors,demographics,storerelationships,andotherinformationcriticaltobuildingmore

Page 9: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

9

valuablerelationships,andtofindnewcustomersthatarelikelytobevaluable.Thisisheavydataintegration.Arewardingcustomerexperiencerequiressignificantlymorenearreal-timeintegrationand,increasingly,predictiveanalyticsthanexistsinmostorganizationstoday.Customersdon’twanttoconfrontinternalorganizationalboundaries.Theywantacustomerexperiencethat’saboutthem,andtheirneeds.Whentheyupdateinformationaboutthemselves,suchasachangeofaddress,theyexpecttodoitonce.Iftheycalltoupdatetheircontactphonenumber,theyexpecttoseeitreflectedonthewebsitewithinminuteofcompletingthephonecall.AnEnterpriseoperationaldatastoreisakeycomponenttoachievingthislevelofnearreal-timeintegration.Improvementsmustbemadetodaytosmoothenthetransitionofcustomercommunicationsbetweensilosandgetcustomerdatainplacetosucceedacrosstheenterprise.

Page 10: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

10

DataMaturityMeansBusinessMaturityInthecompetitivearenaofinformationmanagement,wehaveseenthebarsethighereveryyearforeverylevelofdatamaturityandcompetitiveness.Indeed,astheHaitianProverbgoes,“BeyondtheMountainlieMoreMountains.”However,unlikemountainranges,new“mountains”intermsofinformationcapabilitiesarecontinuallybeingcreatedbythevendorcommunityandhighlymatureorganizations.Onceyougettoapeak,youlookoutandthereisanotherpeak.Forexample,comingsoontobeingaparityitem,anddistinctlyonthedatamaturityspectrum,isartificialintelligence.It’sapluswhenyourkeyvendorsarehelpingtopavethatpathforyou.Topperformersrealizetheyneedmoredataundermanagementfortheirbusiness.Theycontinuallygrowthedatascienceoftheirorganization.Theyrealizetimeshavechangedfromlast-minutesingle-usedatapullsandevenfromthe“everythinggoesintoadatawarehouse”mentality.Today,it’salldata,includingthirdpartydata,withqualityandspeed-andarchitectureandmaturity,whichsetupfutureusesefficiently.Anytechnologistwoulddowelltotakethemselvesoutofacomplete“support”mindsetandintoaleadershipmindsetfortheinitiativestheyareuniquelypositionedtochampionintotheorganization.Thesedata-basedinitiativesarethecutting-edgecompetitiveinitiativesthatwillsettheorganizationapart.Whenyouare“intheknow”,asaninformationprofessionalshouldbe,thereistheobligationtocreatetheseinitiatives.Increasingly,itisbeingexpectedoftheinformationprofessional.InadditiontothetraditionaltopitemofIT-usersatisfaction-topperformersneedtoinitiatewithintheircompanyaswellasraisetheinformationfoundationofthecompanytodealwithcurrentandfutureinitiativesefficiently.Theseactsofleadershipmustbedoneoutsidetheconfinesofabudget.Budgetscomeforprojectsupport.Leadershipisopportunisticandhappenswithinthebudgetaryframeworkoftheprojects.Everydaythereisopportunitytoleadandmaturethedataenvironment.Thatmaturedataenvironmentwouldbematureacrossthedimensionsoftechnology,datastrategy,architectureandorganization.Eachpillarmustberaised.Justasyoucannotskipdatamaturitylevels,youcannotraisesinglepillarswithouttheothers.Forexample,youcannothaveahighlymaturedatastrategywithremedialtechnology.

Topperformersrealizetheyneedmoredataundermanagementfor

theirbusiness.

Page 11: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

11

Dataquality,masterdatamanagement,datasecurity,cloudservicesandbigdatawillanchorthesuccessfulorganization.Andwithamodernarchitecture,therewillbeanabundantneedfordataintegration.Therewillbeaplethoraofdatastorageoptionsutilizedinahighlymatureenvironmentthatiseffectivelymatchingworkloadstoplatforms.Inadditiontothedatawarehouse,therewillbeaDataLake,probablyinHadooporS3,numerouscolumnstoresandin-memory/memorystoragestores,masterdatamanagement,streamingdata,andNoSQLandNewSQLoperationalstoresinadditiontolegacyrelationalstores.Datawillbeamajorpointofexecutiveconversation.DataGovernancewillbepervasive,authoritativeandsupportinitiatives.Dataqualitywillbescored(andhigh).Initiativeswillbedonebytrueagilemethodsandwithaccompanyingorganizationalchangemanagement.Thishighdatamaturityiswhatsupportsthebusinessofinformation,demonstratestheemergingbusinessleadershipandaddressesthemodernbusinesschallenges.

Page 12: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

12

InformationArchitectureisKeytoBusinessViabilityMaturityunderliespositivedigitaltransformation.Whetherbyourchoicetoadaptandadoptorexternalforcesthatthrustdisruptionuponus,organizationsmustdrivetheseinitiativestoremainviable.Improvingfinancialperformanceandcompetitivepositionsaretheeffectofstrivingtechnologicallytowardsdeepercustomerrelationships,efficientoperations,personalizedexperiences,anddetectinganomalies.Therightinformationattherighttimetomaketherightdecisionhasbeenthemantraofinformationmanagementsinceitsinfancy.Thathasnotchangedmuch,buttherelationshipofhumanandmachineinteractionandwhoisproducinganddeliveringdata,timingitsarrival,andmakingthedecisiontotakeactionisshiftmorefromhumantomachine.Thenatureofdataanalysisanddecisionmakingisshifting,evenoutsidethebusinessworld.However,mostorganization’sinformationecosystemsarenotarchitectedforanadvancedtransformationofthisveryrealandpresentparadigmshift.Regardlesswhetheryouaremakingadecisiontodoamajorrerouteofasupplychainorwhatmovietogoseethisevening,orwhetherthisdecisionismadewithartificialintelligenceorahumanbrain,theneedtohavetrustedreliabledataremains.Theinformationmustbearchitectedtoarriveatthebestpossibleconclusion.Takingthemovieexample,theinformationarchitectureofadecadeagowaspickingupthenewspapertocheckshowtimes.Butthisdataissiloed.Itdoesnotpossessweatherdata,trafficdata,crowdindexes,dinnerreservationavailability,orevenyoursentimentofothermoviegoers.Ifyoucouldbringallthatdatatogetherinoneplace,youcouldquicklymaketherightdecision.Youcouldevenautomatethedecision.Thus,a30-minutediscussionandcontemplationofwhatmovie,whenandwheretogo,iftoevengoatall,couldbecondensedintoaninstantaneousdecision.Nowthinkoftheimpactinareal-lifebusinesssituation.Anygoodarchitecturaldesignwillhaveablueprint,aschematicofeverythingneededtocompletethestructure.Youwouldn’tbuildahouseandforgettoplanfor,say,theelectricalwiring.Toensurenothingkeyisoverlooked,let’sgooverthekeycomponentsofamoderninformationarchitectureandgivebusinessrationaleforitsimportance.

Page 13: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

13

DiverseDataIngestandIntegrationAmoderninformationmanagementarchitecturemustbeabletoahandleallkindsofdata.It’snotjusttraditionalbusinessdataconvenientlystoredinotherrelationaldatabases,butalldata.Thecombinationofdatafrommanysources—bothexternalandinternal—isdrivinganewwaveofinsightsandinnovations.Thearchitectureisatthereadytocapturedatafromevenhighlyfragmentedsources,regardlessofstructure,volume,technologyplatform,orlocation.Thisiscriticalfortoday’scomplexenterprises.Thearchitectureconsumes:

• Withanystructure(orlackthereof)—Structured,semi-structured,unstructured• Usinganyintegrationmethod—Batch,real-time,streaming,API• Havinganymetadata—Application-,pattern-,product-based• Fromanysource—Databases,webapps,mobileapps,bigdatasystems,sensors,

socialmedia,etcetera• Fromanylocation—On-premises,remote,cloud,hybrid,thirdparty,public

DataUnderManagementHowever,wearenottalkingaboutjustadatalake,oradumpinggroundforalldata.Thedatamustbetransformedandmanagedintoatrusted,secure,governed,accessibleform-readyfortimelyandactionabledecisionmaking.Justbecausedataiscominginfromanywhereandeverywheredoesnotexcuseusfromapplyingthesamedisciplineandcaretowardsitsquality,completeness,andsecuritythanwewouldourgeneralledger.Thus,yourmodernarchitecturemustincludethecapacityformasterdatamanagement,datagovernance,dataquality,andsecurity.However,thesearenotsimplisticimplementationofvarioustools.Donotgetcaughtinthetrapofthinking,“Oh,we’vegotthatcovered”withtheseveryimportantdisciplines.Infact,iftheyarenotmature,theymustmature.Questiontoaskinclude:• Canyourbusinessusersquicklyidentifydatathathasprescribeddatagovernance

andcompliancerequirements?• Canyourdatastewardseasilyassessandvisualizethequalityofdata?

Page 14: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

14

• Canyourdatasecurityprofessionalsdetectdatamisuse,protectsensitivedata,anddemonstratethatappropriatedetectionandpreventionmechanismsaremaintained?

• Canyoursystemadminsleveragepredictivemaintenanceandperformanceoptimizationalgorithmsindatamanagementprocesses?

Ifyouanswered“No”toanyorallofthese,keysupportstructuresinyourarchitecturemayneedbolsteringtoachieveyourmodernizationgoals.

360˚ViewsWehavealreadyexploredtheuseandpowerofCustomer360˚.ThesameneedsaretrueforProduct,Supplier,StoreLocation,andotherkeyentities.Modernarchitecturefordigitaltransformationwillseedatamanagedfromendtoend.Thismeansfromthemomentitissourcedtothetimeitmaterializesina360˚view,eachpieceofdataismanaged.Datahasbusinessvalue—andeventhoughitissometimesdifficulttoquantify—valueismultipliedandgainedwhendataisleveraged,enhanced,andmadeavailable.The360˚viewisthemodernarchitecture’smaterializedinsightofexperience.Howisacustomer’sexperiencewithus,ourproducts,ourlocations?Whatisourexperiencewithoursuppliers?360˚viewsdon’tjusthappenwithouttheunderlyingarchitectureofend-to-enddatamanagement,andthebusinessvalueofthediversedataweareintegratingandmanagingisnotrealizedwithouteffective360˚viewsandotheradvanceduses.

ArtificialIntelligenceEnablementSuchanadvanceduseinthemodernarchitectureistheenablementofartificialintelligence(AI).Ina2017studycommissionedbyTeradata,shortcomingsinarchitectureandinfrastructurerankedhigherthanlackoftalentorbudgetasbarrierstoAIimplementations.AIforemostneedsdata-qualitydataprovidedbyarobustarchitecture.ThearchitectureforAIhasseveralhallmarks.First,itisbuiltonanenablementstrategy.BusinessprioritiesandcurrentcapabilitiesareidentifiedinallAIusecases.Second,modernarchitecturewillenableAIinthedatapipeline,notjustasananalyticendpoint.Thishugepointcannotbeoveremphasized,becauseitisoftenoverlooked.AIcanbe

Page 15: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

15

appliedtodatamovingfromsourcesintotheinformationecosystempriortoconsumptionandanalysis.Thiscanincludeassessingdatasimilarity,auto-tagging,recommendationstouserssearchingfordata,anddiscoveringstructureinrawdata,butalsofuturepossibilities,includingself-integrationanddevelopmentactionrecommendations.FewITbudgetsseengrowthsincethefinancialcrisisof2008.Yetthevolumeandcomplexityofdatahave,aswellatthetechnologychange.Howwillyoucompete?AIprovidesawaytodomorewiththesameorlessresourceswhenusedtoautomatedatamanagement.Getyourdataacttogether.Beginningwithalookatyourarchitecturefortransformationiscritical.Itmaybethekeytoyourbusiness’futureviability.

ModernarchitecturewillenableAIinthedatapipeline,notjustasananalyticendpoint.

Page 16: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

16

TheIntelligentDataPlatformResponseIntherecentpast,manyofthecriticalcapabilitiesofthemoderndatamanagementplatformhavebeenlargelyoutofreachformanyorganization.Evenmorechallenging,ordownrightimpossible,wastofindallthesecapabilitiesintegratedintoonesolution.Itsimplydidnotexist.Entertheplatformapproach.Bydefinition,aplatformisafoundationaltechnology(orstackoftechnologies)thatareusedasabaseuponwhichotherapplications,processes,andusesaredeveloped.Upuntilthistime,informationmanagementplatformshavebeensingularpurpose—adatawarehouseplatform,amasterdatamanagementplatform,adatagovernanceplatform,andsoon.Amultifaceted,fullspectrum,end-to-enddatamanagementplatformwasnotevenanoption.Theplatformapproachshouldbeastrongconsiderationforanyorganizationseekingtobuilditupthecriticaldatamanagementcapabilitieswediscussedintheprevioussection.First,theplatformapproachbringsthekeydatamanagementcapabilitiestotheorganization.Atrueplatformwillbedatasource,datavolume,datavariety,anddatastructureagnostic—thusitenablestheintegrationofhighlydiversedata.Aplatformalsobringsallkeydatatogetherwithfacilitates360˚viewsofcustomer,product,vendor,andsoforth.Aplatformalsoisafoundationforcurrentandfutureapplications—includingartificialintelligenceandmachinelearningalgorithms—toacceleratetheproductivityofallusers.Aplatformbringsafullsuiteorstackofdatamanagementtoolstocoverallkeydisciplines—whetherthedataismasterortransactional,operationaloranalytical,heavilygovernedorqualityassuredthroughautomation,bigdataoragoldenrecord,real-timeandstreamingorbatchloaded,usedforreferenceorforcompute-intensiveoperations…aplatformisrobustandflexibleenoughtohandleitall.Second,aplatformreducesthecomplexityofdatamanagementinanincreasinglycomplexdataenvironment.CIOsandotherdataleadershipfaceanever-increasingchallengeofnewdataandevolvingbusinessquestions.Theymustbalanceinnovationandarapidlyexpandingusecaseportfoliowithless-than-rapidlyexpanding(orstagnantorevenshrinking)budgets.Withaplatformapproach,itcanbeawelcomechallenge,becauseaplatformcandecreasethecomplexityofmanagingalldata—openingthe

Page 17: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

17

possibilitytonewdataanduseswithoutanexpensivecapitaloutlayandacquiringexpensivetalenttodevelopandsupportthenewtechnology.Itistimetostopthinkingofdataintegration,dataquality,masterdatamanagement,datasecurity,andsoonasseparateapplications,butmoreasstepsinadatamanagementpipeline.AplatformcanprovideaconsistentUIandfunctionsothattheplatformworksconsistentlyfromdatamanagementfunctiontofunction,loweringthelearningcurveandacceleratingproductivity.Third,itunifiesapproachesandralliespracticeanddisciplinearoundaunifiedapproach.RogueorshadowITarebecomingmoreprevalent.Oftentheintentioniswellmeaning,buttoooftenshadowITemergeswhenthecentralizedtechnologystructuresareseenastoocumbersomeortooslowtorespondtobusinessdemand.ThissplinteringanddisenchantmentofITintheorganizationcausesahostofproblemssuchasunnecessarycosts,unsupportedandunsanctionedsolutions,andoverlappingservicesandtechnologies.Evenmoreproblematicisthelackofunityanddisciplinewithdata.Multiplecopiesofkeydataandincongruentdatadefinitionsandbusinessruleswillhauntanorganizationwithmanypainpoints.However,ontheothersideofthecoin,thespiritofinnovationshouldnotbesquashed,butenabled.Aplatformapproachgivesafoundationtobuildon,butalsoaunifiedonewherebestpracticesindatadisciplinecanbemanaged.RogueITgroupscaninnovateandbuildwhattheyneed,buttheydoitintheconfinesofaunifiedplatformleveragingunified,managed,andgoverneddata.Codereuseandtransferableskillsbecomemorepossibleinamorestandardizedenvironment.Agoodplatformshouldprovideasetoftoolsforanykindofdata.Finally,theplatformapproachenablesfutureinnovationwithdataandfutureproofsusagainstinevitableshiftsindatatechnologytrends.Itusedtobethateveryyearbroughtnewtrendsandtechnologiesinthedataworld,nowitseemstoshifteveryquarter.Theinnovationandresultingchangesneverends.EvenifHadoopisoldnews,andPythonbecomesobsolete,aplatformapproachprovidesaframeworkagnosticandaprotectionagainstshiftsintechnologies,data,programminglanguages,andotherfacetsofinformationmanagement.Alegacyapplicationbuiltonanoldertechnologyremainssupportedbytheplatform,butanewapplicationusingcutting-edge(orbleeding-edge)technologycanbepluggedintotheplatformandleveragethesamemanageddataandservicesasthelegacyone.

Page 18: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

18

Aplatformwithadvancedcapabilitieswillprovideautomation.Forexample,newdatacouldbeautomaticallyrecognizedandonboardedintotheinformationecosystem.Automaticintegrationcouldoccurforknowndatatypesandsources.Intelligentsuggestionsforreusebasedonpriorwork.Aplatformapproachissimplyasmartwaytogo.Reductionincostandcomplexityandexpandinguseandinnovationarecriticaltoenablingandsustainingbusinessviabilitywithinformationmanagement.Justastheworkofhundredsofblacksmithswereturnedintoanassemblyline,aplatformcanenablethesameautomationinyourdata.

Page 19: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

19

SequencingInitiativesUtilizinganIDPAnadvantagetotheInformatica’splatformapproachtodatamanagementisitsmodularity.Piecebypiece,blockbyblockisasmartwaytobuildouttheplatform—especiallyfromthegroundup.Integration,360˚domainviews,masterdatamanagement,security,bigdata,andsoforthcanbethoughtofasindividualLego™blocks—arranged,stacked,andconnectedinaconfigurationandonatimelinethatsuitstheenterprise’sneeds,desiredpace,andbudget.Thekeyistodoitstrategically.Aroadmaptobuildanintegrateddataplatformiscrucial,andthepropersequencingofthecomponentsisacriticalsuccessfactor.Thinkbig(abouttheplatformandtheoveralldatalandscape),startsmall(withoneortwocomponentsyoucanmanageandachieveandearlywin),andscalefast(byusingthemomentumtoovercomedataandorganizationalinertiaandcontinuingtobuildoutandgrowtheburgeoningplatform).First,thinkbig.Youmustenvisionthedatamanagementplatformyouwanttobuild.Whatcapabilitiesdoesyourbusinessabsolutelyneedtobesuccessfulinitscompetitivemarket?Whatismostlikelytodisruptyourindustryinthenext24-48months?Whattechnologiesaregoingtogetyouaheadofthatcurve?Whenit’sclearwhatyouarebuildingtowards,youcanbeginbuildingthebaserequiredtogetthere.Weallalsoknowinnovationanddisruptioncanhappenfast,sothefoundationalplatformmustgiveyouthespeedandagilitytodevelopanddeployanewapplicationortechnologyquickly.Ifyouadoptanewemergingtechnologythatwillchangethegameamongyourindustrypeers,youcanbeboggeddownby6monthsof“dataconversion”or“dataqualitywoes”togetitofftheground.Thedataneedstobethereandwaitingforthefutureapplicationsthatwillconnect,consume,andproduceadditionaldata.Second,startsmall.Stepbackandstrategicallyassesswhereyouare.Askyourselfwhatarethedatariskstomovingnewbusinessinitiativesforward.Areyouin“spreadsheetpurgatory”plaguedby“spreadmarts”andDeath-by-Excel?Considergettingyourkeydataundermanagementwithmasterdatamanagement.Areyouoverwhelmedbyaninfluxofdatavolumeandvarietythatiseitherbeingignored,unanalyzed,orevenworse,discarded?Considerasmartly-constructeddatalake.Doyouhavenowaytogetitintothatlakeanddisperseitamongstkeytechnologies?Startwithintegration.Isthedataofsuchpoorqualityandreliabilitythatthebusinessdoesn’ttrustitoritisunsuitabletobuildon?Getgoingwithadataqualitycomponent.Pickingtherightplacestartshouldbemorethoughtfulthanablindfoldeddartthrow.Considerprofessionalservicesthatcan

First,thinkbig.

Second,startsmall.

Page 20: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

20

helpassessyourcurrentstateandpavearoadmapforsuccessandplatformbuildout.Theycanassistyouinstartingwithanimportantbusinessproblemwithclearbenefits,butthatisscopedforfairlyquicksuccess.Third—andthisistheexcitingpart—scalefast.Gainingmomentumwithanearlysuccessandwithastrategicroadmapinplace,youcangrowandexpandintothefull-stackend-to-enddataplatformthatwillempoweryourbusinessinitiativeswiththedataisneedstoevolve,adapt,andevendisrupt.Thisisdatacapabilitymaturityatitshighestlevel—optimizeddatamanagement.Scalingfastdoesnotmeanoutpacingyourmaturity,butharnessingtheplatformanditsmaturityandrapidlydeveloping,deploying,andpivotingoffit.WithInformaticaIntelligentDataplatform,dataisanassetandthepossibilitiesaremaximized.

Third—andthisistheexciting

part—scalefast.

Page 21: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

21

KeystoIntelligentDataPlatformSuccessStayBusiness-Focused.Whilethedomainsofdataintegration,dataquality,masterdatamanagement,datasecurity,cloudservicesandbigdataareinstrumentalinachievingbusinessresults,theyarenottheendproductthatbusinessneeds.Yourbusinessneedsbottom-lineresults–ROI.ROIcanhappenthroughshort-termfinancialbottom-lineimpactorthroughinformation-borneinnovationthatyieldsROIlater.Theinitiativesyouadvocateshouldnotbe“masterdatamanagement”,“bigdata”andthelike.TheyshouldbeclosertoROIasin“targetedmarketing”,“fraudelimination”,etc.LeadfromData.Asnotedbefore,DataLeadershipisBusinessLeadership.Asadataprofessional,bebold.Inmanyorganizations,thedataprofessionalsholdthekeystocompanyviabilityandsuccess,yetthebusinessdoesnotalwaysrecognizethat.UtilizingnewapproacheslikeanIntelligentDataPlatformareessentialtokeepingdatamaturitygoing.Getthedataacttogetherforyourcompanysuchthatthedatais“screamingout”whatneedstobedonewithit.Thisisthehighcallingofthedataprofessionaltoday.SequenceAppropriately.Igavethisatreatmentintheearliersectionduetoitsimportance.SomeelementsofthesequencingoftheinitiativesoftheIntelligentDataPlatformareeasytodo,howinitiativessetupotherinitiativesand,ofcourse,thebusinessimportance.Keepinmindyouaresequencingbusinessinitiatives,nottechnologyinitiatives.Youjusthappentobebuildingtheintelligentdataplatformoutaspartoftheinitiatives.ConsiderTheStaff.Teammembernumbers,skillsandabilitytodedicatetotheinitiativesmustbeconsideredinbuildingtheroadmaptotheintelligentdataplatform.IrecommendaNavySealapproachwithfewer,experiencedresourcesthatcanoperateatthespeedthatthebusinessultimatelyrequires.Furthermore,theintelligentdataplatformcannotbeaccomplishedwithoutanintensefocusonthemanyandgrowingtechnicalbasesthatcanbeusedtostore,viewandmanagedata.Therearemanynow,morethanever,thathavemeritinorganizationstoday,whichiswhyIadvocatecompanieshaveaChiefDataArchitect,orsimilar,positiontogoverntheintroductionofnewdatatechnologies.ApproachThat“TrueNorth”ArchitectureEveryDay.Youwillbeeithermovingyourdatamaturityupordowneverydayandrememberthematuritylevelcredentialscontinuallychange.Artificialintelligencelooms.Momentummattersandcantaketheorganizationswiftlytohigherdatamaturityifmaintained.HistoricallydatahasnotbeencentraltoITarchitecture.Thatisfundamentallychangingasthebusinessseesthevalueofdatatoprovidecompetitivedifferentiationintermsofbettercustomer

Keepinmindyouaresequencingbusiness

initiatives,nottechnologyinitiatives.

Page 22: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

22

experiences,betterpatienthealthcareoutcomes,betteroperationaldecisions,etc.Elicitbusinesshelpandsupportingrowingthedatamaturity.RevisittheTargetArchitecturePeriodically.Forthevolatileandfast-changing,yetveryimportantbusinessassetofdata,thetargetarchitectureshouldberevisitedevery6monthstoensuretheplansareinsynchwiththebestapproachesandtechnologiesthemarkethastooffer.Anintelligentdataplatformthatcangrowinamodularfashionapproachhelpstoenablerapidchangesindatamanagementprioritieswhileminimizingdisruptiontoproductivity.ExhibitLeadership.Changenevercomeseasily.Yet,datafoundationsatorganizationsneedrapidandconsistentchangetoday.Continualadvocacyoftheintelligentdataplatformandotherapproachesdeemedessentialisgoingtoberequired.Leadwithagoodhelpingofpositiveattitude,delegation,vision,motivationandgoalsandyourjourneywillbeexcitingandproductive.

Page 23: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

23

TheInformaticaIntelligentDataPlatformTheInformaticaIntelligentDataPlatform(IDP)isanintegratedend-to-enddatamanagementplatformtospurdatamaturityandenablebusinessinitiativeswiththerightdataattherighttime.IDPalsoaimstodecreasecomplexitybyprovidingaunifiedplatformforenterprisedata,connectivity,metadata,andoperations.Thisbringstheentirerealmofdatamanagementunderasingleumbrella.TheIDPralliestheenterprisearoundasimplifiedandunifieddatamanagementcapability,becauseitacceleratesthedevelopmentanddeploymentofnewdatamanagementprojects.Itisbasedonanext-generation,no-codinguserexperienceacrossallofthedatamanagementcapabilitiesoftheplatform.Nomoredataconversions,expensivedataintegrationdevelopment,orqualityissues.The“data”barontechnologyprojectGanttchartsshrinkconsiderably.TheIDPalsoprovidesapowerfulandconsistentsetofcapabilitiesformanagingdatawhereveritlives—on-premisesorinthecloud—andwhatitis—frommasterdatatobigdata.TheIntelligentDataPlatformisalsomodularallowingyoutostartwithanysinglecomponentandgrowatapacethatmakessensefortheorganization.Relativelyfeworganizationsaregoingtogetfundingtogodoawholenewdatamanagementarchitectureatonce.Investinginitandbuildingitoutastheydelivernewbusinessinitiativesandtheirneedsgrowaremoretypical.Thefollowingdiagramillustratesthedifferentcomponents.

Page 24: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

24

WhatlikelywillsettheInformaticaIDPapart,however,isitsartificialintelligence(AI)capability—theCLAIRE™engine.CLAIRE™—orCloud-scaleAI-poweredReal-timeEngine—usesAIandmachine-learningpoweredbyenterprise-widedataandmetadatatoautomateaspectsofdatacapabilitymaturityandsignificantlyboosttheproductivityofallmanagersandusersofdataacrosstheorganization.CLAIRE™uses(andaugments)metadata—thetechnical,business,operational,andusagedataaboutdata—tointelligentlyacceleratedatamanagementcapabilitiesintheIntelligentDataPlatform.CLAIRE™currentlyenablesintelligentdiscoveryofdatasimilarity,discoveryofdomainsandclassificationviatagging,entitydetectionanddefinition,datarecommendations,discoveryofdatastructure,andanomalydetection.Informaticaplanstocontinuetointegrateintoadditionalpartsoftheplatformovertime.Byautomatingthesecapabilitieswithartificialintelligence,youcanseehowrapidlydatamanagementcapabilitiesarepropelledforwardandnewdataacquisitionisaccelerated.Data-centricbusinessinitiativesarebuiltonafoundationofdataanddatamanagementmaturity.Remainingcompetitiveandleadingintoday’sbusinessclimaterequiresbuildingacompetentdatamanagementcapabilitytofullyleveragethepowerofdataanddeliverdataatthespeedthebusinessrequires.Datamanagementischallengingevenunderordinarycircumstances,butundertheextraordinarycircumstancesofthemodernworld,conventionalapproachescannotmeetthechallengeorscaleintothefuture.Standardizeonanend-to-enddatamanagementplatformthatusesthepowerofyourdata,metadata,andadvancedcapabilitieslikemachinelearningandAItoremaininfrontofdigitaltransformationthatischangingourworld.Dataprovidestheforesighttobecomemoreagile,realizenewgrowthopportunitiesoreveninventnewthings,andwillbeleveragednotjustonce,butagainandagain.GetyourdataacttogetherwiththeInformaticaIntelligentDataPlatform.

Page 25: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

25

AbouttheAuthorWilliamisPresidentofMcKnightConsultingGroup.Heisaninternationallyrecognizedauthorityininformationmanagement.HisconsultingworkhasincludedmanyoftheGlobal2000andnumerousmid-marketcompanies.Histeamshavewonseveralbestpracticecompetitionsfortheirimplementationsandmanyofhisclientshavegonepublicwiththeirsuccessstories.Hisstrategiesformtheinformationmanagementplanforleadingcompaniesinvariousindustries.WilliamisauthorofthebooksIntegratingHadoopandManagement:StrategiesforGainingaCompetitiveAdvantagewithData.Williamisapopularspeakerworldwideandaprolificwriterwithhundredsofpublishedarticlesandwhitepapers.Williamisadistinguishedentrepreneur,andaformerFortune50technologyexecutiveandsoftwareengineer.Heprovidesclientswithstrategies,architectures,platformandtoolselection,andcompleteprogramstomanageinformation.

Page 26: The Need For An Intelligent Data Platform...2. Commit to an Intelligent Data Platform as part of the architecture 3. Organize new information requirements into workloads 4. Pursue

26

AboutInformaticaDigitaltransformationchangesexpectations:betterservice,fasterdelivery,withlesscost.Businessesmusttransformtostayrelevantanddataholdstheanswers.Astheworld’sleaderinEnterpriseCloudDataManagement,we’repreparedtohelpyouintelligentlylead—inanysector,categoryorniche.Informaticaprovidesyouwiththeforesighttobecomemoreagile,realizenewgrowthopportunitiesorcreatenewinventions.With100%focusoneverythingdata,weoffertheversatilityneededtosucceed.WeinviteyoutoexploreallthatInformaticahastooffer—andunleashthepowerofdatatodriveyournextintelligentdisruption.