ManagedFileTransfer:backboneofyouropera7ons ChinmayaTripathy,Integra1onConsultant,YenloRobBlaauboer,Integra1onConsultantYenloSenduranBalasubramaniyam,So<wareEngineerWSO2

April5th2016

Aboutthepresenters

2

ChinmayaTripathySeniorConsultant,YenloChinmayaTripathyisanIntegra1onConsultantwithWSO2knowledgestackalongwith9yearsofexperianceincrossdomainprojectsandtechnologieslikeJava,J2EE,WebServices,Spring,SOAArchitecture,JS,AJAX,DOJO,GWT.HehasaMasterdegreeinComputerApplica1on,followedbygradua1onofscienceasMathema1csasspecialcourse.RobBlaauboerSeniorConsultant,YenloRobisaSeniorBusinessConsultantandSolu1onArchitectwithmorethantwentyyearsexperience.Inaddi1ontohisworkheisanac1vebloggerworkingonanumberofar1clesonthe'InternetofThings'andaWSO2'GeRngStartedwith...'seriesinwhichhetalksaboutWSO2componentsandtheirpurposeespeciallyaimedatnontechnicalreaders.SenduranBalasubramaniyamSo:wareEngineer,WSO2Senduran is a software Engineer at WSO2 and part of WSO2 Enterprise Service Bus engineering team.

3

•  PremierPartnerofWSO2

•  GlobalOrganiza1on

•  OfficesintheNetherlands,Germany,Belgium,UnitedKingdomandUnitedStates

•  ExpertsisIntegra1onSolu1ons

•  Expertsina‘ConnectedBusiness’

•  WSO2project&consultancyservices

•  WSO2supportservices:•  ProductSupport•  DevelopmentSupport•  Opera1onalSupport

•  WSO2Trainingservices

•  Enterprise&Solu1onArchitecture

Whoweare Whatwedeliver

Moreinfoaboutusandourpre-build(WSO2)solu1ons:www.yenlo.com

TopicsWebinar

4

ManagedFileTransfer=SGlloneofthebackbone’sofmanyoperaGons

•  Introduc1onto‘FileTransfer’ingeneral

•  FiletransferinWSO2ESB(Transports)

•  WhataboutManagedFileTransfer?

•  BenefitsofourMFTsolu1onbasedonWSO2

•  Demonstra1on&Technicaldetails

•  Youhaveques1ons?Wehaveanswers!

ThelongevityofFileTransfer

Formanyorganiza1onsfiletransferiss1llpartoftheirdailyopera1ons,forexample:o  Transferfilesbetweensystemso  Interactwithbusinesspartnerso  ManagingLaws(publishing)o  Taxreturnstoconsumers

Filetransferisheretostay….

6

o  Filescanbereallybig,uptoseveralGB,andreallysmall,somekilobytes,forexample

Bigfilesandsmallfiles

7

o  FilescanbePDF,XML,Plaintext,and-so-ono  Filescanbeencryptedorevenneedtobeencrypted

XML, PDF, DOC, D

OCX …

Allkindoffiles

8

o  A<eruploadingyoumightneedtosendtheuploaderareceipto  Calcula1ngahashmightbenecessaryforauditpurposes

ab34e562acd

Receipt We have received…

Filesmayneedreceiptorhash

9

o  Checkformaliciouscontent,isthereanyunwantedpayload?

Receipt Warning! We have received…

Maliciouscontent

10

o  Ac1ve/PassiveorAc1ve/Ac1vesetupo  Makeitscalableo  MakingsureoneESBpicksupthefile,nottwoormoreo  Needstobeadeadleherchannel(EIP)

Setupcanbechallenging

11

FiletransferinWSO2ESB(Transports)

TransportsinWSO2ESB

Forthecompletelist:hRps://docs.wso2.com/display/ESB490/ESB+Transports

o  HTTP/SNIOTransporto  HTTPPassThroughTransporto  HTTP/SServletTransporto  JMSTransporto  VFSTransporto  FIXTransporto  andmore...

13

VFSTransport

SupportedProtocols

o  LocalFileSystemo  FTPo  FTPSo  SFTPo  WindowsShare(SMB)

14

FileTransportsinESB

15

o  VFSTransporto  FileInboundprotocolo  FileConnector

FileHandlingComponents

VFSTransporto  FileprocessingisdonethroughVirtualFileSystem(VFS)

transport.o  VFSTransporthastwoparts

o  VFSTransportListenero  VFSTransportSender

o  EnablingbyUncommen1ngthefollowingentriesinaxis2.xml

<transportreceivername="vfs"class="org.apache.synapse.transport.vfs.VFSTransportListener"/>

<transportSendername="vfs"class="org.apache.synapse.transport.vfs.VFSTransportSender"/>

16

o  Thisisamuchimprovedalterna1vetoVFSTransporto  Supportsmul1-tenancyo  Supportscoordina1oninclusteredenvironment

FileInbound

FileConnector

o  Speedfilecopy

17

VFSusecases

18

HTTPtoVFS

VFSusecases

19

VFStoHTTP

TheYenloManagedFileTransfersolu1onbasedonWSO2

o  ArobustMFTsolu1onbasedonWSO2ESB

o  Manyout-of-the-boxfeaturestoaddressmen1onedchallenges,andmuchmore…

o  Addedhighavailabilitybyadding2ormoreESBnodes

SoYenlocreated...

21

Inalmostallcasesguaranteeddeliveryisanecessity.TheYenloManagedFileTransferoffers:o SLA’so Possibleguaranteeddeliveryo Deliveryonlyonceo Receiptwithorwithouthasho Possibilitytoworkwithencryptedfiles

GuaranteedDelivery

22

Forcon1nuousopera1onaHAsetupisnecessary:o HAinAc1ve/Passivesinglesetupo HAinAc1ve/Passivegroupsetup(2+groups)

AP

AP

Highavailability

23

Contentandmetadatacontrol

Makingcontentbasedrou1ngpossibleusingsimplerulesbasedon,forexample:o RegEXo Metadata(1mestamp)o Inclusionandexclusioncriteria(size,type,extension)o Encryp1onortheabsenceofencryp1ono Virusscanning

24

Clusteredsetup

Managingmul1pleESB’sandmul1pledropdirectories

25

RegExSample

ExampleofMetadatabasedrou1ng

26

Transportvariables(currentversion)

27

Futuredevelopments

o  Encryp1on–Decryp1ono  Hashcrea1onforauditpurposeso  MalicousPayloadscanningo  Receipttosender/uploadero  Poten1alValida1onofpayload(internal)

28

ManagedFileTransferWhatarethebenefits?

Benefitsareclear

o  Highavailabilityo  Mul1tenanto  Monitoring&Tracingo  Guaranteeddeliveryo  MFTisaservice;Sonoheadachesfortheend-user

30

ManagedFileTransferDemonstra1on&Technicalstuff

Demo

o  Runningonlocalmachine:twoWSO2ESB’s(4.9.0)o  Clustered(Hazelcast)withtwoworkers

o  10000(dummy)fileso  7toobigo  13corrupto  8000XMLfileso  2000PDFfiles

o  Es1mated1metofinish:lessthen120seconds

32

ManagedFileTransferYouhaveques1ons?Wehaveanswers!

Contact&Download

34

InterestedinourManagedFileTransfersoluGon?

Downloadthispresenta1on:hhps://www.yenlo.com/en/free-advice/webinarsOrContactus:hhps://www.yenlo.com/en/contact

35

THANK YOU FOR

YOUR ATTENTION