Chromatophore - A Nave CephFS Backup and …...Research At LIBR • Neuroscience-based, clinical and...

Chromatophore-ANa.veCephFSBackupandArchiveTool

BradyDeetzLaureateIns.tuteforBrainResearch

ResearchAtLIBR

•  Neuroscience-based,clinicalanddevelopmentalresearch:1.  Todevelopneuroscience-basedindividuallypredic.veassessments.2.  Todevelopnovelbrain-bodybasedinterven.ons•  Focus:mood,anxiety,addic.on,orea.ngdisorders.

3.  Touseexperimentalsystemstoquicklytestassessmentsandinterven.ons.

MyUnfortunateInheritanceNovember2015

•  1PB-SpectraLogicT950e•  LocalDisks•  SpectraLogicBlackPearl•  400TB-OracleZFS•  100TB-EMCIsilon

CephDesign

•  8xOSDnodes–  256GBRAM–  2xIntelS3610forOS–  24x6TBEnterpriseSATA(24slotchassis)–  2xIntelP3700–  2xXeon2660V4

•  28x2.0GHz– MellanoxConnectX-4(40Gbps)->BrocadeVDX6940

CephDesign(Cont…)

•  2xMDS(ac.ve/standby)+3xMONnode– 128GBRAM– 2xIntelS3610forOS– 2xXeon2643V4•  12x3.4GHz

– MellanoxConnectX-4(40Gbps)->BrocadeVDX6940

Chromatophore?

•  UsesCephFS’sna.velibraries•  Parallel(MPI+OpenMP)•  Backupstodifferentkindsoftargets– Ceph– SpectraLogicS3– AmazonS3– Glacier– Tar– POSIXfilesystems

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

WorkerThread

ConfigFile(JSON) BackupHistory(HDF5)

Wheretogetit?

•  WillbereleasedbytheendofthisDecember– Excuses…•  S.llwri.ngunittests•  Valida.ngDS3codewithSpectraLogic•  RecentlyportedfromPythontoJava

•  hkps://github.com/bdeetz/chromatophore

Q/A

BradyDeetzLaureateIns.tuteforBrainResearch(918)409-0223bdeetz@laureateins.tute.orgbdeetz@gmail.com