iExec: Blockchain-based Fully Distributed Cloud Computing

Gilles.Fedak@inria.fr Haiwu.He@cnic.cas.cn http://iex.ec

Blockchain-based Fully Distributed Cloud Computing

The Promise of Ethereum

•  Dapps: Distributed Applications running on the Blockchain

How to satisfy compute/data-intensive DApps ?

Blockchain offer limited computing resources : storage is expensive, slow EVM, high tx latency etc.

iEx.ec Objective

•  Provides Blockchain-based Distributed Applications access to the off-chain computing resources they need:

–  Computing resources (CPU, GPU, storage) –  Data access (remote storage) –  Applications (compute and/or data-intensive) –  Services (deployed as containers)

Global Market for Computing Resources

Low cost, Secure, on Demand and Fully Distributed Cloud

Ethereum Blockchain

Towards Distributed Cloud Computing

•  Benefits of Decentralizing Data-Centers.–  Be$erenergyefficiency–  Dataclosertotheuser

•  Example of next-gen Data-centers

•  Fog/Edge Computing5Gnetwork--In-networkstorageandprocessing

a)Rutgersb)S@mergyc)Qarnot

Origin of the Technology : Desktop Grid Computing

Using Idle PCs on the Internet to Execute Parallel Applications :

• Maturetechnology

• Advancedfeatures:security,virtualiza@on,QoS

• Manyapplica@ons:Finance,Bio-medical,Chemistry,HighEnergyPhysicsetc…

• EuropeanDesktopGridInfrastructure

• h$p://desktopgridfedera@on.org

BookonDesktopGridCompu@n.Ed.C.Cérin&G.Fedak,CRC/Chapmanandall

XtremWeb XtremWeb-HEP

BitDew SpeQuloS

MapReduce

MPICH-V

2000

•  1st Internet P2P Global Computing Platform•  Bag-of Task Application•  Multi-users & multi-applications

•  Grid & Cloud•  Highly secure•  Virtualization•  Hybrid public/private Infrastructure

•  Parallel computing•  N-faults resilience

20012003

2008 20122010

•  Big Data•  1st Implementation of MapReduce for Internet Computing

•  Large Scale Data Management

•  QoS for Best-effort infrastructure

Building Distributed Cloud

>1M€ EU FP7, ANR funding, ≈100 papers publishedTens of users/applications: Finance, HEP, biomedical research…

iEx.ec Experiments

ResourceManagementMiddleware(XtremWeb-HEP,BitDew)

EthereumBlockchain

DistributedCloud:Grid5K,SGmergy

ApplicaGons(non-blockchainbased)E-Fast

Resource Management on the Blockchain

ResourceProvisioning

MarketManagementFramework

MatchmakingTask/Compu@ngresources

Mul@–CriteriaScheduling

Resultcer@fica@on

VerifiedFiletransfer

ResourcePublica@on

ResourceOntology

E-FAST : E-Services Framework for Knowledge-bAsed Decision SupporT in

Finance

Service Oriented Platform:Integrated,advancedtoolstoanalyzefinancialmarketdata,high-levelservicesthatautoma@callyreacttomarketchangesandproposeinvestmentalterna@ves

Data and Computing-Intensive Methods:Text-mining,NeuralNetworksandGene@cAlgorithms,enhancedbyapplyingrelevantfindingsfromtheefficient-markettheorystudy.

Selling E-FAST using iEx.ecCustomers access E-FAST services which uses iEx.ec for their execution: Onlypayforresourceswhenaservicehasbeensoldtoacustomer

iExec Testbed

Grid5000FrenchInfrastructurededicatedforresearchindistributedsystems:• 9sites,1000nodes,8000cores• GPU,XeonPhi,SSD• 10Gbnetwork• Fullyreconfigurable(baremetalaccess)

S@mergy:install10to100kWserverroomsinbuildingsandcouplingthemwiththeirhea@ngsystemtovalorise

theheatgeneratedbycomputerswhilegedngridofaircondi@onners

Using Stimergy servers as iEx.ec computing resources

iEx.ec Architecture (Envisioned)

iEx.ecSidechain(Proof-of-ContribuGon)

EthereumBlockchain

DistributedCloud

Blockchain-basedDistributedApplicaGons(Dapps)

ResourceManagement(XtremWeb-HEP,BitDew,Gollem,…)

Sidechain for Cloud

• consensusbasedonoff-chainu@liza@onofresources(Proof-of-Contribu@on)• transcientinforma@on• specificworkload• par@alconsensus

Proof-of-Contribution

Ensures that action that happen out of the blockchain leads to correct token transaction in the blockchain Example:execu@onofasetofcomputeintensivetask(Bag-of-Tasks)

Dapp Ethereum iEx.ecsidechain DistributedCloud

transac@on Selectresources/applica@ons Fetch&

executeBoT

Resultscer@fica@on

Feasability?:*AsynchronousRPC• GridCoin(h$p://www.gridcoin.us)• EthereumComputa@onMarketplace(seeGithub)• Reputa@on+Resultcer@fica@on(majorityvo@ng,spotchecking,blacklis@ng..)

contract

Conclusion

iEx.ec: Greener & Smarter Cloud Computing

Thanks to

Mircea Moca (Universitatea Babeș-Bolyai)

Oleg Lodygesnsky (IN2P3/CNRS/Univ. Paris XI)

DACA, Wanxiang Blockchain Lab

cryptofr slack team, chaintech, asseth