Crash Course on Open Source Cloud Computing

  • Published on

  • View

  • Download

Embed Size (px)


Fourth update to these slides, still working on them but wanted them to be available for CloudCamp RTP Updates: - Appliance Creation Tools - OVF - Added Bitnami, Boxgrinder, SuseStudio - Removed marginal tools for Cloud (BFCG2, OpenNMS) - Added logstash


  • 1.Crash Course in OpenSource CloudComputingMark R. HinkleDirector, Cloud Computing CommunityCitrix Systems Inc.Twitter: @mrhinkleEmail:

2. 2Agenda1. Introduction2. Quick Cloud Computing Overview3. Open Source Building Blocks for CloudComputing4. Open Source Tools for Cloud Management5. Questions 3. 3%whoami Responsible for Driving Adoption of CloudStack Open Source Cloud Computing Software Joined Citrix via acquisition July 2011 Former manager of Zenoss Open Source project 100,000 users, 1.5 million downloads Former Linux Desktop Advocate (Zealot?) Former LinuxWorld Magazine Editor-in-Chief Open Management Consortium organizer Author - Windows to Linux Business Desktop Migration Thomson NetDirector Project - Open Source Con guration Management Project Sometimes Author and Blogger at 4. Quick Cloud ComputingOverview: Or the ObligatoryWhat is the Cloud? Slides 5. 5Five Characteristics of Clouds1.On-Demand Self-Service2.Broad Network Access3.Resource Pooling4.Rapid Elasticity5.Measured Service 6. 6Cloud Computing Service Models USER CLOUD a.k.a. SOFTWARE AS A SERVICE Single application, multi-tenancy, network-based, one-to-many delivery of applications, all users have same access to features. Examples:, Google Docs, Red Hat Network/RHEL DEVELOPMENT CLOUD a.k.a. PLATFORM-AS-A-SERVICE Application developer model, Application deployed to an elastic service that autoscales, low administrative overhead. No concept of virtual machines or operating system. Code it and deploy it. Examples: Google AppEngine, Windows Azure, Rackspace Site, Red Hat Makara SYSTEMS CLOUD a.k.a INFRASTRUCTURE-AS-A-SERVICE Servers and storage are made available in a scalable way over a network. Examples: EC2,Rackspace CloudFiles, OpenStack, CloudStack, Eucalyptus, Ubuntu Enterprise Cloud, OpenNebula 7. Deployment Models 7Public, Private & Hybrid Clouds 8. Cloud Still Requires 8Architectural Design Cloud Computing isnt a magical solution Need to design your architecture with the end in mind As you build it make your infrastructure easily replicable 9. Building Compute Cloudswith Open Source Software 10. 10Why Open Source? Typically User-Driven Solutions to Real Problems Larger user base, users helping users Lower barrier to participation Aggressive release cycles stay current with the state-of-the-art Try before you buy, no Brochure-ware, no Powerpoint software Open data, Open standards, Open APIs 11. 11Open Virtual Machine FormatsOpen Virtualization Format (OVF) is an openstandard for packaging and distributing virtualappliances or more generally software to be runin virtual machines.An OVF package consists of several files, placedin one directory. A one-file alternative is the OVApackage, which is a TAR file with the OVFdirectory inside. 12. Tools for Creating OSS VMs and 12Cloud Appliances 13. 13Open Source HypervisorsOpen Source Xen, Xen Cloud Platform (XCP) KVM Kernel-based Virtualization VirtualBox* - Oracle supported Virtualization Solutions OpenVZ* - Container-based, Similar to Solaris Containers or BSD Zones LXC User Space chrooted installsProprietary VMware Citrix Xenserver Microsoft Hyper-V Oracle VM 14. 14Open Source Compute Clouds Year Started License HypervisorsSupported 2008 GPL Xen Cloud Platform, XenCloud Platform, KVM,VMware 2008 GPL Xen, KVM, VMware 2010 ApacheVMware ESX and ESXi, (Developed byMicrosoft Hyper-V, Xen, NASA by Anso KVM and Virtual Box Labs peviously) Other open source compute software include Abiquo and OpenNebula Numerous companies are building cloud software on OpenStack including Nebula, Piston Inc. 15. Open Source Platform-as-a- 15ServiceYear Started Sponsors HypervisorsSupported2011 VMware Spring, Rails, Node.js2011 Red HatExpress Ruby, Php andPythonFlex Jboss, Java EE62010 WSO2 Jboss, Java EE6 16. Open Source 16Cloud Computing Storage GlusterFS Scale Out NAS system aggregating storage over Ethernet or Infiniband CEPH Distributed file storage system developed by DreamHost OpenStack Object Storage (SWIFT) Long-term storage object storage system Sheepdog Distributed storage for KVM hypervisors NFS Old standby, tried and true, not designed for cloud scale or performance 17. Cloud APIs Arent Created Equal17Open Source Abstractions jclouds libcloud deltacloud fog 18. 18Private Cloud ArchitectureAPIAbstractions 19. Managing Clouds withOpen Source Tools 20. Automation Unlocks 20the Potential of the Cloud MeatCloud, Cant Keep up with Cloud Computing Devops & Agile IT Philosophy Script Repetitive Tasks Automate, Automate, Automate 21. 21Why Open Source Tools? Aggressively Developed, Keep Pace with State-of-the- Art User-Developed and Instrumented Easy to Assemble into Automated Toolchains 22. 22What Makes Tools Cloudy? Network Capable Cloud Aware Easy-to-Integrate Adhere to Open Standards Lend Themselves to Automation 23. 23The Myth of the NinesAvailability % Downtime per Downtime per Downtime per Year MonthWeek99.9% (three nines)8.76 hours 43.2 minutes 10.1 minutes99.95% 4.38 hours 21.56 minutes5.04 minutes99.99% (four nines)52.6 minutes 4.32 minutes 1.01 minutes99.999% ( ve nines)5.26 minutes 25.9 seconds 6.05 seconds99.9999% (six nines) 31.5 seconds 2.59 seconds .0605 seconds Average polling interval for monitoring? 5 minutes? Even superhuman operations people cant be alerted and take action in under 5 minutes.One outage per year could drop service level to three nines or worse. 24. 244 Types of Management ToolsProvisioningInstallation of operating systems and other softwareConfiguration ManagementSets the parameters for servers, can specifyinstallation parameters Orchestration/Automation Automate tasks across systemsMonitoringRecords errors and health of IT infrastructure 25. 25Management ToolchainsToolchain (n): MonitoringA set of tools wherethe output of one Patching andProvisioningtool becomes theinput of another tool Con guration 26. Open Source26Provisioning ToolsYear Started LanguageLicense Installation TargetsCobbler (Plus 2007 PythonGPL Red Hat,koan for PXE OpenSUSEboot of VMs) Fedora, Debian, UbuntuKickstart ?PythonGPL Most .dep and RPM based Linux distrosSpacewalk 2008 Perl, Python, Java GPLFedora, CentosCrowbar 2011 RubyApache(Bare metal provisioning) 27. Open Source27Conguration Management Tools Year Started Language License Client/ServerCfengine 1993 CApache YesChef 2009 Ruby Apache Chef Solo NoChef Server -YesPuppet 2004 Ruby GPL yes 28. Open Source 28Monitoring ToolsYear Started License Language Type of CollectionMonitoringMethodsCacti / 2001 GPL PHPPerformance SNMP, syslogRRDToolNagios1999 GPL C/PHPAvailabilitySNMP,TCP,ICMP, IPMI,syslogZabbix2001 GPL C/PHPAvailability/ SNMP, TCP/Performance ICMP, IPMI,and moreSyntheticTransactionsZenoss2005 GPL Python Availability, SNMP, ICMP,Performance,SSH, syslog,Event WMIManagement 29. Open Source 29Automation/Orchestration ToolsYearLanguage License Client/ SupportStartedServerOrganizationCapistrano2006Ruby MIT Yes NoneRunDeck 2010Java ApacheYes DTO SolutionsFunc2007Python GPL Yes Fedora ProjectMCollective 2009Ruby ApacheYes PuppetLabs 30. Aggregated Logging/Event30Managementlogstash is a tool for managing your logs.It helps you take logs and other event datafrom your systems and move it into a centralplace. logstash is open source and completelyfree. You can nd support on the mailing listand on IRC. 31. 31Automated Toolchain Capistrano Command and Application Service RunDeck Fabric Control Orchestration Func Provisioning Activity BCFG2 Con gurationCfengineSystem Con gurationChef Puppet Cloud: OS Install: Abiquo Kickstart Cloud Image OSCloudStack Cobbler BootstrappingLaunch Install Eucalyptus Spacewalk OpenStack 32. Questions?Slides Can be Viewed and Downloaded at: 33. 33Contact MeProfessional: mark.hinkle@citrix.comPersonal: mrhinkle@gmail.comProfessional: mrhinkle@cloud.comPersonal: 919.522.3520 Mark R. HinkleProfessional: http://www.cloudstack.orgPersonal: Director, Cloud Computing CommunityCitrix Systems Inc.Open Source EnthusiastTwitter: @mrhinkle 34. Crash Course in Open Source Cloud Computingby Mark R. Hinkle is licensed under a Creative Commons Attribution- ShareAlike 3.0 United States License.


View more >