All Things Open : Crash Course in Open Source Cloud Computing

  • Published on
    22-Apr-2015

  • View
    195

  • Download
    2

Embed Size (px)

DESCRIPTION

Very few trends in IT have generated as much buzz as cloud computing. This session will cut through the hype and quickly clarify the ontology for cloud computing. The bulk of the conversation will focus on the open source software that can be used to build compute clouds (infrastructure-as-a-service) and the complimentary open source management tools that can be combined to automate the management of cloud computing environments. The session will appeal to anyone who has a good grasp of traditional data center infrastructure but is struggling with the benefits and migration path to a cloud computing environment. Systems administrators and IT generalists will leave the discussion with a general overview of the options at their disposal to effectively build and manage their own cloud computing environments using free and open source software.

Transcript

<ul><li> 1. All Things Open 2014 Crash Course in Open Source Cloud Computing Mark Hinkle Senior Director, Open Source Solutions Citrix Inc. mark.hinkle@citrix.com mrhinkle@gmail.com @mrhinkle </li> <li> 2. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com ABOUT ME I Help Build Open Source Ecosystems Open Source Experience Manage Citrix Open Source Business Office Apache CloudStack Committer and PMC Member Advisory boards Gluster and Xen Project Joined Citrix via Cloud.com acquisition July 2011 Zenoss Core open source project to 100,000 users, 1.5 million downloads Former LinuxWorld Magazine Editor-in-Chief Open Management Consortium organizer Author - Windows to Linux Business Desktop Migration Thomson NetDirector Project - Open Source Configuration Management All Things Open 2014 - Open Source Cloud Computing </li> <li> 3. http://www.slideshare.net/socializedsoftware Attribution You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. ShareAlike If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com Slides Available on Slideshare: Creative Commons Attributions-ShareAlike 4.0 International Share copy and redistribute the material in any medium or format Adapt remix, transform, and build upon the material for any purpose, even commercially. The licensor cannot revoke these freedoms as long as you follow the license terms. All Things Open 2014 - Open Source Cloud Computing </li> <li> 4. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com AGENDA Vetting Open Source Cloud Projects Virtualization Infrastructure-as-a-Service Platform-as-a-Service SDN Open Source for Amazon Web Services All Things Open 2014 - Open Source Cloud Computing </li> <li> 5. VETTING OPEN SOURCE PROJECTS How can you tell if theyre Legit Code Velocity Committers Committer Reputation User-driven or Vendor-Driven Innovation User Activity Corporate Support* Reputation of Foundation* By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com All Things Open 2014 - Open Source Cloud Computing </li> <li> 6. the future of technological innovation is not stealing limited resources away from one another, but creating new resources and new opportunities to create new resources together in a rich ecosystem. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com OPEN SOURCE ISNT A ZERO-SUM GAME Allison Randal Open Source Hacker Former OSCON Program Chair @allisonrandal All Things Open 2014 - Open Source Cloud Computing </li> <li> 7. http://www.openhub.net http://activity.openstack.org By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com OPEN SOURCE ANALYSIS Visualizing Community Activity All Things Open 2014 - Open Source Cloud Computing </li> <li> 8. DevOps Toolchain By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com OPEN SOURCE CLOUD STACK Platform-as-a-Service (PaaS) ? ? Infrastructure-as-a-Service (IaaS) Orchestration ? Compute Storage Networking (Networking-as-a-Service) All Things Open 2014 - Open Source Cloud Computing Orchestration Configuration Management Monitoring </li> <li> 9. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com VIRTUALIZATION Carving up compute resources OPEN SOURCE Xen Project Citrix XenServer KVM VirtualBox OpenVZ LXC libcontainer PROPRIETARY VMware Microsoft Hyper-V OracleVM (Based on Xen Project) All Things Open 2014 - Open Source Cloud Computing </li> <li> 10. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com HYPERVISORS AND CONTAINERS Differences in virtualization Type 1 Hypervisors VMware, Xen Project, Hyper-V Type 2 Hypervisors KVM, VirtualBox All Things Open 2014 - Open Source Cloud Computing Containers LXC, libcontainer </li> <li> 11. Different file formats for virtual machines (VMware uses vmdk file format, Xen and Hyper-V use VHD, KVM uses Raw or QCOW2) Guest images may be processor architecture VMware and Xen can manage SCSI devices, but KVM and Xen can use virtio drivers but not VMware uses a proprietary agent inside the guest OS (VMware tools) which does not work with Xen or KVM By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com THE PORTABILITY PROBLEM Containers compared to Hardware Virtualization bound KVM cannot VMware Yada, Yada, Yada All Things Open 2014 - Open Source Cloud Computing </li> <li> 12. Lets your run a Linux system within A container is a group of processes on a Linux box, put together the provide an isolated environment From the inside, it looks like a VM Externally it looks like normal processes chroot on steroids By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com LINUX CONTAINERS Lightweight Linux Virtualization another Linux system All Things Open 2014 - Open Source Cloud Computing </li> <li> 13. Code Application is stored Build Code is built (Jenkins) Test Unit tests are By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com CONTINUOUS INTEGRATION Rebuild Applications on any Cloud and/or Virtualized Infrastructure in a repository (Subversion,Git) automated (Jenkins) Deploy Deploy code to server various ways Code Build Test Deploy Thoughtworks Go Open Source Continuous Deliver System All Things Open 2014 - Open Source Cloud Computing </li> <li> 14. Docker is an open-source project to easily create lightweight, portable, self-sufficient containers from any application. The same container that a developer builds and tests on a laptop can run at scale, in production, on VMs, bare metal, public clouds and more. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com DOCKER CONTAINER PACKAGING Open source LXC Packaging Engine To learn more please visit: www.docker.io All Things Open 2014 - Open Source Cloud Computing </li> <li> 15. Compliment to LXC not a replacement Managed daemonized processes on Linux Create ability to re-use and manage similar Content agnostic Hardware agnostic Easy to automate Integrated with other tools: Chef, OpenShift, By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com WHAT IS DOCKER System for Managing and Deploying LXC Containers using LXC libcontainer applications Puppet, VMware, etc. All Things Open 2014 - Open Source Cloud Computing </li> <li> 16. DOCKERS GROWING ECOSYSTEM By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com All Things Open 2014 - Open Source Cloud Computing </li> <li> 17. Kubernetes builds on top of Docker to construct a clustered container scheduling service. Kubernetes enables users to ask a cluster to run a set of containers. The system will automatically pick worker nodes to run those containers on, which we think of more as "scheduling" than "orchestration To learn more please visit: https://github.com/GoogleCloudPlatform/kubernetes Greek for Shipmaster By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com KUBERNETES Container Cluster Management Scheduler All Things Open 2014 - Open Source Cloud Computing </li> <li> 18. DOCKER RELATED PROJECTS Fig -Fast, isolated development environments Flynn - Next-generation application platform Panamax Drag-and-Drop Docker Containerization Project Atomic JEOS designed to run Docker containers SocketPlane Docker Networking (coming soon) Weave Docker Networking 13,000+ Docker-related repos on Github By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com All Things Open 2014 - Open Source Cloud Computing </li> <li> 19. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com $141 Billion Market Cap $363 Billion Market Cap All Things Open 2014 - Open Source Cloud Computing $356 Billion Market Cap PUBLIC CLOUD </li> <li> 20. Project Year Started License Virtualization By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com MINIMUM VIABLE CLOUD Infrastructure-as-a-Service | IaaS |Compute Orchestration All Things Open 2014 - Open Source Cloud Computing Technologies Apache CloudStack 2008 Apache (Bare Metal), Xenserver, KVM, LXC VMware Hyper- V Eucalyptus 2006 GPL Xen, KVM, VMware (commercial version) OpenNebula 2005 Apache Xen, KVM, VMware OpenStack 2010 (Developed by NASA by Anso Labs previously) Apache VMware ESX and ESXi, , Xen, XenServer, KVM, LXC, QEMU and Virtual Box </li> <li> 21. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com OPENSTACK The Boy Band of the Open Source Cloud All Things Open 2014 - Open Source Cloud Computing </li> <li> 22. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com OPENSTACK SHARED SERVICES Span Compute, Storage and Networking IDENTITY SERVICE IMAGE SERVICE All Things Open 2014 - Open Source Cloud Computing TELEMETRY SERVICE ORCHESTRATION SERVICE </li> <li> 23. EVEN MORE OPENSTACK PROJECTS Span Compute, Storage and Networking Trove Database Service Ironic Bare Metal (Ironic) Marconi Queue Service By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com Cinder Block Storage Service Ceilometer Metering/Monitoring Heat Orchestration All Things Open 2014 - Open Source Cloud Computing </li> <li> 24. OPENSTACK SOLUTION PROVIDERS If you cant do it yourself OpenStack is not a product. If you are building a large infrastructure, its more like a tool kit. It gives you a lot of technologies that do take a lot of effort to integrate. Chris Kemp, OpenStack Board Member and Co-Founder By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com All Things Open 2014 - Open Source Cloud Computing CEO of Piston Computing </li> <li> 25. By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com CLOUD APIS Everything (should) have an API in the Cloud All Things Open 2014 - Open Source Cloud Computing Deltacloud(ruby) Daisein(java) Jclouds(java) Libcloud(python) Fog(ruby) </li> <li> 26. Project Description Ceph Distributed file storage system developed by DreamHost -&gt; GlusterFS Scale Out NAS system aggregating storage over Ethernet or Riak CS Riak CS is open source software designed to provide simple, available, distributed cloud storage at any scale. Riak CS is S3- API compatible and supports per-tenant reporting for billing and metering use cases. (object) Sheepdog Distributed storage for KVM hypervisors, distributed iSCSI By Mark R. Hinkle @mrhinkle mrhinkle@gmail.com CLOUD STORAGE Virtualized, Distributed usually on Commodity Hardware InkTank -&gt; Red Hat (block, object, file) Infiniband (file) OpenStack Storage Long-term object storage system (object) All Things Open 2014 - Open Source Cloud Computing </li> <li> 27. CLOUD AUTOMATION TOOLS One to many tools for managing large numbers of devices Ansible Ansible's SSH-key based access allows contributors to the Fedora Project to assist in automating infrastructure while having access limited appropriately. (Originally authored Func) Capistrano Utility and framework for executing commands in parallel on multiple remote machines, via SSH. It uses a simple DSL that allows you to define tasks, which may be applied to machines in certain roles RunDeck Rundeck is an open-source process automation and command orchestration tool with a web Func Func provides a two-way authenticated system for generically executing tasks, integrations with MCollective The Marionette Collective AKA MCollective is a framework to build server orchestration or Salt Execute arbitrary shell commands or c...</li></ul>