29
Page 1 © Hortonworks Inc. 2011 – 2014. All Rights Reserved Apache Ambari Using Apache Ambari to Manage Hadoop and YARN Hortonworks. We do Hadoop.

Apache Ambari: Managing Hadoop and YARN

Embed Size (px)

DESCRIPTION

Part of the Hortonworks YARN Ready Webinar Series, this session is about management of Apache Hadoop and YARN using Apache Ambari. This series targets developers and we will feature a demo on Ambari.

Citation preview

  • 1. Apache AmbariUsing Apache Ambari to Manage Hadoop and YARNPage 1 Hortonworks Inc. 2011 2014. All Rights ReservedHortonworks. We do Hadoop.

2. SpeakersPramod ThangaliSenior Director, EngineeringTom BeerbowerHortonworks Member Technical StaffCommitter for Apache AmbariYusaku SakoHortonworks Member Technical StaffCommitter for Apache AmbariPage 2 Hortonworks Inc. 2011 2014. All Rights Reserved 3. Agenda Overview of Apache Ambari Managing YARN with Ambari Ambari Views Demo Q & APage 3 Hortonworks Inc. 2011 2014. All Rights Reserved 4. AgendaAmbariOverviewManagingYARNwithAmbariPage 4 Hortonworks Inc. 2011 2014. All Rights ReservedAmbariViewsDemo Q & A 5. Apache Ambari is aplatform to provision,manage and monitorHadoop clustersPage 5 Hortonworks Inc. 2011 2014. All Rights Reserved 6. Apache Ambari Driving ThemesOperate Hadoopat ScalePage 6 Hortonworks Inc. 2011 2014. All Rights ReservedIntegrate withthe EnterpriseExtend for theEcosystem 7. Enterprise Operations, Integration and ExtensibilityIntegration With Existing Operations ToolsPage 7 Hortonworks Inc. 2011 2014. All Rights ReservedApache Ambari is a 100% open sourceplatform for provisioning, managing andmonitoring Apache Hadoop clustersAMBARI WEBOthersViewpointcompute&storage. . .. . .. . compute&storage.EXTEND .AMBARI REST APIAMBARI SERVERPROVISION | MANAGE | MONITOROPERATEAMBARI STACKS 8. AgendaAmbariOverviewManagingYARNwithAmbariPage 8 Hortonworks Inc. 2011 2014. All Rights ReservedAmbariViewsDemo Q & A 9. Managing YARN with Ambari Deploy Hadoop and YARN including MapReduce2and Tez data processing engines Control service lifecycle operations of YARNincluding start, stop, restart and refresh Manage configurations of YARN includingconfiguration of Capacity Scheduler Monitor health of key YARN components such asResource Manager and Node ManagersPage 9 Hortonworks Inc. 2011 2014. All Rights Reserved 10. SliderSet of tools to make it easy to package, deploy and manage long runningdistributed services on YARN Avoids having to write custom application masters Provides built-in management capabilities via AmbariPage 10 Hortonworks Inc. 2011 2014. All Rights Reserved 11. Slider View Ambari View that manages the life cycle of Sliderized apps Built using Ambari Views capabilityPage 11 Hortonworks Inc. 2011 2014. All Rights Reserved Hortonworks Inc. 2014: DO NOT SHARE. CONTAINS HORTONWORKS CONFIDENTIAL & PROPRIETARY INFORMATION 12. AgendaAmbariOverviewManagingYARNwithAmbariPage 12 Hortonworks Inc. 2011 2014. All Rights ReservedAmbariViewsDemo Q & A 13. Ambari ViewsGoal: enable the delivery of custom UI experiences in Ambari WebDevelopers can extend the Ambari Web interface Views expose custom UI features for Hadoop ServicesAmbari Admins can entitle Views to Ambari Web users Entitlements framework for controlling access to ViewsPage 13 Hortonworks Inc. 2011 2014. All Rights Reserved 14. Example ViewsCapacity SchedulerQueue ManagerPage 14 Hortonworks Inc. 2011 2014. All Rights ReservedHive TezQuery Analyzer 15. Choice of Deployment Model For Hadoop Operators:Deploy Views in an Ambari Server that is managing a Hadoop cluster For Data Workers:Run Views in a dedicated standalone Ambari ServerAmbariServerPage 15 Hortonworks Inc. 2011 2014. All Rights ReservedHADOOPStore & ProcessAmbariViewsServerOperatorsmanage thecluster, mayhave ViewsdeployedDataWorkers usethe clusterand use theAmbariViews Serverfor Views 16. TerminologyTerm DescriptionView Definition Describes the view resources and core view properties such as name,version and any necessary configuration properties.View Package Packages the view client and server assets (and dependencies)View Deployment Deploying a view into AmbariView Version A specific version of a viewView Instance An instantiation of a specific view versionFramework Services View context, instance data, configuration properties and eventsPage 16 Hortonworks Inc. 2011 2014. All Rights Reserved 17. View PackagingView Definition: view.xmlResource / Service classes : JAX-RS annotatedUI classes : html, Servlets deployed as web app (WEB-INF/web.xml).Application logic : Supporting classesDependencies : 3rd party jars or classes WEB-INF web.xml org apache ambari view weather CityResource.class CityResourceProvider.class CityService.class WeatherServlet.class view.xmlview.jarPage 17 Hortonworks Inc. 2011 2014. All Rights Reserved 18. View Versions and Instances Deploy multiple versions and create multiple instances of a view Manage accessibility and usagePage 18 Hortonworks Inc. 2011 2014. All Rights Reserved 19. View Components Deploy client-side assets (such as HTML + JavaScript) Expose server-side resources (such as REST endpoints)Page 19 Hortonworks Inc. 2011 2014. All Rights Reserved 20. Views Server Side Resources ServletsAvailable at URL patterns as defined in standard web.xml REST Endpointsfilesorg.apache.ambari.view.filebrowser.FileBrowserService Ambari Spec Managed resources which provide enhanced API servicesscriptscriptsidorg.apache.ambari.view.pig.resources.scripts.models.PigScriptorg.apache.ambari.view.pig.resources.scripts.ScriptResourceProviderorg.apache.ambari.view.pig.resources.scripts.ScriptServicePage 20 Hortonworks Inc. 2011 2014. All Rights Reserved Hortonworks Inc. 2014: DO NOT SHARE. CONTAINS HORTONWORKS CONFIDENTIAL & PROPRIETARY INFORMATION 21. AgendaAmbariOverviewManagingYARNwithAmbariPage 21 Hortonworks Inc. 2011 2014. All Rights ReservedAmbariViewsDemo Q & A 22. AgendaAmbariOverviewManagingYARNwithAmbariPage 22 Hortonworks Inc. 2011 2014. All Rights ReservedAmbariViewsDemo Q & A 23. Learn More About Ambari and Viewshttp://hortonworks.com/hadoop/ambari/Page 23 Hortonworks Inc. 2011 2014. All Rights Reserved Ambari Views Frameworkhttps://github.com/apache/ambari/tree/trunk/ambari-viewshttps://github.com/apache/ambari/blob/trunk/ambari-views/docs/index.md View Examples + Contribshttps://github.com/apache/ambari/tree/trunk/ambari-views/exampleshttps://github.com/apache/ambari/tree/trunk/contrib/views 24. Thank you!Page 24 Hortonworks Inc. 2011 2014. All Rights Reserved 25. Next StepsPage 25 Hortonworks Inc. 2011 2014. All Rights Reserved 26. Next Steps1. Review Resources2. Review past recordings3. Attend Office Hours4. Attend the nextwebinarPage 26 Hortonworks Inc. 2011 2014. All Rights Reserved 27. ResourcesSetup HDP 2.1 environment Leverage Sandbox: Hortonworks.com/SandboxGet Started with YARN http://hortonworks.com/get-started/YARNAmbari Info http://hortonworks.com/hadoop/ambariPast Recordings http://hortonworks.com/webinars/#libraryPage 27 Hortonworks Inc. 2011 2014. All Rights Reserved 28. Hortonworks Office HoursYARN Office HoursDial in and chat with YARN expertsWe plan Office Hours for September 11th @ 10am PTInvitations will go out to those that attended or reviewed YARN webinarsThese will also be posted to hortonworks.com/webinarsPage 28 Hortonworks Inc. 2011 2014. All Rights Reserved 29. YARN Ready Webinar ScheduleTimelineVisit: Hortonworks.com/webinars/#libraryPage 29 Hortonworks Inc. 2011 2014. All Rights ReservedNativeIntegrationSliderAmbariSept. 4Office HoursSept. 11ScaldingSept. 18SparkOct. 2Office HoursOct. 9Upcoming WebinarsOffice HoursRecorded Webinars:Introductionto YARN ReadyTezSeries: http://info.hortonworks.com/YarnReady-BigData-Webcast-Series.htmlOr sign up for an individual webinar or office hours at the same URL