Lenovo ThinkAgile SX for Microsoft Azure Stack Planning ... · ThinkAgile SXM Support For the latest information and links to helpful content, refer to the Lenovo Data Center Support

Lenovo ThinkAgileSX for Microsoft Azure StackPlanning and Setup Guide

Models: SXM4200, SXM6200, SXM4400, SXM6400

Note

Before using this information and the product it supports, be sure to read and understand the safetyinformation and the safety instructions, which are available at the following address:

http://thinksystem.lenovofiles.com/help/topic/safety_documentation/pdf_files.html

In addition, be sure that you are familiar with the terms and conditions of the Lenovo warranty for yoursolution, which can be found at the following address:

http://datacentersupport.lenovo.com/warrantylookup

Second Edition (December 2017)

© Copyright Lenovo 2017.

LIMITED AND RESTRICTED RIGHTS NOTICE: If data or software is delivered pursuant to a General ServicesAdministration “GSA” contract, use, reproduction, or disclosure is subject to restrictions set forth in Contract No. GS-35F-05925.

http://thinksystem.lenovofiles.com/help/topic/safety_documentation/pdf_files.html

http://datacentersupport.lenovo.com/warrantylookup

Contents

Figures . . . . . . . . . . . . . . . . . . iii

Tables . . . . . . . . . . . . . . . . . . v

Chapter 1. ThinkAgile SX forMicrosoft Azure Stack overview. . . . . 1ThinkAgile SXM documentation and relatedcontent . . . . . . . . . . . . . . . . . . . 1

Chapter 2. ThinkAgile SXM Planningand Setup considerations . . . . . . . . 5

Chapter 3. Overview of planning anddeployment activities . . . . . . . . . . 7Predeployment requirements . . . . . . . . . . 7Deployment activities . . . . . . . . . . . . . 7

Chapter 4. License considerations . . . 9

Chapter 5. Managementconsiderations . . . . . . . . . . . . . 11

Chapter 6. Initial IDs andpasswords . . . . . . . . . . . . . . . 13

Managing IDs and passwords . . . . . . . . . 13

Appendix A. SXM4200/SXM6200models . . . . . . . . . . . . . . . . . 15SXM4200/SXM6200 hardware . . . . . . . . . 20SXM4200/SXM6200 network and managementcabling . . . . . . . . . . . . . . . . . . 22

Appendix B. SXM4400/SXM6400models . . . . . . . . . . . . . . . . . 31SXM4400/SXM6400 hardware . . . . . . . . . 33SXM4400/SXM6400 network and managementcabling . . . . . . . . . . . . . . . . . . 35

Appendix C. Software . . . . . . . . . 43

Appendix D. ThinkAgile SXM powercabling . . . . . . . . . . . . . . . . . 45

Appendix E. Firmware maintenanceand Best Recipe . . . . . . . . . . . . 49

© Copyright Lenovo 2017 i

ii Lenovo ThinkAgile SX for Microsoft Azure Stack Planning and Setup Guide

Figures

1. Front view of SXM4200 in 25U rack . . . . . 152. Rear view of SXM4200 in 25U rack . . . . . 163. Front view of SXM4200 in 42U rack . . . . . 174. Rear view of SXM4200 in 42U rack . . . . . 185. Front view of SXM6200 . . . . . . . . . 196. Rear view of SXM6200 . . . . . . . . . . 207. Views of System x3650 M5 server

nodes . . . . . . . . . . . . . . . . 218. Views of System x3550 M5 HLH . . . . . . 219. View of RackSwitch G8272 TOR switch . . . 2210. View of RackSwitch G8052 BMC

switch . . . . . . . . . . . . . . . . 2211. SXM4200/SXM6200 network and

management cabling diagram . . . . . . . 23

12. Front view of SXM4400 in 25U rack . . . . . 3113. Front view of SXM4400 in 42U rack . . . . . 3214. Front view of SXM6400 . . . . . . . . . 3315. Views of ThinkSystem SR650 server

nodes . . . . . . . . . . . . . . . . 3416. Views of ThinkSystem SR630 HLH . . . . . 3417. View of ThinkSystem NE2572 TOR

switch . . . . . . . . . . . . . . . . 3518. View of RackSwitch G8052 BMC

switch . . . . . . . . . . . . . . . . 3519. SXM4400/SXM6400 network and

management cabling diagram . . . . . . . 36

© Copyright Lenovo 2017 iii

iv Lenovo ThinkAgile SX for Microsoft Azure Stack Planning and Setup Guide

Tables

1. ThinkAgile SXM Machine Type andModels . . . . . . . . . . . . . . . . . 1

2. SXM4200/SXM6200 network cabling forRackSwitch G8272 TOR Switch 2 . . . . . 24

3. SXM4200/SXM6200 network cabling forRackSwitch G8272 TOR Switch 1 . . . . . 26

4. SXM4200/SXM6200 network cabling forRackSwitch G8052 BMC Switch . . . . . . 27

5. SXM4400/SXM6400 network cabling forThinkSystem NE2572 TOR Switch 2 . . . . 37

6. SXM4400/SXM6400 network cabling forThinkSystem NE2572 TOR Switch 1 . . . . 39

7. SXM4400/SXM6400 network cabling forRackSwitch G8052 BMC Switch . . . . . . 40

8. Power cabling for 25U rack . . . . . . . . 459. Power cabling for 42U rack . . . . . . . . 47

© Copyright Lenovo 2017 v

vi Lenovo ThinkAgile SX for Microsoft Azure Stack Planning and Setup Guide

Chapter 1. ThinkAgile SX for Microsoft Azure Stack overview

The Lenovo® ThinkAgile™ SX for Microsoft Azure Stack products are pre-integrated, rack scale solutions thatare specifically designed to enable deployment of hybrid clouds with Microsoft™ Azure™ Stack. The productsare based on Lenovo servers and switches. Management capabilities are provided by Lenovo XClarityAdministrator. The product is revalidated for all updates, providing a complete, lifecycle-managed solution.

Note: The ThinkAgile SX for Microsoft Azure Stack product group is commonly referred to as “ThinkAgileSXM” in the documentation.

SXM4200 and SXM4400

The ThinkAgile SX for Microsoft Azure Stack SXM4200 and SXM4400 include from four to twelve servernodes (depending on rack size and model), a Hardware Lifecycle Host server, two top-of-rack switches, andone management switch. These can be ordered in either a 25U or 42U rack.

SXM6200 and SXM6400

The ThinkAgile SX for Microsoft Azure Stack SXM4200 and SXM6400 include up to twelve server nodes, aHardware Lifecycle Host server, two top-of-rack switches, and one management switch. These can beordered in a 42U rack only.

Models and Machine Types

This documentation refers to the following products:

Table 1. ThinkAgile SXM Machine Type and Models

Product Machine Type Model

SXM4200 – 25U 9565 RCC

SXM4200 – 42U 9565 RCD

SXM6200 (42U only) 9565 RCE

SXM4400 – 25U 9565 RCH

SXM4400 – 42U 9565 RCJ

SXM6400 (42U only) 9565 RCK

ThinkAgile SXM documentation and related contentUpdated. Ready for review.Information about the ThinkAgile SXM products is available online and indownloadable Portable Document Format (PDF) files. In addition, documentation is available for each of thecomponents in the product.

ThinkAgile SXM publications

The most recent ThinkAgile SXM documentation is on the Web, at the following site:

http://thinkagile.lenovofiles.com/help/topic/com.lenovo.thinkagile.sxm.doc/sxm_introduction.html

The following ThinkAgile SXM product publications are available in PDF format. The entire content of thesepublications is contained in the Web-based documentation set.

• Planning and Setup Guide

Provides an overview of the ThinkAgile SXM configuration and deployment requirements and activities.

© Copyright Lenovo 2017 1

http://thinkagile.lenovofiles.com/help/topic/com.lenovo.thinkagile.sxm.doc/sxm_introduction.html

http://systemx.lenovofiles.com/help/topic/com.lenovo.thinkagile.sxm.doc/SXM_Planning_Setup_Guide.pdf

• Administrator’s Guide

Describes ThinkAgile SXM product management and troubleshooting. Also provides information aboutgetting support for the product.

If you need to download the Adobe Reader to view PDF files, you can download it at http://get.adobe.com/reader.

ThinkAgile SXM product page

For information about the current ThinkAgile SXM models, refer to the product page. See the following Website:

http://shop.lenovo.com/us/en/systems/thinkagile/microsoft-azure-stack/

ThinkAgile SXM Support

For the latest information and links to helpful content, refer to the Lenovo Data Center Support page. You cansearch for support information for ThinkAgile SXM and other Lenovo Data Center products. See the followingWeb site:

https://datacentersupport.lenovo.com

Related Lenovo hardware documentation

The following documentation describes ThinkAgile SXM components. Some publications are also available inPDF format.

The following component documentation is relevant to the SXM4400 and SXM6400 models:

Product Documentation Web site

ThinkSystem SR650server

• Installation Guide• Setup Guide• Maintenance Manual• Messages and Codes

Reference

Documentation:http://thinksystem.lenovofiles.com/help/topic/7X05/introduction.html

Product guide:

https://lenovopress.com/lp0644-lenovo-thinksystem-sr650-server

ThinkSystem SR630server

• Installation Guide• Setup Guide• Maintenance Manual• Messages and Codes

Reference

Documentation:http://thinksystem.lenovofiles.com/help/topic/7X01/introduction.html

Product guide:


ThinkSystem NE2572switch

• Installation Guide• Application Guide• Command Reference• REST API Guide• Python Programming

Guide

Documentation:http://systemx.lenovofiles.com/help/topic/com.lenovo.thinksystem.ne2572.doc/ts_ne2572.html

RackSwitch G8052 • Installation Guide• Application Guide• ISCLI – Industry

Standard CLICommand Reference

Documentation:http://systemx.lenovofiles.com/help/topic/com.lenovo.rackswitch.g8052.doc/rs_g8052.html

Product guide:

https://lenovopress.com/tips1270-lenovo-rackswitch-g8052

2 Lenovo ThinkAgile SX for Microsoft Azure Stack Planning and Setup Guide

http://systemx.lenovofiles.com/help/topic/com.lenovo.thinkagile.sxm.doc/SXM_Administrators_Guide.pdf

http://get.adobe.com/reader

http://get.adobe.com/reader





http://thinksystem.lenovofiles.com/help/topic/7X05/introduction.html






http://systemx.lenovofiles.com/help/topic/com.lenovo.thinksystem.ne2572.doc/ts_ne2572.html

http://systemx.lenovofiles.com/help/topic/com.lenovo.thinksystem.ne2572.doc/ts_ne2572.html

http://systemx.lenovofiles.com/help/topic/com.lenovo.rackswitch.g8052.doc/rs_g8052.html



The following component documentation is relevant to the SXM4200 and SXM6200 models:

Product Documentation Web site

System x3650 M5server

• Installation and ServiceGuide

Documentation:http://systemx.lenovofiles.com/help/topic/com.lenovo.sysx.8871.doc/c_product_page.html

Product guide:

https://lenovopress.com/lp0068-lenovo-system-x3650-m5-machine-type-8871

System x3550 M5server

• Installation and ServiceGuide

Documentation:http://systemx.lenovofiles.com/help/topic/com.lenovo.sysx.8869.doc/c_product_page.html

Product guide:





Product guide:





Product guide:


Related Lenovo software documentation

The following third-party publications are related to ThinkAgile SXM components. The content should beavailable in either PDF format or HTML format.

Product Web site

Lenovo XClarity Administrator Documentation:http://sysmgt.lenovofiles.com/help/topic/com.lenovo.lxca.doc/aug_product_page.html

Product guide:

https://lenovopress.com/tips1200-lenovo-xclarity-administrator

Microsoft Azure Stack documentation

See the following sites for relevant Azure and Azure Stack information, documentation, and other resources.

Product/description Web site

Microsoft Azure https://azure.microsoft.com/

Azure Stack product page https://azure.microsoft.com/overview/azure-stack/

Chapter 1. ThinkAgile SX for Microsoft Azure Stack overview 3

http://systemx.lenovofiles.com/help/topic/com.lenovo.sysx.8871.doc/c_product_page.html














http://sysmgt.lenovofiles.com/help/topic/com.lenovo.lxca.doc/aug_product_page.html

http://sysmgt.lenovofiles.com/help/topic/com.lenovo.lxca.doc/aug_product_page.html

https://lenovopress.com/tips1200-lenovo-xclarity-administrator

https://azure.microsoft.com/

https://azure.microsoft.com/overview/azure-stack/

Product/description Web site

Azure Stack usage and billing https://docs.microsoft.com/azure/azure-stack/azure-stack-billing-and-chargeback

Microsoft Azure documentationand tools

https://docs.microsoft.com/en-us/azure/


https://docs.microsoft.com/azure/azure-stack/azure-stack-billing-and-chargeback

https://docs.microsoft.com/en-us/azure/

Chapter 2. ThinkAgile SXM Planning and Setup considerations

The following considerations and limitations apply to ThinkAgile SXM products.

Limitation on automated service requests (Call Home)

Because ThinkAgile SXM products are serviced and supported at the rack level, it is recommended that younot activate Call Home functionality for the components. If you choose to activate Call Home, be aware thatyour product entitlement might not be recognized immediately.

Firmware and “Best Recipe” adherence

Lenovo publishes a ThinkAgile SXM firmware “Best Recipe”, which identifies the supported levels for thevarious components. See Appendix E “Firmware maintenance and Best Recipe” on page 49 for more details.

ThinkAgile SXM entitlement

ThinkAgile SXM products are entitled at the rack level.

If you need support for the product or any of its components or included software, be sure to use your rackserial number associated with Machine Type 9565. If you use the component or software serial number,ThinkAgile Advantage Support might not immediately recognize the correct entitlement, which could delayproper case handling. You can find the serial number on the rack label.



Chapter 3. Overview of planning and deployment activities

ThinkAgile SXM products are intended to be installed and set up in your data center by Lenovo ProfessionalServices. Review the following information to ensure that you are properly prepared for the installation andconfiguration engagement.

Predeployment planning and preparation

Lenovo Professional Services will work with you to confirm the onsite engagement and the necessaryprework. If the necessary predeployment activities are not completed properly, the deployment engagementwill be delayed. See Predeployment requirements for more details.

Deployment engagement overview

See “Deployment activities” on page 7 for the high-level activities that Lenovo Professional Services willperform.

Predeployment requirementsLenovo Professional Services will advise you of the necessary planning and prework that needs to occurbefore the onsite engagement.

The following activities are the responsibility of the customer:

• Unboxing the rack.

• Placing the rack in the data center.

• Connecting power to the rack.

• Connecting the rack to the customer’s network.

• Performing a green light check, to ensure that hardware is operational prior to the onsite deploymentengagement.

• Determining the needed implementation architecture, including the connections to the data centernetwork.

Lenovo offers additional predeployment services for ThinkAgile SXM, such as Inside Delivery and HardwareInstallation.

Microsoft Azure Stack subscription and billing

A Microsoft Azure Stack subscription should be obtained by the customer prior to the deploymentengagement. Lenovo Professional Services will review the requirements in the pre-deployment engagement.

For links to information about Microsoft Azure Stack subscriptions and services (such as billing), see“ThinkAgile SXM documentation and related content” on page 1.

Deployment activitiesLenovo Professional Services performs a specific set of activities to help ensure proper deployment ofThinkAgile SXM products. Additional predeployment services are available.

Note: The success of the onsite engagement is dependent on the correct planning and prework. SeePredeployment requirements for more details.

The onsite installation and configuration activities that Lenovo Professional Services will perform include thefollowing:


• Review the deployment worksheet that was completed during the predeployment engagement.

• Verify that the customer network is ready.

• Verify the as-shipped product configuration.

• Connect the TOR switches to the customer network.

• Perform basic network configuration to integrate the ThinkAgile SXM rack into the customer environment.

• Set up Lenovo XClarity Administrator management of the product.

• Verify and update the product to the ThinkAgile SXM Best Recipe firmware profile.

• Create credentials for IMM access.

• Deploy Azure Stack.

• Register the ThinkAgile SXM product with Microsoft Azure.

• Verify the product environment, to ensure a successful handover.

• Provide a skill transfer to the customer. This includes basic operational tasks and Support processes.

Lenovo Professional Services will provide information about the configured system, for your records.

The following items are not in the scope of the initial ThinkAgile SXM deployment engagement. Many ofthese can be handled via other available Professional Services offerings.

• Installation or configuration of server applications.

• Complete administrative or operations training.

• Data migration from existing storage systems and VMware environments.

• Installation assistance for nonstandard hardware components or components not purchased fromLenovo. Note that this activity can affect the support for the product.


Chapter 4. License considerations

Some software licenses are provided with ThinkAgile SXM products; they must be accepted by thecustomer.

Note: Some license agreements might be accepted on the customer’s behalf by Lenovo Manufacturingduring the installation and provisioning processes. When required, license agreements will be shippedhardcopy or softcopy with the product.

The following licenses are provided:

Application EULA License type License installation

Lenovo XClarity Pro(for XClarity Administrator)

Customer Software is loaded in manufacturing. Customer mustlog in to Lenovo XClarity Administrator and accept thelicense.

Additional licenses might be available for purchase during the ThinkAgile SXM ordering process.

Microsoft Azure Stack subscription and billing

A Microsoft Azure Stack subscription should be obtained by the customer prior to the deploymentengagement. Lenovo Professional Services will review the requirements in the predeployment engagement.

For links to information about Microsoft Azure Stack subscriptions and services (such as billing), see“ThinkAgile SXM documentation and related content” on page 1.



Chapter 5. Management considerations

Day-to-day management of the ThinkAgile SXM product and components can be accomplished throughmultiple interfaces.

Lenovo XClarity Administrator

Lenovo XClarity Administrator is a centralized resource management solution that simplifies infrastructuremanagement, speeds responses, and enhances the availability of server systems.

You can use one of the following management interfaces:

• Web-based interface

• PowerShell

• REST APIs

Note: Lenovo XClarity Administrator does not currently support the Lenovo Cloud Network OperatingSystem, so management of the switches is not currently enabled.

Microsoft Azure Stack

Microsoft Azure Stack provides both Administrator and Tenant portals for management of resources andtasks. For information about using the Microsoft Azure Stack management capabilities, see “ThinkAgile SXMdocumentation and related content” on page 1 for relevant links.

Switch management

The management interfaces include the following:

• The Industry Standard Command Line Interface (ISCLI) provides a simple, direct method for switchadministration. Using a basic terminal, you can issue commands that allow you to view detailedinformation and statistics about the switch, and to perform configuration and switch softwaremaintenance.

• The Browser-based Interface (BBI) provides access to the common configuration, management andoperation features of the switch through a browser.



Chapter 6. Initial IDs and passwords

Most initial passwords must be changed during the setup process; that is essential for the security of thecomponents and the overall product. Default initial IDs and an initial password are set for the preinstalledhardware and software components, as well as the recovery account and root.

Changing initial passwords

During the installation engagement, Lenovo Professional Services will assist you in changing the applicableinitial IDs and passwords.

Important: Changing some IDs or passwords without proper planning will affect the overall configuration forthe cluster. See Managing IDs and passwords for information about ID and password guidelines andprocedures.

Managing IDs and passwordsProper maintenance of IDs and passwords is essential for the security of the components and the overallproduct. Lenovo’s Software Security Review Board stresses in the strongest possible terms that customersshould manage all product credentials according to the recommendations stated here.

Initial IDs passwords

Applicable IDs and passwords will be set or changed during the Lenovo Professional Services deploymentengagement.

Changing passwords

For the password change procedures, refer to the relevant component documentation. See “ThinkAgile SXMdocumentation and related content” on page 1.

Important: Changing some IDs or passwords without proper planning (for example, the IMM on any of theSystem x3650 M5 servers) will affect the overall configuration for the cluster.

Password criteria

The following password criteria are strongly recommended by Lenovo’s Software Security Review Board:

• No less than twenty (20) characters.

• Includes letters, specifically mixed case.

• Includes numbers.

• Includes punctuation.

• Does not include any repeated characters.

It is also recommended that a random password generator be used. One example is the Norton Identity SafePassword Generator. See the following Web site:

https://identitysafe.norton.com/password-generator






Appendix A. SXM4200/SXM6200 models

The SXM4200 (Machine Type 9565) can be ordered with up to twelve System x3650 M5 server nodes,depending on the rack size and model.

ThinkAgile SXM models utilize the following additional hardware:

• The System x3550 M5 server functions as the Hardware Lifecycle Host.

• The RackSwitch G8052 switch functions as the BMC switch.

• The RackSwitch G8272 switches function as the TOR switches.

SXM4200 25U rack views (model RCC)

The SXM4200 in the 25U rack is Machine Type 9565, Model RCC. This model is available with four to eightSystem x3650 M5 servers.

Figure 1. Front view of SXM4200 in 25U rack


Figure 2. Rear view of SXM4200 in 25U rack

SXM4200 42U rack views (model RCD)

The SXM4200 in the 42U rack is Machine Type 9565, Model RCD. This model is available with four to twelveSystem x3650 M5 servers.

Note: The PDUs for the 42U rack are housed in compartments in the rack side wall, and do not use rackslots.



Appendix A. SXM4200/SXM6200 models 17

Figure 4. Rear view of SXM4200 in 42U rack

SXM6200 rack views (model RCE)

The SXM6200 is Machine Type 9565, Model RCE.



Figure 5. Front view of SXM6200


Figure 6. Rear view of SXM6200

SXM4200/SXM6200 hardwareThe ThinkAgile SXM models include server nodes, a Hardware Lifecycle Host (HLH) server, top-of-rack (TOR)switches, a management (BMC) switch, and power distribution units (PDUs).

Configurations

Depending on the model, ThinkAgile SXM products are available in either a 25U or a 42U rack. The productcontains the following hardware:

• Four to twelve System x3650 M5 server nodes (depending on model and configuration ordered)

• One System x3550 M5 server, which acts as the Hardware Lifecycle Host

• Two RackSwitch G8272 TOR switches


The Lenovo Cloud Networking Operating System (CNOS) is installed on these switches.

• One RackSwitch G8052 BMC switch

The Lenovo Enterprise Networking Operating System (ENOS) is installed on this switch.

Server nodes

The following images show the System x3650 M5 server node.

Figure 7. Views of System x3650 M5 server nodes

Note: The LOM ports on the rear are disabled by default in UEFI; this is done during manufacturing.

Hardware Lifecycle Host

The following images show the System x3550 M5 HLH.

Figure 8. Views of System x3550 M5 HLH


Top-of-rack switches

The following image shows the RackSwitch G8272 TOR switches.


Figure 9. View of RackSwitch G8272 TOR switch

Management switch

The following image shows the RackSwitch G8052 BMC switch.

Figure 10. View of RackSwitch G8052 BMC switch

SXM4200/SXM6200 network and management cablingThe ThinkAgile SXM product is precabled for the management and data networks. This information isprovided for your reference.

The following image shows the network and management cabling connections for the ThinkAgile SXMSXM4200 and SXM6200 models:


Figure 11. SXM4200/SXM6200 network and management cabling diagram

Connection notes

Note the following details about the connections.

• Storage/Data (10 GbE)

– Ports 1–12 of RackSwitch G8272 TOR-1 are connected to Mellanox Port 1 of each System x3650 M5node.

– Ports 1–12 of RackSwitch G8272 TOR-2 are connected to Mellanox Port 2 of each System x3650 M5node.

• ISL/VLAG (40 GbE)

The RackSwitch G8272 TOR switches are interconnected between Ports 49 and 50.

• Switch Health (10 GbE)

The RackSwitch G8272 TOR switches are connected to each other for heartbeat/loopback on Port 45.

• Management (1 GbE)

– Ports 1-12 of the RackSwitch G8052 BMC switch are connected to the dedicated IMM port on eachSystem x3650 M5 node.

– Port 46 of the RackSwitch G8052 BMC switch is connected to the dedicated IMM port on the Systemx3550 M5 HLH.

– Port 47 of the RackSwitch G8052 BMC switch is connected to the MGMT port of RackSwitch G8272TOR switch 1.

– Port 48 of the RackSwitch G8052 BMC switch is connected to the MGMT port of RackSwitch G8272TOR switch 2.

• Uplink (10 GbE)


– Ports 47 and 48 of the RackSwitch G8272 TOR switches are connected to the customer borderswitches.

– Port 51 of the RackSwitch G8052 BMC switch is connected to Port 46 of RackSwitch G8272 TORswitch 1.

– Port 52 of the RackSwitch G8052 BMC switch is connected to Port 46 of RackSwitch G8272 TORswitch 2.

• Deployment (10 GbE)

Port 49 of the RackSwitch G8052 BMC switch is connected to Mellanox Port 1 of System x3550 M5 HLH.

SXM4200/SXM6200 network cabling tables

The following tables list the point-to-point connections for each ThinkAgile SXM switch.

Note: The settings apply regardless of the number of servers (4–12, depending on model) and whether theproduct is in a 25U or 42U rack.

Table 2. SXM4200/SXM6200 network cabling for RackSwitch G8272 TOR Switch 2

SourcePort

Destination Connection type

Device Port Optic

54 Reserved n/a n/a n/a




50 RackSwitch G8272 Switch 1 (TOR) 50 n/a QSFP/QSFP, TwinAx, 1m


48 Border-2 Customer 10G-SR LC/LC Fibre (Customer)


46 RackSwitch G8052 Switch (BMC) 52 n/a SFP+/SFP+, TwinAx, 1m

45 RackSwitch G8272 Switch 1 (TOR) 45 n/a SFP+/SFP+, TwinAx, 1m


43 n/a n/a n/a n/a

42 n/a n/a n/a n/a

41 n/a n/a n/a n/a

40 n/a n/a n/a n/a

39 n/a n/a n/a n/a

38 n/a n/a n/a n/a

37 n/a n/a n/a n/a

36 n/a n/a n/a n/a

35 n/a n/a n/a n/a

34 n/a n/a n/a n/a

33 n/a n/a n/a n/a

32 n/a n/a n/a n/a


Table 2. SXM4200/SXM6200 network cabling for RackSwitch G8272 TOR Switch 2 (continued)

SourcePort


Device Port Optic

31 n/a n/a n/a n/a

30 n/a n/a n/a n/a

29 n/a n/a n/a n/a

28 n/a n/a n/a n/a

27 n/a n/a n/a n/a

26 n/a n/a n/a n/a

25 n/a n/a n/a n/a

24 n/a n/a n/a n/a

23 n/a n/a n/a n/a

22 n/a n/a n/a n/a

21 n/a n/a n/a n/a

20 n/a n/a n/a n/a

19 n/a n/a n/a n/a

18 n/a n/a n/a n/a

17 n/a n/a n/a n/a

16 n/a n/a n/a n/a

15 n/a n/a n/a n/a

14 n/a n/a n/a n/a

13 n/a n/a n/a n/a

12 System x3650 M5 Server, Node 12 Mellanox-P2 n/a SFP+/SFP+, TwinAx, 1m












Console n/a n/a n/a n/a

MGMT n/a 48 n/a Cat5e, 1.5m


Table 3. SXM4200/SXM6200 network cabling for RackSwitch G8272 TOR Switch 1

SourcePort


Device Port Optic












43 n/a n/a n/a n/a

42 n/a n/a n/a n/a

41 n/a n/a n/a n/a

40 n/a n/a n/a n/a

39 n/a n/a n/a n/a

38 n/a n/a n/a n/a

37 n/a n/a n/a n/a

36 n/a n/a n/a n/a

35 n/a n/a n/a n/a

34 n/a n/a n/a n/a

33 n/a n/a n/a n/a

32 n/a n/a n/a n/a

31 n/a n/a n/a n/a

30 n/a n/a n/a n/a

29 n/a n/a n/a n/a

28 n/a n/a n/a n/a

27 n/a n/a n/a n/a

26 n/a n/a n/a n/a

25 n/a n/a n/a n/a

24 n/a n/a n/a n/a

23 n/a n/a n/a n/a

22 n/a n/a n/a n/a

21 n/a n/a n/a n/a

20 n/a n/a n/a n/a


Table 3. SXM4200/SXM6200 network cabling for RackSwitch G8272 TOR Switch 1 (continued)

SourcePort


Device Port Optic

19 n/a n/a n/a n/a

18 n/a n/a n/a n/a

17 n/a n/a n/a n/a

16 n/a n/a n/a n/a

15 n/a n/a n/a n/a

14 n/a n/a n/a n/a

13 n/a n/a n/a n/a















Table 4. SXM4200/SXM6200 network cabling for RackSwitch G8052 BMC Switch

SourcePort


Device Port Optic



50 System x3550 M5 Server (HLH) Mellanox-P2 n/a SFP+/SFP+, TwinAx, 1m

49 System x3550 M5 Server (HLH) Mellanox-P1 n/a SFP+/SFP+, TwinAx, 1m

48 RackSwitch G8272 Switch 2 (TOR) MGMT 10G-SR Cat5e, 1.5m

47 RackSwitch G8272 Switch 1 (TOR) MGMT 10G-SR Cat5e, 1.5m

46 System x3550 M5 Server (HLH) BMC n/a Cat5e, 1.5m

45 n/a n/a n/a n/a

44 n/a n/a n/a n/a


Table 4. SXM4200/SXM6200 network cabling for RackSwitch G8052 BMC Switch (continued)

SourcePort


Device Port Optic

43 n/a n/a n/a n/a

42 n/a n/a n/a n/a

41 n/a n/a n/a n/a

40 n/a n/a n/a n/a

39 n/a n/a n/a n/a

38 n/a n/a n/a n/a

37 n/a n/a n/a n/a

36 n/a n/a n/a n/a

35 n/a n/a n/a n/a

34 n/a n/a n/a n/a

33 n/a n/a n/a n/a

32 n/a n/a n/a n/a

31 n/a n/a n/a n/a

30 n/a n/a n/a n/a

29 n/a n/a n/a n/a

28 n/a n/a n/a n/a

27 n/a n/a n/a n/a

26 n/a n/a n/a n/a

25 n/a n/a n/a n/a

24 n/a n/a n/a n/a

23 n/a n/a n/a n/a

22 n/a n/a n/a n/a

21 n/a n/a n/a n/a

20 n/a n/a n/a n/a

19 n/a n/a n/a n/a

18 n/a n/a n/a n/a

17 n/a n/a n/a n/a

16 n/a n/a n/a n/a

15 n/a n/a n/a n/a

14 n/a n/a n/a n/a

13 n/a n/a n/a n/a

12 System x3650 M5 Server, Node 12 BMC n/a Cat5e, 3m






SourcePort


Device Port Optic










MGMT n/a n/a n/a n/a



Appendix B. SXM4400/SXM6400 models

Updated. Ready for reviewThe SXM4400 (Machine Type 9565) can be ordered with up to twelveThinkSystem SR650 server nodes, depending on the rack size and model.

ThinkAgile SXM models utilize the following additional hardware:

• The ThinkSystem SR630 server functions as the Hardware Lifecycle Host.

• The RackSwitch G8052 switch functions as the BMC switch.

• The ThinkSystem NE2572 switches function as the TOR switches.

SXM4400 25U rack views (model RCH)

The SXM4400 in the 25U rack is Machine Type 9565, Model RCH. This model is available with four to eightThinkSystem SR650 servers.


SXM4400 42U rack views (model RCJ)

The SXM4400 in the 42U rack is Machine Type 9565, Model RCD. This model is available with four to twelveThinkSystem SR650 servers.




SXM6400 rack views (model RCK)

The SXM6400 is Machine Type 9565, Model RCK This model is equipped with twelve ThinkSystem SR650servers.



Figure 14. Front view of SXM6400

SXM4400/SXM6400 hardwareUpdated. Ready for review.The ThinkAgile SXM models include server nodes, a Hardware Lifecycle Host(HLH) server, top-of-rack (TOR) switches, a management (BMC) switch, and power distribution units (PDUs).

Configurations

Depending on the model, ThinkAgile SXM products are available in either a 25U or a 42U rack. The productcontains the following hardware:

• Four to twelve ThinkSystem SR650 server nodes (depending on model and configuration ordered)

• One ThinkSystem SR630 server, which acts as the Hardware Lifecycle Host

• Two ThinkSystem NE2572 TOR switches

The Lenovo Cloud Networking Operating System (CNOS) is installed on these switches.

• One RackSwitch G8052 BMC switch

Appendix B. SXM4400/SXM6400 models 33

The Lenovo Enterprise Networking Operating System (ENOS) is installed on this switch.

Server nodes

The following images show the ThinkSystem SR650 server node.

Figure 15. Views of ThinkSystem SR650 server nodes


Hardware Lifecycle Host

The following images show the ThinkSystem SR630 HLH.

Figure 16. Views of ThinkSystem SR630 HLH



Top-of-rack switches

The following image shows the ThinkSystem NE2572 TOR switches.

Important: The port numbering for the ThinkSystem NE2572 is different from the RackSwitch G8052 andother switch models.

Figure 17. View of ThinkSystem NE2572 TOR switch

Management switch

The following image shows the RackSwitch G8052 BMC switch.

Figure 18. View of RackSwitch G8052 BMC switch

SXM4400/SXM6400 network and management cablingUpdated. Ready for review.The ThinkAgile SXM product is precabled for the management and datanetworks. This information is provided for your reference.

The following image shows the network and management cabling connections for the ThinkAgile SXMSXM4400 and SXM6400:


Figure 19. SXM4400/SXM6400 network and management cabling diagram

Connection notes

Note the following details about the connections.

• Storage/Data (25 GbE)

– Ports 1–12 of ThinkSystem NE2572 TOR-1 are connected to Mellanox Port 1 of each ThinkSystemSR650 node.

– Ports 1–12 of ThinkSystem NE2572 TOR-2 are connected to Mellanox Port 2 of each ThinkSystemSR650 node.

• ISL/VLAG (100 GbE)

The ThinkSystem NE2572 TOR switches are interconnected between Ports 49 and 50.

• Switch Health (25 GbE)

The ThinkSystem NE2572 TOR switches are connected to each other for heartbeat/loopback on Ports 43and 44.

• Management (1 GbE)

– Ports 1-12 of the RackSwitch G8052 BMC switch are connected to the dedicated XCC port on eachThinkSystem SR650 node.

– Port 46 of the RackSwitch G8052 BMC switch is connected to the dedicated XCC port on theThinkSystem SR630 HLH.

– Port 47 of the RackSwitch G8052 BMC switch is connected to the MGMT port of ThinkSystem NE2572TOR switch 1.

– Port 48 of the RackSwitch G8052 BMC switch is connected to the MGMT port of ThinkSystem NE2572TOR switch 2.

• Uplink (10/25 GbE)

– Ports 47 and 48 of the ThinkSystem NE2572 TOR switches are connected to the customer borderswitches.

– Port 51 of the RackSwitch G8052 BMC switch is connected to Port 46 of ThinkSystem NE2572 TORswitch 1.

– Port 52 of the RackSwitch G8052 BMC switch is connected to Port 46 of ThinkSystem NE2572 TORswitch 2.


– For the ThinkSystem NE2572 TOR switches, the SFP+ SR transceiver is included for 10GbE.

• Deployment (10 GbE)

Port 49 of the RackSwitch G8052 BMC switch is connected to Mellanox Port 1 of ThinkSystem SR630HLH.

SXM4400/SXM6400 network cabling tables

The following tables list the point-to-point connections for each ThinkAgile SXM switch.

Note: The settings apply regardless of the number of servers (4–12, depending on model) and whether theproduct is in a 25U or 42U rack.

Table 5. SXM4400/SXM6400 network cabling for ThinkSystem NE2572 TOR Switch 2

SourcePort


Device Port Optic





50 ThinkSystem NE2572 Switch 1 (TOR) 50 n/a QSFP28/QSFP28, AOC,1m


48 Border-2 Customer 10/25G-SR LC/LC Fibre (Customer)


46 n/a n/a n/a n/a

45 n/a n/a n/a n/a

44 ThinkSystem NE2572 Switch 1 (TOR) 44 n/a SFP28/SFP28, TwinAx, 1m


42 n/a n/a n/a n/a

41 n/a n/a n/a n/a


39 n/a n/a n/a n/a

38 n/a n/a n/a n/a

37 n/a n/a n/a n/a

36 n/a n/a n/a n/a

35 n/a n/a n/a n/a

34 n/a n/a n/a n/a

33 n/a n/a n/a n/a

32 n/a n/a n/a n/a

31 n/a n/a n/a n/a

30 n/a n/a n/a n/a

29 n/a n/a n/a n/a


Table 5. SXM4400/SXM6400 network cabling for ThinkSystem NE2572 TOR Switch 2 (continued)

SourcePort


Device Port Optic

28 n/a n/a n/a n/a

27 n/a n/a n/a n/a

26 n/a n/a n/a n/a

25 n/a n/a n/a n/a

24 n/a n/a n/a n/a

23 n/a n/a n/a n/a

22 n/a n/a n/a n/a

21 n/a n/a n/a n/a

20 n/a n/a n/a n/a

19 n/a n/a n/a n/a

18 n/a n/a n/a n/a

17 n/a n/a n/a n/a

16 n/a n/a n/a n/a

15 n/a n/a n/a n/a

14 n/a n/a n/a n/a

13 n/a n/a n/a n/a

12 ThinkSystem SR650 Server, Node 12 Mellanox-P2 n/a SFP28/SFP28, TwinAx, 1m











1 ThinkSystem SR650 Server, Node 1 Mellanox-P2 n/a SFP+/SFP+, TwinAx, 1m




Table 6. SXM4400/SXM6400 network cabling for ThinkSystem NE2572 TOR Switch 1

SourcePort


Device Port Optic









46 n/a n/a n/a n/a

45 n/a n/a n/a n/a



42 n/a n/a n/a n/a

41 n/a n/a n/a n/a


39 n/a n/a n/a n/a

38 n/a n/a n/a n/a

37 n/a n/a n/a n/a

36 n/a n/a n/a n/a

35 n/a n/a n/a n/a

34 n/a n/a n/a n/a

33 n/a n/a n/a n/a

32 n/a n/a n/a n/a

31 n/a n/a n/a n/a

30 n/a n/a n/a n/a

29 n/a n/a n/a n/a

28 n/a n/a n/a n/a

27 n/a n/a n/a n/a

26 n/a n/a n/a n/a

25 n/a n/a n/a n/a

24 n/a n/a n/a n/a

23 n/a n/a n/a n/a

22 n/a n/a n/a n/a

21 n/a n/a n/a n/a


Table 6. SXM4400/SXM6400 network cabling for ThinkSystem NE2572 TOR Switch 1 (continued)

SourcePort


Device Port Optic

20 n/a n/a n/a n/a

19 n/a n/a n/a n/a

18 n/a n/a n/a n/a

17 n/a n/a n/a n/a

16 n/a n/a n/a n/a

15 n/a n/a n/a n/a

14 n/a n/a n/a n/a

13 n/a n/a n/a n/a















Table 7. SXM4400/SXM6400 network cabling for RackSwitch G8052 BMC Switch

SourcePort


Device Port Optic

52 ThinkSystem NE2572 Switch 2 (TOR) 40 n/a SFP+/SFP+, TwinAx, 1m

51 ThinkSystem NE2572 Switch 1 (TOR) 40 n/a SFP+/SFP+, TwinAx, 1m

50 ThinkSystem SR630 Server (HLH) Mellanox-P2 n/a SFP+/SFP+, TwinAx, 1m

49 ThinkSystem SR630 Server (HLH) Mellanox-P1 n/a SFP+/SFP+, TwinAx, 1m

48 ThinkSystem NE2572 Switch 2 (TOR) MGMT n/a Cat5e, 1.5m

47 ThinkSystem NE2572 Switch 1 (TOR) MGMT n/a Cat5e, 1.5m

46 ThinkSystem SR630 Server (HLH) BMC n/a Cat5e, 1.5m

45 n/a n/a n/a n/a



SourcePort


Device Port Optic

44 n/a n/a n/a n/a

43 n/a n/a n/a n/a

42 n/a n/a n/a n/a

41 n/a n/a n/a n/a

40 n/a n/a n/a n/a

39 n/a n/a n/a n/a

38 n/a n/a n/a n/a

37 n/a n/a n/a n/a

36 n/a n/a n/a n/a

35 n/a n/a n/a n/a

34 n/a n/a n/a n/a

33 n/a n/a n/a n/a

32 n/a n/a n/a n/a

31 n/a n/a n/a n/a

30 n/a n/a n/a n/a

29 n/a n/a n/a n/a

28 n/a n/a n/a n/a

27 n/a n/a n/a n/a

26 n/a n/a n/a n/a

25 n/a n/a n/a n/a

24 n/a n/a n/a n/a

23 n/a n/a n/a n/a

22 n/a n/a n/a n/a

21 n/a n/a n/a n/a

20 n/a n/a n/a n/a

19 n/a n/a n/a n/a

18 n/a n/a n/a n/a

17 n/a n/a n/a n/a

16 n/a n/a n/a n/a

15 n/a n/a n/a n/a

14 n/a n/a n/a n/a

13 n/a n/a n/a n/a

12 ThinkSystem SR650 Server, Node 12 BMC n/a Cat5e, 3m






SourcePort


Device Port Optic










MGMT n/a n/a n/a n/a


Appendix C. Software

The necessary software tools and operating systems are provided with the ThinkAgile SXM product. Certaininstallation, configuration, and licensing procedures will be performed during the deployment engagement.

Note: Some license agreements might be accepted on the customer’s behalf by Lenovo Manufacturingduring the installation and provisioning processes. When required, license agreements will be shippedhardcopy or softcopy with the product.

The following software and operating systems are provided with ThinkAgile SXM:

• Lenovo XClarity Pro

The Lenovo XClarity Pro suite includes the following:

– Lenovo XClarity Administrator (LXCA)

Lenovo XClarity Administrator provides a single interface for managing the switches and servers in theconfiguration.

This product is provided as a VM on the Hardware Lifecycle Host server.

• Microsoft Windows Server™ 2016 Standard with Desktop Experience

This product is pre-installed on the Hardware Lifecycle Host server. The customer must provide thelicense key during the deployment engagement.

Microsoft Hyper-V™ is included, in order to host the LXCA VMs.

• Microsoft Windows Server 2016 Datacenter

This product is pre-installed on the server nodes. The customer must provide the license key during thedeployment engagement.

Microsoft Hyper-V is included, in order to host the Azure Stack VMs.

• Microsoft Azure Stack for Enterprise

This product will be installed and configured at the customer site. See the Chapter 4 “licenseconsiderations” on page 9 for more information.

• Microsoft Storage Spaces Direct (S2D)

S2D is an integrated part of Azure Stack. It delivers scalable, highly available distributed shared storagethat provides extensive data protection and recovery with no performance bottlenecks and no single pointof failure. S2D will be configured during the deployment engagement

• Lenovo Cloud Networking Operating System (CNOS)

CNOS is pre-installed on the TOR switches.

• Lenovo Enterprise Networking Operating System (ENOS)

ENOS is pre-installed on the BMC switch.



Appendix D. ThinkAgile SXM power cabling

Updated. Ready for reviewThe ThinkAgile SXM rack and components are precabled for power. Thisinformation is provided for your reference.

Power cabling for 25U rack

The following table shows the power cabling for the ThinkAgile SXM 25U rack models. These settings applyregardless of the number of server nodes that are installed. Note that the power cabling is not the same asthe 42U rack models.

Note: The power cabling for all ThinkAgile SXM 25U rack models is the same, regardless of the individualswitch or server components. See the specific model information for details about the hardwarecomponents.

Table 8. Power cabling for 25U rack

Source Destination Connectiontype

PDU Port Device Port

PDU-4 12 Top-of-Rack switch 1 PSU-2 C13/C14

PDU-4 11 Hardware Lifecycle Host PSU-2 C13/C14

PDU-4 10 not used n/a n/a






PDU-4 4 Server node 8 PSU-2 C13/C14




PDU-4 MGMT not used n/a n/a













Table 8. Power cabling for 25U rack (continued)






PDU-2 11 Management switch PSU-2 C13/C14

























Power cabling for 42U rack

The following table shows the power cabling for the ThinkAgile SXM 42U rack models. These settings applyregardless of the number of server nodes that are installed. Note that the power cabling is not the same asthe 25U rack models.

Notes:

• The power cabling for all ThinkAgile SXM 42U rack models is the same, regardless of the individual switchor server components. See the specific model information for details about the hardware components.

• The PDUs for the 42U rack are housed in compartments in the rack side wall, and do not use rack slots.


Table 9. Power cabling for 42U rack







































Appendix D. ThinkAgile SXM power cabling 47

Table 9. Power cabling for 42U rack (continued)




















Appendix E. Firmware maintenance and Best Recipe

ThinkAgile SXM products use a “Best Recipe” to identify the supported firmware levels for the product.

For information about the ThinkAgile SXM Best Recipe, refer to the following Web site:

https://datacentersupport.lenovo.com/solutions/ht505122

Adherence to Best Recipe and Support impact

The ThinkAgile SXM Best Recipe includes component firmware levels that have been tested in anappropriate environment. Any specific firmware that is above or below the level indicated in the Best Recipeis not supported and might impact Lenovo’s ability to support any issues with the relevant component or theentire solution.

Updating firmware

See “ThinkAgile SXM documentation and related content” on page 1 for links to relevant documentation.


https://datacentersupport.lenovo.com/solutions/ht505122


Documents

Lenovo ThinkAgile SX for Microsoft Azure Stack Planning ... · ThinkAgile SXM Support For the latest information and links to helpful content, refer to the Lenovo Data Center Support