69
SymantecStorage: NAS 6.0 Troubleshooting Guide Linux December 2014

Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

  • Upload
    lyphuc

  • View
    281

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Symantec™ Storage: NAS 6.0Troubleshooting Guide

Linux

December 2014

Page 2: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Symantec Storage: NAS Troubleshooting GuideThe software described in this book is furnished under a license agreement and may be usedonly in accordance with the terms of the agreement.

Product version: 6.0

Document version: 6.0 Rev 0

Legal NoticeCopyright © 2014 Symantec Corporation. All rights reserved.

Symantec, the Symantec Logo, the Checkmark Logo, Veritas, Veritas Storage Foundation,CommandCentral, NetBackup, Enterprise Vault, and LiveUpdate are trademarks or registeredtrademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Othernames may be trademarks of their respective owners.

This Symantec product may contain third party software for which Symantec is required toprovide attribution to the third party (“Third Party Programs”). Some of the Third Party Programsare available under open source or free software licenses. The License Agreementaccompanying the Software does not alter any rights or obligations you may have under thoseopen source or free software licenses. See the Third-party Legal Notices document for thisproduct, which is available online or included in the base release media.

The product described in this document is distributed under licenses restricting its use, copying,distribution, and decompilation/reverse engineering. No part of this document may bereproduced in any form by any means without prior written authorization of SymantecCorporation and its licensors, if any.

THE DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIEDCONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY IMPLIEDWARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE ORNON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCHDISCLAIMERS ARE HELD TO BE LEGALLY INVALID. SYMANTEC CORPORATION SHALLNOT BE LIABLE FOR INCIDENTAL OR CONSEQUENTIAL DAMAGES IN CONNECTIONWITH THE FURNISHING, PERFORMANCE, OR USE OF THIS DOCUMENTATION. THEINFORMATION CONTAINED IN THIS DOCUMENTATION IS SUBJECT TO CHANGEWITHOUT NOTICE.

The Licensed Software and Documentation are deemed to be commercial computer softwareas defined in FAR 12.212 and subject to restricted rights as defined in FAR Section 52.227-19"Commercial Computer Software - Restricted Rights" and DFARS 227.7202, "Rights inCommercial Computer Software or Commercial Computer Software Documentation", asapplicable, and any successor regulations, whether delivered by Symantec as on premisesor hosted services. Any use, modification, reproduction release, performance, display ordisclosure of the Licensed Software and Documentation by the U.S. Government shall besolely in accordance with the terms of this Agreement.

Page 3: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Symantec Corporation350 Ellis StreetMountain View, CA 94043

http://www.symantec.com

Page 4: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Technical SupportSymantec Technical Support maintains support centers globally. Technical Support’sprimary role is to respond to specific queries about product features and functionality.The Technical Support group also creates content for our online Knowledge Base.The Technical Support group works collaboratively with the other functional areaswithin Symantec to answer your questions in a timely fashion. For example, theTechnical Support group works with Product Engineering and Symantec SecurityResponse to provide alerting services and virus definition updates.

Symantec’s support offerings include the following:

■ A range of support options that give you the flexibility to select the right amountof service for any size organization

■ Telephone and/or Web-based support that provides rapid response andup-to-the-minute information

■ Upgrade assurance that delivers software upgrades

■ Global support purchased on a regional business hours or 24 hours a day, 7days a week basis

■ Premium service offerings that include Account Management Services

For information about Symantec’s support offerings, you can visit our website atthe following URL:

www.symantec.com/business/support/index.jsp

All support services will be delivered in accordance with your support agreementand the then-current enterprise technical support policy.

Contacting Technical SupportCustomers with a current support agreement may access Technical Supportinformation at the following URL:

www.symantec.com/business/support/contact_techsupp_static.jsp

Before contacting Technical Support, make sure you have satisfied the systemrequirements that are listed in your product documentation. Also, you should be atthe computer on which the problem occurred, in case it is necessary to replicatethe problem.

When you contact Technical Support, please have the following informationavailable:

■ Product release level

■ Hardware information

Page 5: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

■ Available memory, disk space, and NIC information

■ Operating system

■ Version and patch level

■ Network topology

■ Router, gateway, and IP address information

■ Problem description:

■ Error messages and log files

■ Troubleshooting that was performed before contacting Symantec

■ Recent software configuration changes and network changes

Licensing and registrationIf your Symantec product requires registration or a license key, access our technicalsupport Web page at the following URL:

www.symantec.com/business/support/

Customer serviceCustomer service information is available at the following URL:

www.symantec.com/business/support/

Customer Service is available to assist with non-technical questions, such as thefollowing types of issues:

■ Questions regarding product licensing or serialization

■ Product registration updates, such as address or name changes

■ General product information (features, language availability, local dealers)

■ Latest information about product updates and upgrades

■ Information about upgrade assurance and support contracts

■ Information about the Symantec Buying Programs

■ Advice about Symantec's technical support options

■ Nontechnical presales questions

■ Issues that are related to CD-ROMs or manuals

Page 6: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Support agreement resourcesIf you want to contact Symantec regarding an existing support agreement, pleasecontact the support agreement administration team for your region as follows:

[email protected] and Japan

[email protected], Middle-East, and Africa

[email protected] America and Latin America

DocumentationYour feedback on product documentation is important to us. Send suggestions forimprovements and reports on errors or omissions. Include the title and documentversion (located on the second page), and chapter and section titles of the text onwhich you are reporting. Send feedback to:

[email protected]

For information regarding the latest HOWTO articles, documentation updates, orto ask a question regarding product documentation, visit the Storage and ClusteringDocumentation forum on Symantec Connect.

https://www-secure.symantec.com/connect/storage-management/forums/storage-and-clustering-documentation

About Symantec ConnectSymantec Connect is the peer-to-peer technical community site for Symantec’senterprise customers. Participants can connect and share information with otherproduct users, including creating forum posts, articles, videos, downloads, blogsand suggesting ideas, as well as interact with Symantec product teams andTechnical Support. Content is rated by the community, and members receive rewardpoints for their contributions.

http://www.symantec.com/connect/storage-management

Page 7: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Technical Support ............................................................................................... 4

Chapter 1 Introduction ......................................................................... 10

About Troubleshooting .................................................................. 10General tips for the troubleshooting process ...................................... 10General techniques for the troubleshooting process ............................. 11About the support user account ....................................................... 12Configuring the support user account ............................................... 13Using the support login .................................................................. 14

Chapter 2 General troubleshooting procedures .............................. 15

About general troubleshooting procedures ......................................... 15Viewing alerts on the Storage NAS Management Console (GUI)

Dashboard ............................................................................ 16About monitoring Storage NAS alerts ............................................... 17Using the alerts panel .................................................................... 19Filtering alerts .............................................................................. 19Viewing the Storage NAS log files .................................................... 20About event logs .......................................................................... 21About event logs for the Storage NAS Management Console ................ 23Setting the CIFS log level ............................................................... 23Retrieving and sending debugging information ................................... 23

Chapter 3 Monitoring Storage NAS .................................................... 25

About monitoring Storage NAS operations ......................................... 25Monitoring processor activity ........................................................... 25Generating CPU and device utilization reports .................................... 27Monitoring and managing the Storage NAS Management Console

(GUI) ................................................................................... 28Monitoring network traffic ............................................................... 31Exporting and displaying the network traffic details .............................. 32

Contents

Page 8: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Chapter 4 Common recovery procedures ......................................... 34

About common recovery procedures ................................................ 34Restarting servers ........................................................................ 35Bringing services online ................................................................. 36

Using the services command .................................................... 36Recovering from a non-graceful shutdown ......................................... 38Testing the network connectivity ...................................................... 38Troubleshooting with traceroute ....................................................... 39Using the traceroute command ........................................................ 40Refreshing the Storage NAS GUI database ....................................... 40Replacing an Ethernet interface card ................................................ 41Speeding up replication ................................................................. 42

About synchronizing a replication job .......................................... 42Synchronizing a replication job .................................................. 44

Uninstalling a patch release or software upgrade ................................ 44

Chapter 5 Troubleshooting Storage NAS installation andconfiguration issues ..................................................... 45

Viewing the installation logs ............................................................ 45Installation fails and does not complete ............................................. 47Excluding PCI IDs from the cluster ................................................... 47

Chapter 6 Troubleshooting Storage NAS CIFS issues .................... 49

User access is denied on a CTDB directory share .............................. 49

Appendix A Storage NAS command summary .................................... 50

About the command modes in the Storage NAS CLI ............................ 50Network mode commands .............................................................. 50

Network mode - bond commands .............................................. 52Network mode - device commands ............................................ 52Network mode - DNS commands ............................................... 53Network mode - ip commands ................................................... 54Network mode - LDAP commands ............................................. 57Network mode - LDAP client commands ..................................... 58Network mode - NIS commands ................................................ 59Network mode - nsswitch commands .......................................... 59Network mode - ping command ................................................. 59Network mode - pciexclusion commands ..................................... 60Network mode - swap command ................................................ 60Network mode - VLAN commands ............................................. 61

8Contents

Page 9: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Support mode commands .............................................................. 61Support mode - debuginfo commands ........................................ 62Support mode - gui commands .................................................. 63Support mode - iostat commands .............................................. 63Support mode - services commands ........................................... 64Support mode - tethereal commands .......................................... 64Support mode - top command ................................................... 65Support mode - traceroute command .......................................... 65

Supportuser mode commands ........................................................ 66

Index .................................................................................................................... 67

9Contents

Page 10: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Introduction

This chapter includes the following topics:

■ About Troubleshooting

■ General tips for the troubleshooting process

■ General techniques for the troubleshooting process

■ About the support user account

■ Configuring the support user account

■ Using the support login

About TroubleshootingTroubleshooting procedures for Storage NAS include the following types ofprocedures:

■ Alert and log message review

■ Routine maintenance tasks

■ Commonly used recovery procedures

■ Feature-specific problems and resolutions

Each of these procedures are described in the remaining chapters of this guide.

General tips for the troubleshooting processTo troubleshoot a problem, it helps to consider the following:

■ Check for previous occurrence.

1Chapter

Page 11: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Check existing troubleshooting information to see if the problem has occurredbefore. For this type of information, a good source is the Symantec Storage:NASRelease Notes. The release notes contain a list of known issues for StorageNAS and possible workarounds.

■ Consider recent alterations.If a system has problems immediately after some kind of maintenance, softwareupgrade, or other change, the problems might be linked to those changes.

■ Determine what works.If a system does not produce the desired end result, look for what operatesproperly. Identify where the problem is not and focus your efforts in other areas.Whatever components or subsystems necessary for the properly working partsto function are probably okay. For example, if a Storage NAS feature can beconfigured correctly with a Storage NAS CLI command, but it cannot beconfigured with the Storage NAS Management Console (GUI), the feature itselfmay work correctly, but there may be some issues with console interaction.

■ Use your experience.Based on your knowledge of how a system works, think of various failures thatmight cause this problem to occur. Check for those failures. Start with the mostlikely failures based on circumstances, history, or knowledge of existing featureweaknesses.

General techniques for the troubleshooting processAfter applying some general troubleshooting tips to narrow the scope of a problem,here are some techniques to further isolate the problem:

■ Swap identical parts.In a system with identical or parallel parts and subsystems, it is a good idea toswap components between those subsystems and see whether or not theproblem moves with the swapped component. For example, if you experienceStorage NAS network connection problems on one node in a cluster, you couldswap Ethernet Interface cards to determine if the problem moves to the newnode.

■ Remove parallel components.If a system is composed of several parallel or redundant components that canbe removed without crippling the whole system, start removing these components(one at a time) and see if things start to work. For example, in a cluster, shutdownthe nodes one-by-one to see if the problem still persists.

■ Divide the system into sections.

11IntroductionGeneral techniques for the troubleshooting process

Page 12: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

In a system with multiple sections or stages, carefully measure the variablesgoing in and out of each stage until you find a stage where things do not lookright. For example, if you run across a problem with a replication job, check tosee if the job has run successfully before and try to determine the time framewhen the job started to fail.

■ Monitor system behavior over time (or location).Set up a process (such as the Support> traceroute command or a series ofSupport> iostat commands) to monitor system activity over a period of timeor to monitor system activity across the network. This monitoring is especiallyhelpful to track down intermittent problems, processor activity problems, nodeconnection problems, and so on.

About the support user accountStorage NAS includes three types of user accounts:

■ Master

■ System Administrator

■ Storage Administrator

In addition to the accounts listed, an administrator who is logged in as master canenable access for another type of account, the support user account . The Admin>

supportuser commands are used to enable, disable, or view the status of thesupport user. Only an administrator who is logged in as master has the privilegeto enable, disable, change the password, or check the status of the support user.

In some cases, the troubleshooting techniques in this guide require using supportcommands to locate and fix the problem.

Warning:Use caution when executing support commands. The support commandsare intended for advanced users who are familiar with Storage NAS features andfunctions. If you have any questions about using these commands, contact yourSymantec Technical Support Representative for further guidance.

12IntroductionAbout the support user account

Page 13: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Configuring the support user accountTo enable the support user account

◆ If you want to enable the support user, enter the following:

Admin> supportuser enable

For example:

Admin> supportuser enable

Enabling support user.

support user enabled.

Please change default password.

To change the support user password

◆ If you want to change the support user password, enter the following:

Admin> supportuser password

For example:

Admin> supportuser password

Changing password for support.

Old password:

New password:

Re-enter new password:

Password changed

To check the support user status

◆ If you want to check the status of the support user, enter the following:

Admin> supportuser status

For example:

Admin> supportuser status

support user status : Enabled

13IntroductionConfiguring the support user account

Page 14: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To disable the support user account

◆ If you want to disable the support user, enter the following:

Admin> supportuser disable

For example:

Admin> supportuser disable

Disabling support user.

support user disabled.

Using the support login

Note: The support account is intended for Technical Support and advanced usersonly. Administrators cannot create this account.

To use the support login

◆ Log into the CLI as the support account by entering:

support

and then entering:

symantec

For example,

login as: support

support@<ip_address>'s password:

Last login: Tue Oct 28 13:46:33 2014 from snastest.symantec.com

***********************************************************

* Symantec Storage NAS *

* *

* Enterprise Edition *

* Warning: Only Symantec Storage NAS distributed *

* patches & RPMs can be installed on this system! *

* Do not delete contents of lost+found directory *

* of filesystems as it may contain critical *

* temporary Symantec Storage NAS configuration data! *

***********************************************************

source_21a_02:~ #

14IntroductionUsing the support login

Page 15: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

General troubleshootingprocedures

This chapter includes the following topics:

■ About general troubleshooting procedures

■ Viewing alerts on the Storage NAS Management Console (GUI) Dashboard

■ About monitoring Storage NAS alerts

■ Using the alerts panel

■ Filtering alerts

■ Viewing the Storage NAS log files

■ About event logs

■ About event logs for the Storage NAS Management Console

■ Setting the CIFS log level

■ Retrieving and sending debugging information

About general troubleshooting proceduresThis chapter provides an overview of general troubleshooting procedures you canuse to help discover and fix problems.

2Chapter

Page 16: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Viewing alerts on the Storage NAS ManagementConsole (GUI) Dashboard

You can use the Alerts panel on the Storage NAS Management Console (GUI)Dashboard to get a quick overview of any problems that may occur with StorageNAS GUI operations.

Figure 2-1 Storage NAS Management Console (GUI) Dashboard

16General troubleshooting proceduresViewing alerts on the Storage NAS Management Console (GUI) Dashboard

Page 17: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To view alerts on the Storage NAS Management Console:

1 Log on to the Storage NAS Management Console.

Use the following URL to access the Storage NAS Management Console:

https://CONSOLE-IP:8443/sm/Login

Specifies the Storage NAS server IP address.CONSOLE-IP

For example:

https://10.176.112.98:8443/sm/Login

For more information about logging into the Storage NAS Management Console,refer to the Symantec Storage: NAS Web GUI Administrator’s Guide.

2 To view all of the alerts, click on the Alerts tab at the top of the Dashboardwindow.

About monitoring Storage NAS alertsThe Storage NAS Management Console Dashboard Alerts panel displays a list ofalerts.

The information provided with the alerts is the following:

■ Severity - Severity level of the alert

■ Time - Time the alert occurred

■ Message - Message associated with the alert

■ Filter - Filter used for sorting the alerts

17General troubleshooting proceduresAbout monitoring Storage NAS alerts

Page 18: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

If you click on the View All Alerts link, Storage NAS takes you to the Home >Alerts tab where all the alerts are displayed.

Alert levels and definitions are described in Table 2-1.

Note: After an alert is handled, it is removed from the panel. However, it remainsin the syslog.

Table 2-1 Alert levels in precedence order

DefinitionAlert level

There is no icon for this alert.

Indicates that the system is unusable.

Emerg

Indicates that immediate action is required.Alert

Indicates a critical condition.Critical

18General troubleshooting proceduresAbout monitoring Storage NAS alerts

Page 19: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table 2-1 Alert levels in precedence order (continued)

DefinitionAlert level

Indicates an error condition.Error

Indicates a warning condition.Warning

There is no icon for this alert.

Indicates a normal but significant condition.

Notice

Indicates an informational message.Info

There is no icon for this alert.

Indicates a debugging message.

Debug

Using the alerts panelTo view all of the alerts

1 To view all of the alerts, click on the Alerts tab at the top of the Dashboardwindow.

You can also go to the bottom of the Dashboard window, and click on ViewAll Alerts.

The Alerts window opens.

2 In the Alerts window, you can click on any of the nodes.

By clicking on a node, Storage NAS takes you to the Node Details window onthe Cluster tab.

Filtering alertsThe Alerts panel can contain a large number of alerts, informational messages,critical errors, and so on. Often, it can be useful to filter the information that appearin the panel so you can view information associated with a specific troubleshootingissue.

19General troubleshooting proceduresUsing the alerts panel

Page 20: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Use the Filter settings a the top of the Alerts page to control what informationappears in the panel.

Figure 2-2 Alert filter settings

To filter messages, you can choose a pre-defined filter type from the Select Filterdrop-down menu. For example, you can choose Info from the menu to show onlyinformation alerts. See Figure 2-3.

Figure 2-3 Filtering alerts - Showing information alerts only

For more information about filtering alerts, refer to the Symantec Storage: NASWeb GUI Administrator’s Guide.

Viewing the Storage NAS log filesIn addition to the Alerts panel on the Storage NAS Management Console (GUI)Dashboard, the Storage NAS /var/log directory is a good place to find out moreabout problems that may occur.

To view the Storage NAS log files

1 Use the support account to login.

2 Navigate to the /var/log directory.

20General troubleshooting proceduresViewing the Storage NAS log files

Page 21: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Figure 2-4 Storage NAS log files

About event logsIn addition to the system log, each Storage NAS feature has an associated eventlog. When a problem occurs, one of the quickest ways to learn more about whatoccurred is to examine these log files. Event logs for Storage NAS features arestored in the /opt/SYMCsnas/log directory.

21General troubleshooting proceduresAbout event logs

Page 22: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To view the event logs:

1 Use the support account to login.

2 Navigate to the /opt/SYMCsnas/log directory.

Event logs for Storage NAS features are stored in this directory.

For example, the cifs.log contains CIFS event logs.

Figure 2-5 Storage NAS event logs

22General troubleshooting proceduresAbout event logs

Page 23: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

About event logs for the Storage NAS ManagementConsole

In addition to the event logs in /opt/SYMCsnas/log, the Management Console hasseveral components with separate log file locations. The additional logs are locatedas follows:

VRTSsfmh (agentlet): /var/opt/VRTSsfmh/SFS/log/mh.log

Framework log file: /opt/SYMCsnas/esmweb_log/esmweb/log/Web

Tomcat log file: /opt/SYMCsnas/esmweb/tomcat/logs/catalina.out

Setting the CIFS log levelYou can set the CIFS log level for the Storage NAS cluster.

To set the CIFS log level

◆ To set the CIFS-related log level for the Storage NAS cluster, enter thefollowing:

Support> debuginfo setlog loglevel

A valid loglevel ranges from 0 to 10, 10 being the most detailed log level. Itis recommended to increase the CIFS log level, reproduce the CIFS issue, andthen upload debugging information for the CIFS issue.

The default log level is 2.

For example, to set the CIFS log level to 10 for the Storage NAS cluster:

Support> debuginfo setlog 10

See “Retrieving and sending debugging information” on page 23.

Retrieving and sending debugging informationYou can retrieve Storage NAS debugging information from a Storage NAS nodeand send the information to a server using an external FTP or SCP server.

To upload debugging information from a specified node to an external server

◆ To upload debugging information from a specified node to an external server,enter the following:

Support> debuginfo upload nodename debug-URL module

23General troubleshooting proceduresAbout event logs for the Storage NAS Management Console

Page 24: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

For example, to upload all debugging information to an FTP server:

Support> debuginfo upload node1_1

ftp://[email protected]/patches/ all

For example, to upload CIFS-related debugging information to an SCP server:

Support> debuginfo upload node1_1

scp://[email protected]:/tmp/node1_1-cifs-debuginfo.tar.gz

Specifies the nodename from which to collect the debugginginformation.

nodename

Specifies the remote file or directory for uploading debugginginformation.

Depending on the type of server from which you are uploadingdebugging information, use one of the following example URLformats:

ftp://[email protected]/patches/

scp://[email protected]:/tmp/

If debug-URL specifies a remote file, the debuginfo file is savedby that name. If debug-URL specifies a remote directory, thedebuginfo file name displays as the following:

sfsfs_debuginfo_nodename_modulename_timestamp.tar.gz

debug-URL

Specifies the values for module.

Supported module values are the following:

■ all - use to collect all information for debugging■ generic - use to collect all debugging information except for

information related to Symantec products■ cifs - use to collect CIFS-related debugging information■ nas - use to collect Storage NAS related debugging information

module

24General troubleshooting proceduresRetrieving and sending debugging information

Page 25: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Monitoring Storage NAS

This chapter includes the following topics:

■ About monitoring Storage NAS operations

■ Monitoring processor activity

■ Generating CPU and device utilization reports

■ Monitoring and managing the Storage NAS Management Console (GUI)

■ Monitoring network traffic

■ Exporting and displaying the network traffic details

About monitoring Storage NAS operationsThis chapter describes several support tasks that are useful for monitoring StorageNAS operations. Perform these monitoring tasks periodically to ensure that StorageNAS is running smoothly.

As you work with Storage NAS, keep an ongoing record of the output created bymonitoring commands. This process gives you a baseline for judging normaloperations and helps you to flag potential problems before they become serious.

Monitoring processor activityThe Support> top command displays the dynamic real-time view of currentlyrunning tasks. It shows the resources that users and processes consume at a giventime for a specified node.

3Chapter

Page 26: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To use the top command

◆ To use the Support> top command, enter the following:

Support> top [nodename] [iterations] [delay]

Displays the resources and processes at a given time for thespecified node.

nodename

Specifies the number of iterations you want to run. The default isthree.

iterations

Specifies the delay between screen updates. The default is fiveseconds.

delay

For example, to show the dynamic real-time view of tasks running on the nodesnas_01, enter the following:

Support> top snas_01 1 1

top - 16:28:27 up 1 day, 3:32, 4 users, load average: 1.00, 1.00, 1.00

Tasks: 336 total, 1 running, 335 sleeping, 0 stopped, 0 zombie

Cpu(s): 0.1% us, 0.1% sy, 0.0% ni, 99.7% id, 0.0% wa, 0.0% hi, 0.0% si

Mem: 16405964k total, 1110288k used, 15295676k free, 183908k buffers

Swap: 1052248k total, 0k used, 1052248k free, 344468k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND

6314 root 15 0 5340 1296 792 R 3.9 0.0 0:00.02 top

1 root 16 0 640 260 216 S 0.0 0.0 0:04.86 init

26Monitoring Storage NASMonitoring processor activity

Page 27: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Generating CPU and device utilization reportsTo use the iostat command

◆ To use the Support> iostat cpu command, enter the following:

Support> iostat cpu [nodename] [interval] [count]

The name of the node from where the report is generated. Thedefault is console for the Management Console.

nodename

The duration between each report in seconds. The default is 2seconds.

interval

The number of reports generated at the interval entered inseconds. The default is one report.

count

where the nodename option asks for the name of the node from where thereport is generated. The default is console for the Storage NAS ManagementConsole.

For example, to generate the CPU utilization report of the console node, enterthe following:

Support> iostat cpu snas_01

Linux 2.6.16.60-0.21-smp (snas_01) 02/09/14

avg-cpu: %user %nice %system %iowait %steal %idle

1.86 0.07 4.53 0.13 0.00 93.40

27Monitoring Storage NASGenerating CPU and device utilization reports

Page 28: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To use the iostat device command

◆ To use the Support> iostat device command, enter the following:

Support> iostat device [nodename] [dataunit]

[interval] [count]

The nodename option asks for the name of the node from wherethe report is generated. The default is console for theManagement Console.

nodename

The dataunit option lets you generate the report in block(s) orkilobytes(s). The default is block(s).

dataunit

The duration between each report in seconds. The default is twoseconds.

interval

The number of reports generated at the interval entered inseconds. The default is one report.

count

For example, to generate a device utilization report of a node, enter thefollowing:

Support> iostat device snas_01 Blk

Linux 2.6.16.60-0.21-smp (snas_01) 02/09/14

Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn

hda 4.82 97.81 86.11 1410626 1241992

sda 1.95 16.83 4.05 242712 58342

hdc 0.00 0.01 0.00 136 0

Monitoring and managing the Storage NASManagement Console (GUI)

Use the Support> gui commands to manage and monitor the server that supportsthe Storage NAS Management Console (GUI) and the GUI database.

28Monitoring Storage NASMonitoring and managing the Storage NAS Management Console (GUI)

Page 29: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To show GUI server status

◆ To show GUI server status, enter the following:

Support> gui server status

For example:

Support> gui server status

GUI service is ONLINE.

The GUI service status can be ONLINE or OFFLINE.

To start the GUI server

◆ To start the GUI server, enter the following:

Support> gui server start

For example:

Support> gui server start

GUI service is ONLINE.

To stop the GUI server

◆ To stop the GUI server, enter the following:

Support> gui server stop

For example:

Support> gui server stop

GUI service is OFFLINE.

29Monitoring Storage NASMonitoring and managing the Storage NAS Management Console (GUI)

Page 30: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To refresh the GUI database

◆ To refresh the GUI database, enter the following:

Support> gui db refresh [all|filesystem|share|storage|cluster|

replication|settings|alert|user|cifs_homedir]

Refreshes information on all pages of the GUIall

Refreshes file system information in the GUIfilesystem

Refreshes share information in the GUIshare

Refreshes storage information in the GUIstorage

Refreshes cluster information in the GUIcluster

Refreshes replication information in the GUIreplication

Refreshes information on the Settings page of the GUIsettings

Refreshes alert information in the GUIalert

Refreshes user information in the GUIuser

Refreshes CIFS home directory information in the GUI.cifs_homedir

Using the Support> gui refresh command discovers any changes (relatedto file systems, disks, pools, and so on) and those updates are reflected in theStorage NAS GUI displays.

For example:

Support> gui db refresh cluster

To rescan the GUI database

◆ To rescan the GUI database, enter the following:

Support> gui db rescan

For example:

Support> gui db rescan

Please wait... It will take some time.

Rescanning DB... Done.

30Monitoring Storage NASMonitoring and managing the Storage NAS Management Console (GUI)

Page 31: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Monitoring network trafficTethereal is a command-line version of Ethereal, a network protocol analyzersupported by the Linux operating system. It lets you capture packet data from alive network or read packets from a previously-saved capture file.

To help you monitor network traffic, Storage NAS provides a Support> tethereal

command that lets you display and export network traffic data.

■ The Support> tethereal show command displays packed data captured froma live network.

■ The Support> tethereal export command lets you export network trafficdetails for further analysis.

31Monitoring Storage NASMonitoring network traffic

Page 32: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Exporting and displaying the network traffic detailsTo use the tethereal command

◆ To use the Support> tethereal export command, enter the following:

Support> tethereal export url [nodename] [interface] [count]

[source]

Provides the location to export the network traffic details. Thedefault file name tethereal.log is used if a file name is notspecified in the url.

url

The name of the node from where the traffic details are generated.Unless a name is entered, the default is console for theManagement Console.

nodename

Specifies the network interface for the packet capture.interface

Specifies the maximum number of packets to read.

The maximum allowed file size to capture the network traffic detailsis 128 MB. For a very large "count" value, if the file size exceeds128 MB, then the command stops capturing the network trafficdetails.

count

Specifies the node to filter the packets.source

For example, to export the network traffic details, enter the following:

Support> tethereal export scp://[email protected]:˜/

Password: *******

Capturing on pubeth0 ...

Uploading network traffic details to scp://[email protected]:˜/

is completed.

When you export network traffic details, press the Ctrl + C keys to stop thecapture process and upload traffic details to the URL site.

32Monitoring Storage NASExporting and displaying the network traffic details

Page 33: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To use the tethereal show command

◆ To use the Support> tethereal show command, enter the following:

Support> tethereal show [nodename] [interface] [count]

[source]

The name of the node from where the traffic details are displayed.The default is console for the Storage NAS ManagementConsole.

nodename

Specifies the network interface for the packet capture.interface

Specifies the maximum number of packets to read.

If you do not specify a count value, the network traffic continuesto be displayed until you interrupt it.

count

Specifies the node to filter the packets.source

For example, the traffic details for five packets, for the Storage NASManagement Console on the pubeth0 interface are:

Support> tethereal show snas_01 pubeth0 5 172.31.168.140

0.000000 172.31.168.140 -> 10.209.105.147 ICMP Echo (ping) request

0.000276 10.209.105.147 -> 172.31.168.140 ICMP Echo (ping) reply

0.000473 10.209.105.147 -> 172.31.168.140 SSH Encrypted response

packet len=112

0.000492 10.209.105.147 -> 172.31.168.140 SSH Encrypted response

packet len=112

33Monitoring Storage NASExporting and displaying the network traffic details

Page 34: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Common recoveryprocedures

This chapter includes the following topics:

■ About common recovery procedures

■ Restarting servers

■ Bringing services online

■ Recovering from a non-graceful shutdown

■ Testing the network connectivity

■ Troubleshooting with traceroute

■ Using the traceroute command

■ Refreshing the Storage NAS GUI database

■ Replacing an Ethernet interface card

■ Speeding up replication

■ Uninstalling a patch release or software upgrade

About common recovery proceduresThis chapter provides some of the most-common recovery procedures you can useto troubleshoot a problem with Storage NAS.

4Chapter

Page 35: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Restarting serversSome configuration changes do not take effect until the associated server isrestarted. Therefore, some configuration problems can be solved by stopping andrestarting the associated server. For example, when you change AD Domainsettings, you need to restart the CIFS server.

Table 4-1 shows commands you can use to start and stop Storage NAS servers.

Table 4-1 Commands to start and stop servers

DefinitionCommand

Starts all configured backup services.Backup> start

Stops all configured backup services.Backup> stop

Starts the CIFS server.CIFS> serverstart

Stops the CIFS server.CIFS> serverstop

Starts the FTP server.FTP> serverstart

Stops the FTP server.FTP> serverstop

Starts the NFS server.NFS> serverstart

Stops the NFS server.NFS> serverstop

Starts the iSCSI initiator service.Storage> iscsistart

Stops the iSCSI initiator service.Storage> iscsistop

Note:Some commands include the server argument and some do not. Also, someSupport> commands use a service (instead of server) argument. For moreinformation on starting and stopping Storage NAS servers, see the SymantecStorage: NAS Command-Line Administrator’s Guide.

35Common recovery proceduresRestarting servers

Page 36: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Bringing services onlineThe Support> services command lets you bring services that are OFFLINE orFAULTED back to the ONLINE state.

Note: After you use the Support> services command, if a service is still offline orfaulted, you need to contact Technical Support.

These services include:

■ Backup

■ Console service

■ CIFS server

■ FTP

■ FS manager

■ GUI

■ IP addresses

■ NIC information

■ NFS server

Using the services commandTo display the state of the services

◆ To display the important services running on the nodes, enter the following:

Support> services show

snas

Service 01 02

------- -------- --------

nfs ONLINE ONLINE

cifs ONLINE ONLINE

ftp ONLINE ONLINE

iSCSIInitiator OFFLINE OFFLINE

gui ONLINE ONLINE

console ONLINE ONLINE

nic_pubeth0 ONLINE ONLINE

nic_pubeth1 ONLINE ONLINE

fs_manager ONLINE ONLINE

36Common recovery proceduresBringing services online

Page 37: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To display the state of all of the services

◆ To display all of the services running on the nodes, enter the following:

Support> services showall

snas

Service 01 02

------- -------- --------

nfs ONLINE ONLINE

cifs ONLINE ONLINE

ftp ONLINE ONLINE

iSCSIInitiator OFFLINE OFFLINE

console ONLINE ONLINE

gui ONLINE ONLINE

nic_pubeth0 ONLINE ONLINE

nic_pubeth1 ONLINE ONLINE

fs_manager ONLINE ONLINE

10.182.107.201 ONLINE ONLINE

10.182.107.202 ONLINE ONLINE

10.182.107.203 ONLINE ONLINE

10.182.107.204 ONLINE ONLINE

/vx/fs1 ONLINE ONLINE

To fix any service fault

◆ To fix any service fault, enter the following:

Support> services autofix

Attempting to fix service faults...........done

To bring a service online

◆ To bring a service online on the nodes, enter the following:

Support> services online servicename

where servicename is the name of the service you want to bring online.

For example:

Support> services online 10.182.107.203

37Common recovery proceduresBringing services online

Page 38: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Recovering from a non-graceful shutdownIn some cases, when a non-graceful shutdown of a node occurs (for example,during an unexpected system halt or power failure), you may receive an errormessage on the local node asking you to use the Linux fsck (file system check)command to repair files on the node.

Attempting to use the fsck command to repair the node is not recommended (andmay not be possible). Instead, use a healthy node in the cluster to reinstall StorageNAS software on the damaged node.

To recover a node

1 Use the master account to log into Storage NAS.

2 Delete the failed node from the cluster. To delete the node, enter the following:

Cluster> del nodename

where nodename is the name of the failed node.

For example:

Cluster > del snas_01

Note: The failed node information is deleted from the cluster. When the failednode is rebooting, it will detect that it has been deleted and clean itself up.

3 After the node is deleted from the cluster, reboot the deleted node and then itis reachable using its original physical IP address (before the node had beenadded to the cluster).

4 Add the node back by entering the following:

Cluster> add nodeip

where nodeip is the reachable IP address of the deleted node.

For example:

Cluster > add 172.16.113.118

Testing the network connectivityYou can test whether a particular host or gateway is reachable across an IP network.

38Common recovery proceduresRecovering from a non-graceful shutdown

Page 39: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To use the ping command

◆ To use the ping command, enter the following:

Network> ping destination [nodename]

[devicename] [packets]

For example, you can ping host1 using node1:

Network> ping host1 node1

Specifies the host or gateway to send the information to.

The destination field can contain either a DNS name or an IPaddress.

destination

Specifies the nodename to ping from. To ping from any node, useany in the nodename field. The nodename field is an optionalfield. If nodename is omitted, any node is chosen to ping from.

nodename

Specifies the device through which you ping. To ping from anydevice in the cluster, use the any variable in the devicenamefield.

devicename

Specifies the number of packets that should be sent to thedestination.

If the packets field is omitted, five packets are sent to thedestination by default.

The packets field must contain an unsigned integer.

packets

Troubleshooting with tracerouteTraceroute is a widely-available utility supported by the Linux operating system.Much like ping, traceroute is a valuable tool to determine connectivity in a network.The Storage NAS Support> ping command enables you to discover connectionsbetween two systems. The Support> traceroute command checks systemconnections as well, but also lists the intermediate hosts between the two systems.Users can see the routes that packets can take from one system to another. Usethe Support > traceroute command to find the route to a remote host.. Forexample, you might use the Support> traceroute command to verify theconnectivity of each node in your cluster.

39Common recovery proceduresTroubleshooting with traceroute

Page 40: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Using the traceroute commandThe Support> traceroute command displays all of the intermediate nodes on aroute between two nodes.

To use the traceroute command

◆ To use the Support> traceroute command, enter the following:

Support> traceroute destination [source]

[maxttl]

The target node. To display all of the intermediate nodes that arelocated between two nodes on a network, enter the destinationnode.

You need to specify either an IPv4 address for an IPv4 installationor an IPv6 address for an IPv6 installation.

The accepted range for an IPv6 prefix is 0-128 integers.

destination

Specifies the source node name from where you want to beginthe trace.

source

Specifies the maximum number of hops. The default is sevenhops.

maxttl

For example, to trace the route to the network host, enter the following:

Support> traceroute www.symantec.com snas_01 10

traceroute to www.symantec.com (8.14.104.56), 10 hops max, 40 byte

packets

1 10.209.104.2 0.337 ms 0.263 ms 0.252 ms

2 10.209.186.14 0.370 ms 0.340 ms 0.326 ms

3 puna-spi-core-b02-vlan105hsrp.net.symantec.com (143.127.185.130)

0.713 ms 0.525 ms 0.533 ms

4 143.127.185.197 0.712 ms 0.550 ms 0.564 ms

5 10.212.252.50 0.696 ms 0.600 ms 78.719 ms

Refreshing the Storage NAS GUI databaseThere is an on-demand refresh operation that you can use if you find that StorageNAS GUI data is not updated or the latest data is not displayed. The Refreshoperation discovers any changes that occurred to Storage NAS objects and reportsthose changes to the database. Those updates are then reflected in the StorageNAS GUI displays in the Management Console.

40Common recovery proceduresUsing the traceroute command

Page 41: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Indicates the Refresh operation

Using theRefresh operation on theHome > Summary page discovers any changesthat have occurred to all objects, services, and settings, reports those changes tothe database, and updates the Management Console.

The Refresh operation is available on other pages in the console in addition to theHome page. On other pages, the Refresh operation discovers any changes thathave occurred to the objects, services and settings related to that specific pageand updates the corresponding displays in the console.

The Refresh operation updates changes in the database, but it does not recreatethe database.

Note: There is a corresponding Support> gui db refresh command that can beexecuted from the Storage NAS CLI. See the Symantec Storage: NASCommand-Line Administrator’s Guide for more information about using the CLI.

To refresh the Storage NAS GUI database

1 On the Home > Summary page, or from other pages in the console, click theRefresh icon.

2 In the Refresh dialog, verify that you want to discover any changes that haveoccurred to Storage NAS GUI objects, and click OK.

3 In the Result dialog, click OK.

Replacing an Ethernet interface cardIn some cases, you may need to replace an Ethernet interface card on a node. Thissection describes the steps you would take to replace the card.

Note:This procedure works for replacing an existing Ethernet interface card. It doesnot work for adding an additional Ethernet interface card to the cluster. If the Ethernetinterface card you add needs a new device driver, install the new device driverbefore installing the Ethernet interface card on the node

41Common recovery proceduresReplacing an Ethernet interface card

Page 42: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To replace an Ethernet interface card

1 Use the Cluster> shutdown command to shut down the node.

For example:

Cluster> shutdown snas_03

Stopping Cluster processes on snas_03.......done

Sent shutdown command to snas_03

2 Use the Cluster> del command to delete the node from the cluster.

For example:

Cluster> del snas_03

3 Install the replacement Ethernet interface card on the node.

4 Turn on the node.

5 Make sure that the Ethernet interface card is active and online.

6 Use the Cluster> add command to add the node back into the cluster.

For example:

Cluster> add 172.16.113.118

For details on the Cluster> add and Upgrade> commands that are described inthis section, see the Symantec Storage NASCommand-Line Administrator’s Guide.

Speeding up replicationIn some cases, a replication job may not proceed as fast as expected. In thissituation, you may need to resynchronize the replication job.

About synchronizing a replication jobThe first time a replication job is run, Storage NAS makes a full copy of the datafrom the source location to the destination. Subsequent jobs (triggered manuallyor through a schedule) only copy incremental changes.

In certain rare cases, data is already present at the destination, but the replicationcannot make the incremental changes. Examples of this situation include:

■ When replication has not been run for several days or weeks, and the changesthat are tracked by the VxFS file change log have been overwritten (or possiblycorrupted). This log is required for replication.

42Common recovery proceduresSpeeding up replication

Page 43: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

■ When a replication job is temporarily disabled and started again, the next jobrun triggers a full copy of the data.

■ When some changes have been made to the replication definition. For example,an earlier replication consisted of fs1/folder1, but you want to replicate datain fs1/folder2 also. Because fs1/folder2 requires a full copy, fs1/folder1is copied once again, even though only incremental changes are needed.

■ When the direction of the replication has to be reversed from destination tosource. Even though most data is present at both the destination and the source,anytime you create a new job at the destination, a full copy is triggeredautomatically for the first replication.

■ If an administrator accidentally deletes the internal database for replications andno backup is available, creating a new job (even for an existing configuration)triggers a full copy.

In these cases, instead of waiting to initiate a full copy, you can use theReplication> job sync command to leverage the existing data at the destinationand avoid requiring a full copy. The Replication> job sync command returnsthe replication job to a well-defined state and incremental replication can be used.

After you sync a job, the job is re-enabled, and you can use the standard job triggeror set the replication frequency to trigger incremental replication.

Note: Synchronization is only supported on enabled jobs. If you are not able toresume from a failed job, and you want to use the Replication> job sync

command to recover from this state, follow these steps. First, disable the job, thenenable the job again. Then, use the Replication> job sync command tosynchronize the job.

Note: Synchronization can not be performed on a paused replication job. Ifsynchronization is performed on a paused job that has been aborted or stopped,the last recovery point objective (RPO) for the paused job is not available.

43Common recovery proceduresSpeeding up replication

Page 44: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Synchronizing a replication jobTo synchronize an enabled replication job

◆ To synchronize an enabled replication job, enter the following:

Replication> job sync job_name

Specify the name of the replication job you want to synchronize.job_name

For example:

Replication> job sync job14

Uninstalling a patch release or software upgradeOften a problem occurs because of a known product defect. Once the defect isfixed, you can install a patch release or software upgrade to fix the issue.

When you install a patch release or software upgrade:

■ Before you start the installation, use the System> config export command tosave a copy of your configuration. After the upgrade, you can use the System>

config import command to restore your configuration.

■ To upgrade with minimal downtime, you need to obtain a set of temporary VIPand IP addresses to use during the upgrade. Alternatively, you can upgradewithout using temporary VIP and IP addresses, but the downtime increases.

For details on upgrading Storage NAS, refer to the Symantec Storage: NASInstallation Guide.

44Common recovery proceduresUninstalling a patch release or software upgrade

Page 45: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Troubleshooting StorageNAS installation andconfiguration issues

This chapter includes the following topics:

■ Viewing the installation logs

■ Installation fails and does not complete

■ Excluding PCI IDs from the cluster

Viewing the installation logsIf a problem occurs during installation, it can be helpful to view entries in theinstallation logs to help pinpoint problems.

5Chapter

Page 46: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

To view the Storage NAS installation logs

1 During Storage NAS installation and configuration, you can access installerlogs in a temporary folder under /var/tmp.

2 After Storage NAS installation and configuration, you can view a copy of theinstallation logs in the following locations:

/var/log/nas_postinstall.log

This directory contains the Storage NAS specific installation logs.

For example:

/var/log/nas_postinstall.log.201407030655

Storage NASpost-installationlogs

/opt/SYMCsnas/log/Install.log

This directory contains the Storage NAS specific configuration logs.

For example:

/opt/SYMCsnas/log/Install.log.201407030655

Storage NASservice groupconfigurationlogs

/opt/SYMCsnas/log/install_network.log

This directory contains the Storage NAS network configuration logs.

For example:

/opt/SYMCsnas/log/install_network.log.201407030655

Storage NASnetworkinstallation andconfigurationlogs

46Troubleshooting Storage NAS installation and configuration issuesViewing the installation logs

Page 47: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Installation fails and does not completeSome common reasons for installation failures include:

■ Limited memory. You must have at least 8 GB of memory to install Storage NASsoftware on a node.

■ Single core (single CPU)You must have at least two nodes in a cluster (or a dual-CPU system) to installStorage NAS.

■ Missing required operating system packagesYou can use yum to install the missing required operating system packages, ormanually install the missing required packages.See the Symantec Storage: NAS Installation Guide for more information.

■ Gateway accessThe Storage NAS node must be able to reach the default gateway using thepublic network. Verify with your network administrator that the gateway isreachable.

Excluding PCI IDs from the clusterDuring the initial Storage NAS software installation on the first node, you can excludecertain PCI IDs in your cluster to reserve them for future use. The pci exclusion

command can be used to add PCI interface IDs in the exclusion list for subsequentslave node install. The interface cards for which PCI ID's have been added in thePCI exclusion list are not used as private or public interfaces for the subsequentcluster node install. During a new node install, the remaining PCI bus interfacesare searched and added as public or private interfaces .

The Network> pciexclusion command can be used with different options:

■ The Network> pciexclusion show command displays the PCI IDs that havebeen selected for exclusion. It also provides information about whether it hasbeen excluded or not by displaying y(yes) or n(no) symbols corresponding tothe node name. If the node is in the INSTALLED state, it displays the UUID ofthe node.

■ The Network> pciexclusion add pcilist command allows an administratorto add specific PCI ID(s) for exclusion. These values must be provided beforethe installation. The command excludes the PCI from the second nodeinstallation.pcilist is a comma-separated list of PCI IDs.

47Troubleshooting Storage NAS installation and configuration issuesInstallation fails and does not complete

Page 48: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

■ The Network> pciexclusion delete pci command allows an administratorto delete a given PCI ID from exclusion. This command must be used beforethe installation for it to take effect. The command is effective for the next nodeinstallThe PCI ID bits format is hexadecimal (XXXX:XX:XX.X).

To use the Network> pciexclusion command, enter the following:

Network> pciexclusion show

PCI ID EXCLUDED NODENAME/UUID

------ -------- -------------

Network> pciexclusion add FFFF:FF:00.0

SNAS pciexclusion SUCCESS V-288-1363 Given PCI ID FFFF:FF:00.0 has been

added for exclusion

Network> pciexclusion add FFFF:FF:00.1

SNAS pciexclusion SUCCESS V-288-1363 Given PCI ID FFFF:FF:00.0 has been

added for exclusion

Network> pciexclusion show

PCI ID EXCLUDED NODENAME/UUID

------ -------- -------------

0000:0e:00.0 y snas_1

0000:0e:00.0 y a79a7f43-9fe2-4eeb-aa1f-27a70e7a0820

0000:04:00:1 n

Network> pciexclusion delete ffff:ff:00.1

SNAS pciexclusion SUCCESS V-288-1363 Given PCI ID FFFF:FF:00.0 has been

added for exclusionSNAS pciexclusion SUCCESS V-288-1364 Given PCI ID

ffff:ff:00.1 has been deleted from exclusion list

Network> pciexclusion show

PCI ID EXCLUDED NODENAME/UUID

------ -------- -------------

ffff:ff:00.0 n

Network>

48Troubleshooting Storage NAS installation and configuration issuesExcluding PCI IDs from the cluster

Page 49: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Troubleshooting StorageNAS CIFS issues

This chapter includes the following topics:

■ User access is denied on a CTDB directory share

User access is denied on a CTDB directory shareIn some cases, users or groups may be denied access to a CTDB directory shareeven though the correct ACL is set for the share. This issue can occur when theparent directory has an ACL that prevents access for these users or groups.

This behavior is expected. To enable access:

■ Make sure the root-level directory (the parent directory) is added as a CIFSshare.

■ To allow access, apply the same ACL settings to the parent directory as youapplied to the original CTDB directory share.

6Chapter

Page 50: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Storage NAS commandsummary

This appendix includes the following topics:

■ About the command modes in the Storage NAS CLI

■ Network mode commands

■ Support mode commands

■ Supportuser mode commands

About the command modes in the Storage NAS CLIThe Storage NAS CLI provides several command modes. To use any of the CLIcommands, first log in with the user role that you have been assigned. Then enterthe correct mode. The system prompt displays the mode.

The command reference tables describe all the available modes, the commandsassociated with each mode, and the required user privileges for each operation.

Network mode commandsThe Network> mode includes commands to specify and check the status of networkparameters for the Storage NAS cluster.

Note: Before you use Storage NAS network mode commands, you must have ageneral understanding of IP addresses and networking. If you are not familiar withthe terms or output, contact your Network Administrator for help.

AAppendix

Page 51: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-1 shows the Network> mode commands.

Table A-1 Network mode commands

User privilegesDefinitionCommand

Master

System Admin

Creates a logical association between two or moreEthernet interfaces.

See “Network mode - bond commands”on page 52.

bond

Master

System Admin

Manages the NIC devices within a Storage NAScluster.

See “Network mode - device commands”on page 52.

device

Master

System Admin

Identifies the DNS parameters that the StorageNAS cluster can use.

See “Network mode - DNS commands”on page 53.

DNS

Master

System Admin

Manages the Storage NAS cluster IP addresses.

See “Network mode - ip commands” on page 54.

IP

Master

System Admin

Identifies the LDAP parameters that the StorageNAS cluster can use.

See “Network mode - LDAP commands”on page 57.

LDAP

Master

System Admin

Identifies the NIS parameters that the Storage NAScluster can use.

See “Network mode - NIS commands” on page 59.

NIS

Master

System Admin

Provides a single configuration location to identifythe services (such as NIS or LDAP) for networkinformation such as hosts, groups, or passwords.

See “Network mode - nsswitch commands”on page 59.

nsswitch

Master

System Admin

Adds PCI interface IDs in the exclusion list forsubsequent slave node install.

See “Network mode - pciexclusion commands”on page 60.

pciexclusion

51Storage NAS command summaryNetwork mode commands

Page 52: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-1 Network mode commands (continued)

User privilegesDefinitionCommand

Master

System Admin

Tests whether a particular host or gateway isreachable across an IP network.

See “Network mode - ping command” on page 59.

ping

Master

System Admin

Swaps two network interfaces.

See “Network mode - swap command” on page 60.

swap

Master

System Admin

Views, adds, or deletes VLAN interfaces.

See “Network mode - VLAN commands”on page 61.

VLAN

Network mode - bond commandsTable A-2 Bond commands

DefinitionCommand

Creates a bond between sets of two or more named Ethernet interfaceson all Storage NAS cluster nodes.

create

Removes a bond between two or more named Ethernet interfaces onall Storage NAS cluster nodes.

remove

Displays a bond and its type used to distribute traffic among the bondedinterfaces.

show

Network mode - device commandsThe Network> device commands allow you to list, add, remove, rename, or identifyNIC devices within a Storage NAS cluster.

Table A-3 Network device commands

DefinitionCommand

Adds a new or existing unused/excluded NIC device to a Storage NAScluster node. The specified device must be present on all the nodes ofthe Storage NAS cluster.

When a new NIC device is added, the new NIC device gets a newpubeth# in the Storage NAS cluster.

device add

52Storage NAS command summaryNetwork mode commands

Page 53: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-3 Network device commands (continued)

DefinitionCommand

Starts visual indicators on NIC hardware if supported and available.This helps to locate the actual, physical NIC on the node. By default,the timeout value is 120 seconds.

deviceidentify

Prints bus IDs and MAC addresses of all devices on a given nodeirrespective of the device's PCI exclusion state.

device list

Removes NIC devices from cluster control, and if required, the NICdevice can be unplugged from the Storage NAS cluster node. When adevice is removed, all physical and virtual IP addresses are deletedfrom the specified NIC device. All physical IP addresses are kept in afree list and will be available for reuse; virtual IP addresses will not beavailable for reuse. You will need to re-add the NIC device in cases ofreuse.

device remove

Renames a NIC device. Only devices with the prefix eth can berenamed. NIC devices with new names should not be present on thespecified node in the Storage NAS cluster. In cases of mismatches innames of newly-added NICs in the cluster, you can rename thosedevices, and then add the devices to the Storage NAS cluster.

device rename

Network mode - DNS commandsThe DNS commands let you view or change a Storage NAS cluster's DNS settings.You can configure a Storage NAS cluster's DNS lookup service to use up to threeDNS servers. You must enable the Storage NAS cluster's DNS name service beforeyou specify the DNS servers to use for lookups.

Table A-4 DNS commands

DefinitionCommand

Removes the DNS domain name.dns cleardomainname

Removes the IP addresses of DNS name servers from the cluster'sDNS lookup service database.

dns clearnameservers

Disables DNS lookups.dns disable

53Storage NAS command summaryNetwork mode commands

Page 54: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-4 DNS commands (continued)

DefinitionCommand

Enables Storage NAS to perform DNS lookups.

When DNS is enabled, the Storage NAS cluster's DNS service usesthe data center's DNS server(s) to determine the IP addresses ofnetwork entities such as SNMP, NTP, LDAP, and NIS servers withwhich the cluster must communicate.

dns enable

Enter the domain name that the Storage NAS cluster will be in. For therequired information, contact your Network Administrator.

This command clears any previously set domain name.

Before you use this procedure, you must enable the DNS server.

dns setdomainname

Specifies the IP addresses of DNS name servers to be used by theStorage NAS DNS lookup service. The order of the IP addresses is theorder in which the name servers are to be used.

Enter the IP addresses of the name servers. The order of the IPaddresses is the order in which the name servers are to be used.

dns setnameservers

Allows you to have multiple DNS search domains. Specify the searchdomains in the order in which the search domains should be used.

dns setsearchdomains

Displays the current settings of the Storage NAS cluster's DNS lookupservice.

dns show

Network mode - ip commandsTable A-5 lists the commands you can use to configure your IP addresses.

54Storage NAS command summaryNetwork mode commands

Page 55: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-5 Network> IP commands

DefinitionCommand

Adds a virtual or physical IP address to the Storage NAS cluster.

You can specify either an IPv4 address or an IPv6 address.

Storage NAS assigns the newly added IP address to an Ethernetinterface or one of its nodes. Virtual IP addresses are used forcommunication among cluster nodes and with clients on the enterprisenetwork.

By default, this command does not use VLAN Ethernet interfaces unlessthey are specified in the device option.

Storage NAS determines the node to which the IP address will beassigned.

After you add a virtual IP address, it takes a few seconds for it to comeonline. If you enter an IP address that is already used in the cluster, anerror message is displayed. You cannot enter an invalid IP address(one that is not four bytes or has a byte value greater than 255).

Note: An IP address that does not go online may indicate a problemwith the Storage NAS cluster. For help, use the Support> servicescommand, or contact Symantec Technical Support.

ip addr add

Deletes an IP protocol address from the cluster. You can delete physicalIP addresses only if they are not being used by any interface of thecluster. You can also delete virtual IP addresses, except for the consoleIP address. When you add or delete an IP address from the cluster,the cluster automatically evens out the number of virtual IP addresseson each node.

You can specify either an IPv4 address or an IPv6 address.

ip addr del

Modifies an IP protocol address used by the cluster. You can changeboth the physical IP addresses and virtual IP addresses. If you changethe virtual IP address it terminates the NFS connection on the old IPaddress.

You can specify either an IPv4 address or an IPv6 address.

ip addr modify

55Storage NAS command summaryNetwork mode commands

Page 56: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-5 Network> IP commands (continued)

DefinitionCommand

Brings an IP address online on any running node in the cluster. The IPaddress does not need to be in the offline mode for this command towork. You can use this command to switch the IP address from anonline node to another specified node. You can change an IP addressto the online mode if it is in the OFFLINE/FAULTED state. Thiscommand also displays any faults for the IP address on the specifiednode.

You can specify either an IPv4 address or an IPv6 address.

Note: An IP address that does not go online may indicate a problemwith the Storage NAS cluster. For help, use the Support> servicescommand, or contact Symantec Technical Support.

ip addr online

Displays the IP addresses, the devices (Ethernet interfaces) they areassigned to, and their attributes.

Note: Any Ethernet interfaces excluded during the initial Storage NASinstallation will not be displayed.

ip addr show

Changes the network Ethernet interface's attributes or states.ip link set

Displays each Ethernet interface's (device) status, if it connected toeach node in the cluster, the speed, MTU, and MAC address.

Note: Any Ethernet interfaces excluded during the initial Storage NASinstallation are not displayed.

ip link show

Adds a new route for the cluster. The routing table contains informationabout paths to other networked nodes. You can make routing tablechanges on each node of the cluster.

Use all for the nodename to add the route to all of the nodes in thecluster.

Use a netmask value of 255.255.255.255 for the netmask to add a hostroute to ipaddr.

Use a value of 0.0.0.0 for the gateway to add a route that does not useany gateway.

The dev device is an optional argument.

Use any of the public Ethernet interfaces for the device, for example,pubeth0, pubeth1, or any.

ip route add

56Storage NAS command summaryNetwork mode commands

Page 57: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-5 Network> IP commands (continued)

DefinitionCommand

Deletes a route used by the cluster. Use all for nodename to deletethe route from all of the nodes in the cluster. The combination of ipaddrand netmask specifies the network or host for which the route is deleted.Use a value of 255.255.255.255 for the netmask to delete a host routeto ipaddr.

ip route del

Displays the routing table of the nodes in the cluster. You can enter aspecific nodename or use all to display the routing tables for all nodesin the cluster.

ip route show

Network mode - LDAP commandsTable A-6 lists the LDAP commands used to configure the LDAP server settings.

Table A-6 LDAP commands

DefinitionCommand

Sets the base DN value for the LDAP server.

Note: Setting the base DN for the LDAP server is required.

set basedn

Sets the hostname or IP address for the LDAP server.set server

Sets the port number for the LDAP server.set port

Configures an Storage NAS cluster to use the Secure Sockets Layer(SSL) protocol to communicate with the LDAP server.

If your LDAP server does not use SSL for authentication, sets this valueto off (the default value). Consult your system administrator forconfirmation.

If your LDAP server supports SSL, you must set SSL to on. This settingis mandatory. The certificates that are required for SSL areauto-negotiated with the LDAP server when the session is established.

set ssl

Sets the bind Distinguished Name (DN) and its password for the LDAPserver. This DN is used to bind with the LDAP server for read access.For LDAP authentication, most attributes need read access.

Note: Use the LDAP server password. Contact your NetworkAdministrator for assistance.

set binddn

57Storage NAS command summaryNetwork mode commands

Page 58: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-6 LDAP commands (continued)

DefinitionCommand

Sets the LDAP root bind DN and its password. This DN is used to bindwith the LDAP server for write access to the LDAP directory. Thissetting is not required for authentication.

To change some attributes of an LDAP entry, the root bind DN isrequired. For example, if a root user wants to change a user's password,the root user must have administrative privileges to write to the LDAPdirectory.

Note: Use the LDAP server password. Contact your NetworkAdministrator for assistance.

set rootbinddn

Sets the LDAP users, groups, and netgroups base Distinguished Name(DN). PAM/NSS uses this DN to search LDAP groups.

Note: You must set the LDAP users, groups, and netgroups base DN.

setusers-basedn

setgroups-basedn

setnetgroups-basedn

Sets the LDAP password hash algorithm used when you set or changethe LDAP user's password. The password is encrypted with theconfigured hash algorithm before it is sent to the LDAP server andstored in the LDAP directory.

Note: Setting the LDAP password hash algorithm is optional.

setpassword-hash

Displays the configured LDAP settings.get

Clears a configured setting.clear

Network mode - LDAP client commandsYou can display the Lightweight Directory Access Protocol (LDAP) clientconfigurations. LDAP clients use the LDAPv3 protocol to communicate with theserver.

Table A-7 LDAP client commands

DefinitionCommand

Disables the LDAP client configuration. This command stops StorageNAS from querying the LDAP service.

ldap disable

58Storage NAS command summaryNetwork mode commands

Page 59: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-7 LDAP client commands (continued)

DefinitionCommand

Enables the LDAP client configuration.ldap enable

Displays the Storage NAS cluster's LDAP client configuration.ldap show

Network mode - NIS commandsTable A-8 NIS commands

DefinitionCommand

Disables the NIS clients in the Storage NAS cluster.nis disable

Enables the NIS clients in the Storage NAS cluster. You must set theNIS domain name and NIS server name before you can enable NIS.

nis enable

Sets the NIS domain name in the Storage NAS cluster.nis setdomainname

Sets the NIS server name in the Storage NAS cluster.nis setservername

Displays the NIS server name, domain name, the NIS users, groups,and netgroups that are available in the NIS database.

nis show

Network mode - nsswitch commandsThe NSS configuration specifies which network services the Storage NAS clustershould use to authenticate hosts, users, groups, and netgroups. The configurationalso specifies the order in which multiple services should be queried.

Table A-9 Network> nsswitch commands

DefinitionCommand

Configures the order of the NSS services.nsswitch conf

Displays the NSS configuration.nsswitch show

Network mode - ping commandThe Network> ping command is used to test whether a particular host or gatewayis reachable across an IP network.

59Storage NAS command summaryNetwork mode commands

Page 60: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

See Table A-10 on page 60.

Table A-10 Network> ping command

DefinitionCommand

Tesst whether a particular host or gateway is reachable across an IPnetwork.

ping

Network mode - pciexclusion commandsThe pciexclusion commands can be used to add PCI interface IDs in the exclusionlist for subsequent slave node install.

Table A-11 Network> pciexclusion commands

DefinitionCommand

Lets you add specific PCI IDs for exclusion. For the PCI IDs to beexcluded from the second node installation, enter their values with thiscommand before installing Storage NAS software on second orsubsequent nodes.

pciexclusionadd

Deletes a specified PCI ID from being excluded. You must perform thiscommand before installing Storage NAS software on second orsubsequent nodes.

pciexclusiondelete

Displays the list of PCI IDs that have been excluded during the initialStorage NAS installation. A y (yes) or n (no) designates the status ofthe PCI IDs. The yes option means that they have been excluded. Theno option means that they have not yet been excluded.

pciexclusionshow

Network mode - swap commandThe swap command enables you to swap two network interfaces.

Table A-12 Network> swap command

DefinitionCommand

Swap two network interfaces.swap

60Storage NAS command summaryNetwork mode commands

Page 61: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Network mode - VLAN commandsTable A-13 Network> vlan commands

DefinitionCommand

Adds a VLAN interface.vlan add

Deletes a VLAN interface.vlan del

Displays the VLAN interfaces.vlan show

Support mode commandsThe Support>mode includes the commands to monitor the Storage NAS operations.

Each command listed is a keyword that represents a group of related commands.

See “Configuring the support user account” on page 13.

Table A-14 shows the Support> mode commands.

Table A-14 Support mode commands

User PrivilegesDefinitionCommand

Master

System Admin

Retrieves and sends debuginformation for a Storage NASnode.

See “Support mode - debuginfocommands” on page 62.

debuginfo

Master

System Admin

Displays the status of the GUIserver, starts and stops the GUIserver, updates the GUI database,and enables or disables GUIaccess.

See “Support mode - guicommands” on page 63.

gui

Master

System Admin

Generates CPU statistics.

Generates a device utilizationreport.

See “Support mode - iostatcommands” on page 63.

iostat

61Storage NAS command summarySupport mode commands

Page 62: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-14 Support mode commands (continued)

User PrivilegesDefinitionCommand

Master

System Admin

Brings services that are OFFLINEor FAULTED back to the ONLINEstate.

See “Support mode - servicescommands” on page 64.

services

Master

System Admin

Exports the network traffic detailsto the specified location.

Displays captured packet data froma live network.

See “Support mode - tetherealcommands” on page 64.

tethereal

Master

System Admin

Displays the dynamic real-timeview of currently running tasks.

See “Support mode - topcommand” on page 65.

top

Master

System Admin

Displays network routes thatpackets can take from one systemto another.

See “Support mode - traceroutecommand” on page 65.

traceroute

Support mode - debuginfo commandsUse the Support> debuginfo commands to retrieve and send debug informationfor a Storage NAS node.

See “Retrieving and sending debugging information” on page 23.

See “Support mode commands” on page 61.

Table A-15 shows the Support> debuginfo commands.

Table A-15 Support> debuginfo commands

DescriptionCommand

Sets the CIFS log level for the Storage NAS cluster.debuginfosetlog

62Storage NAS command summarySupport mode commands

Page 63: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-15 Support> debuginfo commands (continued)

DescriptionCommand

Retrieves Storage NAS debugging information from a Storage NAS nodeand sends the information to a server using an external FTP or SCPserver.

debuginfoupload

Support mode - gui commandsUse the Support> gui commands to manage and monitor the server that supportsthe Storage NAS Management Console (GUI) and the GUI database.

See “Monitoring and managing the Storage NAS Management Console (GUI)”on page 28.

See “Support mode commands” on page 61.

Support mode commands shows the Support> gui commands.

Table A-16 Support> gui commands

DescriptionCommand

Updates the latest changes in the GUI database. Unlike the Support>gui rescan command, this command updates changes in the database,but it does not recreate the database.

gui dbrefresh

Rescans the database for the GUI. This command generates a freshdatabase and updates all the changes in the cluster.

gui db rescan

Starts the GUI servergui serverstart

Shows the status of the GUI servergui serverstatus

Stops the GUI servergui serverstop

Support mode - iostat commandsUse the Support> iostat commands to monitor CPU and I/O statistics.

See “Using the services command” on page 36.

See “Support mode commands” on page 61.

Table A-18 shows the Support> iostat commands.

63Storage NAS command summarySupport mode commands

Page 64: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Table A-17 Support> iostat commands

DefinitionCommand

Generates statistical information. When the command is used for thefirst time, it contains CPU utilization information since the system wasbooted. Each subsequent report shows the details since the last report.

iostat cpu

Generates the device utilization report. This information can be usedto balance the load among the physical disks by modifying the systemconfiguration. When this command is executed for the first time, itcontains information since the system was booted. Each subsequentreport shows the details since the last report. There are two options forthis command.

iostat device

Support mode - services commandsUse the Support> services commands to bring services that are OFFLINE orFAULTED back to the ONLINE state.

See “Using the services command” on page 36.

See “Support mode commands” on page 61.

Table A-18 shows the Support> services commands.

Table A-18 Support> services commands

DefinitionCommand

Attempts to fix any service that is offline or faulted, running on all of thenodes in the cluster.

autofix

Fixes a specific service. Enter the servicename and this option attemptsto bring the service online. If the servicename is already online, noaction is taken. If the servername is a parallel service, an attempt ismade to online the service on all nodes. If the servicename is a failoverservice, an attempt is made to online the service on any of the runningnodes of the cluster.

online

Lists the state of all of the services. The state of the IPs and file systemsare only shown if they are not online.

show

Lists the state of all of the services including the state of the IPs andthe file systems.

showall

Support mode - tethereal commandsUse the Support> tethereal commands to display and export network traffic data.

64Storage NAS command summarySupport mode commands

Page 65: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

See “Using the services command” on page 36.

See “Support mode commands” on page 61.

Table A-19 shows the Support> tethereal commands.

Table A-19 Support> tethereal commands

DefinitionCommand

Lets you export network traffic details for further analysis.tetherealexport

Displays packed data captured from a live network.tethereal show

Support mode - top commandUse the Support> top command to display and export network traffic data.

See “Using the services command” on page 36.

See “Support mode commands” on page 61.

Table A-20 shows the Support> top command.

Table A-20 Support> top command

DefinitionCommand

Displays the dynamic real-time view of currently running tasks. It showsthe resources that users and processes consume at a given time for aspecified node

top

Support mode - traceroute commandUse the Support> traceroute command to see the routes that packets can takefrom one system to another.

See “Using the services command” on page 36.

See “Support mode commands” on page 61.

Table A-21 shows the Support> traceroute commands.

Table A-21 Support> traceroute command

DefinitionCommand

Displays all of the intermediate nodes on a route between two nodes.traceroute

65Storage NAS command summarySupport mode commands

Page 66: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Supportuser mode commandsThe Supportuser> mode includes the commands to enable, disable, or view thestatus of the support user.

Warning:Use caution when executing support commands. The support commandsare intended for advanced users who are familiar with Storage NAS features andfunctions. If you have any questions about using these commands, contact yourSymantec Technical Support Representative for further guidance.

See “Configuring the support user account” on page 13.

Table A-22 shows the Supportuser> mode commands.

Table A-22 Supportuser mode commands

User PrivilegesDefinitionCommand

MasterDisables the supportuser withoutpermanently removing itfrom the system. Bydefault, the support useris in disable modewhen Storage NAS isinstalled.

supportuser disable

MasterEnables the supportuser for the tracing anddebugging of any node.The enable commandlets the support userlogin remotely.

supportuser enable

MasterChanges the supportuser password. Thepassword can bechanged at any time.

supportuser password

MasterChecks the status of thesupport user (whether itis enabled or disabled).

Note: You must havemaster privilege to usethis command.

supportuser status

66Storage NAS command summarySupportuser mode commands

Page 67: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Aabout

common recovery procedures 34event logs 21, 23job resynchronization 42monitoring commands 25network services 50services command 36

alertsalerts panel using 19filtering 19monitoring 17viewing on the dashboard 16

Cchanging

support user password 13checking

support user status 13CIFS

setting the log level 23common recovery procedures

about 34configuring

job resynchronization 44CPU utilization report

generating 27

Ddashboard

viewing alerts 16debugging information

retrieving and sending 23device utilization report

generating 27disabling

support user account 13displaying

node-specific network traffic details 32

Eenabling

support user account 13event logs

about 21, 23exporting

network traffic details 32

Ffiltering

alerts 19

Ggeneral techniques

troubleshooting 11general tips

troubleshooting process 10generating

CPU utilization report 27device utilization report 27

GUI databaserefreshing 28, 40refscanning 28

GUI serverstarting and stopping 28

GUI server statusshowing 28

Iinstallation

common failures 47installation logs

viewing 45

Jjob resynchronization

about 42configuring 44

Index

Page 68: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

Llogin

support account 14Technical Support 14

Mmanaging

Storage NAS Management Console (GUI) 28monitoring

alerts 17installation logs 45processor activity 25

monitoring commandsabout 25

Nnetwork

testing connectivity 38network services

about 50network traffic details

exporting 32node-specific network traffic details

displaying 32

Ppatch release

uninstalling 44processor activity

monitoring 25

Rrecovering

from a non-graceful shutdown 38refreshing

GUI database 28, 40replacing

Ethernet interface card 41replication

speeding up 42rescanning

GUI database 28restarting

servers 35retrieving

debugging information 23

Ssending

debugging information 23servers

restarting 35services command

about 36using 36

settingCIFS log level 23

showingGUI server status 28

shutdownrecovering from a non-graceful 38

software upgradeuninstalling 44

startingGUI server 28

stoppingGUI server 28

Storage NAS log filesviewing 20

Storage NAS Management Console (GUI)managing 28

support accountlogin 14

support user accountabout 12disabling 13enabling 13

support user passwordchanging 13

support user statuschecking 13

Ttechnical support

login 14testing

network connectivity 38traceroute

troubleshooting with 39traceroute command

using 40troubleshooting

about 10general procedures 15

troubleshooting processgeneral techniques 11

68Index

Page 69: Symantec Storage:NAS6.0 Troubleshooting Guide · Troubleshooting Guide Linux ... 6.0 Documentversion:6.0Rev0 LegalNotice ... Chapter 5 Troubleshooting Storage NAS installation and

troubleshooting process (continued)general tips 10

Uuninstalling

patch release or software upgrade 44using

alerts panel 19services command 36traceroute command 40

Vviewing

installation logs 45Storage NAS log files 20

69Index