53
Exchange Server 2013 Functional Test Plan Prepared for Commonwealth of Pennsylvania October 19, 201 !ersion 1"3 Pre#are$ by Scott %lexan$er Princi#al Cons&ltant [email protected] Contributors

Exchange Server 2013_Functional Test Plan Ver1 3

Embed Size (px)

DESCRIPTION

Exchange Server 2013_Functional Test Plan Ver1 3

Citation preview

Exchange Server 2013

Prepared for Customer

Prepared forCustomerAugust 4, 2015 Version 1.3

Prepared byScott AlexanderPrincipal [email protected]

Revision and Signoff SheetChange RecordDateAuthorVersionChange reference09/17/2014Scott Alexander.1Initial draft

ReviewersNameVersion approvedPositionDate

Page viExchange Server 2013, Functional Test Plan, Version 1.0 DraftPrepared by Alexander, Scott"Exchange Server 2013_Functional Test Plan Ver1.0.docx" last modified on 7 Nov. 14, Rev 6

Table of Contents1Executive Summary71.1Background Information71.2Purpose71.3Document Scope71.3.1In Scope71.3.2Out of Scope71.4Audience82Test Environment92.1Method103System Testing113.1Built-In Global Testing113.1.1Service Health113.2Built-in Mailbox Server Testing113.2.1Test Mail Flow113.2.2SMTP Connectivity123.2.3Replication Health123.2.4Mailbox Database Copy Status133.2.5Database Statistics133.2.6Replication Statistics143.2.7Mailbox Connectivity Test143.2.8Mailbox Assistant Health153.2.9Server Health153.3Built-In Client Access Server Testing163.3.1Outlook Connectivity Test163.3.2Web Services163.3.3ActiveSync173.3.4ECP Connectivity173.3.5IMAP183.3.6POP183.3.7Mailbox Replication Service193.4Exchange High Availability193.4.1Database Failure193.4.2Server Failure203.4.3Secondary Datacenter Failure203.4.4Primary Datacenter Failure213.5Mailbox Access223.5.1Autodiscover Internal223.5.2Autodiscover External223.5.3OWA Access Internal233.5.4OWA Access External233.5.5ActiveSync233.6Outlook Functionality Test243.6.1OAB Download243.6.2Out of Office243.6.3Free/Busy Data Availability253.6.4Meeting Booking253.6.5Meeting Update263.6.6Meeting Cancellation263.6.7Resource Booking273.6.8Address List273.6.9Global Message Size Limit283.6.10Mailbox Quota Warning283.6.11Prohibit Send Quota283.6.12Recover Deleted Items293.6.13Mail Tips293.6.14Mailbox Delegation293.6.15Mailbox Signature303.7OWA Functionality Testing303.7.1OWA Maximum Message Size303.7.2OWA Web Ready Document Viewing313.7.3OWA Out Of Office313.7.4OWA Free/Bus Availability323.7.5OWA Meeting Booking323.7.6Meeting Update from OWA323.7.7OWA Meeting Cancellation333.7.8OWA Address List333.8Mail Routing343.8.1Mail routing between Exchange 2013 Mailboxes within the Organization343.8.2Mail routing between Exchange 2007 and Exchange 2013 Mailboxes within the Organization343.8.3Mail Routing outgoing between Exchange 2013 mailboxes and Internet Mailboxes353.8.4Mail Routing Incoming between Exchange 2013 mailboxes and Internet Mailboxes using OWA353.9Public Folders363.9.1Exchange 2013 Mailboxes Accessing legacy 2007 PFs363.9.2Exchange 2013 Mailboxes can add new PFs to legacy 2007 PFs363.9.3Exchange 2013 Mailboxes can Modify new PFs to legacy 2007 PFs373.9.4Exchange 2013 Mailboxes can delete new and existing PFs to legacy 2007 PFs373.10POP3 and IMAP4 Clients373.10.1POP3 Service Activity testing373.10.2POP3 client testing383.10.3IMAP Service Activity testing383.10.4IMAP client testing39

Executive SummaryBackground InformationMicrosoft Consulting Services (MCS) has been retained by Customer to provide expertise and knowledge transfer for a migration from the existing messaging system(s) to one based on the Microsoft Exchange Server 2013 platform. This solution will be based on the Microsoft Exchange Server 2013 Product Line Architecture.PurposeThe purpose of this document is to provide a test plan that describes the strategy, approach and test cases for Exchange Server 2013 functional testing activities. This document will also provide the details for tools required to perform testing and expected results from each test case.Document ScopeThe scope of this document is to provide the test cases that will be used to verify the functionality of Exchange Server 2013 and validate the health of system components.In Scope Exchange Server 2013 built-in system health testing Exchange Server 2013 functional testing Mailbox Connectivity testing use different devices inside and outside of the corporate network Mail flow testing within the organization Internet Mail flow testing using EOP (Microsoft Exchange Online Protection)Out of Scope Performance testing System performance testing (Loadgen) Backup and Restore testingNote: To perform the client connectivity testing from internet and to test internet mail flow, CUSTOMER needs to setup the internet connectivity in test lab and register the required DNS records on internet for test lab environment.Test lab environment will be built as close to production environment as possible.AudienceThis document has been prepared for a technical audience and is intended for personnel associated with the Exchange Server 2013 deployment, including: Exchange Architecture Teams Windows Active Directory Team Networking Team Enterprise Operations Team Project Management Team Microsoft Account TeamTest EnvironmentCustomer staging email architecture will be built on the latest release of Windows Server platform that is Windows Server 2012 R2 and Microsoft Exchange Server 2013 CU6. The Exchange 2013 architecture will be deployed on premises, with network simulated sites Site1, Site2, and Site3. Exchange server resources in the Site1 site will host active mailboxes during normal runtime conditions and Site2 site will act as passive datacenter. Site3 site will host the File Share Witness (FSW). In the event of a disaster in the primary site, the secondary site will have the ability to run independently without affecting end user response times. The Exchange 2013 resources will be integrated into the existing Exchange 2007 organization that exists in the staging environment.With Exchange 2013, high availability and site resiliency of mailbox data will be achieved through the concept of DAG. A DAG is a Database Availability Group consisting of multiple servers in a cluster (maximum 16) that will hold the copies of the individual databases. A single database will have 4 copies spread across members of the DAG. There will be one active and three passive copies of a database, out of which two passive copy will be located in secondary site. Users connect to active database copy to send and receive their mail; the passive copies of an individual database will get updates with continuous replication from the active copy. At any given time, for a failure, maintenance, or other reason, Exchange can make any of the passive copies active on another member of the DAG. There will be two Exchange 2013 DAGs within the staging environment, one for user mailboxes and one for public folders. Servers in the secondary site will host only the passive copies of the databases and will be activated only in-case of the primary site failureNote: This document assumes that all the machines will be built as per Customer standard build process that includes all updates, patches, anti-virus etc.MethodThe test cases defined in this document will be performed with variety of tools as below. Exchange Administration Center (EAC) Exchange Management Shell Standard Exchange Management Shell Commands Exchange Management Shell Scripts provided with Exchange 2013 Messaging Clients Outlook 2010 or Later Sp3 or higher Internet Explorer 8 or higher Built-In Windows UtilitiesSystem TestingBuilt-In Global TestingExchange Server 2013 has built-in PowerShell commands that can be used to test certain global parameters of Exchange Server 2013, therefore applies to more than a single Exchange Server.Service HealthItemDescription

Test ReferenceST.01.

Test LocationCUSTOMER Staging Environment

Test DescriptionThe Test-ServiceHealth command can be used to verify that all Microsoft Windows services that the Exchange 2013 server requires are running and set to automatic start-up status

Test to be PerformedRun the following command from the Exchange Management Shell on any Exchange 2013 server:Get-ExchangeServer Identity | Test-ServiceHealth | ft Role,RequiredServicesRunning,ServicesNotRunning AutoSizeFor details refer to test-servicehealth

Expected ResultEach role of each server should be examined. For each role, the RequiredServicesRunning column of the output should read True and the ServicesNotRunning column should not list any services

Actual Result

Notes

Built-in Mailbox Server Testing

Test Mail FlowItemDescription

Test ReferenceST.02.

Test LocationCUSTOMER Staging Environment

Test DescriptionThe Test-Mailflow cmdlet tests mail submission, transport, and delivery. The cmdlet verifies that each Mailbox server can successfully send itself a message.

Test to be PerformedRun the following Exchange Management Shell command from each Exchange 2013 server. This cannot be run remotely:Test-Mailflow | ftFor details refer to test-mailflow

Expected ResultA list of mail flow checks per Mailbox server and their results will be presented. For each check, the TestMailflowResult column should read Success

Actual Result

Notes

SMTP ConnectivityItemDescription

Test ReferenceST.03.

Test LocationCUSTOMER Staging Environment

Test DescriptionThe Test-SmtpConnectivity cmdlet against a Mailbox server attempts to establish an SMTP connection to all bindings of all Receive connectors hosted on that server

Test to be PerformedRun the following Exchange Management Shell command against any Exchange 2013 server:Get-TransportService | Test-SmtpConnectivityFor details refer to Test-SmtpConnectivity

Expected ResultThe cmdlet should show the result as successfully connected to SMTP service.

Actual Result

Notes

Replication HealthItemDescription

Test ReferenceST.01.

Test LocationCUSTOMER Staging Environment

Test DescriptionThe Test-ReplicationHealth cmdlet is designed for the proactive monitoring of continuous replication and the continuous replication pipeline, the availability of Active Manager, and the health and status of the underlying cluster service, quorum, and network components. The Test-ReplicationHealth cmdlet can be run locally or remotely against any Mailbox server in a DAG.

Test to be PerformedRun the following Exchange Management Shell command against all Exchange 2013 servers running the Mailbox server role:Get-MailboxServer | where {$_.admindisplayversion -like "Version 15*"} | Test-ReplicationHealth | ft -AutoSizeFor details refer to Test-ReplicationHealth

Expected ResultA list of replication checks and the results will be presented. For each check, the Result column should read Passed

Actual Result

Notes

Mailbox Database Copy StatusItemDescription

Test ReferenceST.02.

Test LocationCUSTOMER Staging Environment

Test DescriptionThe get-MailboxDatabaseCopyStatus is used to view health and status information of all the copies of the database

Test to be PerformedRun the following Exchange Management Shell command against all Exchange 2013 servers running the Mailbox server role:Get-MailboxDatabaseCopyStatus *For details refer to Get-MailboxDatabaseCopyStatushttp://technet.microsoft.com/en-us/library/bb691314(v=exchg.150).aspx

Expected ResultThe result should list all the databases with replication health, and the result should show the status healthy for all the databases

Actual Result

Notes

Database StatisticsItemDescription

Test ReferenceST.03.

Test LocationCUSTOMER Staging Environment

Test DescriptionExchange 2013 includes a script called CollectOverMetrics.ps1, which can be found in the Scripts folder. CollectOverMetrics.ps1 reads DAG member event logs to gather information about database operations (such as database mounts, moves, and failovers) over a specific time period.

Test to be PerformedRun the following script to generate the report for all databases in the DAGCollectOverMetrics.ps1 -DatabaseAvailabilityGroup DAG1 -Database:"DB*" -GenerateHTMLReport ShowHTMLReportFor more information refer to CollectOverMetrics.ps1http://technet.microsoft.com/en-us/library/bb691314(v=exchg.150).aspx

Expected ResultThe result should list all the databases with the information about mount, failure, move etc

Actual Result

Notes

Replication StatisticsItemDescription

Test ReferenceST.04.

Test LocationCUSTOMER Staging Environment

Test DescriptionCollectReplicationMetrics.ps1 collects data from performance counters related to database replication. The script gathers counter data from multiple Mailbox servers, writes each server's data to a .csv file, and then reports various statistics across all of this data (for example, the amount of time each copy was failed or suspended, the average copy or replay queue length, or the amount of time that copies were outside of their failover criteria).

Test to be PerformedRun the following script to generate the report for all databases in the DAGCollectReplicationMetrics.ps1 -DagName DAG1 -Duration "01:00:00" -Frequency "00:01:00" ReportPath For more information refer to CollectReplicationMetrics.ps1http://technet.microsoft.com/en-us/library/bb691314(v=exchg.150).aspx

Expected ResultBased on the parameters specified above, this script will run for one hour. The output should show the replication statistics for each database in the DAG, this data can be used to monitor the replication health

Actual Result

Notes

Mailbox Connectivity TestItemDescription

Test ReferenceST.05.

Test LocationCUSTOMER Staging Environment

Test DescriptionThe Test-MapiConnectivity cmdlet verifies server functionality. This cmdlet logs on to the mailbox that you specify (or to the SystemMailbox if you don't specify the Identity parameter) and retrieves a list of items in the Inbox. Logging on to the mailbox tests two critical protocols used when a client connects to a Mailbox server: MAPI and LDAP. During authentication, the Test-MapiConnectivity cmdlet indirectly verifies that the MAPI server, Exchange store, and Directory Service Access (DSAccess) are working

Test to be PerformedRun the following powershell command to perform the testTest-MapiConnectivity -Server For more information refer to test-mapiconnectivityhttp://technet.microsoft.com/en-us/library/dd351258(v=exchg.150).aspxhttp://technet.microsoft.com/en-us/library/bb691314(v=exchg.150).aspx

Expected ResultThe output should display success or failure at logging onto each database currently hosted on that particular server. Note that if no databases are currently active on the server you will receive a warning that the operation could not be performed.

Actual Result

Notes

Mailbox Assistant HealthItemDescription

Test ReferenceST.06.

Test LocationCUSTOMER Staging Environment

Test DescriptionThe Mailbox Assistants service runs on all servers that have the Mailbox server role installed. This service is responsible for scheduling and dispatching several assistants that ensure mailboxes function correctly.Test-AssistantHealth cmdlet verifies that the Microsoft Exchange Mailbox Assistants service (MSExchangeMailboxAssistants) is healthy, to recover from health issues, and to report the status of the diagnosis or recovery action

Test to be PerformedRun the following powershell command to perform the testTest-AssistantHealth -ServerName -IncludeCrashDump -ResolveProblems | Format-ListFor more information refer to test-AssistantHealthhttp://technet.microsoft.com/en-us/library/bb691314(v=exchg.150).aspx

Expected ResultThe output should display the health information of MailboxAssistant

Actual Result

Notes

Server HealthItemDescription

Test ReferenceST.07.

Test LocationCUSTOMER Staging Environment

Test DescriptionGet-Healthreport returns health information related to the server you specify. You can use the health values to determine the state of the server. The cmdlet also returns an alert value that provides the specific state of your server.

Test to be PerformedRun the following powershell command to perform the testGet-HealthReport Identity For more information refer to Get-HealthReporthttp://technet.microsoft.com/en-us/library/bb691314(v=exchg.150).aspx

Expected ResultThe output should display the health values that includes the following: Online Partially Online Offline Sidelined Functional Unavailable

Actual Result

Notes

Built-In Client Access Server Testing

Outlook Connectivity TestItemDescription

Test ReferenceST.08.

Test LocationCUSTOMER Staging Environment

Test DescriptionUse the Microsoft Connectivity Analyzer (https://testconnectivity.microsoft.com/) to execute the Microsoft Office Outlook Connectivity Test - Outlook Connectivity.

Test to be PerformedFollow the steps in the wizard for the Outlook Connectivity test.

Expected ResultOutlook Connectivity test must complete successfully without any error

Actual Result

Notes

Web ServicesItemDescription

Test ReferenceST.09.

Test LocationCUSTOMER Staging Environment

Test DescriptionUse the Microsoft Connectivity Analyzer (https://testconnectivity.microsoft.com/) to execute the Microsoft Exchange Web Services Connectivity Test - Synchronization, Notification, Availability, and Automatic Replies.

Test to be PerformedFollow the steps in the wizard for the Synchronization, Notification, Availability, and Automatic Replies test.

Expected ResultThese tests walk through many basic Exchange Web Services tasks to confirm they're working. The operations tested by default are GetFolder, CreateItem, DeleteItem, and SyncFolderItems. The output must provide result for each operation

Actual Result

Notes

ActiveSyncItemDescription

Test ReferenceST.010.

Test LocationCUSTOMER Staging Environment

Test DescriptionTest-ActiveSyncConnectivity cmdlet performs a full synchronization between a mobile device and a specified mailbox to test the functionality of Exchange ActiveSync.

Test to be PerformedRun the following Exchange Management Shell commands against any Exchange 2013 server:$credential = Get-Credential -UserName Customer-stglab\testuser31

Test-ActiveSyncConnectivity -UseAutodiscoverForClientAccessServer:$true -MailboxCredential $credential |ft AutosizeFor Details refer to test-activesyncconnectivity

Expected ResultIf the test fails, an error message will be displayed on powershell

Actual Result

NotesBetter to use Remote connectivity analyzer to test outlook connectivity, to perform the use Remote Connectivity Analyzer here

ECP ConnectivityItemDescription

Test ReferenceST.011.

Test LocationCUSTOMER Staging Environment

Test DescriptionUse a web browser to connect and logon to EAC to verify Exchange Administration Center functionality for all Exchange 2013 servers in the environment.

Test to be PerformedOpen a web browser and connect to https:///ecp or https://webmail.beta.pa.gov/ecp. Logon using administrative credentials. Validate that you can successfully logon and access the EAC interface.

Expected ResultLogon to EAC directly to each server will result in a cert error as the server names are not included on the SAN cert. After continuing to the website the administrator will be able to logon.

Actual Result

Notes

IMAPItemDescription

Test ReferenceST.012.

Test LocationCUSTOMER Staging Environment

Test Descriptionthe Test-ImapConnectivity cmdlet to verify that the IMAP4 service is running as expected. The Test-ImapConnectivity cmdlet can be used to test the IMAP4 functionality for a specified Client Access server for all mailboxes on servers running Microsoft Exchange Server 2013 in the same Active Directory site

Test to be PerformedRun the following Exchange Management Shell command against any Exchange 2013 server:Test-ImapConnectivity ClientAccessServer ENSTGEXCH001 MailboxCredential:(Get-Credential Customer-stglab\testuser31)For Details refer to test-imapconnectivity

Expected ResultA series of tests will be run and each test should be completed successfully

Actual Result

Notes

POPItemDescription

Test ReferenceST.013.

Test LocationCUSTOMER Staging Environment

Test Descriptionthe Test-PopConnectivity cmdlet to verify that the IMAP4 service is running as expected. The Test-PopConnectivity cmdlet can be used to test the POP3 functionality for a specified Client Access server for all mailboxes on servers running Microsoft Exchange Server 2013 in the same Active Directory site

Test to be PerformedRun the following Exchange Management Shell command against any Exchange 2013 server:Test-PopConnectivity ClientAccessServer ENSTGEXCH001 MailboxCredential:(Get-Credential Customer-stglab\testuser31)For Details refer to test-imapconnectivity

Expected ResultA series of tests will be run and each test should be completed successfully

Actual Result

Notes

Mailbox Replication ServiceItemDescription

Test ReferenceST.014.

Test LocationCUSTOMER Staging Environment

Test DescriptionThe Microsoft Exchange Mailbox Replication service runs on mailbox servers. Test-MRSHealth command ensures that the Mailbox Replication service is running and that it responds to a remote procedure call (RPC) ping check.

Test to be PerformedRun the following Exchange Management Shell command on any Exchange 2013 server:Test-MRSHealth For Details refer to Test-MRSHealth

Expected ResultThe commends runs against mailbox servers to validate the health of MRS, if there are any errors or warnings that will be displayed on PowerShell

Actual Result

Notes

Exchange High AvailabilityDatabase FailureItemDescription

Test ReferenceST.015.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate the passive copy of a database in the same datacenter comes online automatically upon a failure of a database

Test to be Performed Login to Exchange 2013 mailbox server with administrative permissions Offline a disk that contains the active copy of a mailbox database from disk manager to force database failure Monitor the databases on second Exchange 2013 mailbox server that has a passive copyGet-MailboxDatabaseCopyStatus -Identity

Expected ResultDatabases on second mailbox server that has a passive copy of the database should come online automatically without any administrative interference

Actual Result

NotesTo resume the database copy from a failed and suspended state you need to run the following: Resume-MailboxDatabaseCopy \The active database copy then needs to be moved back to the AP1 server using, Move-ActiveMailboxDatabase ActivateOnServer

Server FailureItemDescription

Test ReferenceST.016.

Test LocationCUSTOMER Staging Environment

Test Description Validate the databases running on an Exchange 2013 server are automatically mounted on Exchange Servers hosting passive copy in the same datacenter Validate the mail flow Validate client access using Outlook, OWA and any other client that is used

Test to be Performed Power off one of the Exchange 2013 servers to simulate a server failure Monitor the databases on another servers that are hosting the passive copies of the databases on failed server Send emails to mailboxes Exchange 2013 and internet mailboxes like outlook.com to validate mails are delivered Try accessing mailboxes using OWA and Outlook Clients that are connected already should not see any disconnection in the services Verify the clients are able to access the mails and public folders

Expected ResultPassive copies of databases should come online automatically without any administrative interferenceUsers should continue send and receive emailsUsers should continue accessing mailboxes with different clients

Actual Result

Secondary Datacenter FailureItemDescription

Test ReferenceST.017.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate all the services that are running in Primary Datacenter continue running without any interruption

Test to be Performed Power off all the servers in secondary datacenter Monitor the databases on Exchange 2013 servers in primary datacenter Try accessing mailboxes using OWA and Outlook Clients that are connected already should not see any disconnection in the services Mail flow should continue working as normal

Expected ResultPassive copies of databases should come online automatically without any administrative interference

Actual ResultCUSTOMER Passive datacenter doesnt host any active mailboxes, hence there should be no interruption to any service

NotesThis test was not executed because the passive datacenter does not host any active services so there would be nothing to failover.

Primary Datacenter FailureItemDescription

Test ReferenceST.018.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate all the databases that are hosted in primary datacenter are mounted on Exchange servers in passive datacenter automaticallyValidate mailboxes that were hosted in primary datacenter continue using exchange services like OWA, Outlook Anywhere, OAB etc. and are able to send and receive emails

Test to be Performed Power off all Exchange 2013 servers in primary datacenter On the secondary datacenter DAG should continue running and should be able to achieve quorum automatically with the help of witness server sitting in third datacenter From a mailbox that was hosted on primary datacenter, send emails to mailboxes on Exchange 2013 and internet mailboxes to validate mails are delivered Try accessing mailboxes using OWA and Outlook from a mailbox that was hosted on primary datacenter Clients that are already connected may experience a disconnection for a short period until the services are restored.

Expected ResultThe failover from primary datacenter to secondary datacenter must be automatic and service should restore on secondary datacenter without any manual intervention

Actual Result

Notes

Mailbox AccessAutodiscover InternalItemDescription

Test ReferenceST.019.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that an internal, domain-joined Outlook 2010 or Later client can connect via the autodiscover service automatically

Test to be Performed Logon to a desktop/laptop using one of the Exchange 2013 test user accounts Open Outlook 2010 or Later for the first time, with no previous Outlook profile configured Follow the first-start procedure to connect to the test mailbox

Expected ResultThe autodiscover process should allow the first-start procedure to automatically configure access to the mailbox without prompting the user for their email address and any authentication prompts

Actual Result

NotesInternal domain joined users will use SCP to locate the server for autodiscover process. The computer must be joined to domain

Autodiscover ExternalItemDescription

Test ReferenceST.020.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that an external, Outlook 2010 or Later client can connect via the autodiscover service automatically

Test to be Performed Ensure the client workstation has internet connectivity Logon to a desktop/laptop using one of the Exchange 2013 test user accounts Open Outlook 2010 or Later for the first time, with no previous Outlook profile configured Follow the first-start procedure to connect to the test mailbox

Expected ResultThe autodiscover process should allow the first-start procedure to automatically configure access to the mailbox without prompting the user for their email address and any authentication prompts

Actual Result

NotesUser must login to workstation with his domain credentials for automatic discovery process, otherwise user would need to provide their email address and credentials to configure profile with autodiscover

OWA Access InternalItemDescription

Test ReferenceST.021.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that an internal user can access their mailbox using OWA via forms based authentication

Test to be Performed Logon to a desktop/laptop using one of the Exchange 2013 test user accounts Using a browser, navigate to https://mail.CUSTOMER.net/owa to access the mailbox via OWA Provide credentials to access OWA in the form

Expected ResultAfter providing the credentials, users should be able to view the mailbox.

Actual Result

Notes

OWA Access ExternalItemDescription

Test ReferenceST.022.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that an external user can access their mailbox using OWA via forms based authentication

Test to be Performed Using a browser, navigate to https://mail.CUSTOMER.net/owa to access the mailbox via OWA Provide credentials to access OWA in the form

Expected ResultAfter providing the credentials, users should be able to view the mailbox.

Actual Result

Notes

ActiveSyncItemDescription

Test ReferenceST.023.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that an external user can access their mailbox using ActiveSync, user must have his/her email address and password handy to configure the mobile device

Test to be Performed Modify internal DNS record for mobilemail to point to the 2013 load balanced VIP Test from ActiveSync devices to validate they can still access both 2013 and 2007 mailboxes after AirWatch SEG redirected to Exchange 2013

Expected ResultAfter providing the credentials, users should be able to view the mailbox on mobile device.

Actual Result

Notes

Outlook Functionality TestOAB DownloadItemDescription

Test ReferenceST.024.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that clients can download the Offline Address Book (OAB)

Test to be Performed While logged on to workstation internally using one of the test user account, open Outlook 2010 or Later and connect to the test mailbox Use the Send/Receive menu option to request a full download of the Offline Address Book Open event viewer and check event ID 27 starting OAB download Followed by another event ID 27 OAB download succeeded

Expected ResultThe Offline Address Book should be downloaded without error, if there are errors the error would be logged into application event log

Actual Result

Notes

Out of OfficeItemDescription

Test ReferenceST.025.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that clients can access the Out of Office feature via Exchange Web Services

Test to be Performed While logged on internally on a workstation using one of the test user accounts, open Outlook 2010 and connect to the test mailbox Access the Out of Office feature by selecting FileAutomatic Replies Customize automatic replies for internal and external mails Send an email to the account that has automatic replies setup from both internal and external mailbox The sender should receive automatic reply message from the recipient

Expected ResultThe Out of Office window should be displayed correctly with no error messagesThe sender should receive automatic reply message from recipient as defined in automatic reply settings

Actual Result

Notes

Free/Busy Data AvailabilityItemDescription

Test ReferenceST.026.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that clients can check the availability of another user

Test to be Performed Login to Test User 1 Exchange 2013 mailbox using Outlook 2010 or Later Create a meeting request and type Test User 2 in To field Click on scheduling assistant In Outlook 2010 or Later scheduling assistant, check see the availability information of User1 and User2

Expected ResultMeeting availability data should be displayed for both users

Actual Result

Notes

Meeting BookingItemDescription

Test ReferenceST.027.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that clients can successfully book a meeting with another user

Test to be Performed Login Test User1 Exchange 2013 test mailbox using Outlook 2010 or Later Create a new meeting requires, and add Test User2 in TO field Click on scheduling assistant Select the time of meeting and send the meeting request Open Test User2 mailbox using outlook Accept the meeting and send the response Check the calendar of both User1 and User2 and see the meeting appears in both the users calendar

Expected ResultThe meetings should be accepted and appear in both users calendars

Actual Result

NotesIf the meeting is not accepted by the recipient, the meeting would appear as tentative in the calendar

Meeting UpdateItemDescription

Test ReferenceST.028.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that clients can send meeting updates to other users and update the calendar

Test to be Performed Login to Test User1 Exchange 2013 test mailbox using Outlook 2010 or Later Open the meeting that was created in test case Error! Reference source not found. Change the date and time of the meeting and click on send update Open Test User2 mailbox using outlook Check the User2 has received meeting update request Open the meeting update item from outlook and click on accept Check the calendar of User2 to verify the meeting date and time has been updated in calendar

Expected ResultAfter accepting the meeting update, the calendar should be updated with new date and time

Actual Result

Notes

Meeting CancellationItemDescription

Test ReferenceST.029.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that clients can send meeting cancellation and update calendar

Test to be Performed Login to Test User1 Exchange 2013 test mailbox using Outlook 2010 or Later Open the meeting that was created in test case Error! Reference source not found. Click on cancel meeting and click on send cancellation Open Test User2 mailbox using outlook Check the User2 has received meeting cancellation Open the meeting cancellation item from outlook and click on remove from calendar Check the calendar of User2 to verify the meeting has been removed from calendar

Expected ResultAfter accepting the meeting cancellation, the meeting should be removed from the calendar

Actual Result

Notes

Resource BookingItemDescription

Test ReferenceST.030.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that clients can successfully book a resource along with a meeting request

Test to be Performed Login to Test User1 Exchange 2013 test mailbox using Outlook 2010 or Later Create a new meeting requires, and add User2 in TO field Next to location field, click on Rooms button All Rooms address book will be opened Select a room from the address book Click on scheduling assistant, you should see the User2 and Room Mailbox name as attendees Select the time of meeting and verify both User2 and Room are available send the meeting request User1 should receive an automatic (acceptance or decline) response from resource mailbox

Expected ResultThe user should be able to book resource and should receive automatic response from resource mailbox

Actual Result

Notes

Address ListItemDescription

Test ReferenceST.031.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that the address list shows all exchange recipients

Test to be Performed Log into Outlook 2010 or Later using one of the Test User1 Exchange 2013 test user accounts In Outlook 20007, view the members of the Global Address list From outlook open address list option From drop down select any other address list and check you are able to see the expected recipients from that address list

Expected ResultThe Global Address List and any other address should show all respective exchange recipients

Actual Result

Notes

Global Message Size LimitItemDescription

Test ReferenceST.032.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that the global maximum message send size cannot be exceeded by users

Test to be Performed Log into Outlook 2010 or later using one of the test user accounts In Outlook, compose a new message to the other test user account and include an attachment greater than 25MB in size Send the message

Expected ResultThe system should reject the message based on it exceeding the 20MB global sending message size

Actual Result

Notes

Mailbox Quota WarningItemDescription

Test ReferenceST.033.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that mailbox warning quotas are functioning correctly

Test to be Performed Log into Test User1 mailbox via Outlook 2010 or Later Ensure that this mailbox contains 5 GB + of mailbox data Wait for the next scheduled warning message to be sent

Expected ResultThe test mailbox should receive a system-generated warning message advising the user that the warning threshold has been met

Actual Result

NotesAssuming the mailbox warning quota is set to 5GB

Prohibit Send QuotaItemDescription

Test ReferenceST.034.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that mailbox prohibit send quotas are functioning correctly

Test to be Performed Log into a Test User1 mailbox via Outlook 2010 or Later Ensure that this mailbox contains over 5 GB of mailbox data Attempt to send a new message to any user

Expected ResultThe user should be prevented from sending new messages until the mailbox size is reduced

Actual Result

NotesAssuming the prohibit send is set to 5 GB

Recover Deleted ItemsItemDescription

Test ReferenceST.035.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that mailbox is able to recover mails using recover delete items option

Test to be Performed Log into Test User1 Exchange 2013 test mailbox via Outlook 2010 or Later Highlight a message in inbox and press + to permanently delete the message from inbox Verify message is not gone to deleted items folder Click on tools and click on recover deleted items Verify the message deleted above step is in dumpster Right Click on message and click on recover Verify the message is recovered to inbox

Expected ResultThe message should be recovered to inbox of the user

Actual Result

Notes

Mail TipsItemDescription

Test ReferenceST.036.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that user is seeing mail tips while composing emails

Test to be Performed Log into a Test User1 Exchange 2013 test mailbox via Outlook 2010 or Later or later Create a new mail items and in TO filed type one internal user User2 and an external user [email protected] Check on top of the email item whether user is seeing any mail tips

Expected ResultUser should be seeing a mail tip about external user

Actual Result

NotesFor my Hotmail account, I saw The following message that the recipient is outside your organization.

Mailbox DelegationItemDescription

Test ReferenceST.037.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate the delegate settings are working

Test to be Performed Create Two mailbox in Exchange 2013 as TestUser31 and TestUser32 Login to desktop / laptop with the newly created mailbox account Open outlook and validate the profile is created automatically From outlook create delegation and assign Send AS delegation to another mailbox on Exchange 2013 Secretary Login to Testuser32 mailbox from outlook Check whether secretary is able to send as on behalf of manager Validate the delegation is working as expected

Expected ResultDelegated User TestUser32 should be able to send emails on behalf of manager

Actual Result

NotesMailbox has delegated Send AS permissions and view all object permissions to secretary

Mailbox SignatureItemDescription

Test ReferenceST.038.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate the signature is working as expected

Test to be Performed Open a mailbox and create a signature using Outlook 2010 or Later Compose a new mail and check the signature is added to new mail

Expected ResultSignature is an outlook property. This test to check user scenario

Actual Result

NotesMailbox must have a signature configured

OWA Functionality TestingOWA Maximum Message SizeItemDescription

Test ReferenceST.039.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that the OWA maximum message compose size cannot be exceeded by users

Test to be Performed Log into OWA using one of test user 31 accounts Attempt to compose a new message to the other test user 32 test user account and include an attachment greater than 25MB in size

Expected ResultThe system should prevent composition and sending of the message based on it exceeding the 20MB OWA maximum message compose size

Actual Result

Notes

OWA Web Ready Document ViewingItemDescription

Test ReferenceST.040.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that OWA web-ready document viewing is functioning correctly

Test to be Performed Log into a test user 31 Exchange 2013 test mailbox via OWA Compose a new message to the other test user 32 Exchange 2013 test user Attach any standard Word .DOC file Send the message to the other test user 32 Exchange 2013 user Log into the test user 32 user mailbox Open the message and hover the mouse cursor over the attachment select the [Preview] option that appears below the attached Word document

Expected ResultThe Word document should be rendered within OWA rather than requiring it to be opened within Word itself

Actual Result

Notes

OWA Out Of OfficeItemDescription

Test ReferenceST.041.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate OWA clients can access the Out of Office feature

Test to be Performed Login to one of the test user 32 Exchange 2013 test mailbox using OWA In the main OWA window, click Options then Set Automatic Replies On the Automatic Replies tab, configure the Out of Office as required Send a mail to Test User 32 from any other mailbox internal and external Both external and internal users should see an out of office message

Expected ResultThe Automatic Replies screen should be displayed correctly and allow the Out of Office reply to be set

Actual Result

Notes

OWA Free/Bus AvailabilityItemDescription

Test ReferenceST.042.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate OWA clients can check the availability of another user

Test to be Performed Login to Test User3 1 mailbox using OWA Create a new meeting request and add User32 in to field Click on scheduling assistant and verify the availability information of User1 and User2

Expected ResultMeeting availability data should be displayed for both users

Actual Result

Notes

OWA Meeting BookingItemDescription

Test ReferenceST.043.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that both internal and external OWA clients can successfully book a meeting with another user

Test to be Performed Login to Test User 31 mailbox using OWA Create a new meeting request and add User32 in to field Click on scheduling assistant and verify the availability information of User1 and User2 Choose the time of meeting and click on send Login to User32 mailbox using OWA and accept the meeting and send the response to organizer (user31) Check the mailbox of User31 to see response email Check the calendar and verify the meeting appears in the calendar of both user31 and user32

Expected ResultThe meetings should be accepted and appear in both users calendars

Actual Result

Notes

Meeting Update from OWAItemDescription

Test ReferenceST.044.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that both internal and external OWA clients can send a meeting udpates

Test to be Performed Login to Test User 31 mailbox using OWA Go to calendar and open the meeting that was created in the test case Error! Reference source not found. Change the date and time of the meeting and click on send update Login to User32 mailbox using OWA and open the meeting update item Click on accept the meeting update Go to calendar and verify the meeting is updated with new date and time

Expected ResultAfter accepting the updated meeting request, the calendar should be updated with new date and time

Actual Result

Notes

OWA Meeting CancellationItemDescription

Test ReferenceST.045.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that both internal and external OWA clients can send a meeting udpates

Test to be Performed Login to Test User 31 mailbox using OWA Go to calendar and open the meeting that was created in the test case Error! Reference source not found. Click on cancel meeting and click on send Login to User32 mailbox using OWA and open the meeting cancellation and click on remove from calendar Go to calendar and verify meeting is removed from the calendar

Expected ResultAfter accepting the meeting cancellation request, the meeting should be removed from calendar

Actual Result

Notes

OWA Address ListItemDescription

Test ReferenceST.046.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate Users are able to view address list in OWA

Test to be Performed Login to Test User 31 mailbox using OWA Compose a new mail and click on TO field By default Default Global Address List will appear Verify all the exchange recipients appear in the list

Expected ResultUser should see the Global Address List and all recipients in the list

Actual Result

Notes

Mail RoutingMail routing between Exchange 2013 Mailboxes within the OrganizationItemDescription

Test ReferenceST.047.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that Users are able to send and receive emails while using Outlook

Test to be Performed Login to Test User 31 mailbox using Outlook 2010 or Later Compose a new mail and add User32 in to field Type subject as Test @ 10:30:00 06062013 Type some text in message body Send the message Open User32 mailbox in Outlook 2010 or Later View the message and reply back to same message with delivery receipt and read receipt Go back to User31 mailbox and see the reply from User32 Verify User32 receives the delivery and read receipt from User31

Expected ResultBoth users should be receiving emails from each other

Actual Result

Notes

Mail routing between Exchange 2007 and Exchange 2013 Mailboxes within the OrganizationItemDescription

Test ReferenceST.048.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that Users are able to send and receive emails while using Outlook

Test to be Performed Login to Exchange 20013 user Test User 31 mailbox using Outlook 2010 or Later Compose a new mail and add c-sbarsoum-stg in to field Type subject as Test @ 10:30:00 06062013 Type some text in message body Send the message Open User32 mailbox in Outlook 2010 or Later View the message and reply back to same message with delivery receipt and read receipt Go back to User31 mailbox and see the reply from User32 Verify User32 receives the delivery and read receipt from User31

Expected ResultBoth users should be receiving emails from each other

Actual Result

Notes

Mail Routing outgoing between Exchange 2013 mailboxes and Internet MailboxesItemDescription

Test ReferenceST.049.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that users are able to send mails out to internet recipients

Test to be Performed Login to Test User 32 mailbox using Outlook 2010 or Later Compose a new mail and add an external email address in to field Type subject as Test @ 10:30:00 06062013 Type some text in message body Send the message Check the queue at transport server Open the recipient mailbox and verify the message is received by the recipient Reply back to the message and verify the user gets the mail from internet mailbox in the outlook

Expected ResultInternet recipient should receive the mails from internal mailboxes

Actual Result

Notes

Mail Routing Incoming between Exchange 2013 mailboxes and Internet Mailboxes using OWAItemDescription

Test ReferenceST.050.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate users are able to send and receive emails while using OWA

Test to be Performed Login to Test User 1 mailbox using OWA Compose a new mail and add User2 in to field Type subject as Test @ 10:30:00 06062013 Type some text in message body Send the message Open User2 mailbox OWA View the message and reply back to same message with delivery receipt and read receipt Go back to User1 mailbox and see the reply from User2 Verify User2 receives the delivery and read receipt from User1

Expected ResultBoth users should be receiving emails from each other

Actual Result

Notes

Public FoldersAdd tests for Exchange 2013 mailboxes accessing, adding, editing, and deleting public folder data on Exchange 2007 legacy public foldersExchange 2013 Mailboxes Accessing legacy 2007 PFsItemDescription

Test ReferenceST.051.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate that exchange 2013 mailboxes can access legacy 2007 PFs.

Test to be Performed Login to Test User 31 mailbox using Outlook 2010 or higher Click on Public Folders All Public Folders Make sure that you are able to view all the child level PFs

Expected ResultAble to browse all the child level PFs

Actual Result

Notes

Exchange 2013 Mailboxes can add new PFs to legacy 2007 PFsItemDescription

Test ReferenceST.052.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate exchange 2013 mailboxes can add new PFs to legacy 2007 PFs

Test to be Performed Login to Test User 31 or Test User 32 mailbox using Outlook 2010 or higher Click on Public Folders All Public Folders Select any child PFs and can add PFs based on the level of permissions assigned on that PF.

Expected ResultCan add the new PFs.

Actual Result

Notes

Exchange 2013 Mailboxes can Modify new PFs to legacy 2007 PFsItemDescription

Test ReferenceST.053.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate exchange 2013 mailboxes can modify new PFs to legacy 2007 PFs

Test to be Performed Login to Test User 31 or Test User 32 mailbox using Outlook 2010 or higher Click on Public Folders All Public Folders Select any child PFs and can add PFs based on the level of permissions assigned on that PF.

Expected ResultCan modify the new and existing PFs.

Actual Result

Notes

Exchange 2013 Mailboxes can delete new and existing PFs to legacy 2007 PFsItemDescription

Test ReferenceST.054.

Test LocationCUSTOMER Staging Environment

Test DescriptionValidate exchange 2013 mailboxes can delete new and existing PFs to legacy 2007 PFs

Test to be Performed Login to Test User 31 or Test User 32 mailbox using Outlook 2010 or higher Click on Public Folders All Public Folders Select any child PFs and can add PFs based on the level of permissions assigned on that PF.

Expected ResultCan delete the new and existing PFs.

Actual Result

Notes

POP3 and IMAP4 ClientsAdd tests for Exchange 2013 mailboxes logging on, sending/receiving email from Outlook connected over POP3 and IMAP4POP3 Service Activity testingItemDescription

Test ReferenceST.055.

Test LocationCUSTOMER Staging Environment

Test DescriptionThe Get-Servercomponent cmdlet to retrieve configuration settings for Microsoft Exchange Server 2013 components and endpoints

Test to be PerformedRun the following Exchange Management Shell command against any Exchange 2013 server:Get-ServerComponentState Identity ENSTGEXCH001For details refer to Get-Servercomponent

Expected ResultThis cmdlet should provide active for all the components

Actual Result

Notes

POP3 client testingItemDescription

Test ReferenceST.056.

Test LocationCUSTOMER Staging Environment

Test DescriptionPerform POP testing through outlook 2010 or greater using any one of the testing account Testuser31 or Testuser32

Test to be Performed Open control panel-click on Mail to create a new outlook new outlook profile for POP3 account Select Manual setup and select POP or IMAP Fill out the information and select POP in the Server Information Provide the Incoming mail server: Outgoing mail server (SMTP): Provide the Logon Information Click on More Setting- Select Outgoing Server and click on My Outgoing Server Under Advanced- click on this server requires an encrypted connection (SSL)

Expected ResultThe outlook client should be able to provide with the results.

Actual Result

Notes

IMAP Service Activity testingItemDescription

Test ReferenceST.057.

Test LocationCUSTOMER Staging Environment

Test DescriptionThe Get-Servercomponent cmdlet to retrieve configuration settings for Microsoft Exchange Server 2013 components and endpoints

Test to be PerformedRun the following Exchange Management Shell command against any Exchange 2013 server:Get-ServerComponentState Identity ENSTGEXCH001For details refer to Get-Servercomponents

Expected ResultThis cmdlet should provide active for all the components

Actual Result

Notes

IMAP client testingItemDescription

Test ReferenceST.058.

Test LocationCUSTOMER Staging Environment

Test DescriptionPerform IMAP testing through outlook 2010 or greater using any one of the testing account Testuser31 or Testuser32

Test to be Performed Open control panel-click on Mail to create a new outlook new outlook profile for IMAP account Select Manual setup and select POP or IMAP Fill out the information and select IMAP in the Server Information Provide the Incoming mail server: Outgoing mail server (SMTP): Provide the Logon Information Click on More Setting- Select Outgoing Server and click on My Outgoing Server Under Advanced- click on this server requires an encrypted connection (SSL)

Expected ResultThe outlook client should be able to provide with the results.

Actual Result

Notes

Page 38Exchange Server 2013, Functional Test Plan, Version 1.0 DraftPrepared by Alexander, Scott"Exchange Server 2013_Functional Test Plan Ver1.0.docx" last modified on 7 Nov. 14, Rev 6