Cognos Test Cases

Purpose:Test that reports, cubes, event studio objects, schedules, emails, and auditing all function correctly. Verify that modifications to the “end user experience” are minimal and that the changes that developers will see are moderate. Verify that the data, speed and presentation for each report is the same in 8.2 and 8.3 or better and document any differences (good or bad) using the same prompt values to run the report or object in 8.2 and 8.3 to verify the results are the same. If there is a problem in either environment, document it. Test as many different packages as possible.

DifferencesWhen viewing a report, the various options are available in different drop downs.“Keep this version”

Bookmark – do we want to allow this?Can save to unsecured folders if logged in (check Informal)

Drill thru from cube if formatted date in cube – pass the date so does not work (about 3 -4 cubes)Cube build date is in the properties from Analysis Studio – click on cube name and double arrows in information pane

Implementation Tasks:Deploy full content store from existing production environment to new environmentDisable all schedulesCopy CubesRecreate training users

trn001 – Payroll Cultural, Human Resourcestrn002 - Payroll Cultural, Payroll Aviationtrn003 – City Operator Permittrn004 – Police Applicationstrn005 – Developer - Police

Test cases:1. Prompted Report2. Unprompted Report3. Secured reports (Payroll, tcop, public safety, HR)4. Anonymous user

a. Unsecured reports – can they be accessed by anonymousb. Can they “save as a view”?c. Verify user does not have access to what they shouldn’t

5. Cross tab report6. Complex formatting7. Complex data manipulation8. Multiple subreports9. Drill thru reports10. Drill thru to applications11. Run format working correctly(Excel, PDF, CSV)12. Scheduled report

a. Email13. Cubes – drill up and down in the columns and rows, add filters, add to context.

a. Drill thru to a report – are the expected filter values working, b. Drill thru to a report with a drill thruc. CRM cubes

14. Reports against a cube drill up and down in the columns and rows, add filters, add to context, ..a. Drill thru to a report – are the expected filter values working, b. Drill thru to a report with a drill thru

15. Auditing16. Event Studio objects17. Schedules running correctly including emails18. Create a report – template working correctly, 19. Create an Analysis Studio object20. Create Queries21. Create a report against a cube22. Create an Event Studio object23. Framework Manager – test making modification, publishing, creating a new model24. Powerplay Transformer –

a. create a cube against an existing iqdb. create a cube against a Framework Manager query itemc. CRM

25. Verify Administrative tasksa. Create data sourcesb. Add/Modify users/groupsc.

Report/Cube Path Test cases run

Tester Test Date

Comments Results

Warrant Search Public Folders > Public Safety > Warrants

1, 3, 4c Julie 8/1/08 Pass

Police Crime Statistics

Public Folders > Public Safety

14a Julie 8/1/08 Pass

Incident By Address Public Folders > Public Safety > CAD Incident

1, 3, 4c Julie 8/1/08 Logon error, try later UDT connection not working

Job Application Totals by Department - Open Applications

Public Folders > Human Resources > Job Applications

2, 3, 4c, 5 Julie 8/1/08 Logon error, try later Notes software not installed

Unmatched Invoices - All

Public Folders > Financial > MARSG > Unmatched Invoices and Releases

1, 4a, 4b, 10 Julie 8/1/08 Pass

Unmatched Invoices over 90 days

Public Folders > Financial > MARSG > Unmatched Invoices and Releases

1, 4a, 4b, 7, 10

Julie 8/1/08 Pass

Unmatched Releases - Daily

Public Folders > Financial > MARSG > Unmatched Invoices and Releases

2, 4a, 4b, 7 Julie 8/1/08 Pass

P29 Leave Report Public Folders > Financial > Payroll > Leave Reports

1, 3, 6, 8 Judy 07/08/08 Entered my Employ ID and 2008 for the year, report response time was much quicker in newer version of Cognos

Pass

CTCD – Time Card Details

Public Folders > Financial > Payroll > Timecard Reports

1, 3, 6, 7 Judy 07/08/08 Entered 07/04/08 for the Pay Period End Date and 0FAIS for the Payroll Unit, report response time was much quicker in newer version of Cognos

Pass

Transactions – Historical 1992 through Present (NP)

Public Folders > Financial > General Ledger > General Ledger - Historical

1, 4a, 4b, 6 Judy 07/08/08 Selected Finance and Admin Serv. Dept., 745 Communications Fund, 6/01/08 to 6/30/08, Slow in both

Pass

Report/Cube Path Test cases run

Tester Test Date

Comments Results

Paid Items – Historical

Public Folders > Financial > MARSG > Paid Invoices - Historical

1, 4a, 4b, 10 Judy 07/08/08 Prompted to download Filenet viewer to retrieve invoice images.

Pass

PCVO - Position Control Vacancy and Overfill Report

Public Folders > Financial > Payroll > Position Control Reports

1, 3, 5, 6, 7, 8

Judy 07/08/08 Entered FAIS% for the Organization, report response time was much quicker in newer version of Cognos

Pass

PCV - Position Control Vacancy

Public Folders > Financial > Payroll > Position Control Reports

1, 3, 5, 6, 7, 8

Judy 07/08/08 Entered FAIS% for the Organization, report response time was much quicker in newer version of Cognos

Pass

Position Control Detail Report - Summarized by Organization/Union

Public Folders > Financial > Payroll > Position Control Reports

1, 3, 5, 6, 7, 8

Judy 07/08/08 Entered FAIS% for the Organization, report response time was about the same in both environments.

Pass

Current Paid Items Public Folders > Financial > MARSG > Paid Invoices - Current Fiscal Year

Stephanie

07/08/08 Cube in Analysis Studio.Need to compare when there is some data in 8.2

Pass

Sus or Rev MVD licenses

Public Folders > City Operator Permit

2, 3, 4c Stephanie

07/08/08 Has a saved report, run from “run” action. Paged down slightly faster in 8.3, Tested PDF, and all excel formats, anonymous could not see, trn003 could run

Pass

CRM - Large Item Pick-up exception

Public Folders > CRM/311 > Solid Waste

1, 13 Stephanie

07/08/08 Slow in both environments (prompts about 2 min., report about 1 min), ran as anonymous, could not save, drill thru worked, save in html worked

Pass

Report/Cube Path Test cases run

Tester Test Date

Comments Results

Daily Worklist Report by Quadrant

Public Folders > CRM/311 > DMD

1, 9, 10 Stephanie

07/08/08 Use stmasm. Slow in both (about 40 – 50 seconds). Drill throughs all worked, saved in PDFNOTE: “no records found” at the bottom of the report with 3 records in both env.

Pass

Telecommunications Detail - Current Fiscal Year

Public Folders > Telecommunications

1,4b Stephanie

07/13/08 Used “economic development” in 8.2 and 8.3, got the same results, emailed the report to myself and it worked, emailing the link did not. I was not able to save the report to my folders. I was able to add a bookmark, View in excel worked

emailing the link did not work

CRM - Large Item Pick-up Exception Report -Afternoon

Public Folders > CRM/311 > Scheduled

2, 12 Stephanie

07/13/08 Ran thru the run action, no records found in both but I do see the previous versions – looked like the schedule was running. I disabled all schedules except this one and changed email recipient from “Luchetti Deanna M (swddml);CCC Supervisors;” to Judy and I and added attach report

Pass

Daily Worklist Report with Detail Information

Public Folders > CRM/311 > DMD

1, 4a, 4b, 10 Stephanie

07/14/08 Took over 2 minutes in both environments. Slow.Under “Add this report”, I was able to Add the report to Public Folders > Departments - Informal Reports > Planning,

But not My Folders as Anonymous.

Pass

Report/Cube Path Test cases run

Tester Test Date

Comments Results

Unmatched Invoices - Daily

Public Folders > Financial > MARSG > Unmatched Invoices and Releases

1, 4a, 4b Stephanie

07/14/08 Under “Keep this version”, I was able to save the report view to Informal/Campaign and ran it from the new location. It looks like I could have added the report view to most of the cube packages. Also, I was able to email the report to myself and both the link and the attached report workedUnder “Add this report”, I was able to add it as a bookmark and it ran fine from there.

Under “Keep this version”, it looks like I could have added the report view to most of the cube packages.

CRM Summary By Agent

Public Folders > CRM/311 > Contact Center Reports

13, 14 David 07/08/2008

All test scenarios worked fine.

CRM Case Summary Cases by Quickcode

Public Folders > CRM/311 > Analytical Reports

13, 14 David 07/08/2008

Unable to test drill thru to Related Reports. To slow in both environments. Will check again after the 8.3 environment has been updated

Purchase Orders Details (MARSG)

Public Folders > Financial > MARSG > Contracts and Purchase Orders

Judy 08/07/08 Recreated report in 8.2 environment because of the following error message:

Error Message in 8.3:

Water ReportsInjury Time – Fiscal YTD

Public Folders > Water Authority > Dashboard Reports

2 David Working in 8.3. No longer present in 8.2

YTD Historical Balances - Overtime

Public Folders > Water Authority > Dashboard Reports

2 David Tested and working as expected

Report/Cube Path Test cases run

Tester Test Date

Comments Results

Injury Time Public Folders > Water Authority > Dashboard Reports

2 David Not tested. This report was not found in the 8.3 environment. Report needs to be deployed in 8.3.

Postage Detail Report 5D

Public Folders > Utility Billing > CIS > Daily Reports > Scheduled

2, 3, 12, 17 David Not tested. Report needs to be deployed in 8.3 with current data

All Exception Reports - AM Reports

Public Folders > Water Authority > Payroll > Secured > Payroll Exception Reports

2, 3, 12, 17 David Not tested. Report needs to be deployed in 8.3 with current data

Testing of Drill Thru from a cube to a report

Drill Through Definition

Cube Name Report Name Path including Analysis Object Name

Test cases run

Tester Test Date

Comments Results

Current Paid Items

MARSG - Current Paid Items

Current Paid Items

Public Folders > Financial > MARSG > Paid Invoices - Current Fiscal Year

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links**New View Target Mapping and View passed source value functions

Pass

General Ledger Current Encumbrances

Current Encumbrances

Current Encumbrances

Public Folders > Financial > General Ledger > General Ledger - Current Fiscal Year

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Pass

General Ledger Current Daily Transactions

GL Current Daily Transactions

GL Current Daily Transactions

Public Folders > Financial > General Ledger > Daily Transactions

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Pass

Drill Through Definition

Cube Name Report Name Path including Analysis Object Name

Test cases run

Tester Test Date

Comments Results

AR Open Items - Less Companies 05 and 06

AR Open Items - Less Companies 05 and 06

AR Open Items - Less Companies 05 and 06

Public Folders > Financial > Accounts Receivable

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Pass

AR Open Items - Less Companies 05, 06, NT and Future Payments

AR Open Items - Less Companies 05 and 06 and NT and Future Payments  

AR Open Items - Less Companies 05 and 06 and NT and Future Payments

Public Folders > Financial > Accounts Receivable

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Pass

AR Open Items - Less Companies 05, 06, NT, Future Payments and Grants

AR Open Items - Less Companies 05 and 06 and NT and Future Payments and Grants  

AR Open Items - Less Companies 05 and 06 and NT and Future Payments and Grants

Public Folders > Financial > Accounts Receivable

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Pass

Drill Through Definition

Cube Name Report Name Path including Analysis Object Name

Test cases run

Tester Test Date

Comments Results

General Ledger Current Fiscal Year Transactions (NP)

GL Current Balances - No Encumbrances 

Current Fiscal Year Transactions - NP

Public Folders > Financial > General Ledger > General Ledger - Current Fiscal Year

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Labor Distribution by Employee - Current Pay Period Drill

Labor Distribution - Fiscal with Employees

Labor Distribution - Fiscal with Employees

Public Folders > Financial > Payroll > Labor Distribution - Secured

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Labor Distribution by Employee - Current Fiscal Year Drill

Labor Distribution - Fiscal with Employees

Labor Distribution - Fiscal with Employees

Public Folders > Financial > Payroll > Labor Distribution - Secured

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Drill Through Definition

Cube Name Report Name Path including Analysis Object Name

Test cases run

Tester Test Date

Comments Results

Unmatched Invoices

MARSG - Unmatched Invoices

Unmatched Invoices

Public Folders > Financial > MARSG > Unmatched Invoices and Releases

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

Unmatched Releases

MARSG - Unmatched Releases

Unmatched Releases

Public Folders > Financial > MARSG > Unmatched Invoices and Releases

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

CRM Drill Details

CRM Case Summary

CRM Case Summary Aging Period

Public Folders > CRM/311 > Open Cases

Melissa Parras

7\15 & again 7\22

Tested drill down, up, related links, filtering and exporting.

Worked as expected.

CRM Materials Removed Drill Details

CRM Field Services Materials Removed  

CRM Field Services Materials Removed

Public Folders > CRM/311 > DMD

Melissa Parras

7\15 & again 7\22

Tested drill down, up, related links, filtering and exporting.

Worked as expected.

CRM Materials Used Drill Details

CRM Field Services Materials Used

CRM Field Services Materials Used

Public Folders > CRM/311 > DMD

Melissa Parras

7\15 & again 7\22

Tested drill down, up, related links, filtering and exporting.

Worked as expected.

Drill Through Definition

Cube Name Report Name Path including Analysis Object Name

Test cases run

Tester Test Date

Comments Results

Telecommunications Detail Report - Current Fiscal Year

Telecommunications Detail - Current Fiscal Year

Telecommunications Detail - Current Fiscal Year

Public Folders > Telecommunications

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions

CRM Drill Details

CRM Case Summary

CRM Case Summary by Category

Public Folders > CRM/311 > Analytical Reports

9, 10, 13b, 14b

Judy 8/27/08 Tested drill down, up, and drill-through to related links **New View Target Mapping and View passed source value functions