SAS Visual Analytics

at Statistics Canada (Statcan)

Cheryl Wang

Statistics Canada, Ottawa

November 17 2016

Agenda

Data Visualisation (DV) Business @Statcan

SAS VA & Existing SAS@Statcan

Statcan SAS VA Architect

Statcan SAS VA with SAS Grid

Statcan SAS VA Deployment

Utilization of Statcan SAS VA

Business to Operation

Examples

Data Visualisation Business @Statcan

Canada’s central statistical agency

Mandate to collect, compile, analyse and publishstatistical information on the economic, social and general conditions of the whole country and its citizens

300+ Surveys: Census (every 5 years), Labor Force, Consumer Price Index, Systems of National Accounts

DV Business @Statcan (Cont’d)

Collection: progress, schedule, response rate, work load

Processing: QA resulting data; alert; drill down

Analysis: summary, tables, charts, regression, variance

Dissemination: KPI, Map Charts, tables and charts

Other: Visualised Reports for HR, Finance, etc.

Large amount of data, large # of users & DV business cases

An Enterprise Solution / Platform: SAS VA with Existing SAS@Statcan

Processing

SAS VA with Existing SAS@Statcan

Collection Dissemination

SAS VA & SAS Grid & SAS Servers

(high performance / availability / scalability / security)

Survey Lifecycle

Analysis

Statcan SAS VA Architect

SAS EG

Management Console

Statcan SAS VA with SAS Grid

Clients

SAS Grid

SAS VA

NFS

CFS/Projects

CFS/Projects

VA HUB

- Management Console- Putty

- FileZilla- SAS EG- MSOffice Add-in- Other BI clients

GIS

Servers

Statcan SAS VA Deployment

SAS VA Version 7.2

No Hadoop, non-distributed, no mobile BI

All tiers on single virtual Linux server with

12 cores; 205 GB memory; 291 GB local disk storage

SAS Grid projects folders mounted to VA server (NFS)

Built by SAS Admin with SAS consultant; single sign-on

Supported by SAS Admin and SAS VA team

Only available on internal Statcan intranet

Utilization of Statcan SAS VA

Since Oct 2014, for learning, research, prototyping,

evaluation, decision making purposes

Promote VA into key business areas: Census, National Accounts,

Income Statistics, Consumer Prices, Data Warehouse

Create polices and guidelines: roles and responsibilities (users,

power users, VA team, SAS admin); metadata folder structures; change

management process; communications; governance

Solve technical challenges: bilingualism, customized geographic

maps (ArcGIS map service), autoLoad, formats, other data source,

APM, EV, etc.

Utilization of Statcan SAS VA (Cont’d)

Integration with other SAS products: SAS EG, MS Office

Add-in, SAS Stored Process, etc.

Automation, batch process, scheduling

Real time reports: refresh data frequently or on demand

Sharing and distribution

Advanced Visual Statistics: Linear Regression, Logistics

Regression, Linear model, Decision Tree, Clustering

Integration with existing SAS environment: non-grid SAS

servers

Business to Operation

Step1: Business needs & modeling (IT&User)

Step2: Build VA-ready data outside SAS VA (IT&User)

o SAS Grid/SAS Servers/Local SAS

o Other processing environments (SQL Server, Oracle, C, etc.)

Step3: Build project specific operational environments

on SAS VA server

o LASR servers (metadata, instance, configuration)

o Project folders at OS level, metadata level

o Project templates and policies

Business to Operation (Cont’d)

Step4: Load VA-Ready Data into LASR server (IT)

o Importing from raw source (dev, exceptions only)

oReload-Unload (source meta -> LASR meta: Predefined relations)

o Auto load (meta folders and auto load configurations)

Step5: Conduct Visual Analytical Tasks in VA (users & IT)

oData Building (Users & IT)

o Building Reports(IT & advanced users)

o Exploration, view, alerts; comments, discussions (users);

Example 1: Hierarchical Map Charts

Province_city_postcode_population

· Province: SAS internal code

· City: Character

- City_latitude: Numeric

- City_longititude: Numeric· postcode:Character - post_latitude: Numeric - post_longititude: Numeric· Demo_population: Numeric

Statcan VA Reports - Examples

Statcan VA Reports - Examples

Example 2 – Dashboard

Population_ISB

· OEID: Character

· NAICS: Numeric

· Province: Character

· StatisticalAreaClassification: Character

· ProfiledRevenue: Numeric· GSTSales: Numeric· IncomeTaxRevenue: Numeric· Year_Birth: Date

…...

Dashboards

21/11/201620 Statistics Canada • Statistique Canada

Pierre Lafrance

Assistant Director

Yves Deguire

Senior Technical Advisor

Étienne Rouette

Section Chief

Joel Orr

Team Leader, SAS Admin Group

Cheryl Wang

Team Leader

SASTC VA Working Group

SAS VA Evaluation Users

SAS VA Star Team @ Statcan

Questions?