Planning and Deploying a Managed Self-Service BI Environment Kay UnkrothSenior Program ManagerMicrosoft Corporation

DBI-B312

Session Objectives and Takeaways Overview Deployment Tools and Steps

SQL Setup, PowerPivot Config Tool, ScriptsUpgrade and Update Procedures

Typical Topologies and Server Configurations

Single server vs. multiple server farmsDedicated vs. non-dedicated servers

System Architecture Deployment Troubleshooting

Excel Services, FE/BE communication, data refreshPowerPivot Management Dashboard

Managed Self-Service BI Stack

Collaboration Platform

SharePoint

User Experience

Data Infrastructure and BI Platform

Microsoft SQL ServerIBM DB2

Others (OLE DB/ODBC)

Text Files

ExcelFiles

Microsoft SQL Azure

Teradata Reporting Services

DataFeedsOracle

Excel

SQL Server

PowerPivotPower View

GeoFlowData Explorer

SQL ServerAnalysis Services

Reporting Services

Hive

Excel ServicesPowerPivotPower View

PerformancePointVisio Services

PowerPivot and Power View Features in SharePoint

Browser InteractivityWorkbooks as a Data

Source

Scheduled Data Refresh

PowerPivot Gallery

Management Dashboard

Power View

BISM Link FilesData Feed Library

Data Alerts

Light-up Story for SharePoint 2013

Deploy your SharePoint 2013 farms andenable shared services, such as Excel Services

and PerformancePoint Services.

Install Analysis Services in SharePoint mode andregister the server in Excel Services

to enable the core PowerPivot functionality.

Install Reporting Services add-in and Reporting Services in SharePoint-integrated

modeto unlock stunning browser-based data

exploration, visualization, and presentation experiences.

Nati

ve

EC

SFeatu

res

Core

BI

Featu

res

Pow

er

Vie

w

1

2

3

Deploy the PowerPivot for SharePoint 2013 Add-In

to provide additional capabilities, such as full access to workbooks as a data source,

scheduled data refresh, PowerPivot Gallery, and IT Management Dashboard.

All

Pow

erP

ivo

tFeatu

res

4

SQL Server Database Engine

Analysis Services

PowerPivot for SharePoint 2013 Reporting Services Power

ViewPerformancePoint Services

Excel ServicesVisio Services

SharePoint 2013 Enterprise

Demo

PowerPivot for SharePoint Light-up

PowerPivot for SP 2013 Server TopologiesSingle Server

Reporting Services Power View

Analysis Services SharePoint 2013 Enterprise

SQL Server Database Engine

Separate SQL Server

Reporting Services Power View

SharePoint 2013 Enterprise

Analysis Services SQL Server

Database Engine

Shared SQL Server

Reporting Services Power View

SharePoint 2013 Enterprise

Analysis Services SQL Server Database

Reporting Services Power View

SharePoint 2013 Enterprise

Large Farm

SQL Server Database

Analysis Services

Reporting Services Power View

SharePoint 2013 Enterprise

PowerPivot for SP 2013 Scale Out

Large SharePoint 2013 Farm

Web Front-End Servers

Clients

Application Servers

SQL Server Databases

Config.Database

Content Database

s

Service App.

Databases

Analysis Services in SharePoint

Mode

1. Install SQL Server 2012 SP1 PowerPivot for SharePoint on an additional server.

2. Grant SharePoint farm and service accounts Analysis Services server admin rights on the new server.

3. Register the new server in the BI Servers configuration of Excel Services

Demo

Verifying the Excel Services Configuration

Workbooks as a Data Source

EWA/EWS

RS add-in

PPS Web Service

PowerPivot Web Service

Browser

Excel client

RemoteSP farms

Excel Calculation

Services (ECS)

PPS Service App

RS Service App

PowerPivot System Service

Client Front-End Service Apps Analysis Services

AD

OM

D.N

ET

EC

S

API

ECS API

XML/A Client

12

1

2

1

2

MSOLAP

ECS API1

2

Data Model

Other

Timer Job

Only Excel Services loads and unloads PowerPivot data models. All other applications, including PowerPivot, must use Excel Services to load a data model before establishing a

direct connection via TCP/IP. The steps are transparent to applications using MSOLAP, ADOMD.NET, or AMO.

SSPM

Installing Individual Data Providers

Analysis Services in SharePoint

mode

Excel Calculation

Services

SharePoint Content Database

XLSX

LoadData Model

SPClient

MSOLAP ADOMD.NET AMO

ECS API

Only SQL Server Setup and spPowerPivot.msi install the SPClient component.Individual provider packages available in the SQL Server Feature Pack do not include

SPClient.

SPClient is a hidden feature that

will be installed regardless of the feature selection.

Installing the PowerPivot Package -- spPowerPivot.msi

Large SharePoint 2013 Farm

Web Front-End Servers Application Servers

SQL Server Databases

Config.Database

Content Database

s

Service App.

Databases

Analysis Services in SharePoint

Mode

Install MSOLAP, ADOMD.NET, and AMO on all SharePoint servers.

Install PowerPivot for SharePoint 2013 on at least one server (preferably the server hosting Central Administration)

Demo

Accessing a Data Model from within a Farm

Installing Power View in SharePoint 2013Client Front-End Service Apps Analysis

Services

Installing PowerPivot Add-In Features

EWA/EWS

PowerPivot Web Service

Excel Calculation Services (ECS)

PowerPivot System Service

Client Front-End Service Apps Analysis Services

Data Model

SSPM

SharePoint Timer Service

Usage Data Import

Usage Data Processing

PowerPivot Data Refresh

PowerPivot Health Statistics Collector

PowerPivot Mgmt Dashboard Processing

PowerPivot Setup Extension

Timer Jobs:

Management Dashboard

PPivot App DatabaseSQL Server Databases

AMO

ADOMD.NET

MSOLAP

Internet Explorer

Business

App

PowerPivot UI

Internet Explorer

SharePoint Lists Service

Data Feed Client

BISM Link File

Data Feed Export

PowerPivot Configuration Tool and Scripts

Config DB

2 Deploy .wsp’s to SP servers:• Copy files• Install features• Add assemblies to GAC

SP Timer Service

SP Timer Service

SP Timer Service

3 Configure local service instances and SharePoint

Dependencies

Run PowerPivot for SharePoint

2013 Configuration

1 Deploy .wsp’sto config db

Scripting the PowerPivot Deployment

The PowerPivot Cmdlets are in the farm solution.

PowerShell Scripts for PowerPivot

PowerPivot Reference for PowerShell

PowerPivot Config Tool – Script tab

1. Add-SPSolution –LiteralPath “C:\Program Files\Microsoft SQL Server\110\Tools\PowerPivotTools\SPAddinConfiguration\Resources\PowerPivotFarmSolution.wsp”

2. Install-SPSolution –Identity PowerPivotFarmSolution.wsp –GACDeployment –Force

3. Get-help *powerpivot*

http://msdn.microsoft.com/en-us/library/hh213341.aspx

PowerPivot Solutions and Features

Deploy PowerPivotWebApplicationSolution.wsp

Deploy PowerPivotFarmSolution.wsp and PowerPivotFarm14Solution.wsp

Deployed once at the farm level and automatically available on all SharePoint servers

Install PowerPivot Features

• PowerPivot (Farm)• PowerPivotAdmin (Central Admin)• PowerPivotSite (Site Collections)

Note that PowerPivot for SharePoint only supports Web applications using Windows authentication. Forms-based and SAML authentication are not supported.

Activate PowerPivot Features

In the Site Collection, under Site Collection Features, make sure the PowerPivot Integration Site Collection Feature is set to Active.

Demo

PowerPivot Solutions and Features in Central Administration and Site Collections

Upgrading or Patching Multi-Server Farms

SharePoint Servers

1. Install the new version of spPowerPivot.msi according to the deployment instructions.

3. On one server that has the PowerPivot for SharePoint 2013 Configuration tool, run the tool to upgrade features, services, applications and solutions in the farm.

2. Move to the next SharePoint server and install the new version of spPowerPivot.msi

Refreshing a PowerPivot Workbook

Scheduled Data Refresh

Interactive Data Refresh

1. User opens a PowerPivot workbook in the browser.

2. In the browser window, user opens the Data menu and clicks Refresh Selected Connection or Refresh All Connections.

3. Excel Services loads the PowerPivot database, processes it, and then queries it to refresh the Excel workbook cache.

Note: Interactive data refresh is only available for Excel 2013 workbooks.

1. User displays the Manage Data Refresh page.

2. On the Manage Data Refresh page, user enables Data Refresh and configures a refresh schedule.

3. At the specified time, the PowerPivot System Service sends a request to Excel Services to load and process the PowerPivot database, refresh the workbook, and save the workbook back to the content database.

Note: PowerPivot no longer sets the Refresh on Open flag.

Scheduled Data Refresh Architecture

Analysis Services Engine

Microsoft SQL ServerIBM DB2

Others (OLE DB/ODBC)

Text Files

ExcelFiles

Microsoft SQL Azure

TeradataReporting Services

DataFeedsOracle

Analysis Services Server requires appropriate data

providers/client libraries for the AS engine to access the

data sources.

PowerPivot App Database (Work

Queue and Refresh History)

SharePoint Content

Database

SharePoint Configuration

Database

XLSX

RDBMS Server

PowerPivot System Service

Excel Calculation

ServicesPowerPivot Data Refresh Timer Job

User Interface(Manage

Data Refresh page)

SharePoint Timer Service

Secure Store Service (Refresh Credentials)

Demo

Refreshing PowerPivot Workbooks

Management Dashboard Architecture

Excel Calculation Services

Server Health and Workbook Activity Workbooks

PowerPivot Service Application

PowerPivot Web Service

Client Libraries

UsageLog

s

SharePoint Timer ServiceUsage Data

ImportMgmt Dashboard

ProcessingPowerPivot HealthStatistics Collector

PowerPivot Application Database

Usage data collection must be enabled for SharePoint components to log

usage data.

PowerPivot Management Data Workbook

PowerPivot Management Dashboard

Usage Data Processing

SharePoint Usage Database

(Customizing the PowerPivot Management Dashboard: http://msdn.microsoft.com/en-us/library/ff718155(v=SQL.105).aspx)

Demo

PowerPivot Management Dashboard

Troubleshooting Tools and Resources

PowerPivot-Related

SharePoint-Related1. ULS Parsing Tool (ULS

Viewer)2. Fiddler (HTTP debugging

proxy)3. Network Monitor

(protocol analyzer)4. Performance Monitor

(server health and resource consumption)

Resources

1. SQL Server PowerPivot for SharePoint Newsgroup

2. Team/Personal/MVP Blogs:• blogs.msdn.com/

PowerPivot• powerpivotgeek.co

m• dennyglee.com• powerpivotpro.com• powerpivot-

info.com• powerpivotblog.nl

3. Twitter > #PowerPivot4. Chapter 9 of Professional

Microsoft PowerPivot for Excel and SharePoint

1. PowerPivot Management Dashboard (workbook and server health statistics at a glance)

2. PowerPivot Management Dashboard Source Workbook (custom management solutions)

3. SQL Server Management Studio (query PowerPivot Application database and view loaded PowerPivot databases)

4. SQL Server Profiler (XMLA communication between PowerPivot System Service and Analysis Services)

Summary

Related contentDBI-B209 Dynamite Data Visualization with Power View in Microsoft ExcelDBI-B220 Effective Data VisualizationDBI-B215 Overview of Business Intelligence in Microsoft Office and SharePoint 2013DBI-B331 Developing and Managing a BI Semantic Tabular Model in Microsoft SQL Server 2012 Analysis ServicesDBI-B325 Do You Have Big Data? (Most Likely!)DBI-B303 Microsoft PowerPivot Excel 2013 in ActionDBI-B336 Big Data Analytics with Microsoft Excel 2013DBI-B326 Deploying Microsoft SQL Server Reporting Services in SharePoint Mode: Why and HowDBI-B339 Predictive Analytics with Microsoft Big DataDBI-B328 Delivering KPIs with Microsoft SQL Server Analysis ServicesDBI-B320 Tips and Tricks for Building Rich Reports in Microsoft SQL Server 2012 Reporting ServicesDBI-B316 Running BI Workloads on Windows Azure Virtual MachinesDBI-B321 Using Power View with Multidimensional ModelsDBI-B210 BI Power HourDBI-B225 Microsoft “Data Explorer” for Excel: Discover, Combine, and Refine your DataDBI-B312 Planning and Deploying a Managed Self-Service BI EnvironmentDBI-B401 Enriching Big Data for AnalysisDBI-B315 Querying in DAX

msdn

Resources for Developers

http://microsoft.com/msdn

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

TechNet

Resources

Sessions on Demand

http://channel9.msdn.com/Events/TechEd

Resources for IT Professionals

http://microsoft.com/technet

Complete an evaluation on CommNet and enter to win!

© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.