Migration Caching

Embed Size (px)

Citation preview

  • 8/10/2019 Migration Caching

    1/23

    December 4, 2008 1

    Repository/Web Catalog Migration Tips

    and Caching

    Melinda Rojo

    Dan Malone

  • 8/10/2019 Migration Caching

    2/23

    December 4, 2008 2

    Session Overview

    Under the covers the OBIEE dashboards are comprisedof a multitude of objects in both the Metadata

    Repository and the Web Catalog. Version control andmigrating these objects between environments are

    non trivial tasks. This session will share what we havelearned.

    We will also discuss how we used OBIEE caching toimprove performance and the methods we used toautomate clearing the OBI server cache when the

    data warehouse refresh is complete.

  • 8/10/2019 Migration Caching

    3/23

    December 4, 2008 3

    Session Topics

    Architecture Overview

    Migration Overview

    Metadata Repository

    Web Catalog

    Cache Management

  • 8/10/2019 Migration Caching

    4/23

    December 4, 2008 4

    Architecture Overview

    2 Servers per Environment 2 Metadata Repositories

    Shared Web Catalog No replication

    4 Environments Pre-Development

    Development

    Test

    Production

    Windows Terminal ServicesAdministration Tools

  • 8/10/2019 Migration Caching

    5/23

    December 4, 2008 5

    Migration Overview

    Pre-Migration Tasks

    Metadata Repository Migration

    Web Catalog Migration

  • 8/10/2019 Migration Caching

    6/23

    December 4, 2008 6

    Pre-Migration Tasks

    Change Ownership of Web CatalogObjects to Administrator

    Set Permissions on Objects

    Setup Security in Target Environment

    Create New Groups

    Repository Groups

    Web Catalog Groups

  • 8/10/2019 Migration Caching

    7/23December 4, 2008 7

    Metadata Repository Migration

    Development Migrate Metadata Repository (.rpd file)

    between servers in same environment

    Development -> TestTest -> Production

    Promote Metadata Repository betweenenvironments

    Migrate Metadata Repository (.rpd file)between servers in same environment

  • 8/10/2019 Migration Caching

    8/23December 4, 2008 8

    Migration in the Same Environment

    Copy physical Metadata Repository file(.rpd) from one server to the other

    Tips & Tricks

    Stop BI services to ensure no changes are

    occurring

    Requires outage since BI services are

    stopped during copy

  • 8/10/2019 Migration Caching

    9/23December 4, 2008 9

    Migration Between Environments

    Option #1: Copy/Paste changes manually Only selected changes will migrate to target environment

    Physical layer changes will overwrite

    Business Model and Presentation layer changes requiredelete then paste

    Initialization blocks and variables are duplicated

    To avoid down time in production, copy-paste to both servers

    Option #2: Copy Metadata Repository file (.rpd) All changes will migrate to target environment

    Not all changes are ready to migrate Passwords for privileged users can be different

    Passwords for connection pools can be different

  • 8/10/2019 Migration Caching

    10/23December 4, 2008 10

    Web Catalog Migration

    Do not copy physical filesAll or nothing

    Why?

    See Security Presentation Exceptions

    Saved data formats /system/metadata

    Cannot use Catalog Manager because objectsare owned by system account

  • 8/10/2019 Migration Caching

    11/23December 4, 2008 11

    Migrating with Catalog Manger

    Catalog Manager is a Windows only tool On-line changes only with Linux environment

    Tool allows connection to multiple catalogs Toolallows copy paste method Copy is an additive process ONLY

    Remember to delete objects in target environment

    Copies permissions between environments Set Paste ACL preference

    Groups need to be created first

    In both presentation and metadata

    Allows selection of multiple objects

    Allows for Smart Rename (fix refs)

  • 8/10/2019 Migration Caching

    12/23December 4, 2008 12

    Screen Shot of Web Catalog

  • 8/10/2019 Migration Caching

    13/23

    December 4, 2008 13

    Migration Tips

    Only migrate Shared folder and sub-folders

    Delete-copy-paste is best but requires

    outage Is there a new Subject Area?

    Must log into Answers and view the subjectarea Subject Area privileges are not available until

    someone accesses it

  • 8/10/2019 Migration Caching

    14/23

    December 4, 2008 14

    Questions?

  • 8/10/2019 Migration Caching

    15/23

    December 4, 2008 15

    What Caches?

    Browser

    Presentation Services

    BI Server

  • 8/10/2019 Migration Caching

    16/23

    December 4, 2008 16

    Cache Management Requirements

    We want to use cache to improveperformance

    Warehouse refreshes daily

    Different business areas refresh at

    different intervals

  • 8/10/2019 Migration Caching

    17/23

    December 4, 2008 17

    What options did we not use?

    Physical Layer Tables Set to expire at a given interval

  • 8/10/2019 Migration Caching

    18/23

    December 4, 2008 18

    Clearing the Cache Manually

    Presentation Services Refresh icon on Dashboard

    Clear My Selections

    Manage Sessions

    Session Management Close all Cursors

    Clear BI Server cache

    BI Server

    Repository -> Manage ->Cache

    Purge

    Changes to the Business Model

    Restart BI Server

  • 8/10/2019 Migration Caching

    19/23

    December 4, 2008 19

    Clearing the Cache Automatically

    Physical Layer Set to never expire

    Tables in the warehouse PolyData Stats table with last load date

    Business Model to Stats table name mapping

    View joining these tables

    Initialization block sets dynamic repository variables 10 minute refresh

    Multiple variables in single init block

    Business Model logical column associated with thevalue of the repository variable

  • 8/10/2019 Migration Caching

    20/23

    December 4, 2008 20

    Automated Cache Clearing

  • 8/10/2019 Migration Caching

    21/23

    December 4, 2008 21

    The Magic Behind Automated

    Cache Clearing

    Data Warehouse job completes andupdates PolyData Stats table

    The initialization block changes the

    repository variable value The Logical Column value is changed

    Changing the value is considered achange to the business model

    Therefore the cache clears!

  • 8/10/2019 Migration Caching

    22/23

    December 4, 2008 22

    Questions?

  • 8/10/2019 Migration Caching

    23/23

    December 4 2008 23

    Contact

    OBIEE Technical Conference:http://polydata.calpoly.edu/dashboards/obiee_conf/index.html

    Email: [email protected]

    http://polydata.calpoly.edu/dashboards/obiee_conf/index.htmlhttp://polydata.calpoly.edu/dashboards/obiee_conf/index.html