Upload
cameroon45
View
362
Download
0
Embed Size (px)
Citation preview
Information When and Where It's Needed with Oracle Database 10g
Bob ThomeSenior Manager, Distributed Database
Oracle Corporation
Session id: 40149
Oracle Database 10g – The Database for Grid Computing
Better information faster– Spread work across more resources– Access to resources on demand
Easy alignment of IT resources with business needs
– Dynamic allocation of resources as needed Reduced IT costs
– Improve utilization of existing resources– Utilize less expensive commodity platforms– Consolidate resources to reduce management
costs
Virtual Computing Resources
The Grid enables virtualization of resources across servers, data centers, and enterprises
Types of virtual resources– Network– Storage– CPU– Data
Provisioning technologies the key to unlocking the virtual resources on the Grid
Data Provisioning
Provides access to data when and where you need it
Optimizes information access regardless of physical location of data
Integrates information in distributed environments
Enables virtualization of data in Grids
1986 2002
Oracle Data Provisioning
Oracle Streams
Message Gateways
Enterprise/Generic Gateways
Rules Engine Advanced Replication
Heterogeneous Services
Publish/Subscribe
Advanced Queuing Symmetric Replication
Updateable Snapshots (Replication) Remote Procedure Calls
Read Only Snapshots (Replication)
Gateways to 3rd Parties
Distributed Transactions
Location Transparency
Distributed Query
Grid Computing
Methods of Data Provisioning
Consolidate Information Federate Information Share Information
Methods of Data Provisioning
Consolidate Information Federate Information Share Information
Consolidate Information
Consolidate heterogeneous data into a central database
– Any data (audio, video, XML, email, messages, etc…)
– Any platform (Linux, Windows, Solaris, HPUX, AIX, Tru64, OpenVMS, OS/390)
– Proven scalability Hundreds of Very Large Database customers Industry leading benchmarks
Benefits of Consolidation
Simplest form of Data Provisioning Lower administration costs
– Fewer servers and databases to manage
Faster application deployment– Deploy application once, at central server
Faster access to global data– Queries and DML run faster against centralized
data
Features
Massive database support Real Application Clusters (RAC) XML Database Virtual Private Database Partitioning LOBs and BFILEs Loading and migration tools And many more…
New
Massive Database
Ultra large database: 8 Million Terabytes Ultra large number of Tablespaces or Files: 64K
– Tablespaces become tapes in a tape rack
Ultra large data files: 4 Terabytes in a single file Ultra large LOB columns: 8 Gigabytes * blocksize
– Essentially unbounded, can store any object
Proven scalability: Hundreds of VLDB customers
New
Methods of Data Provisioning
Consolidate Information Federate Information Share Information
Federate Information
Federate data in multiple data stores into a single virtual database
– Access both Oracle and non-Oracle data– Access both structured and unstructured data– Hide physical location of data from applications
Benefits of Federation
Fast provisioning– Simple changes yield immediate results
Supports provisioning of data that cannot be consolidated
– Legacy applications– Data requiring local ownership
Ad Hoc provisioning to infrequently accessed data
Features Multiple access methods
– Distributed SQL– XQuery
Any data source– Oracle and non-Oracle
data stores– External files– Web services
Advanced indexing technology
Oracle
DB2
XML
Excel
FlatFiles
TextWebServices
Access Remote Databases with Distributed SQL
Access remote data store transparently
– DB Links hide location of remote data store
Access multiple data stores as single DB
– Tables in multiple remote databases appear local
Perform distributed transactions
– automatic two-phase commit– distributed SQL optimizations
Access Data with XQuery
Query structured and semi-structured data– Relational Data– Native XML files
Reduce application complexity XQuery support evolving with emerging
standard
Access Oracle and non-Oracle Data Stores
Heterogeneous data integration built into the Oracle database
– SQL Translation– Data Dictionary Translation– Procedure execution on non-Oracle system
Transparent Gateways– Available for most major non-Oracle data stores (e.g.,
DB2, SQL Server, Sybase, etc.)– Optimized, certified, end-to-end support
Generic Connectivity– Gateway to any 3rd-party ODBC or OLEDB driver
Access External Files
Access native XML Files– Query via XQuery or SQL
Access proprietary file types via filters– Transform into XML files– Over 100 file types supported by supplied filters
Access external tables– Map data in external files into tables
Database Web Services
Web services consumer– Java classes, PL/SQL, triggers call external
services– Web services viewed as SQL data source
Web services provider– Query database via web service– Perform messaging operations– DML Web Services– Call PL/SQL, Java
Full XML support in database
New
Access Web Services as a SQL Data Source
Built-in support for access to web services data
Track, aggregate, refresh, and query dynamic data and data produced on demand
Web
Service C
lient
Fram
ewo
rk (S
OA
P)
Datab
ase Mo
du
le (W
eb S
ervice
Clien
t)
SELECT city_name, temp, low_temp, high_temp FROM TABLE (Temp_TF)
SOAP Request/Response
HT
TP
Clien
t S
tack
Web Service Provider
(e.g., Weather Service)T
able
Fu
nct
ion
New
Locate Information with UltraSearch
Oracle Ultra Search indexes documents across multiple repositories
– Oracle and non-Oracle databases, HTML web pages, files on disk, IMAP mail servers, and more
Search document meta-data as well as content “Normalize” meta-data across multiple data stores Crawl Oracle databases and others that support
ODBC standard
Federation in Action
Hong Kong Ministry of Education
Integrate legacy Sybase applications with new packaged applications running Oracle
Must keep data synchonized in real-time
Solution: Transparent Gateway
Oracle Sybase
PackageApp
LegacyApp
"Oracle Distributed SQL allows us to effortlessly update data in multiple databases as a single
distributed transaction… reducing the burden on our
application developers."
"Oracle Distributed SQL allows us to effortlessly update data in multiple databases as a single
distributed transaction… reducing the burden on our
application developers."
- Charles Farnell, Venture Forth
Methods of Data Provisioning
Consolidate Information Federate Information Share Information
Share Information
Share information between users, applications, and databases
– Move or copy information as needed– Traditionally implemented as replication or
message queuing– Has evolved to include warehouse loading, event
notification, workflow, and EAI
Benefits of Sharing
Greater flexibility– Locate data where you want it– Control access– Share information with business partners
Faster access to local data– Queries and DML run faster against smaller, local data
store
Higher Availability– Applications not dependent on availability of remote data
stores
Information Sharing Features
Streams– Message Queuing– Replication– Workflow– Much more
Materialized Views Transportable Tablespaces Data Pump New
Eliminate Complexity with Oracle Streams
Unifies all enterprise information into a single Stream
– Unifies database, messaging, replication, publish/subscribe APIs and capabilities
Avoids inherent problems with multiple technologies:
– Multiple development models– Multiple operational models– Builders do the integration
Not just a unified branding of different features
Unified Infrastructure for Information Sharing
Rules based Publish/
SubscribePropagation
Directed andSubset
InformationStreams
In streamTransformations
AutomatedCaptureData Data
ChangesChanges
DatabaseDatabaseEventsEvents
ApplicationApplicationMessagesMessages
DataDataFeedsFeeds
DataDataWarehouses Warehouses and Data Martsand Data Marts
UpdateableUpdateableReplicasReplicas
MessagingMessagingApplicationsApplications
StandbyStandbyDatabasesDatabases
Operational Operational Data StoresData Stores
Intelligent, Unified, Intelligent, Unified, Time OrderedTime Ordered
Information StreamInformation Stream
Stream a File or Database
Oracle Streams can move any file– OS File, BFILE, Database File (tablespace)
Create a replica with a single command– Select tablespaces to replicate and DB Link– Automatically create a synchronized copy
Tracks changes at sourceTransports tablespacesApplies changes to destination
Easy to extend/modify configuration– Apply changes from replica to production database– Add data transformations
Offload processing or migrate to the grid
New
Grid migration with no downtime
Migrate to the Grid – Single command moves your database
Migrate between different platform/OS– Cross-platform transportable tablespaces
move data to new database
No downtime– Capture changes at
source during migration– Update new database– Repoint applications
New
Oracle10g Streams Features
Downstream Capture Performance Improvements Manageability Improvements Row Migration enhancements Expanded datatype support RAC Hot mining and failover Simplified messaging APIs Batch Enqueue/Dequeue of messages Automatic preparation for Explicit Dequeue of
messages Tibco Messaging Gateway
New
Share Data with Materialized Views
Data warehousing– Compute and store aggregated
data, such as sums or averages, for faster queries
Mobile computing– Easy mass deployment– Disconnected computing
Replication– Incrementally maintain local
subset of data – Read-only or updateable with
conflict resolution
NYNY(master)(master)
Updateable Materialized Views
Transportable Tablespaces
Unplug and plug database data files– Move and share data without unload and reload– Plug/unplug performance independent of tablespace size– Mount read-only tablespaces on multiple databases– Cross-platform support– Rename Tablespaces
OS copyFile 1 File
2expdat.dmp
File 1 File
2expdat.dmp
2424
New
Data Pump
High speed, parallel, bulk data and metadata movement of Oracle database contents
– Throttle parallelism up or down, stop and restart– Network mode requires no intermediate dump file
Flexible tool for moving or copying subsets of database in the Grid
– Flexible object selection transfers specific objects– Remaps schemas, datafiles and tablespaces– Interactively add files to dump set
Streams compatible– Export objects to new database and use Streams to
synchronize
New
Data Sharing with Streams: Internet Securities, Inc.
Internet Securities, Inc (www.securities.com) provides Internet-delivery of emerging market news and business information
Over 1 Terabyte of content from over 4400 publications (retained since 1988)
Growing by 10,000 documents per day Documents indexed using Oracle Text Increasing customer demand required
performance and availability improvements
Data Sharing with Streams: Internet Securities, Inc.
Replica of Search database maintained using Oracle Streams to improve performance and availability
Queries execute in half the time or better Switchover in case of failure is instantaneous Can scale to additional replicas as demand grows
Streams
Search DB Search DB
"Streams proved to deliver all the
functionality we wanted for a large
scale database replication solution."
"Streams proved to deliver all the
functionality we wanted for a large
scale database replication solution."
-W. Les Wozniak, Rosetta Biosoftware
Network
Provisioning Data in the GridClustered database Instances
SAN 1 SAN 2 SAN 3 SAN 4
BladeRack
Summary
Oracle supports efficient provisioning of data resources:
– Consolidate Information—Scalable access to large amounts of information
– Federate Information—Data can be located where needed but accessed as single database
– Share Information—Multiple users and applications can share data/information to operate more effectively
AQ&Q U E S T I O N SQ U E S T I O N S
A N S W E R SA N S W E R S