1
Data1 Log Data1 Data1 Log Data Log Data Log Data 16K Mich Talebzadeh [email protected] Version 1, Jan 2012 User 1 Log Cache Shared Memory Named Cache * 16K buffer pool * ASE Static Overhead Procedure Cache Short term memory needs Others Hash Values 64K buffer pool * - Object Permissions - Column Stats Sybase Open Client Engine 0 Registers File Descriptors/channels CPUs CPUs Stored procedures Triggers Cursors Log Cache Runnable Task Queue Sleep Queue Lock Chains Running Task User N Log Cache Execution Plans - Procedures - Views ASE Executable Total Physical Memory (read-only) Maximum Memory (Dynamic) Fork Fork Engine 1 Registers File Descriptors/channels Running Task ASE Executable Engine N Registers File Descriptors/channels Running Task ASE Executable Sybase Open Client Application Server Client PC Spare Capacity ASE Internal Threads Checkpoint Worker(s) Main ASE checkpoint process. Shutdown Deadlock Tune Checks periodically for deadlocks Mirror Handler Disk mirroring. Handles ASE specific mirroring ASTC Handler(s) Intra-server cross database two-phase commit Checkpoint Sleep Performs periodic checkpoints HK Wash Housekeeper job. Washes dirty buffers. Runs at CPU idle time HK GC Housekeeper job. Garbage collector, example deleted rows HK Chores Flushes table and account statistics. Handles timeout of detached transactions Port Manager Enables Dynamically to start and stop listeners on any given port on a per-engine basis Network Handler(s) There are as many network handler threads as there are ‘master' entries in the interfaces file master System Catalogue & MDA Tables model Template database sybsystemprocs System stored procedures sybsystemdb Two-phase Commit sybsecurity ASE Audit tempdb Temporary Work Area Additional tempdbs System Databases Backup Server Tape ASE Job Scheduler ASE Config File ASE Run Server File ASE Error log File Inter- faces File XP Server User Databases Shrinkable syslogs Data Cache Overhead ULC, One Logical Page each ASE Internal threads can run on any engine Task queue cycle 1- Sleep queue 2- Runnable task queue 3- Running (on any Engine) 4- Sleep queue Data Cache (with default 8K page example) User 1 User 1 thread initiates “group commit” and flushes the Log Cache MRU Wash Marker LRU tempdb Cache * Spinlock default data cache Operating System Hash Table MRU/LRU strategy. Asynchronous Write of dirty buffers after the Wash Marker Buffer ageing C D D D 1 Initial Network Handshake by any engine 3 Master Device Network affinity migration to the least loaded engine 2 Partitioned cache sybsystemprocs device tempdbs, on separate data & log devices. On file systems with dsync false User databases are built on separate data and log devices. Databases can share multiple devices and a device can have fragments from multiple databases Separate data and log devices Hot local or remote compressed backups. Password protected. Cross- platform dump and load capability ASE recommends raw devices. tempdbs can be on file systems, tmpfs or ramdisks Free Memory To another ASE Pending I/O - Process Waiting for I/O - Process Waiting for lock - Process sent to sleep LRU Strategy MRU (fetch-and- discard) strategy C C D C Transportable databases Rep Agent * picks up replicated data Syslogshold table (Dynamic) Oldest open transaction Disk Offline Engines License Heartbeat Checks and synchronizes licensing information with License Server License Server * indicates optional setup PLC Flusher * In Asynchronous log service, it flushes the User Log Cache to the Log Cache Log Writer * In Asynchronous log service it flushes the Log Cache to disk Statement Cache Saved abstract plans IMDB Cache * In-memory database * Data Compression * Sybdiag * Default page size buffer

Ase15 7 Architecture

Embed Size (px)

DESCRIPTION

Ase15 7 Architecture

Citation preview

Page 1: Ase15 7 Architecture

Data1

Log

Data1

Data1

Log

Data

Log

Data

Log

Data

Log Cache

16K

Mich [email protected] 1, Jan 2012

User 1 Log Cache

Shared Memory

Named Cache *16K buffer pool *

ASE Static Overhead

Procedure Cache

Short term memory needs

Others

Hash Values

64K buffer pool *

- ObjectPermissions

- Column Stats

Sybase Open Client

Engine 0Registers

File Descriptors/channels

CPUs CPUs

Stored procedures

TriggersCursors

Log Cache

Runnable Task Queue Sleep Queue Lock Chains

RunningTask

User N Log Cache

Execution Plans- Procedures- Views

ASE Executable

Tota

l Phy

sica

l Mem

ory

(rea

d-on

ly)

Max

imum

Mem

ory

(Dyn

amic

)

Fork

Fork

Engine 1Registers

File Descriptors/channelsRunning

Task

ASE Executable

Engine NRegisters

File Descriptors/channelsRunning

Task

ASE Executable

Sybase Open Client

Application ServerClient PC

Spare Capacity

ASE Internal ThreadsCheckpoint Worker(s)

Main ASE checkpoint process.

Shutdown

Deadlock TuneChecks

periodically for deadlocks

Mirror Handler

Disk mirroring. Handles ASE

specific mirroring

ASTC Handler(s)Intra-server

cross database two-phase

commit

Checkpoint Sleep

Performs periodic

checkpoints

HK WashHousekeeper job. Washes dirty buffers. Runs at CPU

idle time

HK GCHousekeeper job. Garbage

collector, example

deleted rows

HK ChoresFlushes table and account

statistics. Handles timeout

of detached transactions

Port Manager

Enables Dynamically to start and stop listeners

on any given port on a per-engine basis

Network Handler(s)There are as many

network handler threads as there are ‘master' entries in the interfaces file

masterSystem

Catalogue &MDA Tables

modelTemplate database

sybsystemprocsSystem stored

procedures

sybsystemdbTwo-phase

Commit

sybsecurityASE Audit

tempdbTemporary Work

Area

Additional tempdbs

System Databases

Backup Server

Tape

ASE Job Scheduler

ASE Config

File

ASE Run

Server File

ASE Error log

File

Inter-faces File

XP Server

Standby Engine(s)Standby Engines

User DatabasesShrinkable

syslogs

Data Cache Overhead

ULC

, One

Log

ical

Pag

e ea

ch

ASE Internal threads can run on any engine

Task queue cycle1- Sleep queue2- Runnable task queue3- Running (on any Engine)4- Sleep queue

Data Cache (with default 8K page example)

User 1User 1 thread initiates “group commit” and flushes the Log Cache

MRU Wash Marker LRU

tempdb Cache *

Spinlockdefault data cache

Operating System

Hash TableM

RU

/LRU

strategy.

Asynchronous Write of dirty

buffers after the Wash M

arker

Buffer ageing

C D D D

1

Initial Network Handshake by any

engine

3

Master Device

Network affinity migration to the least

loaded engine2

Partitioned cache

sybsystemprocs device

tempdbs, on separate data & log devices. On file systems with dsync false

User databases are built on separate data and log devices. Databases can share multiple devices and a device can have fragments from multiple databases

Separate data and log devices

Hot local or remote compressed backups. Password protected. Cross-platform dump and load capability

ASE recommends raw devices. tempdbs can be on file systems, tmpfs or ramdisks

Free Memory

To another ASE

Pending I/O

- Process Waiting for I/O- Process Waiting for lock- Process sent to sleep

LRU Strategy MRU (fetch-and-discard) strategy

CCD C

Transportabledatabases

Rep Agent *picks up

replicated data

Syslogshold table(Dynamic)

Oldest open transaction

Disk

Offline Engines

License Heartbeat

Checks and synchronizes

licensing information with License Server

License Server

* indicates optional setup

PLC Flusher *In Asynchronous log

service, it flushes the User Log Cache

to the Log Cache

Log Writer *In Asynchronous

log service it flushes the Log Cache to disk

Statement CacheSaved abstract plans

IMDB Cache *

In-memory database *

DataCompression *

Sybdiag *Default page size buffer