Bench Marking on Web Server for Budget 2008 Day

Embed Size (px)

Citation preview

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    1/31

    MALAYSIAN PUBLIC SECTOR

    OPEN SOURCE SOFTWARE (OSS)

    PROGRAMME

    BENCHMARK/EVALUATION REPORT

    on WEB SERVERS for BUDGET 2008 DAY

    AUGUST 2008

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    2/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    Copyright

    The government of Malaysia retains the copyright of this document.

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    3/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    Table of Contents

    1.0 EXECUTIVE SUMMARY.....................................................................................................1

    2.0 INTRODUCTION..................................................................................................................12.1 Background ......................................................................................................................12.2 Purpose ............................................................................................................................22.3 Scope .............................................................................................................................3

    2.3.1 Benchmarking activities ............................................................................................32.3.2 Visitor access statistic ..............................................................................................32.3.3 Personnel involved ...................................................................................................4

    3.0 METHODOLOGY ................................................................................................................53.1 Benchmarking methodology ............................................................................................53.2 Visitor access recording and statistic generation ............................................................5

    4.0 BENCHMARKING REPORT ...............................................................................................6

    4.1 Benchmarking Activities..................................................................................................64.1.1 Experimental Setup ..................................................................................................64.1.2 Test System Specification And Configuration ...........................................................74.1.3 Commands Used ......................................................................................................7

    4.2 Result of Benchmarking Exercise ..................................................................................94.2.1 Apache Web Server 2.2.3 .........................................................................................94.2.2 Lighttpd Web Server 1.4.15-1 ................................................................................10

    4.3 Proposed Infrastructure Solution ...................................................................................115.0 BUDGET DAY SERVER OPERATION REPORT .............................................................13

    5.1 Server Preparation Activities .......................................................................................135.2 Production Server Setup & Configuration ...................................................................13

    5.2.1 Sysctl.conf ..............................................................................................................135.2.2 Synchronization scripts ..........................................................................................14

    5.3 Budget Day Operation Report .....................................................................................175.4 Visitors Statistic For The Budget Day ..........................................................................17

    5.4.1 General statistic ......................................................................................................175.4.2 Visitors per hour......................................................................................................185.4.3 Visitors by countries (Top 20) .................................................................................195.4.4 Visitors by operating system types..........................................................................205.4.5 Visitors by browser types.........................................................................................20

    6.0 BENEFITS OF OSCC'S PARTICIPATION ........................................................................217.0 CONCLUSION ..................................................................................................................22

    8.0 APPENDICES ..................................................................................................................248.1 Snapshot Treasury Portal during the Budget Day .........................................................248.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo embedded ...........258.3 Snapshot of Awstats reports...........................................................................................268.4 Snapshot of appreciation letter from MOF.....................................................................27

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    4/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    1.0 EXECUTIVE SUMMARY

    This document is designed to provide detailed report of all exercises done by OSCC during

    their participation in preparing a dedicated web server for the Budget 2008 presentation day

    conducted by the Ministry Of Finance (MOF). Due to a massive visitor access spike projected

    during the budget day, OSCC team has been assigned to propose, set up and maintain a web

    server infrastructure solution based on Open Source technology that is reliable to handle the

    visitor surge, secure and cost saving. This solution is meant to replace the solution adopted

    by MOF for the past years that are too expensive and complex. The solution provided by

    OSCC has successfully performs reliably and receives more than 130,000 page views

    without any problem. The solution also saves MOF a huge amount of money as it eliminates

    the need of expensive hardwares and it only uses a single unit of server equipped with free

    Open Source softwares. All activities, findings and information will be presented in detail

    within this report which will be used as source of reference for similar implementation in the

    future.

    2.0 INTRODUCTION

    2.1 Background

    Over the years Ministry Of Finance's (MOF) website (http://www.treasury.gov.my) receives a

    huge number of web accesses particularly during the national budget day presentation. These

    spikes of requests were caused by a large number of visitors trying to get information

    concerning the upcoming year's budget and also downloading the Malaysia Economic

    Reports in digital format documents. Visitors also access the website to get information about

    the live video broadcast of the presentation, and for this purpose the treasury website only

    provide a web URL to a third party portal that handles the web broadcast. For the past years

    OSCC had involved whether directly or indirectly in providing consultancy and human

    expertise in preparing a suitable server solution for the budget presentation day. It was

    Page 1

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    5/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    reported that in 2005, during the Malaysian Budget 2006 presentation day, such huge visitor

    accesses had caused the web server to stall due to the excessive load congesting the server

    resources. This event had caused denial of service state to the server thus causing failure of

    web access requests to the visitors. To prevent the situation from happening again, for the

    Malaysian Budget 2007 presentation day in 2006, drastic approaches have been taken. An

    alternative server infrastructure consists of several unit of servers with load balancing

    approach was implemented to substitute the actual web server only for the budget days

    period. This solution was installed a few days prior to the budget date and being

    decommissioned several days after once visitor access numbers back to normal day to day

    routine. The solution had proven to be reliable as there are no denial of access reported but

    for MOF's view, it was somewhat too expensive and too complicated and they are seeking for

    a more practical and economical approach for the next national budget day. In August 2007,

    OSCC once again been invited to provide consultancy and to facilitate the preparation

    process for the Malaysian Budget 2008 presentation day. Both R&D and Technical Unit of

    OSCC involved cooperatively to propose, design, install and operates a suitable server

    solution for the budget day.

    2.2 Purpose

    The purpose of this document is to:-

    1. Identify suitable web server infrastructure solution to be applied by Ministry Of Finance

    for the Budget 2008 presentation day

    2. To identify whether or not a server load balancing formation is needed to handle high

    web access request on the particular day

    3. To determine which type of web server package to be used

    4. To provide reports of operations initiated during the actual budget presentation day

    5. To present web access statistic captured for the whole budget day

    6. To table any related findings gathered during and after the operation day

    Page 2

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    6/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    The testing is not in any way done to declare which web server application is better compared

    to others, but merely to find which solution is the most suitable within the scope of our specific

    requirement. Therefore, any results, findings and recommendation provided in this report

    should not be considered as a generalized head to head comparison.

    2.3 Scope

    2.3.1 Benchmarking activities

    Only two web servers software were selected to be the testing subjects which were Apache

    (http://www.apache.org) and Lighttpd (http://www.lighttpd.net). All testing activities were done

    on machines with the same hardware specifications, identical operating systems and similar

    configurations and performance tuning settings. All testing were done in a lab located in

    OSCC. All network connections were Local Area Network in nature which means that

    maximum network bandwidth should be approximately 100Mbps.

    2.3.2 Visitor access statistic

    This report examines visitor activity log data for the website www.treasury.gov.my only for thebudget presentation day which is on the 7th September 2007. Only genuine human visitor will

    be counted in the analysis and no visits or page hits by automated robots such as crawler,

    bots and external data mining agents will be used within this report.

    Due to the internet nature of 'the world without boundaries', visitor origins in the analysis will

    be from all over the world which is not limited to specific geographical location. Data that will

    be taken into consideration are hourly unique visitors and visitors which are divided by

    countries. The analysis will also provide comparison between operating system types andinternet browser types to estimate the percentage in term of users who are using open source

    technologies.

    Page 3

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    7/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    2.3.3 Personnel involved

    Both RND and technical teams were involved directly with this project. There were also a

    number of personnel from MOF participate in various activities throughout the server

    benchmarking, server preparation and during operation day.

    OSCC personnel involved in the benchmarking activities:

    1. Haris (R&D Unit)

    2. Jamal (R&D Unit)

    3. Hisham (Technical Unit)

    4. Azizul (Technical Unit)

    5. Maisarah (R&D Unit)

    6. Indhran (R&D Unit)

    OSCC personnel involved for the server preparation and operation day:

    1. Haris (R&D Unit)

    2. Jamal (R&D Unit)

    3. Hisham (Technical Unit)

    4. Azizul (Technical Unit)

    Page 4

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    8/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    3.0 METHODOLOGY

    3.1 Benchmarking methodology

    The benchmarking activities were done using an open source web server stress test tool

    called ApacheBench (AB). ApacheBench is a command line computer program for measuring

    the performance of HTTP web servers, in particular the Apache HTTP Server. It was designed

    to give an idea of the performance that a given Apache installation can provide. In particular, it

    shows how many requests per second the server is capable of serving. A series of testing

    were done on each test subject and the results were recorded. On each occasion, a number

    of connections and quantity of concurrency were pre-determined. If the test finished

    successfully, meaning all request been served effectively by the test subject without any failed

    or denied request, the number of concurrency will be increased and another round of test will

    be done. The procedures were repeated until the subject matters fail to serve. This would

    mean that the limit of connection that the particular web server can handle has been found.

    By using this method, a comparison can be made on which web server has the capability to

    serve the highest number of connections and maintain availability through sudden spike of

    visitor access.

    3.2 Visitor access recording and statistic generation

    Throughout the operation process including the budget presentation day, no additional

    monitoring tools were used on the web server rather than the conventional web server log

    capability provided by both Apache and Lighttpd. This is to minimize resource usage of the

    particular server to keep the free of unnecessary overhead. The web server logs are kept in

    the access_log. Analyses were done to the log after the budget day to generate meaningful

    statistic using an open source log analyzer tool called Awstat (http://awstats.sourceforge.net).

    AWStats is a free powerful and featureful tool that generates advanced web, streaming, ftp or

    mail server statistics, graphically. This log analyzer works as a CGI or from command line and

    shows you all possible information your log contains, in few graphical web pages. It uses a

    partial information file to be able to process large log files, often and quickly. It can analyze

    Page 5

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    9/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    log files from all major server tools like Apache log files (NCSA combined/XLF/ELF log format

    or common/CLF log format), WebStar, IIS (W3C log format) and a lot of other web, proxy,

    wap, streaming servers, mail servers and some ftp servers.

    4.0 BENCHMARKING REPORT

    4.1 Benchmarking Activities

    4.1.1 Experimental Setup

    A series of benchmarking activities were done using the Apache Bench tool. 2 servers with

    identical hardware specification, Operating System and configurations were installed

    with Apache and Lighttpd respectively.

    Machine A :

    IP address : 10.20.20.51

    Apache 2.2.3

    Machine B :

    IP address : 10.20.20.52

    Lighttpd 1.4.15-1

    Another machine was being set up as the testing terminal where the benchmarking and stress

    test tool will be executed. This machine was equipped with the Apache Bench Tool.

    Page 6

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    10/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    4.1.2 Test System Specification And Configuration

    All machines specification are identical. Using the same hardware model, operating system

    and configurations.

    Maker Model HP DC770

    Processor Intel(R) Pentium(R) D CPU 3.20GHz

    RAM 512 MB

    Hard Disk 40 GB

    Operating System Linux CentOS 5

    4.1.3 Commands Used

    Command used to launch the benchmarking process

    ab n 10000 c xxx http://ipaddress/

    Where :-

    n is the number of connections to be generated during the test emulating the number of web

    access estimated to be received by the server within a specific timeframe (approximately

    below 20 seconds) during the budget day. The value 10000 was pre-determined by the

    team as the appropriate number of estimated connection judging by the projected number of

    web access for the upcoming budget day based on the past years pattern.

    c is the number of concurrent connection that will take place during the series of tests. This

    is the most crucial element within the benchmarking activities, understanding that the aspect

    of availability should be the highest priority in the choosing the most suitable solution. For

    each round of testing, the number of concurrent connection will be increased until error

    encountered which signals the actual limit where the web server capable of serving.

    Example : ab n 10000 c 500 http://10.20.20.52/

    *Testing the Machine B with 10000 number of connection with 500 number of concurrency.

    During the test, system resource utilization was monitored and logged using vmstat

    Page 7

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    11/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    command. This was to find any spike of resource usage or any occurrence of I/O bottleneck.

    Several data that were closely monitored were:

    CPU Idle To determine whether any excessive CPU usageoccurred during the stress test process. High CPU

    Idle status means that the system is healthy

    Free Memory To determine whether any excessive RAM usage

    occurred during the stress test process. High Free

    Memory status means that the system is

    healthy

    Page 8

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    12/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    4.2 Result of Benchmarking Exercise

    4.2.1 Apache Web Server 2.2.3

    Number of request (n) = 10,000

    On each test round, Apache failed to surpass 400 concurrency connection level.

    Page 9

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    13/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    4.2.2 Lighttpd Web Server 1.4.15-1

    Number of request (n) = 10,000

    Page 10

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    14/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    Based on the above results, it is clear that Lighttpd capable of handling larger number of

    concurrent web requests compared to Apache when it comes to serving static web contents.

    The above rounds of tests were repeated a few times but the outcome persists. In addition,

    the team also tried a larger number of requests to the Lighttpd server which was supposedly

    beyond the scope of testing by increasing the n number and the c number and lighttpd

    proves to have the ability to withstand them.

    4.3 Proposed Infrastructure Solution

    Based on the results of the testing, the team has decided to opt for Lighttpd as the web server

    to use. We are confident that a single server with adequate hardware specification, equipped

    with Lighttpd could withhold the high number of web access requests during the budget day

    provided that the server only servers static contents without any server side scripting nor any

    king of database connectivity involved. To make sure that the server uses resources efficiently

    and to increase stability, several modifications and fine tuning configurations will be done to

    the production server. These include CPU & RAM allocation and kernel optimization tuning.

    Unneeded services were also turned off minimize resource overhead. All software installation,

    modification and tuning processes will be done by OSCC with assistance of MOF personnel.

    In addition, one unit of standby server will be also placed alongside the production server for

    Page 11

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    15/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    contingency measure such as in the event of hardware failure to the primary server. The

    standby server also has the same configuration and contents as the production server with

    almost identical hardware specification. The team had also suggested the use of multiple

    servers located in different data centers if in case large binary files such as 'self extracting

    compilation of economic reports' were going to be served and made available to the public as

    what have been done in the previous years. Those servers will act as the alternatives

    download locations listed as download links within the download page in the main portal,

    where visitors can choose from. This method will reduce the burdens of the primary portal.

    Those server were also equipped with Lighttpd where minimal hardware specification as low

    as a Personal Computer (PC) specification could be used.

    Based on mutual agreement with MOF, three alternative download locations were identified.

    Those three servers are:

    The standby server which are located in NetMyne Datacenter alongside primary server

    One unit of server located at Ministry of Finance

    One unit of server located at OSCC

    A simple bash script was created to handle synchronization among servers to make sure that

    all servers have the same up-to-date web contents. The scripts will be provided in the later

    part of this document.

    *** However during the budget day, none of the alternative download servers were utilized, as

    there are no large binary files were served by MOF, and the main server showed no indication

    of congestion and it's resource utilization were successfully kept at the very minimum.

    Page 12

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    16/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    Overview of the proposed server structure for Budget 2008 presentation day

    Page 13

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    17/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    5.0 BUDGET DAY SERVER OPERATION REPORT

    5.1 Server Preparation Activities

    All servers has been freshly installed with Linux CentOS 5 one week before the actual event.

    Several round of stress test were done on all machines to make sure they don't have any

    problem particularly on the hardware aspect. An overnight stress test also have be done using

    combination of AB stress tool and cron job to make sure that the servers are stable.

    5.2 Production Server Setup & Configuration

    5.2.1 Sysctl.conf

    Exact file location: /etc/sysctl.conf

    #additional parameter to increase performancekernel.shmmax = 436883456

    kernel.shmall = 268435456

    kernel.sem = 500 51200 64 2048

    kernel.shmmni = 4096

    fs.file-max = 65536

    net.core.rmem_default = 262144

    net.core.wmem_default = 262144

    net.core.rmem_max = 262144

    net.core.wmem_max = 262144

    net.ipv4.ip_local_port_range = 1024 65000

    kernel.msgmni = 2048

    kernel.msgmax = 65536

    vm.page-cluster = 20

    net.ipv4.tcp_rmem = 4096 87380 16777216

    net.ipv4.tcp_wmem = 4096 87380 16777216

    net.ipv4.tcp_tw_reuse = 1

    Page 14

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    18/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    5.2.2 Synchronization scripts

    The main script (called via command line at the primary server by the system administrator)

    Exact file location: /usr/local/bin/rsync-mof

    #!/bin/bash# mirror-script.sh# created by Jamalif [ $(whoami) = bajet08 ]; then

    echo -e "\n\nProcess started. Please wait..."/usr/local/bin/rsync-mdec2sleep 1/usr/local/bin/rsync-oscc

    sleep 1/usr/local/bin/rsync-treasuryecho -e "Process finished\n\n"

    elseecho -e "Denied: Only bajet08 user can run this script\n"

    fi

    The above script will launch three series of rsync instances.

    /usr/local/bin/rsync-mdec2

    #!/bin/sh# mirror-script.sh# created by JamalDATE=`/bin/date +%y%m%d-%H%M%S`OUTFILE=/var/log/mirror/mdec2-$DATE.logdate >> /var/log/mirror/mdec2-exec.logif [ -f "/home/bajet08/rsync-mof.pid" ]; then

    RUNPID=`cat /home/bajet08/rsync-mof.pid`if ps -p $RUNPID; then

    echo "Mirror is already running..."

    echo "Mirror is already running..." >> /var/log/mirror/mdec2-exec.log

    exit 1else

    echo "Mirror pid found but process dead, cleaning up">> /var/log/mirror/mdec2-exec.log

    fi

    Page 15

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    19/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    elseecho "No process Detected" >> /var/log/mirror/mdec2-exec.log

    fiecho $$ > /home/bajet08/rsync-mof.pidecho -n "MDEC2 Server Mirroring Started at "echo "Mirror Started " >> /var/log/mirror/mdec2-exec.logdate#$rsync $mirror $local > $OUTFILE 2>&1/usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no-i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \

    /var/www/html/ 202.75.59.26:/var/www/html > $OUTFILE 2>&1

    /usr/local/bin/rsync-oscc

    #!/bin/sh# mirror-script.sh# created by JamalDATE=`/bin/date +%y%m%d-%H%M%S`OUTFILE=/var/log/mirror/oscc-$DATE.logdate >> /var/log/mirror/oscc-exec.logif [ -f "/home/bajet08/rsync-mof.pid" ]; then

    RUNPID=`cat /home/bajet08/rsync-mof.pid`if ps -p $RUNPID; then

    echo "Mirror is already running..."

    echo "Mirror is already running..." >> /var/log/mirror/oscc-exec.logexit 1else

    echo "Mirror pid found but process dead, cleaning up">> /var/log/mirror/oscc-exec.log

    fielse

    echo "No process Detected" >> /var/log/mirror/oscc-exec.logfiecho $$ > /home/bajet08/rsync-mof.pidecho -n "OSCC Server Mirroring Started at "echo "Mirror Started " >> /var/log/mirror/oscc-exec.logdate/usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no-i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \

    /var/www/html/ 210.187.27.213:/var/www/html > $OUTFILE 2>&1

    Page 16

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    20/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    /usr/local/bin/rsync-treasury

    #!/bin/sh# mirror-script.sh# created by JamalDATE=`/bin/date +%y%m%d-%H%M%S`OUTFILE=/var/log/mirror/treasury-$DATE.logdate >> /var/log/mirror/treasury-exec.logif [ -f "/home/bajet08/rsync-mof.pid" ]; then

    RUNPID=`cat /home/bajet08/rsync-mof.pid`if ps -p $RUNPID; then

    echo "Mirror is already running..."echo "Mirror is already running..." >> /var/log/mirror/treasury-

    exec.logexit 1

    elseecho "Mirror pid found but process dead, cleaning up"

    >> /var/log/mirror/treasury-exec.logfi

    elseecho "No process Detected" >> /var/log/mirror/treasury-exec.log

    fiecho $$ > /home/bajet08/rsync-mof.pidecho -n "Treasury Server Mirroring Started at "

    echo "Mirror Started " >> /var/log/mirror/treasury-exec.logdate/usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no-i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \

    /var/www/html/ 202.75.6.53:/var/www/html > $OUTFILE 2>&1

    Page 17

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    21/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    5.3 Budget Day Operation Report

    Several OSCC staffs have been located at all critical points where the servers reside. Each of

    them will monitor the log files activity of each server for any kind of problem. Live report file

    uploading processes were done by MOF's staff directly to the primary server and the

    synchronization scripts will distribute and duplicate the changes to other backup servers.

    There are no occurrence of error detected for the whole day and the backup servers were not

    utilized at all as the primary server shows any symptom of resources drainage.

    5.4 Visitors Statistic For The Budget Day

    Below is the visitor statistic collected during the Budget 2008 Presentation Day which was

    held on 7th September 2007. All data were taken from web access log and was analyzed

    using Awstats. Only the primary server was used during that day, therefore all statistics shown

    here are purely from a single server.

    5.4.1 General statistic

    Date : 7th September 2007

    Total number of unique visitors 9, 874Total number of visits 12, 796 (1.29 visits/visitor)

    Total number of pages viewed 130, 398 (10.19 Pages/Visit)

    Total number of hits generated 519, 184 (40.57 Hits/Visit)

    Total bandwidth consumed 4.58 GB (374.95 KB/Visit)

    Page 18

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    22/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    5.4.2 Visitors per hour

    Hours Pages Hits Bandwidth

    00:00 am 282 1263 7,619,401

    01:00 am 145 601 4,713,187

    02:00 am 114 486 3,400,969

    03:00 am 96 377 2,695,992

    04:00 am 56 160 973,597

    05:00 am 45 144 1,096,283

    06:00 am 110 504 3,377,156

    07:00 am 671 3,800 18,702,079

    08:00 am 1,979 10,428 56,068,174

    09:00 am 2,505 11,851 70,603,683

    10:00 am 2,739 12,972 79,936,375

    11:00 am 3,046 14,192 79,977,401

    12:00 pm 2,192 10,347 59,969,313

    01:00 pm 1,626 7,457 44,138,365

    02:00 pm 5,388 23,544 142,280,704

    03:00 pm 16,097 76,505 393,637,888

    04:00 pm 32,647 150,655 580,046,848

    05:00 pm 28,605 104,234 1,040,812,032

    06:00 pm 12,070 33,375 835,983,360

    07:00 pm 5,166 16,029 343,683,072

    08:00 pm 3,335 11,222 264,849,408

    09:00 pm 5,187 12,175 405,623,808

    10:00 pm 4,551 10,335 380,430,336

    11:00 pm 1,746 6,529 92,384,038* The above data doesn't includes traffic generated by robots, worms,

    or replies with special HTTP status codes.

    Page 19

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    23/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    5.4.3 Visitors by countries (Top 20)

    No Country Pages Hits Bandwidth

    1. Malaysia 119,908 485,441 4.29 MB

    2. United States 2,559 7,589 59.42 MB

    3. Singapore 2,468 6,838 61.50 MB

    4. Japan 1,125 3,672 20.01 MB

    5. Australia 715 2,862 22.97 MB

    6. India 551 953 45.21 MB

    7. Hong Kong 541 2,103 12.63 MB

    8. European country 439 1,640 14.87 MB

    9. Great Britain 379 1,422 17.34 MB

    10. France 191 755 3.86 MB

    11. Indonesia 179 636 4.95 MB

    12. China 161 672 3.30 MB

    13. Germany 154 466 3.92 MB

    14. South Korea 134 646 2.31 MB

    15. Philippine 74 198 1.62 MB

    16. Taiwan 67 290 1.97 MB

    17. New Zealand 61 278 1.24 MB

    18. Qatar 48 141 1.56 MB

    19. Switzerland 45 224 1.22 MB

    20. United Arab Emirates 42 177 0.53 MB

    Page 20

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    24/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    5.4.4 Visitors by operating system types

    Operating Systems Hits Percent

    1. Windows 500,848 96.40%

    2. Unknown 14,574 2.80%

    3. Macintosh 1,829 0.30%

    4. Linux 1,559 0.30%

    5. Symbian OS 332 0%

    6. Sun Solaris 42 0%

    5.4.5 Visitors by browser types

    Browsers Hits Percent

    1. MS Internet Explorer 445,607 85.80%

    2. Firefox 54,316 10.40%

    3. NetAnts 10,638 2.00%

    4. Mozilla 2,244 0.40%

    5. Unknown 1,919 0.30%

    6. Opera 1,826 0.30%7. Safari 1,764 0.30%

    8. Netscape 570 0.10%

    9. RssReader (RSS Reader) 82 0%

    10. K-Meleon 37 0%

    11. Others 181 0%

    Page 21

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    25/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    6.0 BENEFITS OF OSCC'S PARTICIPATION

    Benefits for OSCC

    1. OSCC gained significant visibility during Budget Day 2008 by having its logo

    embedded within the treasury.gov.my website from 2.00pm until 5.00pm. More than

    250,000 hits generated during that time-frame.

    2. Valuable knowledge based on research about comparison between 2 open-source web

    server (Apache/Lighttpd).

    3. Data will be used for OSCC OSS benchmarking reports as part of RND department

    deliverables

    4. Transfer of technology, exposure and knowledge sharing about Open Source

    technology to MOF.

    5. Providing solid proof about reliability, flexibility and future potential of open source

    products .

    6. Valuable lessons and experience for all OSCC Technical and RND department staffs .

    7. Helping MOF in substantially reducing the total cost for preparing budget day servercompared to previous years.

    Page 22

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    26/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    7.0 CONCLUSION

    Overall, our recommended server infrastructure solution performs reliably in serving such high

    number of web access for the www.treasury.gov.my portal during the budget 2008

    presentation day. All requests were successfully served and the server did not encounter

    any kind of problem such as network congestion or service interruption during the production

    period. The resource utilization of the server also kept at very minimum with majority of the

    system resources such as CPU and RAM were underutilized which means that the same

    setup could theoretically handles even larger number of web access request in the future if

    the same infrastructure solution and practices were to be reused.

    Both MOF and OSCC have gained valuable experiences and knowledge throughout each of

    the project phase especially during the benchmarking, installation and production phase.

    Those knowledge and experience would be helpful in improving OSCC operation most

    importantly in the technical aspects in the future. The benchmarking activities have provided

    valuable knowledge especially in realizing the solidness of open source web server products

    particularly for Lighttpd web application. Although the team did not took the results as

    absolute declaration of which web server is the better compared to others as there a a lot of

    external variables should be considered in making any justification, nevertheless it was a

    good indicator of the wide variety of possibilities offered by the open source world where there

    are so many alternatives to choose from in catering any specific needs.

    Based on number of visitors divided by operating system types and internet browser types,

    Microsoft has proven that they dominated the operating system and internet browser

    application market especially for desktop workstation among the internet users particularly in

    Malaysia. This information is crucial to the future strategic planning for OSCC as it could be

    used as a guideline or reference in tabulating the trend of open source usage among the

    Malaysian people. Only 0.30% of the total visitors were using Linux operating system while for

    Page 23

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    27/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    Open Source internet browser, Firefox only manage to achieve slightly above 10%.

    The number is tremendously small compared to the Microsoft and shows that user

    acceptance toward open source technologies for desktop workstation and software

    application is still arguable and majority of computer users are still prefer proprietary products.

    This is also indicates that there are still a large room for OSCC to work on in the future.

    Prepared by: Harifazillah Jamel, OSCC MAMPU

    Page 24

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    28/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    8.0 APPENDICES

    8.1 Snapshot Treasury Portal during the Budget Day

    Page 25

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    29/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    8.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo

    embedded

    Page 26

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    30/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    8.3 Snapshot of Awstats reports

    Page 27

  • 8/14/2019 Bench Marking on Web Server for Budget 2008 Day

    31/31

    MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMMEPhase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

    8.4 Snapshot of appreciation letter from MOF