PROPRIETARY & CONFIDENTIAL ISV / Software Solutions competency Testing Process with VeriTest November 28th 2005

PROPRIETARY & CONFIDENTIALPROPRIETARY & CONFIDENTIAL

ISV / Software Solutions competency Testing Process with VeriTestISV / Software Solutions competency Testing Process with VeriTest

November 28th November 28th 20052005

© 2003 Lionbridge Technologies, Inc. © 2005 Lionbridge Technologies, Inc.

Agenda

Veritest Overview

Platform Test Specifications

FAQ, Online Registration Process

To get ready & to support the test effort

Resources and Contacts


Lionbridge Technologies: Continues to GrowLionbridge Technologies: Continues to Grow

Stable, Public Company (NASDAQ: LIOX)

- $400M+ in 2005, profitable

- Continued growth expected in 2006

- Recent acquisition of Bowne Global Solutions created one of the world's largest globalization and offshore services company

Global IT Outsourcing Solutions- Application Development & Maintenance

(Lionbridge)

- Content Development, Conversion & Enhancement (Lionbridge)

- Globalization (Lionbridge)

- System, Application, Product, and Localization Testing (VeriTest)

14 of the world’s 20 most valuable companies are Lionbridge customers. BusinessWeek 2004

$0

$50,000

$100,000

$150,000

$200,000

$250,000

$300,000

$350,000

$400,000

$450,000

2002 2003 2004 2005(est.)

Continuing Revenue Growth


VeriTest: Setting the Standard in Testing Since 1987VeriTest: Setting the Standard in Testing Since 1987

World’s largest independent quality assurance and software testing company

- Leading test architects, engineers, and analysts across US, Europe, Asia

- Scalable offshore execution in India and China

- Unmatched, global-networked infrastructure---from 32-way servers to data center class storage lab

Industry leader

- Exclusive provider and architect of industry-leading certification programs

- Developer of PC Magazine benchmarks

- Test and publish industry-standard benchmarks


The Lionbridge TeamThe Lionbridge TeamLocal Connections, Global EfficiencyLocal Connections, Global Efficiency

4,000 Worldwide Staff1,300 in India and ChinaPresence in 25 countriesExperience and Efficiency


Global Program ManagementGlobal Program ManagementGlobal Program ManagementGlobal Program Management

Develop

Test

DeployGlobally

Networked Worldwide InfrastructureNetworked Worldwide Infrastructure

Offshore and OnshoreOffshore and Onshore

Lionbridge Delivers A Unique Set of CompetenciesLionbridge Delivers A Unique Set of Competencies


VeriTest: Independent Quality Assurance and Software TestingVeriTest: Independent Quality Assurance and Software Testing

QA Consulting CertificationPerformanceTesting

InteroperabilityTesting

FunctionalTesting

Test Automation

Localization Testing


Microsoft Technologies

Lead to MS Certified Partner

Validation of platform interaction, ensuring basic ISV commitment. Typically 3-5 days.

Lead to MS GOLD Certified PartnerValidation of platform interoperability, ensuring product meets MS dev standards. Typically 1-6 weeks.

Windows Family XP Home / Pro2000 SRV /2003 SRV Standard Ed. Advanced/Enterprise Ed. Datacenter Ed.

.NET Framework .NET Connected Logo testing* -10 pts

SQL Server 2000 / 2005 Verified for SQL Server 2000

Certified for SQL Server 2000 / 2005

SQL DWA testing60 points

Microsoft MBS, CRM

Microsoft ISA Server

Microsoft MBS Test for ISV Solutions

Microsoft ISA Server Test - 20 pts Benefits may also include one or more of the following: Use of Certification Logo (* only) MS Catalog Listing Other Product Group Benefits

Windows Mobile Designed for Windows Mobile* – 20 pts

Commerce ServerCommerce Server 2002 Integration testing

– 20 pts

Microsoft Global Certification Microsoft Global Certification ProgramsPrograms at VeriTest at VeriTest

MS Platform Test

for ISV solutions

20 pts to 60 ptsCertified for Windows Srv 2003*

60 pointsDesigned for Win XP*

20 pts

Verified for Win 2003 – 10 pts

Verified for Win XP – 10 pts


Agenda

Veritest Overview


Online Registration Process




Platform Test SpecificationsPlatform Test Specifications

The Platform Test consists of two foundation components, and four elective components.

A software application is required to pass two components of the Platform Test, includingat least one foundation component.

The foundation components are the Windows Server and Windows Client components : Win Server 2003* , Win XP. The elective components are :

•Microsoft Office, •SQL Server 2000 •SQL Server 2005•Web Services plus .NET Framework (.NET Connected logo test),•Managed Code.

The application must pass the Windows Server or the Windows ClientComponent, plus at least one additional component.

Hardware : dual – processor machine

(*) Please note Windows Server 2000 will no longer be an option for the Windows Server component.


Platform Test SpecificationsPlatform Test Specifications

List of the options:

Windows Server / SQL Server (2000 or 2005)

Windows Server / Managed Code

Windows Server / Web Services and .NET Framework

Windows Server / Office 2003

Windows Server / Windows Client (*)

Windows Client / SQL Server 2000 or 2005

Windows Client / Managed Code

Windows Client / Web Services and .NET Framework

Windows Client / Office 2003

Windows Server plus 2, 3, 4, or 5 components

Windows Client plus 2, 3, 4, components (*) only if the client code and the server code are different


Checklist for the Platform Test for ISV SolutionsChecklist for the Platform Test for ISV Solutions

Microsoft Windows ClientFundamental Requirements

Desktop applications must comply with all fundamental requirements to pass testing for this component

1. Executes on Microsoft Windows XP and maintains stability while performing primary functionality

2. Uses Windows Resources (heaps, locks, and handles) appropriately

3. Does not attempt to replace files protected by Windows File Protection

4. All device or filter drivers installed by the application are digitally signed by Microsoft WHQL

5. All kernel-mode drivers installed by the application pass Windows driver verification

Optional Requirements

Desktop applications must comply with any one of the optional requirements to pass testing for this component

1. Does not require a reboot during installation, operation, or removal

2. Provides installation program that supports "All Users" Installs

3. Remains stable while performing Fast User Switching

4. Supports use by a Limited User

Note:

There is a constraint of 2 hours for setup and configuration. Installation of products should be intuitive and easy to follow by anyone with typical Administrator abilities. Products must include a documented installation procedure, preferably with an automated installation routine.



Microsoft Windows ServerFundamental Requirements

Server applications must comply with all fundamental requirements to pass testing for this component

1. Executes on Microsoft Windows Server 2003 and maintains stability while performing primary functionality

2. Uses Windows Resources (heaps, locks, and handles) appropriately

3. Does not attempt to replace files protected by Windows File Protection

4. All device or filter drivers installed by the application are digitally signed by Microsoft WHQL

5. All kernel-mode drivers installed by the application pass Windows driver verification


Server applications must comply with any one of the optional requirements to pass testing for this component

1. Does not require a reboot during installation, operation, or removal

2. Does not disable other services during installation, operation, or removal

3. Supports Active Directory

4. Supports Windows Management Instrumentation (WMI)

5. Utilizes Windows SharePoint Services

6. Utilizes ASP.NET for Web Applications

Note:

There is a constraint of 2 hours for setup and configuration. Installation of products should be intuitive and easy to follow by anyone with typical Administrator abilities. Products must include a documented installation procedure, preferably with an automated installation routine.



Microsoft Office 2003Applications must comply with any one requirement to pass testing for this component.

Application requires at least one of the programs included in Microsoft Office 2003

Editions to exercise some of its documented functionality. Eligible applications must be one of the following:

1. Application includes a COM add-in for Microsoft Office 2003

2. Application includes a VBA add-in for Microsoft Office 2003

3. Application includes a VSTO add-in for Microsoft Office 2003

4. Application exposes data in Microsoft Office 2003 via Research and Reference feature

5. Application integrates data in Microsoft Office 2003 via Smart Tags

Special notes :

Application requires one of the Microsoft Office 2003 Editions programs to exercise some its documented functionality

Microsoft Office 2003 Editions supports extensive development capabilities that enable ISVs to build solutions incorporating programs from Microsoft Office 2003 Editions.

Applications that call at least one of the listed below Microsoft Office 2003 Editions programs as some of its documented functionality is exercised comply with this requirement: Access, Excel, FrontPage, InfoPath, Live Meeting, OneNote, Outlook, PowerPoint, Project, Publisher, Small Business Accounting, Visio, Word.



Microsoft SQL Server

Microsoft SQL Server 2000 or Microsoft SQL Server 2005

Fundamental Requirements

Applications must comply with all fundamental requirements to pass testing for this component

1. Supports ADO, ADO.NET, OLE DB, ODBC, or JDBC to connect to SQL Server


Applications must comply with any one of the optional requirements to pass testing for this component

1. Requires SQL Server 2000 SP3

2. Supports SQL Server Authentication or Windows Authentication



Web Services and the .NET FrameworkApplications must comply with any one requirement to pass testing for this component

1. Exposes a Web service using .NET Framework or .NET Compact Framework

2. Consumes a Web service using .NET Framework or .NET Compact Framework

Please note : in both cases, dll and exe files need to be written in Managed Code



Managed CodeApplications must comply with all requirements to pass testing for this component

1. All Application Assemblies consist of Managed Code

We use a tool, FxCop available at http://www.gotdotnet.com/team/fxcop

Note : the .net Framework 2.0 is the default. Please precise if still on v1.1


Agenda

Veritest Overview






FAQFAQ

Which Application to submit ?

Which Components to select ?

Costs ?

What happens if it fails ?

How to register and submit my application ?


Which Application to submit?Which Application to submit?

What can we test ?- Software that goes to the market (with 3 client references),

- Components like ActiveX with sample application/code

- Applications with any 3rd party h/w or s/w as long as : compliant and provided by the ISV

What can’t we test ?- Development libraries (i.e. functions)

- Installation time maybe a blocking factor: the base test fee includes up to two hours installation time, including back-end elements. Charges for additional time to install and configure products for testing: $110/h

You may opt to ship pre-configured hardware for backend elements or provide technical assistance to VeriTest in order to reduce installation time

Connection through the Internet MS Virtual PC for the test environment if none of the application code runs

on it (ex: Oracle etc)


Which test components to select ?Which test components to select ?

Application environment :

Is my application running on Win Server or Win XP?

Does my application have a client and a server?

Does my application use MS SQL Server 2000 or 2005 ?

Does my application use MS Office 2003?

Does my application use the .Net Framework?

If yes, does it use / provide Web services?

If yes, is it managed code compliant?

(*) Please note that only client/server applications are eligible for testing for both the Windows Client and Windows Server components of the Platform Test. A client/server application is defined as an application that installs code on the Windows Client platform, and different code on the Windows Server platform, and there is interaction between the code on the two platforms.

List of the options:

Win Server and / or Windows Client (*)

SQL Server 2000 / 2005

Office 2003

Managed Code

Web Services and .NET Framework


Costs : $400 / componentCosts : $400 / component


Costs : additional charges Costs : additional charges

Microsoft Platform Test for ISV Solutions at VeriTest: Additional fees

Application Interface Language

The basic test fee covers testing of applications with an English user interface. Applications with a user interface in a different language will be charged an extra fee:

$100 per component tested

Installation time

The base test fee includes up to two hours installation time, including back-end elements. Charges for additional time to install and configure products for testing:

$110 per additional hour

You may opt to ship pre-configured hardware for backend elements or provide technical assistance to VeriTest in order to reduce installation time.

Retests

Retests on new builds if the test fails: 65% of the original public test fee.

Check in US Dollar

Credit card transactions : add 3.5% to the total fee


What if it fails ?What if it fails ?

In case of success, an “Pass report ” email is sent to the ISV as soon as the test is done.

What if the application fails ?- A detailed Fail report is sent by email as soon as the test is done.- The Fail report includes steps to reproduce- Retest is at 65% of the initial public price

How to get prepared: - read and read again the specifications- pretest on a clean machine : OS from scratch, NTFS, empty Dllcache- The upper test level may give more precise information


Registration ProcessRegistration Process

Online registration : https://cert.veritest.com/register

3 items

- Vendor Questionnaire

- Software delivery : FTP or mail

- Payment : online


RRegistration Processegistration Process : : VeriTest Web SiteVeriTest Web Site


On-line registrationOn-line registration

Total time:45-60 minutes

Once you’ve entered this information, you can always come back later to make changes.



3-5 minutes



10-15 minutes Remember to make a note of your Tracking

Number.







5-10 minutes



5-10 minutes

Repeat this step to select all the test components you wish to have your product tested for.

Note: Your product has to pass testing for at least the Windows Client or Windows Server test component plus one other test component in order to pass testing for the Platform Test overall





















Done : we went through the Windows Server component

Next: we would need to proceed for MS SQL Server

Repeat this step for all the test components you are registering your product for.




Agenda

Veritest Overview






How to get readyHow to get ready

How to support the Certification engineer

All supporting materials in English

Step by step / click by click installation / configuration document : 10 – 20 pages with screenshots and basic guidelines

Provide a demo database, sample data set

Submit the application with the right licensing and/or user/password

Responsive technical contact as advertised in the online registration

Alias Email (e.g. : [email protected])


How to get readyHow to get ready

How to get prepared :

Read and read again the specifications

Internal preTest on a clean machine :

•install from scratch Windows + SP + Critical updates

•empty c:\windows\drivercache folders (enable show hidden / system files)

•empty c:\windows\system32\dllcache folders

•run in a command line « sfc /CACHESIZE=0 », then reboot

The upper level may give more precise information :

- Certified for Windows 2003 Server

- Certified for SQL Server

- Designed for Windows XP


Some Tools…Some Tools…

Resource use : how to use the AppVerifier

search for ACT 3.0 @ www.microsoft.com/downloads

Managed Code : how to use FxCop

http://www.gotdotnet.com/team/fxcop

Kernel mode Driver test : how to use verifier.exe

WsdlVerify : WsdlVerify is a proprietary tool from VeriTest that invokes a Web Service over the Internet to ensure the WSDL file for a Web Service is compliant with the WSI standards. The WSDL file must be accessible from the Internet for testing. Equivalent on http://gotdotnet.com/team/tools/web_svc/default.aspx


Tools : AppVerifierTools : AppVerifier

Options can be run one by one

PROPRIETARY & CONFIDENTIALPROPRIETARY & CONFIDENTIAL

Resources and ContactsResources and Contactshttp://www.veritest.com/certification/ms/platformtest.asp

[email protected]

[email protected] for generic query

[email protected]

Documents

PROPRIETARY & CONFIDENTIAL ISV / Software Solutions competency Testing Process with VeriTest November 28th 2005