2
Product Brochure The LDRA tool suite LDRA Testbed ® LDRA Testbed is the process management tool at the core of the LDRA tool suite. LDRA Testbed performs the Code, Quality and Design Reviews on the source code.It conducts Test Verification for code coverage, including statement, branch / decision, test path (LCSAJ), procedure / function call metrics and it provides access to the Test Manager. TBrun ® TBrun is LDRA’s automated unit testing tool. The functionality within TBrun includes a GUI interface which automates the production of test data vectors (by using TBeXtreme) whilst test harness and stub generation is completely automatic. It also produces the test documentation and other reports. Automatic generation of test data vectors can be provided by TBeXtreme for robustness, test scenarios and support of black-box, white- box and object-box testing. TBeXtreme LDRA has revolutionised the traditional “unit testing” process, whether performed on the host or target system with its new testing capability - eXtreme Testing. TBeXtreme uses the information gathered by the Code, Quality and Design Review capabilities of the LDRA tool suite to provide a totally automated solution. TBeXtreme automates the unit/module/integration testing processes and eliminates the traditional time and resource problems associated with bottom-up testing. TBobject Box TBobject Box provides an Object Code Verification capability, offering the only direct way to relate code coverage at the source code level with that achieved at the object code level. In addition to this the module provides the mechanism to extend, where necessary, the code coverage at the assembler level. Target License Package (TLP) The target license package provides the right to use and to receive support for the LDRA tool suite when it is used for target testing. The TLP allows the user to receive assistance from LDRA in configuring the LDRA tool suite to interface with a specific tool chain. DO-178B Tool Qualification Pack Certification authorities such as the FAA, CAA and JAA require tool qualification to be carried out on a project- by-project basis to show that the tools are fit for purpose when certifying software to the DO-178B standard. The LDRA tool suite falls under the category of ‘Software Veri- fication Tool’ for DO-178B tool qualification purposes and the LDRA Tool Qualification Packs enable clients to follow a process which will provide the information required in order to certify the LDRA tool suite. TBreq ® TBreq is a unique solution that can help development teams overcome the challenges of mapping test specifications, unit testing scenarios, test data and code coverage verification back to their high level design requirements. TBreq interfaces directly with management tools such as Telelogic DOORS®, IBM® Rational® RequisitePro®, Microsoft® Word documents or Excel spreadsheets in order to ensure traceability across the complete software lifecycle thus verifying the completeness of the requirements coverage. TBreq manages the development lifecycle for the requirements, via the built-in TBmanager dashboard through derived or low-level requirement generation as well as the delegation of work to developers, testers and QA engineers. TBsafe TBsafe provides developers, testers and managers of high integrity software with a set of analysis tools to help them to test their code rigorously to exacting standards such as those required for DO-178B, Def Stan 00-55 and IEC 61508. Features include Information Flow Analysis, Modified Condition/Decision Coverage (MC/DC) for DO-178B Level A as well as Exact Semantic Analysis. TBpublish TBpublish captures the analysis and test results from the LDRA tool suite and publishes the results via an HTML index, into a self-contained directory for easy navigation and collaborative reference. TBaudit TBaudit offers development and test managers an automatically generated, user-configurable Microsoft Word report which contains the results of the Review and Testing activities carried out by the development, QA and testing teams using the LDRA tool suite. TBpublish is a prerequisite for TBaudit. TBevolve TBevolve enables project teams to accurately monitor the impact of code changes on their testing process. As the source code changes TBevolve will compare a baseline copy of a system with new versions and will highlight changed source code lines and report on untested source code which affects the overall code coverage analysis. Other languages, assemblers and host / target platforms are available. Please contact LDRA for more information. Target Platforms IDE: ARM RealView Development Suite Cosmic IDEA Freescale CodeWarrior Green Hills MULTI IAR Embedded Workbench iSYSTEM winIDEA Keil µVision TI CodeComposer Studio Wind River Tornado & Workbench Target: ARM ARM7/ARM9 Freescale MC68K, MPC5xx, 6xx & 8xx Infineon TriCore, C166 Intel 8051, 80C196 MIPS SmartMIPS, 4Kx PowerPC 5xx, 6xx, 7xx & 8xx Renesas SuperH xx TI TMS320Cxx Languages Ada 83 Ada 95 C C++ Host Platforms Windows 9x/NT/2000/XP/Vista Unix, Linux HP OpenVMS (Alpha & IA-64 Itanium) Freescale Assemblers Intel Assemblers Texas Instruments Assemblers Languages shown in orange signify TBrun availability. The LDRA tool suite is available for the following source code languages and host / target platforms: Client Testimonials Languages & Platforms www.ldra.com LDRA Technology Inc. USA LDRA Technology S.A.R.L. France All brand names and product names mentioned herein are trademarks or registered trademarks of their respective companies. Picture acknowledgements: Invensys Dimetronic, QinetiQ, Esaote, Lockheed Martin, Neptec, European Space Agency,Phillips Medical. Lexus Car picture, Copyright © 2005 - 2008 NihonCar.com Inc. LDRA Ltd. reserves the right to change any specifications contained within this literature without prior notice. Designed by Young Greenwood Design (01260) 226541 PB v6.1 02/08 QinetiQ Vectored-thrust Aircraft Advanced Control (VAAC) Harrier Lexus LS460 with world's first motor-driven electric variable valve timing control system developed by Denso F-35 Lightning II The tools reporting facilities for audit purposes are excellent. The team have also been able to dramatically increase the throughput of unit testing and as a result deliver the project on time. John Schneider, Director of Engineering, Neptec Neptec's Laser Camera System in use on Space Shuttle LDRA has the ability to work with Limited Target HW which is important in the automotive sector in order to meet the demands for cost reduction and downsizing. We use the LDRA tool suite as a benchmark for other third-party and similar software platform products. Akihito Iwai, Project Manager DENSO Japan LDRA has proven they will support us in any way to get the job done especially in meeting demanding milestones. They provided outstanding support for several F-35 teammates: Lockheed Martin (Fort Worth), BAE (Wharton), Northrop Grumman (El Segundo), Seaweed, and Honeywell which directly contributed to a successful first flight of the AA-1 aircraft. We continue to work closely with LDRA to develop the needed automated process support to ensure that our software meets program cost, schedule, and quality targets. John H. Robb, Air Vehicle Software Senior Manager, LMCO LDRA is becoming so popular here that once software engineers have used the tools they are insisting they need to have it available at all times. Gary Sheppard, Senior Software Engineer, QinetiQ’s Avionic Systems Integration Group (ASIC) LDRA Technology Inc. (US) Lake Amir Office Park 1250 Bayhill Drive Suite # 360 San Bruno CA 94066 Tel: (650) 583 8880 LDRA UK & Worldwide Portside, Monks Ferry, Wirral, CH41 5LH Tel: +44 (0)151 649 9300 e-mail: [email protected]

Client Testimonials The LDRA tool suite - MOASOFT · The LDRA tool suite LDRA Testbed® LDRA Testbed is the process management tool at the core of the LDRA tool suite. LDRA Testbed

  • Upload
    others

  • View
    12

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Client Testimonials The LDRA tool suite - MOASOFT · The LDRA tool suite LDRA Testbed® LDRA Testbed is the process management tool at the core of the LDRA tool suite. LDRA Testbed

Product Brochure

The LDRA tool suite

LDRA Testbed®

LDRA Testbed is the process management tool at the core of the LDRA tool suite. LDRA Testbed performs the Code, Quality and Design Reviews on the source code.It conducts Test Verification for code coverage, including statement, branch / decision, test path (LCSAJ), procedure / function call metrics and it provides access to the Test Manager.

TBrun®

TBrun is LDRA’s automated unit testing tool. The functionality within TBrun includes a GUI interface which automates the production of test data vectors (by using TBeXtreme) whilst test harness and stub generation is completely automatic. It also produces the test documentation and other reports. Automatic generation of test data vectors can be provided by TBeXtreme for robustness, test scenarios and support of black-box, white-box and object-box testing.

TBeXtreme™

LDRA has revolutionised the traditional “unit testing” process, whether performed on the host or target system with its new testing capability - eXtreme Testing. TBeXtreme uses the information gathered by the Code, Quality and Design Review capabilities of the LDRA tool suite to provide a totally automated solution. TBeXtreme automates the unit/module/integration testing processes and eliminates the traditional time and resource problems associated with bottom-up testing.

TBobject Box™

TBobject Box provides an Object Code Verification capability, offering the only direct way to relate code coverage at the source code level with that achieved at the object code level. In addition to this the module provides the mechanism to extend, where necessary, the code coverage at the assembler level.

Target License Package (TLP)

The target license package provides the right to use and to receive support for the LDRA tool suite when it is used for target testing. The TLP allows the user to receive assistance from LDRA in configuring the LDRA tool suite to interface with a specific tool chain.

DO-178B Tool Qualification Pack

Certification authorities such as the FAA, CAA and JAA require tool qualification to be carried out on a project-by-project basis to show that the tools are fit for purpose when certifying software to the DO-178B standard. The LDRA tool suite falls under the category of ‘Software Veri-fication Tool’ for DO-178B tool qualification purposes and

the LDRA Tool Qualification Packs enable clients to follow a process which will provide the information required in order to certify the LDRA tool suite.

TBreq®

TBreq is a unique solution that can help development teams overcome the challenges of mapping test specifications, unit testing scenarios, test data and code coverage verification back to their high level design requirements. TBreq interfaces directly with management tools such as Telelogic DOORS®, IBM® Rational® RequisitePro®, Microsoft® Word documents or Excel spreadsheets in order to ensure traceability across the complete software lifecycle thus verifying the completeness of the requirements coverage. TBreq manages the development lifecycle for the requirements, via the built-in TBmanager dashboard through derived or low-level requirement generation as well as the delegation of work to developers, testers and QA engineers.

TBsafe™

TBsafe provides developers, testers and managers of high integrity software with a set of analysis tools to help them to test their code rigorously to exacting standards such as those required for DO-178B, Def Stan 00-55 and IEC 61508. Features include Information Flow Analysis, Modified Condition/Decision Coverage (MC/DC) for DO-178B Level A as well as Exact Semantic Analysis.

TBpublish™

TBpublish captures the analysis and test results from the LDRA tool suite and publishes the results via an HTML index, into a self-contained directory for easy navigation and collaborative reference.

TBaudit™

TBaudit offers development and test managers an automatically generated, user-configurable Microsoft Word report which contains the results of the Review and Testing activities carried out by the development, QA and testing teams using the LDRA tool suite. TBpublish is a prerequisite for TBaudit.

TBevolve™

TBevolve enables project teams to accurately monitor the impact of code changes on their testing process. As the source code changes TBevolve will compare a baseline copy of a system with new versions and will highlight changed source code lines and report on untested source code which affects the overall code coverage analysis.

Other languages, assemblers and host / target platforms are available. Please contact LDRA for more information.

Target Platforms IDE:

ARM RealView Development Suite

Cosmic IDEA

Freescale CodeWarrior

Green Hills MULTI

IAR Embedded Workbench

iSYSTEM winIDEA

Keil µVision

TI CodeComposer Studio

Wind River Tornado & Workbench

Target:

ARM ARM7/ARM9

Freescale

MC68K, MPC5xx, 6xx & 8xx

Infineon TriCore, C166

Intel 8051, 80C196

MIPS SmartMIPS, 4Kx

PowerPC 5xx, 6xx, 7xx & 8xx

Renesas SuperH xx

TI TMS320Cxx

Languages Ada 83

Ada 95

C

C++

Host Platforms Windows 9x/NT/2000/XP/Vista

Unix, Linux

HP OpenVMS (Alpha & IA-64 Itanium)

Freescale Assemblers

Intel Assemblers

Texas Instruments Assemblers

Languages shown in orange signify TBrun availability.

The LDRA tool suite is available for the following source code languages and host / target platforms:

Client Testimonials

Languages & Platforms

www.ldra.comLDRA Technology Inc.

USA

LDRA Technology S.A.R.L. France

All brand names and product names mentioned herein are trademarks or registered trademarks of their respective companies.Picture acknowledgements: Invensys Dimetronic, QinetiQ, Esaote, Lockheed Martin, Neptec, European Space Agency,Phillips Medical.Lexus Car picture, Copyright © 2005 - 2008 NihonCar.com Inc.LDRA Ltd. reserves the right to change any specifications contained within this literature without prior notice.

Designed by Young Greenwood Design (01260) 226541

PB v6.1 02/08

QinetiQ Vectored-thrust Aircraft Advanced Control (VAAC) Harrier

Lexus LS460 with world's first motor-driven electric variable valve timing control system developed by Denso

F-35 Lightning II

‘The tools reporting facilities for audit purposes are excellent. The team have also been able to dramatically increase the throughput of unit testing and as a result deliver the project on time.’ John Schneider, Director of Engineering, Neptec

Neptec's Laser Camera System in use on Space Shuttle

‘LDRA has the ability to work with Limited Target HW which is important in the automotive sector in order to meet the

demands for cost reduction and downsizing. We use the LDRA tool suite as a benchmark for other third-party and similar

software platform products.’ Akihito Iwai, Project Manager DENSO Japan

‘LDRA has proven they will support us in any way to get the job done especially in meeting demanding milestones. They provided outstanding support for several F-35 teammates: Lockheed Martin

(Fort Worth), BAE (Wharton), Northrop Grumman (El Segundo), Seaweed, and Honeywell which directly contributed to a successful

first flight of the AA-1 aircraft. We continue to work closely with LDRA to develop the needed automated process support to ensure that our

software meets program cost, schedule, and quality targets.’John H. Robb, Air Vehicle Software Senior Manager, LMCO

‘LDRA is becoming so popular here that once software engineers have used the tools they are insisting they need to have it available at all times.’Gary Sheppard, Senior Software Engineer, QinetiQ’s Avionic Systems Integration Group (ASIC)

LDRA Technology Inc. (US)Lake Amir Office Park

1250 Bayhill Drive Suite # 360San Bruno CA 94066Tel: (650) 583 8880

LDRA UK & WorldwidePortside, Monks Ferry,

Wirral, CH41 5LHTel: +44 (0)151 649 9300

e-mail: [email protected]

Page 2: Client Testimonials The LDRA tool suite - MOASOFT · The LDRA tool suite LDRA Testbed® LDRA Testbed is the process management tool at the core of the LDRA tool suite. LDRA Testbed

3. Code ReviewBy making use of the powerful analysis features including programming standards checking and the sophisticated reporting capabilities, the LDRA tool suite minimises the need for repetitive and labour intensive manual inspections.

To prevent runtime errors and ensure that source code satisfies the development team’s coding standards, the user can run checks against sets of programming rules and configure their own user-defined model or use an industry recognised standard such as MISRA-C:1998, MISRA-C:2004, HIS, JSF AV C++, High Integrity C++ or MISRA-C++:2008. The ability to quickly identify violations early in the software development lifecycle improves the quality of code, reduces the errors found during formal testing and helps to ensure on-time delivery within budget.

A key deliverable of running the code review function is an automated, efficient and repeatable process which saves both time and resources and supplies developers with unparalleled levels of detail that cannot be matched by traditional manual techniques. The Code Review Report provides an overview of code violations and warnings with the ability to drill down into the source code to address the problems which have been identified by the LDRA tool suite.

4. Quality ReviewThis component enables the user to quickly determine the quality of the software using comprehensive sets of metrics encompassing software testability, maintainability and clarity. LDRA has applied significant effort to the automation of this highly beneficial Quality Review process.

The LDRA tool suite goes beyond common complexity metrics to determine “essential complexity”, that is the sections of the source code which require refactoring. Code density metrics are another unique feature of LDRA’s Quality Review process as these point to potential future maintainability problems.

The key deliverables of the Quality Review process are the Quality Model visualisation, system quality metrics and code refactoring guidelines that can all be used to improve overall code confidence. The consistent enforcement of a user specified Quality Model is reported for development team and management review thereby improving project level communications.

5. Unit Testing (eXtreme testing)LDRA has revolutionised the traditional “unit testing” activity, which is typically performed on the host and/or target systems, with its new testing capability, eXtreme Testing. Utilising the information gathered by the code, quality and design review capabilities, eXtreme Testing is a totally automated solution which ensures that most source code behaviour can be quickly and easily exercised simultaneously recording high levels of code coverage. Consequently, eXtreme Testing automates the unit/ module/integration testing processes, including test harness and test vector production and eliminates the traditional time and resource problems associated with bottom-up testing.

Additional key benefits of eXtreme Testing with LDRA TBrun include:

• Automated test driver / harness generation with no manual scripting requirement

• High levels of test throughput may be achieved via the intuitive graphical and command line interface options

• Sophisticated automated analysis facilities which reduce test effort, freeing up developers and empowering testers

• Test data and test results are stored and maintained for fully automated regression analysis

• Automated detection and documentation of source code changes

• Tool driven test vector generation• Facilitates execution of tests in host, target and simulator

environments• Automatically generated test case documentation including

pass/fail and regression analysis reports

Among the key deliverables of eXtreme Testing is the automatic generation of test cases and drivers removing the need for manual scripting and entry of values, as well as test case build up and tear down routines.

6. Target TestingA key feature of the target testing capabilities of the LDRA tool suite is the high degree of flexibility that the tool supports which is unmatched by competitive test products and virtually eliminates risks associated with unique target constraints and evolving target systems.

Moreover, the LDRA tool suite's Object Code Verification offers a proven, single-tool solution to directly compare code coverage at the source code level with that achieved at the object code level.

A key deliverable of the LDRA tool suite in respect of target testing is the ability to provide highly automated solutions for a wide range of processor / IDE (Integrated Development Environment) combinations, which greatly assists in overcoming the significant challenge of deploying the test execution on a specific target.

7. Test VerificationCode coverage measurement and dynamic analysis processes are applied to the development of safety, business and mission critical software because they must adhere to the most stringent standards. A key element of many of these processes, for example, DO-178B - MC/DC for safety critical software development projects, is the ability to be able to visualise, manage and measure software code coverage.

The analysis, testing and maintenance of code typically constitute 70% of the software development lifecycle. LDRA’s strategies and technology can be used to manage and even reduce these costs.

LDRA’s Object Code Verification Solution The demands of DO-178B (6.4.4.2 Structural Coverage Analysis) are such that developers of applications that are subject to the standard are required to implement object code verification facilities for those elements of the application that have a Level-A (safety-critical) classification.

LDRA has recognised and responded to the increasing requirement for object code verification solutions from differing industry sectors and can provide a complete structural coverage analysis solution for both source and object code from unit to system and integration levels. This mode of operation for the LDRA tool suite is known as the ‘Object-Box Mode’.

The solution utilises the combination of both high level and object level (assembler) code variants of the LDRA tool suite with the object level tool being determined by the target processor on which the application is required to run. A typical example might see C/C++ and TMS320C2xx Assembler copies of the LDRA tool suite teamed together.

LDRA provides an automated unit level solution for object code verification and, with TBrun, LDRA has taken tool support for this type of analysis a significant step further than other tool vendors. The ‘Object-box Mode’ enables users to create test cases for structural coverage of high-level source and apply these exact same test cases to the corresponding object code.

The ability to quickly pinpoint inadequately or untested software, test to a high standard and reduce regression testing costs is vitally important. The key requirement is to save resources, increase product quality and shorten time-to-market. The key deliverables of LDRA’s test verification component are providing Coverage Metrics for the following:

• Statement

• Branch/Decision

• Procedure/Function Call

• Branch Decision Condition

• Branch Condition Combination

• Modified Condition / Decision Coverage (MC/DC for DO-178B Level A)

• Dynamic Data Flow

• LCSAJ

8. Test ManagerBeing able to fully understand a system can take a long time and require large amounts of resource. The LDRA tool suite assists developers and test engineers in understanding, documenting and maintaining large complex systems. Additionally, Test Manager automatically detects changes to the source file(s) and performs a validation of associated regression test cases.

Some of the key features include:

• Automatic Software Change Detection which identifies and tracks significant source code changes and enables project teams to accurately monitor the impact of these changes on the testing process and the overall analysis of the code.

• Regression Test Management this provides the ability to have traceability information and accept the tests for automated regression testing. The tests and their results can be easily stored with their associated unit under a test baseline control system.

• Documentation assists the process of achieving quality standards such as ISO 9001:2000. The level of detail within the reports includes a high level overview, quality report and metrics reports; and from within these reports, it is possible to drill down directly to the source code.

A key deliverable of the Test Manager is to provide full system documentation for audit purposes and version-control purposes, as well as helping to reduce ongoing maintenance costs.

LDRA Capabilities LDRA Capabilities

Unit testing (eXtreme testing) GUI

High and Low Level examples of LDRA Dynamic Coverage

Analysis Report

Test Manager Report

Example Target Testing System

Code Review Report Diagram

Which lifecycle tasks does the LDRA tool suite automate?LDRA has developed its tool suite to assist with the 8 major tasks which need to be performed so that an organisation can achieve its software development and maintenance goals. The LDRA tool suite capabilities are unique in their integration of requirements traceability with static and dynamic analyses and their ability to test software on virtually any host or target system.

1. Requirements Traceability VerificationUsing the LDRA tool suite you can bridge the gap between requirements residing in any repository, such as Telelogic DOORS®, IBM® Rational® RequisitePro®, a Microsoft® Word document or Excel spreadsheet, to create a Requirements Traceability Matrix (RTM) that you can verify using all the capabilities of the LDRA tool suite. The RTM can be mapped to LDRA analysed source code or flow down from mappings performed in modelling tools such as Telelogic Rhapsody® and The MathWorks Simulink®. Either way, your requirements can be fully verified using an automated process that provides round-trip engineering across the entire software development lifecycle. With the LDRA tool suite the reporting, resolution and management of defects are all complementary to requirements management, and these too can be incorporated into the RTM, bridging yet another major gap in most software development processes.

A key deliverable of the RTM is the capability to automatically ensure that if changes occur to the requirements, design or source code. they are easily traceable. The RTM capability, in conjunction with the other LDRA capabilities, allows users to greatly reduce the costs associated with verification, debugging and change management, the largest aggregate cost in software development today.

2. Design ReviewLDRA’s Design Review performs an analysis of the as-built design of the source code implementation. The code’s structure, control flow and data flow are graphically depicted and examined, making design conformance (or non-conformance) easily visible.

Design visualisation at all levels is extremely powerful; these include statement block, procedure (or class), application and system. The LDRA tool suite's colour-coded diagrams greatly enhance the Design Review process:

• The Static Callgraph provides a hierarchical display of the application and system entities.

• The Static Flowgraph provides a graphical display of the control flow across program blocks.

The key deliverables of this component of the LDRA tool suite are a systematic analysis linked to a graphical representation of the as-built design, including system callgraphs and procedure flowgraphs, data flow analyses reports (from both parameter and variable usage viewpoints) and path level analysis reports employing LDRA’s LCSAJ technology. These deliverables document a top-down Design Review process that can be used by development teams and management. The results from these design analyses are also automatically carried forward into LDRA’s Unit testing and Test Verification components.

This brochure introduces the capabilities of the LDRA tool suite and shows how they can be utilised throughout the software development lifecycle. The LDRA tool suite capabilities are critical to success with safety and mission critical software including the implementation of their associated processes, such as DO-178B and IEC 61508 as well as the relevant industry certifications, FDA for example.

The techniques incorporated in the LDRA tool suite have been performed across hundreds of projects in many vertical industries, such as avionics, defence, automotive, telecoms, energy and medical. These techniques can be utilised by an entire project team within the software development lifecycle, including project or requirements managers, developers, QA managers, test and maintenance engineers.

LDRA Capabilities

LDRA Lifecycle Automation Capabilities

Static Callgraph and Flowgraph

TBreq Family Tree Diagrams