8.6. Import Test Results

Klaros-Testmanagement allows users to import test results from several test frameworks. If the related test cases are not already defined in the Klaros-Testmanagement database, they will be automatically created.

The following frameworks are supported:

AUnit

AUnit provides mechanisms by which developers can test their AspectJ aspects in isolation in support of Test Driven Development.

Boost Test

The Boost Test library provides a matched set of components for writing test programs, organizing tests into simple test cases and test suites, and controlling their runtime execution.

Check

Check is a unit testing framework for C.

CppTest

CppTest is a portable and powerful, yet simple, unit testing framework for handling automated tests in C++. The focus lies on usability and extendability.

CppUnit

CppUnit is a C++ unit testing framework.

ctest

ctest is the testing driver provided by CMake.

CUnit

CUnit is a lightweight system for writing, administering, and running unit tests in C.

embUnit

Embedded Unit is unit testing framework for Embedded C Systems.

Free Pascal Unit

Free Pascal Unit is a port to Free Pascal of the JUnit core framework.

GLib/gtester

GLib provides the core application building blocks for libraries and applications written in C. It provides the core object system used in GNOME, the main loop implementation, and a large set of utility functions for strings and common data structures. gtester is a utility to run unit tests that have been written using the GLib test framework.

GoogleTest

GoogleTest is a unit testing library for the C++ programming language created by Google.

GUIdancer

GUIdancer is an Eclipse-based tool for automated functional testing through the Graphical User Interface (GUI).

JBehave

JBehave is a framework for Behaviour-Driven Development (BDD). BDD is an evolution of test-driven development (TDD) and acceptance-test driven design, and is intended to make these practices more accessible and intuitive to newcomers and experts alike. It shifts the vocabulary from being test-based to behaviour-based, and positions itself as a design philosophy.

JsUnit

JsUnit is a Unit Testing framework for client-side (in-browser) JavaScript. It is essentially a port of JUnit to JavaScript. Also included is a platform for automating the execution of tests on multiple browsers and mutiple machines running different OSs.

Jubula

Jubula provides automated functional GUI testing for various types of applications.

JUnit

JUnit is a simple framework to write repeatable tests. It is an instance of the xUnit architecture for unit testing frameworks.

MbUnit

MbUnit is an extensible unit testing framework for the .NET Framework that takes in and goes beyond xUnit pattern testing. MbUnit is part of the Gallio bundle.

MSTest

MSTest is the command-line command that is used to run tests. This command has several options you can use to customize your test run.

NUnit

NUnit is a unit-testing framework for all .Net languages.It is written entirely in C# and has been completely redesigned to take advantage of many .NET language features, for example custom attributes and other reflection related capabilities.

PHPUnit

PHPUnit is a member of the xUnit family of testing frameworks and provides both a framework that makes the writing of tests easy as well as the functionality to easily run the tests and analyse their results.

QF-Test

QF-Test is a professional tool for automated testing of Java and Web applications with a graphical user interface.

QTestLib

The QTestLib framework is a tool for unit testing Qt based applications and libraries.

Ranorex

Ranorex is a GUI test automation framework for testing of desktop, web-based and mobile applications.

Selenium

Selenium is a web browser automation tool primarily used for automated testing of web apps. Selenium is able to produce JUnit-compatible test results, which can be imported into Klaros-Testmanagement.

Test Complete

TestComplete is a cross platform automated GUI testing tool from SmartBear Software.

TESSY

TESSY is a software tool to automate module-unit testing of embedded software written in various embedded dialects of the programming languages C and C++.

TestNG

TestNG is a testing framework inspired from JUnit and NUnit but introducing some new functionalities that make it more powerful and easier to use. TestNG is able to produce JUnit-compatible test results, which can be imported into Klaros-Testmanagement.

TUSAR

TUSAR stands for Thales Unified Sofware Analysis Report. It is a generic metric format composed of 4 categories: Coverage, Measure, Test and Violations.

UnitTest++

UnitTest++ is a lightweight unit testing framework for C++. It was for test-driven development on a wide variety of platforms. Simplicity, portability, speed, and a small footprint are all very important aspects.

Valgrind

Valgrind is an instrumentation framework for building dynamic analysis tools.

xUnit.net

xUnit.net is a free, open source, community-focused unit testing tool for the .NET Framework. xUnit.net works with ReSharper, CodeRush, TestDriven.NET and Xamarin.

[Note] Support for Frameworks not listed here

Even if you did not find your favorite testing framework here this does not mean that it is not already supported.

Many tools offer to export their result files in the JUnit XML format (e.g. Selenium, Robot and others) which is a supported format.

If you like to see an additional format supported, please contact support@verit.de.

To start the import, an XML file with results from a supported test framework must be uploaded. When the file upload is completed it is mandatory to select the system under test and the test environment these results should be assigned to. The format of the result file is typically detect automatically.

Import Results Page

Figure 8.17. Import Results Page


Clicking the Next button opens the Assign Test Results to Test Cases page. The test case to assign each test result to can be selected using the corresponding drop-down box. Each result must be assigned to a different test case. If no test case is selected here a new test case is automatically created upon import. When the option Create additional test suite result is selected test suite results are automatically created for the corresponding test suite information contained in the result file. This information may vary with the import format. Additionally a corresponding test suite is created for the test suite result if it did not yet exist.

The Import Test Results Page

Figure 8.18. The Import Test Results Page


Pressing the Import button will import all results into Klaros-Testmanagement.