OpenSUSE Announces First Public Release of openQA
The openSUSE Project announces the 1.0 release of the unique cross-
distribution-capable, fully automated testing framework openQA. openQA
is the only comprehensive testing tool which can run tests on every
level of the OS, from core functionality like the bootloader and booting
the kernel up to testing applications like Firefox and LibreOffice. It
shows the results in a convenient web interface and allows testers to
see screenshots and even videos of the issues found. openQA is used to
run nightly tests of the 'Factory' development repository for the
upcoming openSUSE 12.1 release. openQA is available under the GPL
version 2 or later.
Software Testing is Hard
Testing complex software is a crucial part of development. However, in-
depth, frequent testing is difficult, time-consuming and boring. To
ensure that software is tested regularly and predictably, automation is
crucial. Many in-house tools which can test specific applications have
been developed but there was no comprehensive testing tool for a full
operating system until openQA. openQA does its work entirely hands-off
and offers a convenient web interface with an overview of the results.
With openQA developers can catch and fix issues in the development
process much faster and thus ensure a more reliable product.
openQA Makes it Easy
openQA can test any operating system which is able to run in a virtual
machine. By taking screenshots of the process and comparing these to
reference images it determines if tests are passed or not. The OS-
autoinst tool, part of openQA, controls the testing process by sending
virtual keyboard and mouse events to the operating system being
installed and run. It is able to respond to what is shown on the screen
so it can handle a variety of issues while not having to stop the test.
openQA determines if the installation of the operating system worked
correctly and whether a number of applications started properly. At the
end of the test, all images are encoded into a video for consultation by
a human tester in case this is needed. A status overview of the tests
can be shown in a web interface, currently available for the openSUSE
Factory development repository on openqa.opensuse.org.
Coolo, openSUSE release manager noted: "I'm thrilled to see the 1.0
release of openQA. openQA's automated testing has been very beneficial
to the stability of openSUSE Factory and I'm confident it can do the
same for other Linux distributions"
openQA is Cross-platform Capable
openQA is developed as two software pieces: OS-autoinst and the web
interface. OS-autoinst right now supports Fedora, Ubuntu, Debian,
FreeBSD and even OpenIndiana. It can be used to test even MS DOS and
Windows systems. A number of videos on how openQA works can be found at
The openQA web interface is openSUSE specific right now. It gives an
overview of the status of all tests and allows the tester to look at
specific screenshots of issues as well as video's of the entire testing
openQA is Free
openQA has been published under the General Public License version 2 or
later. Installation instructions can be found on the wiki and the team
is eager to hear feedback on openQA and use cases.
The openSUSE project is a worldwide effort that promotes the use of
Linux everywhere. openSUSE creates one of the world's best Linux
distributions, working together in an open, transparent and friendly
manner as part of the worldwide Free and Open Source Software community.
The project is controlled by its community and relies on the
contributions of individuals, working as testers, writers, translators,
usability experts, artists and ambassadors or developers. The project
embraces a wide variety of technology, people with different levels of
expertise, speaking different languages and having different cultural