feedc0de/qt-creator
1
0
Fork 0
forked from qt-creator/qt-creator
Code Pull Requests Activity

Doc: Update AutoTest plugin related docs

Browse Source 
Grouping of test results by their application had been
added.
More blacklisted result types had been added to Qt5.12.

Change-Id: I860c301fd5b9586809679d7def275a908d6fcf10
Reviewed-by: Leena Miettinen <riitta-leena.miettinen@qt.io>
This commit is contained in:
Christian Stenger
2019-02-15 10:24:18 +01:00
parent 56584b1dde
commit 27f12bd2ce
1 changed files with 33 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files

46
doc/src/howto/creator-only/creator-autotest.qdoc
View File

@@ -333,22 +333,9 @@
\row \row
\li BENCH \li BENCH
\li Benchmark test. \li Benchmark test.
\row
\li BFAIL
\li Blacklisted test case failed. Since Qt 5.4, you can
provide a BLACKLIST file for tests. It is mainly used internally
by the Qt CI system.
\row
\li BPASS
\li Blacklisted test case passed.
\row \row
\li DEBUG \li DEBUG
\li Debug message. \li Debug message.
\row
\li XFAIL
\li Test case is expected to fail, so it is marked by using the
QEXPECT_FAIL macro. If the test case passes instead, an
unexpected pass (XPASS) is written to the test log.
\row \row
\li FAIL \li FAIL
\li Test case failed. Double-click the line for more information. \li Test case failed. Double-click the line for more information.
@@ -371,12 +358,40 @@
\row \row
\li SYSTEM \li SYSTEM
\li An error message received from or influenced by the OS. \li An error message received from or influenced by the OS.
\row
\li XFAIL
\li Test case is expected to fail, so it is marked by using the
QEXPECT_FAIL macro. If the test case passes instead, an
unexpected pass (XPASS) is written to the test log.
\row \row
\li XPASS \li XPASS
\li Test case passed even though it was expected to fail. \li Test case passed even though it was expected to fail.
\row \row
\li WARN \li WARN
\li Warning message. \li Warning message.
\endtable
Since Qt 5.4, you can provide a BLACKLIST file for tests. It is mainly used
internally by the Qt CI system.
\table
\header
\li Result
\li Description
\row
\li BFAIL
\li Blacklisted test case failed.
\row
\li BPASS
\li Blacklisted test case passed.
\row
\li BXFAIL
\li Blacklisted test case failed but was marked to be expected to fail.
\row
\li BXPASS
\li Blacklisted test case passed even though it was expected to fail.
\endtable \endtable
To view only messages of a particular type, select To view only messages of a particular type, select
@@ -391,6 +406,11 @@
\uicontrol {Limit result output} check box. To disable automatic scrolling, \uicontrol {Limit result output} check box. To disable automatic scrolling,
deselect the \uicontrol {Automatically scroll results} check box. deselect the \uicontrol {Automatically scroll results} check box.
Test results can be grouped by the executable path that was used to run the
tests. This is useful if you have multiple test executables and run them all
at once. To enable this functionality you need to select the
\uicontrol {Group results by application} check box.
Internal messages and run configuration warnings for deduced configurations Internal messages and run configuration warnings for deduced configurations
are omitted by default. To view them, deselect the \uicontrol {Omit internal are omitted by default. To view them, deselect the \uicontrol {Omit internal
messages} and \uicontrol {Omit run configuration warnings} check boxes. messages} and \uicontrol {Omit run configuration warnings} check boxes.