Ideally JUnit tools would handle multiple failures per test case, but they don't, so here we are. Closes #1919