Fork me on GitHub
Built by Maven

Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
764 0 0 138 81.937% 4,847.812

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 591 0 0 135 77.157% 3,536.902
org.apache.maven.surefire.its.jiras 173 0 0 3 98.266% 1,310.909

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 10.874
AdditionalClasspathIT 1 0 0 0 100% 5.523
AggregateReportIT 1 0 0 0 100% 10.918
ArgLineIT 1 0 0 0 100% 6.558
ArgLinePropertiesIT 1 0 0 0 100% 7.641
AssumptionFailureReportIT 1 0 0 0 100% 5.59
CheckSingleTestIT 4 0 0 0 100% 20.384
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 32.873
CheckTestFailIfNoTestsIT 3 0 0 0 100% 12.024
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 6.353
CheckTestNgBeforeMethodIT 1 0 0 0 100% 7.061
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 5
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 6.204
CheckTestNgExecuteErrorIT 1 0 0 0 100% 6.697
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 5.651
CheckTestNgJdk14IT 1 0 0 0 100% 7.213
CheckTestNgListenerReporterIT 8 0 0 0 100% 59.52
CheckTestNgListenersIT 1 0 0 0 100% 6.452
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 7.501
CheckTestNgReportTestIT 3 0 0 0 100% 24.376
CheckTestNgSuiteXmlIT 3 0 0 1 66.667% 13.775
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 6.791
CheckTestNgVersionsIT 20 0 0 2 90% 145.203
ClasspathFilteringIT 1 0 0 0 100% 5.336
ClassPathOrderIT 1 0 0 0 100% 7.498
ClasspathScopeFilteringIT 1 0 0 0 100% 4.451
ConsoleOutputIT 4 0 0 0 100% 35.244
CrashDetectionIT 3 0 0 0 100% 16.636
DefaultConfigurationIT 1 0 0 0 100% 4.567
EnvironmentVariableIT 1 0 0 0 100% 6.966
EnvironmentVariablesIT 2 0 0 0 100% 15.979
FailFastJUnitIT 12 0 0 0 100% 288.68
FailFastTestNgIT 6 0 0 0 100% 71.822
ForkConsoleOutputIT 4 0 0 0 100% 21.328
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 5.328
ForkModeIT 12 0 0 0 100% 129.741
ForkModeMultiModuleIT 4 0 0 0 100% 35.431
ForkModeTestNGIT 12 0 0 0 100% 100.58
IncludesExcludesFromFileIT 6 0 0 0 100% 30.458
IncludesExcludesIT 3 0 0 0 100% 16.117
Java9FullApiIT 3 0 0 3 0% 0.006
JUnit44HamcrestIT 1 0 0 0 100% 5.669
JUnit47ConcurrencyIT 1 0 0 0 100% 5.397
JUnit47ParallelIT 59 0 0 0 100% 436.647
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 7.815
JUnit47RedirectOutputIT 2 0 0 0 100% 14.435
JUnit47RerunFailingTestWithCucumberIT 3 0 0 0 100% 21.946
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 6.381
JUnit47WithCucumberIT 2 0 0 0 100% 15.27
JUnit48TestCategoriesIT 8 0 0 0 100% 68.028
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 7.736
JUnit4IgnoreIT 2 0 0 0 100% 13.595
JUnit4RerunFailingTestsIT 5 0 0 0 100% 142.359
JUnit4RunListenerIT 2 0 0 0 100% 14.203
JUnit4VersionsIT 16 0 0 0 100% 115.993
JUnitDepIT 4 0 0 0 100% 29.912
JUnitPlatformIT 8 0 0 0 100% 67.708
LongWindowsPathIT 1 0 0 0 100% 6.9
ModulePathIT 1 0 0 1 0% 0.001
NoRunnableTestsInClassIT 1 0 0 0 100% 7.141
PlainOldJavaClasspathIT 1 0 0 0 100% 7.07
PlexusConflictIT 2 0 0 0 100% 14.435
PojoSimpleIT 1 0 0 0 100% 7.2
ReportersIT 1 0 0 0 100% 7.89
ResultCountingIT 3 0 0 0 100% 26.02
RunOrderIT 4 0 0 0 100% 25.84
RunOrderParallelForksIT 4 0 0 0 100% 25.981
SiblingAggregatorIT 1 0 0 0 100% 7.266
SmartStackTraceIT 1 0 0 0 100% 7.192
SystemPropertiesTestIT 2 0 0 0 100% 12.471
TestMethodPatternIT 7 0 0 0 100% 54.059
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 558.646
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 301.896
TestMultipleMethodsIT 3 0 0 0 100% 20.992
TestNgGroupsIT 5 0 0 0 100% 39.351
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 8.452
TestNgSuccessPercentageIT 1 0 0 0 100% 5.605
TestSingleMethodIT 9 0 0 0 100% 67.065
TimeoutForkedTestIT 1 0 0 0 100% 7.771
TwoTestCasesIT 4 0 0 0 100% 29.371
UmlautDirIT 2 0 0 0 100% 16.098
UnicodeTestNamesIT 1 0 0 0 100% 9.361
UseIsolatedClassLoaderIT 1 0 0 0 100% 7.456
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 4.878
WorkingDirectoryIT 4 0 0 0 100% 25.169
WorkingDirectoryMissingIT 1 0 0 0 100% 7.804
XmlReporterRunTimeIT 1 0 0 0 100% 28.077

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 6.444
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 6.036
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 8.317
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 8.076
Surefire1053SystemPropertiesIT 2 0 0 0 100% 14.907
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 7.419
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 8.427
Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 26.703
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 30.094
Surefire1122ParallelAndFlakyTestsIT 2 0 0 0 100% 13.753
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 17.512
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 7.162
Surefire1144XmlRunTimeIT 1 0 0 0 100% 6.798
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 13.593
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 11.175
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 46.544
Surefire1177TestngParallelSuitesIT 1 0 0 0 100% 10.017
Surefire1179IT 1 0 0 0 100% 10.625
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 5.978
Surefire1202RerunAndSkipIT 2 0 0 0 100% 38.023
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 58.888
Surefire1211JUnitTestNgIT 2 0 0 0 100% 15.038
Surefire1264IT 2 0 0 0 100% 16.412
Surefire1265Java9IT 1 0 0 1 0% 0.001
Surefire1278GroupNameEndingIT 1 0 0 0 100% 6.683
Surefire1295AttributeJvmCrashesToTestsIT 6 0 0 0 100% 55.552
Surefire1364SystemPropertiesIT 10 0 0 0 100% 71.05
Surefire1367AssumptionLogsIT 4 0 0 0 100% 23.258
Surefire1383ScanSessionDependenciesIT 1 0 0 0 100% 4.881
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 10.649
Surefire141PluggableProvidersIT 4 0 0 0 100% 34.296
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 6.209
Surefire1490ReportTitleDescriptionIT 2 0 0 0 100% 39.533
Surefire162CharsetProviderIT 1 0 0 0 100% 6.286
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 6.015
Surefire257NotRerunningTestsIT 1 0 0 0 100% 8.373
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 14.74
Surefire34SecurityManagerIT 2 0 0 0 100% 11.886
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 6.41
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 13.143
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 6.433
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 6.379
Surefire44InnerClassTestIT 1 0 0 0 100% 5.922
Surefire500PuzzlingErrorIT 1 0 0 0 100% 6.506
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 12.031
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 5.555
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 32.937
Surefire613TestCountInParallelIT 1 0 0 0 100% 7.012
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 36.305
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 7.624
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 5.968
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 9.053
Surefire673MockitoIT 1 0 0 0 100% 6.037
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 5.931
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 6.631
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 5.938
Surefire697NiceSummaryIT 1 0 0 0 100% 6.014
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 8.609
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 6.183
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 10.611
Surefire740TruncatedCommaIT 1 0 0 0 100% 5.073
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 23.469
Surefire772BothReportsIT 3 0 0 0 100% 11.417
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 15.382
Surefire772NoSurefireReportsIT 4 0 0 0 100% 15.561
Surefire772SpecifiedReportsIT 3 0 0 0 100% 11.2
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 4.952
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 21.188
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 6.108
Surefire809GroupExpressionsIT 6 0 0 0 100% 35.784
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 5.842
Surefire817SystemExitIT 1 0 0 0 100% 5.327
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 6.923
Surefire828EmptyGroupExprIT 4 0 0 0 100% 25.647
Surefire832ProviderSelectionIT 1 0 0 0 100% 6.681
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 13.866
Surefire847AdditionalFailureIT 1 0 0 0 100% 6.091
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 54.45
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 4.983
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 4.699
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 14.111
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 8.976
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 6.632
Surefire943ReportContentIT 2 0 0 0 100% 20.18
Surefire946KillMainProcessInReusableForkIT 3 0 0 0 100% 22.212
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 7.679
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 5.868
Surefire979WrongClassLoaderIT 1 0 0 0 100% 6.178
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 5.304
Surefire995CategoryInheritanceIT 5 0 0 0 100% 24.541

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 10.874

AdditionalClasspathIT

additionalClasspath 5.523

AggregateReportIT

aggregateReport 10.918

ArgLineIT

argLine 6.558

ArgLinePropertiesIT

argLine 7.641

AssumptionFailureReportIT

testWriteSkippedMessageToReport 5.59

CheckSingleTestIT

singleTestDotJava 5.45
singleTestNonExistentOverride 5.246
singleTestNonExistent 4.991
singleTest 4.697

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 5.559
failIfNoTestsForkModeOnce 5.498
dontFailIfNoTestsForkModeNever 5.054
dontFailIfNoTestsForkModeOnce 5.549
failIfNoTestsForkModeNever 5.471
failIfNoTestsForkModeAlways 5.742

CheckTestFailIfNoTestsIT

failIfNoTests 4.172
dontFailIfNoTests 4.042
jUnit48CategoriesFailWhenNoTests 3.81

CheckTestNgBeforeMethodFailureIT

TestNgBeforeMethodFailure 6.353

CheckTestNgBeforeMethodIT

TestNgBeforeMethod 7.061

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 5

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 6.204

CheckTestNgExecuteErrorIT

executionError 6.697

CheckTestNgGroupThreadParallelIT

TestNgGroupThreadParallel 5.651

CheckTestNgJdk14IT

TestNgJdk14 7.213

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 7.092
testNgListenerReporter[1: TestNG 5.7] 6.973
testNgListenerReporter[2: TestNG 5.10] 6.953
testNgListenerReporter[3: TestNG 5.13] 7.662
testNgListenerReporter[4: TestNG 5.14.6] 8.205
testNgListenerReporter[5: TestNG 5.14.9] 6.339
testNgListenerReporter[6: TestNG 6.0] 7.094
testNgListenerReporter[7: TestNG 6.9.9] 9.202

CheckTestNgListenersIT

TestNgListenerReporter 6.452

CheckTestNgPathWithSpacesIT

TestWithSpaces 7.501

CheckTestNgReportTestIT

testNgReport 9.032
shouldNotBeVerbose 8.214
shouldBeVerbose 7.13

CheckTestNgSuiteXmlIT

suiteXml 6.873
suiteXmlForkCountTwoReuse 6.902
suiteXmlForkModeAlways
+ [ Detail ]
 0
Fails - see SUREFIRE-1123

CheckTestNgSuiteXmlSingleIT

TestNgSuite 6.791

CheckTestNgVersionsIT

XXXtest50
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test502 7.702
test510 7.377
test511 8.912
test512 7.962
test513 8.927
test514 7.444
test685 9.638
test5131 8.382
test5141 9.291
test5142 8.923
test47 9.183
test51 8.251
test55 7.195
test56 7.882
test57 6.241
test58 6.81
test59 7.265
test60 7.818
XXXtest501
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 5.336

ClassPathOrderIT

classPathOrder 7.498

ClasspathScopeFilteringIT

additionalClasspath 4.451

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding 6.963
properNewlinesAndEncodingWithDefaultEncodings 7.32
largerSoutThanMemory 16.101
properNewlinesAndEncodingWithoutFork 4.86

CrashDetectionIT

hardCrashInReusableFork 5.549
crashInReusableFork 5.602
crashInFork 5.485

DefaultConfigurationIT

defaultConfiguration 4.567

EnvironmentVariableIT

environmentVariable 6.966

EnvironmentVariablesIT

testWhenUseSystemClassLoader 8.861
testWhenDontUseSystemClassLoader 7.118

FailFastJUnitIT

test[junit4-oneFork-ff1] 12.797
test[junit47-oneFork-ff1] 10.226
test[junit4-oneFork-ff2] 21.564
test[junit47-oneFork-ff2] 21.647
test[junit4-twoForks-ff1] 17.197
test[junit47-twoForks-ff1] 17.178
test[junit4-twoForks-ff2] 21.689
test[junit47-twoForks-ff2] 22.028
test[junit4-oneFork-ff3] 43.67
test[junit47-oneFork-ff3] 43.888
test[junit4-twoForks-ff3] 27.792
test[junit47-twoForks-ff3] 29.004

FailFastTestNgIT

test[testng-oneFork-ff1] 7.15
test[testng-oneFork-ff2] 11.108
test[testng-twoForks-ff1] 9.712
test[testng-twoForks-ff2] 11.611
test[testng-oneFork-ff3] 18.441
test[testng-twoForks-ff3] 13.8

ForkConsoleOutputIT

printSummaryTrueWithRedirect 5.77
printSummaryFalseWithoutRedirect 5.301
printSummaryTrueWithoutRedirect 4.967
printSummaryFalseWithRedirect 5.29

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 5.328

ForkModeIT

testForkModeOncePerThreadSingleThread 7.965
testForkModePerTest 8.795
testForkCountZero 6.448
testForkCountOneNoReuse 8.851
testForkCountTwoNoReuse 20.878
testForkModeNever 6.345
testForkCountTwoReuse 19.573
testForkCountOneReuse 7.555
testForkModeOncePerThreadTwoThreads 19.643
testForkModeAlways 9.15
testForkModeNone 6.651
testForkModeOnce 7.887

ForkModeMultiModuleIT

testForkCountOneNoReuse 10.447
testForkCountTwoNoReuse 8.945
testForkCountTwoReuse 7.864
testForkCountOneReuse 8.175

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 6.81
testForkModePerTest 8.229
testForkCountZero 5.544
testForkCountOneNoReuse 8.439
testForkCountTwoNoReuse 13.278
testForkModeNever 5.604
testForkCountTwoReuse 12.833
testForkCountOneReuse 6.25
testForkModeOncePerThreadTwoThreads 12.864
testForkModeAlways 8.569
testForkModeNone 5.731
testForkModeOnce 6.429

IncludesExcludesFromFileIT

testSimpleMixed 5.26
testMissingExcludes 3.86
testRegex 5.766
testPath 5.487
testMissingIncludes 4.611
testSimple 5.474

IncludesExcludesIT

testPathBasedIncludesExcludes 5.279
testIncludesExcludes 5.093
testRegexIncludesExcludes 5.745

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome
+ [ Detail ]
 0.006
skipped
shouldLoadMultipleJavaModules_ToolchainsXML
+ [ Detail ]
 0
skipped
shouldLoadMultipleJavaModules_JvmParameter
+ [ Detail ]
 0
skipped

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 6.444

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 6.036

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 8.317

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 8.076

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 7.685
checkWarningsFileEncoding 7.222

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 7.419

Surefire1080ParallelForkDoubleTestIT

test 8.427

Surefire1082ParallelJUnitParameterizedIT

checkClassesRunParallel 8.389
shouldRunTwo 10.047
checkOutFileClassesRunParallel 8.267

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 30.094

Surefire1122ParallelAndFlakyTestsIT

nonParallelCreatesCorrectReport 7.483
parallelCreatesCorrectReport 6.27

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 8.7
testNgReport688 8.812

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 7.162

Surefire1144XmlRunTimeIT

testXmlRunTime 6.798

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 8.042
testJUnit48Provider4 5.551

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 5.747
testSpecifiedTestNotInIncludes 5.428

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 7.663
shouldRunWithCliOption[testng-option-ff] 7.277
shouldRunWithCliOption[junit-option-X] 8.422
shouldRunWithCliOption[testng-option-X] 7.664
shouldRunWithCliOption[junit-option-e] 7.67
shouldRunWithCliOption[testng-option-e] 7.848

Surefire1177TestngParallelSuitesIT

shouldRunTwoSuitesInParallel 10.017

Surefire1179IT

suiteXmlForkCountTwoReuse 10.625

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 5.978

Surefire1202RerunAndSkipIT

junit47 19.817
junit4 18.206

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 15.815
reusableForksJUnit47 14.901
reusableForksJUnit4 13.518
notReusableForksJUnit4 14.654

Surefire1211JUnitTestNgIT

withoutJUnit 7.998
withJUnit 7.04

Surefire1264IT

positiveTests 8.354
negativeTests 8.058

Surefire1265Java9IT

shouldRunInPluginJava9
+ [ Detail ]
 0.001
skipped

Surefire1278GroupNameEndingIT

testOnlyGroups 6.683

Surefire1295AttributeJvmCrashesToTestsIT

test[0] 10.987
test[1] 11.708
test[2] 7.993
test[3] 7.154
test[4] 10.334
test[5] 7.376

Surefire1364SystemPropertiesIT

junit47InProcessParallel 10.426
junit47Forked 7.251
junit47InProcess 6.512
testNg 6.836
junit3Forked 6.56
junit47ForkedParallel 6.998
junit4Forked 6.402
testNgInProcess 7.143
junit4InProcess 6.346
junit3InProcess 6.576

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 5.239
shouldSeeLogsParallelInPlugin 5.485
shouldSeeLogsParallelForked 5.972
shouldSeeLogsForked 6.562

Surefire1383ScanSessionDependenciesIT

test 4.881

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 10.649

Surefire141PluggableProvidersIT

pluggableProviderPresent 8.725
invokeRuntimeException 9.218
invokeReporterException 7.927
constructorRuntimeException 8.426

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 6.209

Surefire1490ReportTitleDescriptionIT

shouldHaveCustomizedReportTitleAndDescription 26.605
shouldHaveDefaultReportTitleAndDescription 12.928

Surefire162CharsetProviderIT

testCharsetProvider 6.286

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 6.015

Surefire257NotRerunningTestsIT

shouldNotRerun 8.373

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 14.74

Surefire34SecurityManagerIT

testSecurityManager 6.14
testSecurityManagerSuccessful 5.746

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 6.41

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 6.127
testTestNgAndJUnitTogether 7.016

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 6.433

Surefire42NotExtendingTestCaseIT

testInnerClass 6.379

Surefire44InnerClassTestIT

testInnerClass 5.922

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 6.506

Surefire510TestClassPathForkModesIT

testForkOnce 6.131
testForkAlways 5.9

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 5.555

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 17.216
testReportWithoutAggregate 15.721

Surefire613TestCountInParallelIT

testParallelBuildResultCount 7.012

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 7.497
testJunit3ParallelSuiteBuildResultCount 6.65
testJunit3AllParallelBuildResultCount 7.038
testJunit3BuildResultCount 7.374
testJunit3SuiteBuildResultCount 7.746

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 7.624

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 5.968

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 4.944
systemProperties 4.109

Surefire673MockitoIT

testBuildFailingWhenErrors 6.037

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 5.931

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 6.631

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 5.938

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 6.014

Surefire705ParallelForkTimeoutIT

testTimeoutForked 8.609

Surefire733AllOverrridesCapturedIT

testLogOutput 6.183

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 5.348
vmStartFailShouldFailBuildk 5.263

Surefire740TruncatedCommaIT

testRussianLocaleReport 5.073

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 10.812
testClassesParallelWithSuite 12.657

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 4.013
testSkippedFailsafeReportGeneration 3.764
testReportGeneration 3.64

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 3.884
testForcedFailsafeReportGeneration 3.911
testSkipForcedFailsafeReportGeneration 3.718
testReportGeneration 3.869

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 3.824
testSkippedSurefireReportGeneration 3.886
testSkipOptionalSurefireReportGeneration 3.803
testReportGeneration 4.048

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 3.774
testSkippedFailsafeReportGeneration 3.683
testReportGeneration 3.743

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 4.952

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 13.037
testSecondExecutionRunsAfterFirstExecutionFails 8.151

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 6.108
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

testNGRunCategoryAB 6.58
testExcludedGroups 6.687
testJUnitRunCategoryNotC 5.955
incorrectJUnitVersions 3.87
categoryAB 6.474
testNGRunCategoryNotC 6.218

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 5.842

Surefire817SystemExitIT

systemExit1 5.327

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 6.923

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 6.812
testJUnitRunEmptyGroups 6.757
testTestNGRunEmptyExcludeGroups 6.043
testTestNGRunEmptyGroups 6.035

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 6.681

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 7.239
classWithoutCategory 6.627

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 6.091

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 16.156
jarShouldUseFile 10.691
warShouldUseClasses 12.495
osgiBundleShouldUseFile 15.108

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 4.983

Surefire907PerThreadWithoutThreadCountIT

categoryAB 4.699

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 7.133
timeoutInForkWithNoBuildFail 6.978

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 8.976

Surefire930TestNgSuiteXmlIT

suiteXmlRun 6.632

Surefire943ReportContentIT

test_noParallel 12.505
test_parallelBoth 7.675

Surefire946KillMainProcessInReusableForkIT

testExit 7.548
testHalt 7.312
testInterrupt 7.352

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 7.679

Surefire975DefaultVMEncodingIT

runWithRussian1251 5.868

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 6.178

Surefire985ParameterizedRunnerAndCategoriesIT

test 5.304

Surefire995CategoryInheritanceIT

junit411ShouldRunExplicitCategory 5.133
junit411ShouldExcludeExplicitCategory 4.561
junit412ShouldExcludeInheritedCategory 5.023
junit412ShouldRunInheritedCategory 5.109
negativeTestShouldRunAllCategories 4.715

JUnit44HamcrestIT

testJUnit44Hamcrest 5.669

JUnit47ConcurrencyIT

test47 5.397

JUnit47ParallelIT

unknownThreadCountClasses 4.713
threadCountSuites 8.438
unlimitedThreadsSuitesAndMethods1 6.864
unlimitedThreadsSuitesAndMethods2 6.549
unknownThreadCountMethods 4.241
threadCountClassesAndMethods 6.304
reusableThreadCountClassesAndMethodsOptimized 6.912
unknownThreadCountSuites 4.246
reusableThreadCountAll 5.915
forcedShutdown 8.48
unknownThreadCountAll 4.989
serial 12.566
reusableThreadCountAllOptimized 6.703
suites 9.538
unlimitedThreadsMethods1 7.562
unlimitedThreadsMethods2 7.708
unlimitedThreadsSuitesAndClasses1 6.297
unlimitedThreadsSuitesAndClasses2 7.583
threadCountAllOptimized 6.595
threadCountAll 7.82
everyThreadCountSuitesAndClasses 6.602
unknownThreadCountBoth 5.102
threadCountSuitesAndClassesOptimized 6.682
classesAndMethods 6.903
everyThreadCountSuitesAndMethods 7.245
unknownThreadCountSuitesAndClasses 5.022
reusableThreadCountSuitesAndClassesOptimized 7.845
unknownThreadCountSuitesAndMethods 4.299
suitesAndClasses 7.65
suitesAndMethods 7.568
shutdown 10.605
threadCountClassesAndMethodsOneCore 11.65
everyThreadCountClassesAndMethods 7.801
all 6.891
unknownThreadCountClassesAndMethods 4.799
threadCountSuitesAndMethodsOptimized 7.047
reusableThreadCountSuitesAndMethodsOptimized 8.077
unlimitedThreadsClasses1 7.722
unlimitedThreadsClasses2 8.437
threadCountClasses 8.096
everyThreadCountAll 7.022
threadCountMethods 9.336
unlimitedThreadsSuites1 8.947
unlimitedThreadsSuites2 9.628
threadCountSuitesAndClasses 7.105
unlimitedThreadsClassesAndMethods1 7.41
unlimitedThreadsClassesAndMethods2 6.321
threadCountSuitesAndMethods 7.098
classes 8.544
reusableThreadCountSuitesAndClasses 7.995
methods 8.332
reusableThreadCountSuitesAndMethods 8.066
timeoutAndForcedShutdown 8.192
threadCountClassesAndMethodsOptimized 7.938
unlimitedThreadsAll1 6.387
unlimitedThreadsAll2 6.917
forcedShutdownVerifyingLogs 6.703
threadCountClassesAndMethodsOneCoreOptimized 10.74
reusableThreadCountClassesAndMethods 7.9

JUnit47ParallelNotThreadSafeIT

test 7.815

JUnit47RedirectOutputIT

testClassesParallel 6.735
testPrintSummaryTrueWithRedirect 7.7

JUnit47RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse 9.123
testRerunFailingErrorTestsWithOneRetry 6.56
testRerunFailingErrorTestsTwoRetry 6.263

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 6.381

JUnit47WithCucumberIT

testWithParallelClasses 8.41
testWithoutParallel 6.86

JUnit48TestCategoriesIT

testCategoriesACFullyQualifiedClassName 8.075
testBadCategoryForkAlways 8.928
testCategoriesABForkAlways 9.855
testCategoriesBadCategory 7.651
testCategoriesACClassNameSuffix 7.361
testCategoriesACFullyQualifiedClassNameForkAlways 8.804
testCategoriesAB 8.021
testCategoriesACClassNameSuffixForkAlways 9.333

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 7.736

JUnit4IgnoreIT

testJunit4Ignore 6.546
testJunit47ParallelIgnore 7.049

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 27.765
testRerunFailingErrorTestsWithOneRetry 28.766
testRerunFailingErrorTestsTwoRetry 29.275
testRerunOneTestMethod 28.2
testRerunOneTestClass 28.353

JUnit4RunListenerIT

testJUnit4RunListener 6.884
testRunlistenerJunitCoreProvider 7.319

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 6.89
testJunit[1: JUnit 4.1] 6.845
testJunit[2: JUnit 4.2] 7.353
testJunit[3: JUnit 4.3] 7.952
testJunit[4: JUnit 4.3.1] 7.764
testJunit[5: JUnit 4.4] 6.533
testJunit[6: JUnit 4.5] 7.034
testJunit[7: JUnit 4.6] 7.27
testJunit[8: JUnit 4.7] 7.153
testJunit[9: JUnit 4.8] 7.966
testJunit[10: JUnit 4.8.1] 7.446
testJunit[11: JUnit 4.8.2] 7.114
testJunit[12: JUnit 4.9] 7.855
testJunit[13: JUnit 4.10] 6.614
testJunit[14: JUnit 4.11] 7.104
testJunit[15: JUnit 4.12] 7.1

JUnitDepIT

testJUnit44DepWithSneaky381 7.248
testJUnit44Dep 7.068
testJUnit47Dep 7.859
testJUnit48Dep 7.737

JUnitPlatformIT

testVintageEngine 8.158
testJUnitPlatform_1_0_0 8.927
testJUnitPlatform_1_1_1 9.064
testJUnitPlatform_1_2_0 8.723
testTags 7.192
testJQwikEngine 8.365
testMultipleEngines 9.592
testJupiterEngine 7.687

LongWindowsPathIT

shouldRunInSystemTmp 6.9

ModulePathIT

testModulePath
+ [ Detail ]
 0.001
skipped

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 7.141

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 7.07

PlexusConflictIT

testPlexusConflict 6.859
testPlexusConflictIsolatedClassLoader 7.576

PojoSimpleIT

testit 7.2

ReportersIT

testRedirectOutputTestNg 7.89

ResultCountingIT

testCountingWithJunit481ForkAlways 11.337
testCountingWithJunit481ForkOnce 7.901
testCountingWithJunit481ForkNever 6.782

RunOrderIT

testReverseAlphabetical 7.326
testNonExistingRunOrder 5.251
testHourly 6.664
testAlphabetical 6.599

RunOrderParallelForksIT

testReverseAlphabetical 6.489
testNonExistingRunOrder 5.251
testHourly 7.25
testAlphabetical 6.991

SiblingAggregatorIT

testSiblingAggregator 7.266

SmartStackTraceIT

misg 7.192

SystemPropertiesTestIT

testSystemProperties 6.452
testSystemPropertiesNoFork 6.019

TestMethodPatternIT

testJUnit48WithCategoryFilter 8.357
testJUnit48Provider47 7.923
testMethodPatternAfter 7.987
testTestNGMethodPattern 7.517
testJUnit48Provider4 7.036
testJUnit44 7.365
testTestNgMethodBefore 7.874

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 6.479
shouldMatchExactClassAndMethodCharacters[0] 5.949
shouldMatchExactClassAndMethodWildcard[0] 5.372
testSuccessTwo[0] 6.116
simpleNameTest[0] 5.458
simpleNameTestWithJavaExt[0] 6.079
regexClass[0] 4.412
shouldNotRunExcludedClasses[0] 5.863
shouldNotRunExcludedMethods[0] 5.92
simpleNameTestWithJavaExtWildcardPkg[0] 5.719
shouldMatchMultiplePatterns[0] 6.428
shouldMatchExactClassAndMethodsPostfix[0] 5.837
simpleNameTestWithWildcardPkg[0] 6.126
shouldMatchWildcardPackageAndClassAndMethod[0] 5.807
shouldMatchExactClassAndMultipleMethods[0] 5.933
fullyQualifiedTest[0] 5.793
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 5.821
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 6.535
shouldMatchExactClassAndMethodsWildcard[0] 5.98
shouldMatchMultiplePatternsComplex[0] 5.415
simpleNameTestAsParallel[0]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[0] 5.891
shouldMatchMultiplePatternsAsParallel[0]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[0] 5.727
shouldMatchSimpleClassNameAndMethod[0] 5.816
shouldMatchExactClassAndMethodPostfix[0] 5.97
shouldMatchMultiplePatternsComplexAsParallel[0]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[0] 5.617
regexClassAndMethod[0] 5.971
shouldNotRunExcludedClassesAndMethods[1] 7.011
shouldMatchExactClassAndMethodCharacters[1] 6.877
shouldMatchExactClassAndMethodWildcard[1] 6.427
testSuccessTwo[1] 6.838
simpleNameTest[1] 6.596
simpleNameTestWithJavaExt[1] 6.855
regexClass[1] 6.72
shouldNotRunExcludedClasses[1] 7.027
shouldNotRunExcludedMethods[1] 6.52
simpleNameTestWithJavaExtWildcardPkg[1] 6.37
shouldMatchMultiplePatterns[1] 6.902
shouldMatchExactClassAndMethodsPostfix[1] 6.099
simpleNameTestWithWildcardPkg[1] 6.447
shouldMatchWildcardPackageAndClassAndMethod[1] 6.537
shouldMatchExactClassAndMultipleMethods[1] 5.907
fullyQualifiedTest[1] 6.324
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 6.967
negativeTest[1]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[1] 6.891
shouldMatchExactClassAndMethodsWildcard[1] 5.864
shouldMatchMultiplePatternsComplex[1] 5.853
simpleNameTestAsParallel[1] 5.001
matchSimpleClassAndMethodWithWildcardPkg[1] 4.98
shouldMatchMultiplePatternsAsParallel[1] 5.338
shouldNotRunExcludedClassesIfIncluded[1] 5.07
shouldMatchSimpleClassNameAndMethod[1] 5.175
shouldMatchExactClassAndMethodPostfix[1] 5.017
shouldMatchMultiplePatternsComplexAsParallel[1] 5.356
matchSimpleClassAndMethodWithJavaExt[1] 5.012
regexClassAndMethod[1] 6.327
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 5.53
simpleNameTestWithJavaExt[2] 6.11
regexClass[2] 6.371
shouldNotRunExcludedClasses[2] 6.019
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 6.12
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 5.853
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 6.199
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
negativeTest[2] 5.621
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 6.374
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0.001
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[3]
+ [ Detail ]
 0
skipped
testSuccessTwo[3]
+ [ Detail ]
 0
skipped
simpleNameTest[3] 5.723
simpleNameTestWithJavaExt[3] 5.82
regexClass[3] 6.149
shouldNotRunExcludedClasses[3] 6.479
shouldNotRunExcludedMethods[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[3] 6.384
shouldMatchMultiplePatterns[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[3] 6.79
shouldMatchWildcardPackageAndClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[3]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[3] 6.359
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
+ [ Detail ]
 0.001
skipped
negativeTest[3] 5.021
testRegexSuccessTwo[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[3]
+ [ Detail ]
 0.001
skipped
simpleNameTestAsParallel[3] 5.799
matchSimpleClassAndMethodWithWildcardPkg[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[3]
+ [ Detail ]
 0.001
skipped
shouldNotRunExcludedClassesIfIncluded[3] 6.285
shouldMatchSimpleClassNameAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[3]
+ [ Detail ]
 0
skipped
regexClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[4]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodWildcard[4]
+ [ Detail ]
 0
skipped
testSuccessTwo[4]
+ [ Detail ]
 0
skipped
simpleNameTest[4] 5.792
simpleNameTestWithJavaExt[4] 5.409
regexClass[4] 6.094
shouldNotRunExcludedClasses[4] 5.323
shouldNotRunExcludedMethods[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[4] 6.045
shouldMatchMultiplePatterns[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[4] 4.955
shouldMatchWildcardPackageAndClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[4]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[4] 5.579
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
+ [ Detail ]
 0
skipped
negativeTest[4] 5.577
testRegexSuccessTwo[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[4]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[4] 6.143
shouldMatchSimpleClassNameAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[4]
+ [ Detail ]
 0
skipped
regexClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[5]
+ [ Detail ]
 0
skipped
testSuccessTwo[5]
+ [ Detail ]
 0
skipped
simpleNameTest[5] 6.335
simpleNameTestWithJavaExt[5] 6.395
regexClass[5] 6.849
shouldNotRunExcludedClasses[5] 6.692
shouldNotRunExcludedMethods[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[5] 5.683
shouldMatchMultiplePatterns[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[5] 5.8
shouldMatchWildcardPackageAndClassAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[5]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[5] 6.401
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
+ [ Detail ]
 0
skipped
negativeTest[5] 4.976
testRegexSuccessTwo[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[5]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[5] 6.814
matchSimpleClassAndMethodWithWildcardPkg[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[5]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[5] 6.431
shouldMatchSimpleClassNameAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[5]
+ [ Detail ]
 0
skipped
regexClassAndMethod[5]
+ [ Detail ]
 0
skipped

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 6.402
shouldMatchExactClassAndMethodCharacters[0] 6.195
shouldMatchExactClassAndMethodWildcard[0] 6.585
testSuccessTwo[0] 6.484
simpleNameTest[0] 6.204
simpleNameTestWithJavaExt[0] 6.094
regexClass[0] 5.53
shouldNotRunExcludedClasses[0] 6.092
shouldNotRunExcludedMethods[0] 6.031
simpleNameTestWithJavaExtWildcardPkg[0] 5.689
shouldMatchMultiplePatterns[0] 6.979
shouldMatchExactClassAndMethodsPostfix[0] 5.959
simpleNameTestWithWildcardPkg[0] 6.591
shouldMatchWildcardPackageAndClassAndMethod[0] 5.298
shouldMatchExactClassAndMultipleMethods[0] 6.446
fullyQualifiedTest[0] 6.794
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 6.06
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 6.267
shouldMatchExactClassAndMethodsWildcard[0] 6.224
shouldMatchMultiplePatternsComplex[0] 5.682
simpleNameTestAsParallel[0] 6.239
matchSimpleClassAndMethodWithWildcardPkg[0] 6.071
shouldMatchMultiplePatternsAsParallel[0] 6.757
shouldNotRunExcludedClassesIfIncluded[0] 6.155
shouldMatchSimpleClassNameAndMethod[0] 6.214
shouldMatchExactClassAndMethodPostfix[0] 6.825
shouldMatchMultiplePatternsComplexAsParallel[0] 6.847
matchSimpleClassAndMethodWithJavaExt[0] 5.196
regexClassAndMethod[0] 6.107
shouldNotRunExcludedClassesAndMethods[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[1]
+ [ Detail ]
 0
skipped
testSuccessTwo[1]
+ [ Detail ]
 0
skipped
simpleNameTest[1] 6.401
simpleNameTestWithJavaExt[1] 6.452
regexClass[1] 6.184
shouldNotRunExcludedClasses[1] 6.229
shouldNotRunExcludedMethods[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[1] 5.401
shouldMatchMultiplePatterns[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[1] 6.492
shouldMatchWildcardPackageAndClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[1]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[1] 6.255
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
+ [ Detail ]
 0
skipped
negativeTest[1] 5.294
testRegexSuccessTwo[1]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodsWildcard[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[1]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[1] 6.118
matchSimpleClassAndMethodWithWildcardPkg[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[1] 6.536
shouldMatchSimpleClassNameAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[1]
+ [ Detail ]
 0
skipped
regexClassAndMethod[1]
+ [ Detail ]
 0.001
skipped
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 6.068
simpleNameTestWithJavaExt[2] 6.604
regexClass[2] 6.674
shouldNotRunExcludedClasses[2] 6.289
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 6.364
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 5.308
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 6.547
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
negativeTest[2] 5.092
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0.001
skipped
simpleNameTestAsParallel[2] 5.507
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 6.06
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped

TestMultipleMethodsIT

testJunit48Provider4 7.198
testJunit44 5.559
testJunit48Provider47 8.235

TestNgGroupsIT

testExclusion 9.3
testGroupsAndExclusion 7.62
groupsWithDash 7.452
testOnlyGroups 7.754
groupsBySimpleRegex 7.225

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 8.452

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 5.605

TestSingleMethodIT

fullyQualifiedTestNg 7.507
testJunit48Provider4 6.472
testJunit44 7.214
testJunit48parallel 7.023
testJunit48Provider47 8.167
fullyQualifiedJunit48Provider47 7.962
fullyQualifiedJunit48Provider4 7.245
testTestNg5149 7.137
testTestNg 8.338

TimeoutForkedTestIT

testTimeoutForked 7.771

TwoTestCasesIT

testJunit4Suite 7.338
testTestNGSuite 7.568
testTwoTestCases 7.232
testTwoTestCaseSuite 7.233

UmlautDirIT

testUmlautIsolatedClassLoader 9.319
testUmlaut 6.779

UnicodeTestNamesIT

checkFileNamesWithUnicode 9.361

UseIsolatedClassLoaderIT

testUseSystemClassLoader 7.456

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 4.878

WorkingDirectoryIT

testWorkingDirectory 7.485
testWorkingDirectoryChildOnlyNoFork 5.792
testWorkingDirectoryNoFork 6.249
testWorkingDirectoryChildOnly 5.643

WorkingDirectoryMissingIT

testWorkingDirectory 7.804

XmlReporterRunTimeIT

testForkModeAlways 28.077

Failure Details

[Summary] [Package List] [Test Cases]


suiteXmlForkModeAlways
skipped: Fails - see SUREFIRE-1123
XXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
XXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
shouldLoadMultipleJavaModules_JavaHome
skipped: skipped
shouldLoadMultipleJavaModules_ToolchainsXML
skipped: skipped
shouldLoadMultipleJavaModules_JvmParameter
skipped: skipped
shouldRunInPluginJava9
skipped: skipped
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
testModulePath
skipped: skipped
negativeTest[0]
skipped: skipped
simpleNameTestAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: skipped
negativeTest[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
simpleNameTestAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[3]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[3]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[3]
skipped: skipped
testSuccessTwo[3]
skipped: skipped
shouldNotRunExcludedMethods[3]
skipped: skipped
shouldMatchMultiplePatterns[3]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[3]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
skipped: skipped
testRegexSuccessTwo[3]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[3]
skipped: skipped
shouldMatchMultiplePatternsComplex[3]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[3]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[3]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[3]
skipped: skipped
regexClassAndMethod[3]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[4]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[4]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[4]
skipped: skipped
testSuccessTwo[4]
skipped: skipped
shouldNotRunExcludedMethods[4]
skipped: skipped
shouldMatchMultiplePatterns[4]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[4]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
skipped: skipped
testRegexSuccessTwo[4]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[4]
skipped: skipped
shouldMatchMultiplePatternsComplex[4]
skipped: skipped
simpleNameTestAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[4]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[4]
skipped: skipped
regexClassAndMethod[4]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[5]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[5]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[5]
skipped: skipped
testSuccessTwo[5]
skipped: skipped
shouldNotRunExcludedMethods[5]
skipped: skipped
shouldMatchMultiplePatterns[5]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[5]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
skipped: skipped
testRegexSuccessTwo[5]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[5]
skipped: skipped
shouldMatchMultiplePatternsComplex[5]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[5]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[5]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[5]
skipped: skipped
regexClassAndMethod[5]
skipped: skipped
negativeTest[0]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[1]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[1]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[1]
skipped: skipped
testSuccessTwo[1]
skipped: skipped
shouldNotRunExcludedMethods[1]
skipped: skipped
shouldMatchMultiplePatterns[1]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[1]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
skipped: skipped
testRegexSuccessTwo[1]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[1]
skipped: skipped
shouldMatchMultiplePatternsComplex[1]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[1]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[1]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[1]
skipped: skipped
regexClassAndMethod[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped