The total number of tests that are expected to run when this Suite
's run
method is invoked.
The total number of tests that are expected to run when this Suite
's run
method is invoked.
a Filter
with which to filter tests to count based on their tags
A List
of this Suite
object's nested Suite
s.
A List
of this Suite
object's nested Suite
s. If this Suite
contains no nested Suite
s,
this method returns an empty List
.
Runs this suite of tests.
Runs this suite of tests.
an optional name of one test to execute. If None
, all relevant tests should be executed.
I.e., None
acts like a wildcard that means execute all relevant tests in this Suite
.
the Reporter
to which results will be reported
the Stopper
that will be consulted to determine whether to stop execution early.
a Filter
with which to filter tests based on their tags
a Map
of key-value pairs that can be used by the executing Suite
of tests.
an optional Distributor
, into which to put nested Suite
s to be executed
by another entity, such as concurrently by a pool of threads. If None
, nested Suite
s will be executed sequentially.
a Tracker
tracking Ordinal
s being fired by the current thread.
if any passed parameter is null
.
Runs zero to many of this suite's nested suites.
Runs zero to many of this suite's nested suites.
the Reporter
to which results will be reported
the Stopper
that will be consulted to determine whether to stop execution early.
a Filter
with which to filter tests based on their tags
a Map
of key-value pairs that can be used by the executing Suite
of tests.
an optional Distributor
, into which to put nested Suite
s to be run
by another entity, such as concurrently by a pool of threads. If None
, nested Suite
s will be run sequentially.
a Tracker
tracking Ordinal
s being fired by the current thread.
if any passed parameter is null
.
Runs a test.
Runs a test.
the name of one test to execute.
the Reporter
to which results will be reported
the Stopper
that will be consulted to determine whether to stop execution early.
a Map
of key-value pairs that can be used by the executing Suite
of tests.
a Tracker
tracking Ordinal
s being fired by the current thread.
if any of testName
, reporter
, stopper
, configMap
,
or tracker
is null
.
Runs zero to many of this suite's tests.
Runs zero to many of this suite's tests.
an optional name of one test to run. If None
, all relevant tests should be run.
I.e., None
acts like a wildcard that means run all relevant tests in this Suite
.
the Reporter
to which results will be reported
the Stopper
that will be consulted to determine whether to stop execution early.
a Filter
with which to filter tests based on their tags
a Map
of key-value pairs that can be used by the executing Suite
of tests.
an optional Distributor
, into which instances of this Suite
class
that are responsible for executing individual tests contained in this Suite, or groups of this Suite
's
tests, may be placed so as to be run
by another entity, such as concurrently by a pool of threads.
a Tracker
tracking Ordinal
s being fired by the current thread.
if any of testName
, reporter
, stopper
, groupsToInclude
,
groupsToExclude
, or configMap
is null
.
Suite style name.
Suite style name.
A Map
whose keys are String
tag names with which tests in this Suite
are marked, and
whose values are the Set
of test names marked with each tag.
A Map
whose keys are String
tag names with which tests in this Suite
are marked, and
whose values are the Set
of test names marked with each tag. If this Suite
contains no tags, this
method returns an empty Map
.
Subclasses may implement this method to define and/or discover tags in a custom manner, but overriding method implementations
should never return an empty Set
as a value. If a tag has no tests, its name should not appear as a key in the
returned Map
.
An Set
of test names.
An Set
of test names. If this Suite
contains no tests, this method returns an empty Set
.
Although subclass and subtrait implementations of this method may return a Set
whose iterator produces String
test names in a well-defined order, the contract of this method does not required a defined order. Subclasses are free to
implement this method and return test names in either a defined or undefined order.
The time limit, in milliseconds, in which each test in a Suite
that mixes in
TimeLimitedTests
must complete.
The default Interruptor
strategy used to interrupt tests that exceed their time limit.
The default Interruptor
strategy used to interrupt tests that exceed their time limit.
This trait's implementation of this method returns ThreadInterruptor
, which invokes interrupt
on the main test thread. Override this method to change the test interruption strategy.
a ThreadInterruptor
A stackable implementation of withFixture
that wraps a call to super.withFixture
in a
failAfter
invocation.
A stackable implementation of withFixture
that wraps a call to super.withFixture
in a
failAfter
invocation.
the test on which to enforce a time limit
Trait that when mixed into a suite class establishes a time limit for its tests.
This trait overrides
withFixture
, wrapping asuper.withFixture(test)
call in afailAfter
invocation, specifying a timeout obtained by invokingtimeLimit
and anInterruptor
by invokingdefaultTestInterruptor
:failAfter(timeLimit) { super.withFixture(test) } (defaultTestInterruptor)
Note that the
failAfter
method executes the body of the by-name passed to it using the same thread that invokedfailAfter
. This means that the same thread will run thewithFixture
method as well as each test, so no extra synchronization is required. A second thread is used to run a timer, and if the timeout expires, that second thread will attempt to interrupt the main test thread via thedefaultTestInterruptor
.The
timeLimit
field is abstract in this trait. Thus you must specify a time limit when you use it. For example, the following code specifies that each test must complete within 200 milliseconds:If you run the above
ExampleSpec
, the second test will fail with the error message:The test did not complete within the specified 200 millisecond time limit.
If you prefer, you can mix in or import the members of
SpanSugar
and place units on the time limit, for example:The
failAfter
method uses anInterruptor
to attempt to interrupt the main test thread if the timeout expires. The defaultInterruptor
returned by thedefaultTestInterruptor
method is aThreadInterruptor
, which callsinterrupt
on the main test thread. If you wish to change this interruption strategy, overridedefaultTestInterruptor
to return a differentInterruptor
. For example, here's how you'd change the default toDoNotInterrupt
, a very patient interruption strategy that does nothing to interrupt the main test thread:Like the previous incarnation of
ExampleSuite
, the second test will fail with an error message that indicates a timeout expired. But whereas in the previous case, theThread.sleep
would be interrupted after 200 milliseconds, in this case it is never interrupted. In the previous case, the failed test requires a little over 200 milliseconds to run. In this case, because thesleep(300)
is never interrupted, the failed test requires a little over 300 milliseconds to run.