Evaluation and Report Language (EARL) 1.0 Schema
Formal schema of the Evaluation and Report Language (EARL) 1.0
Editor's Working Draft 10 June 2009
Assertion
a statement that embodies the results of a test
Assertor
an entity such as a person, a software tool, an organization, or any other grouping that carries out a test collectively
Test Subject
the class of things that have been tested against some test criterion
Test Criterion
a testable statement, usually one that can be passed or failed
Test Requirement
a higher-level requirement that is tested by executing one or more sub-tests
Test Case
an atomic test, usually one that is a partial test for a requirement
Test Result
the actual result of performing the test
Test Mode
describes how a test was carried out
Outcome Value
a discrete value that describes a resulting condition from carrying out the test
Pass
the class of outcomes to denote passing a test
Fail
the class of outcomes to denote failing a test
Undetermined
the class of outcomes to denote an undetermined outcome
Not applicable
the class of outcomes to denote the test is not applicable
Not tested
the class of outcomes to denote the test has not been carried out
Software
any piece of software such as an authoring tool, browser, or evaluation tool
Asserted By
assertor of an assertion
Subject
test subject of an assertion
Test
test criterion of an assertion
Result
result of an assertion
Mode
mode in which the test was performed
Main Assertor
assertor that is primarily responsible for performing the test
Outcome
outcome of performing the test
Pointer
location within a test subject that are most relevant to a test result
Info
additional warnings or error messages in a human-readable form
Automatic
where the test was carried out automatically by the software tool and without any human intervention
Manual
where the test was carried out by human evaluators
Semi-Automatic
where the test was partially carried out by software tools, but where human input or judgment was still required to decide or help decide the outcome of the test
Undisclosed
where the exact testing process is undisclosed
Unknown
where the testing process is unknown or undetermined
Passed
the subject passed the test
Failed
the subject failed the test
Cannot tell
it is unclear if the subject passed or failed the test
Inapplicable
the test is not applicable to the subject
Untested
the test has not been carried out