AMTSO
Also written Anti-Malware Testing Standards Organization
The industry body that sets standards for how security products are tested fairly. Its Guidelines for Testing of Agentic Security Products v1.0 (2 September 2026) is the first testing standard written for this category: it defines test-case classification dimensions (attack vector, target of protection, environment, harm type, severity, required capability), insists that model refusal not be counted as product protection, and asks testers to report the distribution of outcomes rather than a single pass or fail.
See also model refusal · variance · how we test
Related terms
-
Model refusal
Testing & measurement
The underlying model declining the request on its own, with no security product involved.
-
Variance
Testing & measurement
How much a result moves when the same test is run again. Any figure involving a model is a sample from a distribution, not a constant — the same judge…
Frameworks & standards
What auditors, buyers and regulators reference. See the compliance crosswalk for the control-by-control mapping.