Knowledge Maxxing← Back to topic library
Responsible Tech MaxxingAdvancedSafety Testing90 sec
Adversarial testing
Adversarial testing systematically probes a system with inputs specifically crafted to trigger incorrect or harmful behavior, rather than testing with typical, expected inputs.
Prerequisite: Red teaming
What matters
Because real-world misuse rarely looks like a typical test case, adversarial testing is what reveals how a system behaves under conditions it wasn't explicitly designed for.
Example
Testing an image classifier with subtly altered images specifically designed to fool it into a wrong classification is adversarial testing.
Common misconception
Adversarial testing is not just testing edge cases that happen to occur naturally; it specifically involves inputs deliberately crafted to exploit a weakness.
Recall question
How does an adversarial test input differ from a typical edge-case test input?
Keywords and related concepts
adversarial testingcrafted inputsrobustnessred teaming