Red-teaming and adversarial testing

Red-teaming is structured adversarial testing: deliberately trying to make the system produce unsafe, off-policy, or incorrect outputs. Done well, it produces a regression suite that catches future failures. Done poorly, it's anecdote collection.