CAA as an adversarial red-teaming tool (proposed application) — relocates the attack surface of → Red Teaming

hindsight · grounded in Steering Llama 2 via Contrastive Activation Addition · explored within the theme Elicitation as audit: steering for red-teaming

Red teaming, as practiced across the earlier corpus, means finding adversarial inputs: prompts, conversations, or scenarios that make a model produce unsafe output, whether hunted by crowdworkers or generated by another LM. caa-red-teaming-application proposes something that only became conceivable once activation engineering existed as a mature technique: instead of searching input space for a prompt that triggers a bad behavior, perturb the model's internal activations directly with a steering vector and see whether the behavior can be triggered that way (contrastive-activation-addition, §"9.1 Suggested future work", p. 9). This changes what "finding" a vulnerability means. Prompt-based red-teaming is fundamentally a search problem over an enormous, poorly understood input space, and the paper notes that "systematically finding inputs that reveal these flaws is challenging." Activation-space elicitation sidesteps that search: the intervention is a single vector and a multiplier, applied directly, rather than a string that has to be discovered by trial or generation. The two approaches probe the same underlying question -- can this behavior be elicited at all -- through different surfaces, one external and anecdotal, one internal and systematic.