Skip to content

Attacks Reference

Reference for the 100+ adversarial attacks Dreadnode AI red teaming runs across generative AI and traditional ML, from LLM jailbreaks to evasion, extraction, membership inference, inversion, and multimodal probing.

An adversarial attack is a systematic search for inputs that make an AI system violate its intended behavior: a jailbreak that bypasses safety alignment, a perturbation that flips a classifier’s prediction, or an injection that hijacks an agent’s actions. Each attack is an optimization loop that iterates against the target and scores how far it moved that behavior.

Dreadnode AI red teaming provides 100+ adversarial attacks. They split into two families:

CategoryAttacksBest for
Core jailbreakTAP, PAIR, GOAT, Crescendo, Rainbow, GPTFuzzer, BEAST, AutoDAN, ReNeLLM, DrAttack, Deep Inception, PromptGeneral-purpose jailbreak testing
Advanced adversarialAutoRedTeamer, NEXUS, Siren, CoT Jailbreak, Genetic Persona, JBFuzz, T-MAP, APRT, and 21 moreStronger targets, specialized techniques
White-box (open-box)GCG, Faster-GCG, I-GCG, AttnGCG, Mask-GCG, ARCA, GBDA, PEZ, COLD, Soft-GCG, AmpleGCG, refusal ablation, soft-prompt, LatentBreakOpen-weight surrogates, transfer to your target
Agent attacksIterInject, AgentVigil, EVATool-using, RAG, and GUI/computer-use agents
MultimodalMultimodal AttackCross-modality probing
EvasionHopSkipJump, SimBA, Square, ZOO, TextFooler, and moreFlipping a classifier’s prediction
ExtractionKnockoff, Copycat, ActiveThief, Jacobian, and moreStealing a surrogate copy of a model
Membership inferenceLiRA, shadow-model, loss/entropy threshold, label-onlyDetecting training-set membership
Model inversionMI-Face, NES inversionReconstructing training inputs
Image adversarialSimBA, NES, ZOO, HopSkipJumpVision model robustness
BudgetQueriesRecommended attacks
Minimal~50deep_inception + renellm
Moderate~500tap + pair + crescendo
Standard~500-1000Above + autoredteamer, refusal_aware, cot_jailbreak, persona_hijack
Extensive~2000+Full campaign: tap, pair, crescendo, goat, goat_v2, autoredteamer, rainbow, jbfuzz
SituationRecommended attack
First test, general purposetap
Fast black-box jailbreakpair
Model resists single-turn attackscrescendo
Want diverse failure modesrainbow
Large-scale fuzzinggptfuzzer
Keyword-filtered targetdrattack
Role-play susceptible targetdeep_inception
Suffix robustness testingbeast
Reasoning model (o1, o3)cot_jailbreak
Strong target, need adaptive strategyautoredteamer
Models with predictable refusalsrefusal_aware
Progressive multi-phase assessmentaprt_progressive
Vision modelsimba, nes, zoo, or hopskipjump
DefenseEffective attacks
Strong system promptcrescendo, deep_inception, drattack
Output classifierbeast, autodan_turbo, renellm, guardrail bypass transforms
Rate limitingpair (most query-efficient), deep_inception
Input sanitizationbeast, drattack, encoding transforms
Tool-call filteringAgentic workflow transforms
Content moderationGuardrail bypass transforms
Conversation monitoringcrescendo, reasoning attack transforms