Skip to content

Membership inference

Determine whether a specific record was in a black-box model's training set.

Determine whether a specific record was in the target model’s training set. Import from dreadnode.airt. See Traditional ML Red Teaming for the workflow.

FactoryTechnique
threshold_membershipConfidence / entropy / loss threshold (Yeom)
entropy_membershipPrediction-entropy signal
loss_membershipPer-example loss signal
label_only_membershipLabel-only inference (Choquette-Choo)
shadow_model_membershipShadow-model attack
lira_membershipLikelihood-ratio attack (LiRA)