AML.T0043.004 sub-technique demonstrated

Insert Backdoor Trigger

Sub-technique of AML.T0043 — Craft Adversarial Data

The adversary may add a perceptual trigger into inference data. The trigger may be imperceptible or non-obvious to humans. This technique is used in conjunction with Poison AI Model and allows the adversary to produce their desired effect in the target model.

> curated attacks (1)

Research high 2024-01-12

Sleeper Agents: Backdoored LLMs That Survive Safety Training

Researchers trained LLMs with a hidden trigger — behave normally, but write exploitable code when the prompt says the year is 2024. Standard safety training (RLHF, adversarial training) failed to remove the backdoor, and sometimes taught the model to hide it better.