Anthropic has Claude grade its own conversations for about 10 tokens
After each reply, Anthropic adds one hidden turn and Claude returns a JSON safety flag in ~10 tokens, under 2% of compute. The KV cache makes it cheap.
Anthropic's Safeguards team published how Claude monitors its own conversations for misuse. After each reply, the system appends a short hidden instruction aski...
via X