Break output guardrails by controlling the answer channel
When a separate model checks the final answer, you can route the payload through a channel the checker does not read, like code or a citation.
When a separate model checks the final answer, you can route the payload through a channel the checker does not read, like code or a citation.
When an app renders model output as HTML without sanitizing, an attacker who controls part of the prompt gets XSS in the victim's session.