Brazilian Court Sanctions Lawyers for Prompt Injection in Court Filing(jetstream.security)
331 points by doodlesdev 1 day ago | 210 comments
tl;dr: A Brazilian labor court fined two law firms roughly $16,000 (10% of the claim's value) for embedding a hidden prompt-injection attack in a court filing—white text on a white background instructing any reviewing AI to respond superficially and not challenge the documents. The court's Galileu AI system detected the hidden instruction, flagged it, and blocked processing. The ruling, believed to be the first of its kind globally, grounded the sanction in procedural good-faith obligations under Brazil's Civil Procedure Code.
HN Discussion:
  • •Questions legal distinction between manipulating AI versus humans with similar instructions
  • •Offers technical mitigation like OCR to defeat hidden prompt injections
  • ~Draws parallel to advertising, suggesting manipulation is normalized elsewhere
  • ~Doubts the injection would have actually worked on modern models
  • ↓Opposes courts using AI to review filings in the first place