LLM poisoning: the brand attack nobody is watching for

It takes a few hundred documents — not millions — to change how an AI model behaves. If AI assistants are becoming the first place your customers hear about you, poisoning is a reputation risk that deserves a detection plan.

In late 2025, Anthropic, the UK AI Security Institute and the Alan Turing Institute published the largest LLM data-poisoning study to date — and its headline finding dismantled a comfortable assumption. The field had believed that poisoning a big model required controlling a meaningful percentage of its training data, putting attacks out of reach. It doesn't.

~250malicious documents were enough to reliably backdoor language models from 600M to 13B parameters — a near-constant number regardless of model or dataset size (Anthropic et al., 2025).

As The Register put it, data quantity turns out not to be the barrier anyone thought — larger models don't need proportionally more poisoned data. Security press immediately started asking the operational question: what does an attacker do with this? The study tested benign backdoors deliberately. But the mechanism is general — plant enough crafted content where training and retrieval pipelines will ingest it, and you can nudge how a model completes certain prompts.

Why this is a brand problem, not just a security problem

Poisoning discussions usually live in security teams. That misses where the damage lands. As we covered in the previous post, AI assistants are becoming the first — often only — place a customer hears an assessment of your brand, your candidate, or your agency's guidance. Now put those two facts together:

A competitor, an activist operation, or a state actor doesn't need to hack anything. They need to seed the web with content that the next training run or retrieval index ingests. The result doesn't look like an attack — it looks like "the AI said so."

The detection problem: poisoning is invisible without a baseline

Here's the trap: if you don't systematically record what the models say about you, a poisoned answer is indistinguishable from an ordinary one. There's no error message. The model is just as confident. The only observable signature is change over time — and you can only see change if you captured the "before."

That's what daily, deterministic answer monitoring gives you. Lanice AI's LLM Benchmarking asks the same questions to the same models every day at temperature 0, embeds every answer, and stores the concrete model version that served it. That turns poisoning detection into a solvable classification problem:

A drift spike with no release behind it is the poisoning signature. Without a version-stamped daily baseline, you simply cannot see it.

An AI judge then reads the before-and-after answers and reports what actually moved: sentiment toward the subject, stance changes, and specific claims that appeared or vanished — "newly mentions a safety recall," "no longer recommends over competitor." You get the changed sentences highlighted, the morning it happens, instead of discovering months later that every assistant on Earth quietly turned on you.

Observational, deliberately

One boundary worth stating: monitoring should watch the models, not fight them. Lanice AI's benchmarking is strictly observational — it records how catalog models answer a fixed question set; it does not attempt to steer, jailbreak or counter-poison the models being watched. Defence here is knowing fast, then responding in the open: corrections, content, provider escalation, comms. The teams that will handle their first AI-layer reputation incident well are the ones who already know what "normal" looks like.

Rehearse it before the world sees it.

Lanice AI builds a synthetic audience to your exact spec and runs your message, survey, website or model monitor against it — live, on a demo call.

Book a demo

Sources & further reading

  1. Anthropic — A small number of samples can poison LLMs of any size
  2. The Register — Data quantity doesn't matter when poisoning an LLM
  3. Dark Reading — It Takes Only 250 Documents to Poison Any AI Model
  4. Engadget — Researchers find just 250 malicious documents can leave LLMs vulnerable to backdoors