Inside the 32 Signals: How ContentTrace Reads a Draft
- →ContentTrace reads a draft the way a strict editor would: Claude applies a fixed rubric to seven sections in parallel calls, at temperature 0.
- →Every signal gets a score from 0 to 10 plus two short observations that point to the exact text behind the score.
- →The eighth section, Statistical Proxies, is measured in code and shown for reference only. It carries no weight in the Human Score.
- →Ten content types change the section weights and mark signals that don't fit the genre as N/A, so a white paper isn't punished for lacking a personal story.
- →Calibration maps the raw score so typical AI text lands near 25 and typical human text near 75, capped between 2 and 98.
- →The observations are worth more than the number. Edit what they point to, then score again.
Paste a draft into ContentTrace and seven requests leave at the same moment. Each one carries the full text and a single section of a fixed rubric. A few seconds later, seven sets of scores come back, each signal with two short notes attached, and code adds a handful of measurements on the side. The Human Score at the top of the report is the last thing computed, and the least interesting.
That ordering is deliberate. Since the scoring engine was rebuilt on September 30, 2026, the method has been simple to describe and slightly unusual: a language model acting as an editor, a rubric it can't improvise around, and a calibration step that turns raw marks into a number people can read. No secret classifier. No model trained on your writing.
This post walks through each piece, because a score you can't inspect is a score you shouldn't trust.
28 are judged against a rubric. 4 are measured in code and shown for reference.
An editor with a fixed rubric
The core of the engine is what researchers call LLM-as-a-judge. Claude, Anthropic's model, reads the draft as an editor and scores it against written criteria. The approach has a real research base. In the MT-Bench and Chatbot Arena study, Lianmin Zheng and colleagues found that strong model judges reached over 80% agreement with human preferences, about the same rate at which humans agree with each other.
The same study listed the weak spots: position bias, verbosity bias, self-enhancement bias. A rubric is the fix for most of them. The judge isn't asked whether a draft "feels human." It's asked to rate specific, named behaviors, one at a time, on a 0 to 10 scale.
The obvious design is one large prompt that reads the whole draft and returns all 28 judged signals at once. It works on paper. In practice, a single call juggling that many criteria risks letting them bleed into each other, so a draft with great word choice drifts upward on voice too. Splitting the work into seven parallel calls, one per section, keeps each judgment narrow. It also happens to be faster, which is a nice side effect of good hygiene.
Every call runs at temperature 0, the setting that removes most of the model's randomness. Anthropic's API documentation recommends values near 0 for analytical work and adds an honest caveat: even at 0, results aren't fully deterministic. So the promise is the same score or a very close one for the same text, never a magic fixed number. Anyone selling the second version is selling something.
Two observations per signal, pointing at the text
A bare 4 out of 10 on Opinion Strength tells you almost nothing. That's why every signal comes back with two short observations that cite the draft itself: the hedge in the second paragraph, the conclusion that weighs both sides and picks neither, the example that reads like it was invented for the occasion.
This is the insider detail most people miss on their first report. The notes are the product. The scores exist so you know which notes to read first.
The rubric also names the newer habits of AI drafts, the ones that slipped past older checklists: chat-style openers and closing offers, the "it isn't this, it's that" contrast formula, ideas grouped in threes over and over, em dashes used for rhythm, conclusions that never commit, smooth coverage with no insider detail, and empathy that could apply to anyone. There's a mild irony in asking a model to spot these. It knows the moves because models made them famous.
That irony carries a real risk. The G-Eval paper by Yang Liu and colleagues warned that LLM evaluators may favor text written by LLMs. A judge left to its own taste might reward the very polish it produces. Naming the patterns explicitly is the counterweight.
Eight sections, and the one that carries no weight
The 32 signals sit in eight sections. Seven are judged by the rubric. The eighth, Statistical Proxies, holds Vocabulary Richness, Burstiness Approximation, Response Calibration and Entropy Variance. Those four are computed in code and shown in the report, but they carry no weight in the Human Score.
That last choice surprises people, and it should. Burstiness, the idea that human sentence lengths swing more than machine ones, is the most quoted "AI tell" on the internet. It's also easy to fake and easy to misread, since plenty of careful human writers keep an even rhythm. A metric that sounds scientific and moves the score on noise does more harm than good, so it stays on the page as context and off the scale.
The default weights favor thinking over surface. Cognitive Fingerprinting leads at 16%, then Word Choice & Phrasing at 15% and Voice & Perspective at 14%. Content & Logic sits at 13%, Structure & Flow and Emotional Texture at 12% each, and Pragmatics & Subtext at 10%. They're relative weights: the score is a weighted average over whichever sections apply to the text.
Content types decide what counts
A rubric that expects personal stories everywhere would flunk every API reference ever written. So ContentTrace sorts each text into one of 10 content types, detected automatically or picked by you: General, Personal blog / essay, Thought leadership / opinion, Company blog / brand article, Corporate / white paper, Technical / documentation, Academic / student essay, Marketing / web copy, Social post, and Email / letter.
Each type shifts the section weights and marks signals that don't fit the genre as N/A, which removes them from the score. A company blog post leaves out Personal Anecdotes Present, Vulnerability Present, Opinion Drift / Self-Correction and Thinking Out Loud, because brand articles rarely speak as one person. Technical documentation leaves out 7 signals, including Opinion Strength and Irony or Dry Humor. Nobody wants jokes in their install guide.
"When a signal doesn't fit the genre, its absence says nothing about the writing. So the rubric stops asking."Content Trace · Voice & Perspective Signal
Calibration: from raw marks to a readable score
Raw rubric scores mean different things in different genres. Formal writing scores lower on voice signals even when a person wrote every word, while a chatty email scores higher. Comparing them on one scale would be unfair to the white paper.
So the content types roll up into 4 calibration groups: formal (academic, technical, corporate), business (company blog, thought leadership, marketing), personal (personal blog, social, email) and general (chat or Q&A answers and mixed text). Within each group, the displayed score is anchored so it reads 25 at the median raw score of AI samples and 75 at the median raw score of human samples.
The result is capped between 2 and 98. No score of 0, no score of 100. That cap is a small, stubborn piece of honesty: no tool can be certain who wrote a text, so the scale refuses to pretend.
How to use the report without chasing the number
There's a specific sinking feeling in pasting a draft you're proud of and watching the Human Score come back at, say, 41. The instinct is to start fiddling: add a contraction here, a short sentence there, hit score again. That route produces cosmetic edits and very little better writing.
The better route is boring and works. Open the lowest section. Read both observations under its lowest signal. Go to the passage they quote and fix the thing they describe, usually by adding something real: a position, a detail only someone close to the work would know, a moment where the argument turns. Then score again and see whether the observations changed. A draft readers finish is the target, and the signals map the parts they'd skip.
ContentTrace is pro-AI by design. Drafting with a model is fine. Google's guidance on helpful content asks how and why a page was made, and treats automation as something to disclose where readers would expect it, never as a ban. The report exists to show where an AI-assisted draft still reads like everybody else's, so the final version doesn't.
Frequently asked questions
To turn a report into edits, How to Read a Detection Report walks through it section by section. Why Your AI Detector Score Keeps Changing covers why fixed settings matter. And How to Humanize AI Content maps practical edits to the sections.
- Zheng et al., Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena (arXiv, 2023)
- Liu et al., G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment (arXiv, 2023)
- Anthropic Claude API docs: Create a Message (temperature parameter)
- Google Search Central: Creating helpful, reliable, people-first content
Colin H builds ContentTrace at Web Thrive. He has spent 20+ years in B2B SaaS marketing, running content, SEO and AEO programs, and now builds them around AI-assisted content production. Read the ContentTrace manifesto

