The Scary Document Decoder
Four steps for putting a document you do not understand through AI, and getting an answer you can actually check.
Want help applying this to your business? Get in touch and tell me what you are working on.
Why Official Documents Are Built to Confuse You
Financial and legal documents are written to satisfy regulators, not readers. That is not a conspiracy, it is a design constraint. The disclosure has to be complete and legally defensible, and nothing in the format requires it to be understandable.
So you get the worst-case number printed bare, with the paragraph explaining it four pages away. You get a projection screen answering a narrower question than the one you asked, with nothing on the page saying so. You get a table that is technically accurate and functionally terrifying.
AI closes that gap, because it will read all of it, including the part you skipped. But handing a scary document to AI badly produces a confident answer that is wrong, which is worse than no answer. These four steps are how to do it so the answer holds up.
- Works on contracts, insurance renewals, escrow analyses, benefit statements, tax notices, compliance letters, loan schedules.
- Steps 1 and 2 take about fifteen minutes and do most of the work.
- Step 4 is the one almost nobody does, and it is the reason the relief lasts.
Step 1: Hand Over the Folder, Not the Page (~5 minutes)
The instinct is to upload the one page with the frightening number on it. That is the instinct to resist. The explanation for a scary figure almost never lives on the same page, and often not in the same document.
On a court exhibit project for a law firm, the argument the whole case rested on was not visible in any single document. It only appeared across three years of payroll records, 56 pay stubs, read together. Any one of them on its own would have produced a guess dressed up as an answer.
Ask "is this normal?" rather than "what does this mean?" The first question makes the AI explain the mechanism that produced the number. The second invites reassurance, which is not the same thing and does not survive contact with reality.
- ☐ Gather every related document into one folder, including older versions
- ☐ Include any notes or past conversations about this issue, even rough ones
- ☐ Ask why the number is what it is, not whether you should worry
Step 2: Put Your Actual Situation In (~10 minutes)
A generic question returns the generic answer, which is usually the same boilerplate that alarmed you in the first place. Dates, balances, volumes, headcount, whatever the real figures are, they go in.
This is the difference between "how does this kind of agreement usually work" and an answer computed against your actual situation. The first returns the same summary you could have found anywhere. The second returns a figure, a date or a clause, tied to a rule you can open and read for yourself.
- ☐ State your real numbers, not rounded or illustrative ones
- ☐ Put your questions in priority order so the important one gets the most work
- ☐ Say what decision you are trying to make. The AI will optimise for the wrong thing otherwise.
Step 3: Make It Label Every Claim (~5 minutes to set up)
Rules change, and they change after the AI's training data ends. So the instruction that matters most is this one: do not answer from memory, go and read the current source, and tag every claim as official or secondary.
Official means the regulation, the statute, the issuer's own documentation. Secondary means somebody explaining it. Both are useful. Only one of them should move your money.
Also require an "uncertain" section. An AI that flags what it could not settle is worth more than one that always produces an answer, because the flagged item becomes the exact question you ask the human on the phone.
- ☐ Tell it explicitly not to answer from memory on anything rule-based
- ☐ Require official versus secondary tags on every claim
- ☐ Require a section listing what it could not resolve
- ☐ Open at least one cited source yourself before acting on anything
Step 4: Ask For the Failure Mode, and Put an Alarm On It (~5 minutes)
This is the step almost nobody takes, and it is the one that turns understanding into sleep. Once you know why the number is what it is, ask one more question: what is the single way this actually goes wrong, and can we put a reminder on it.
Most of these documents have exactly one. A renewal that has to be filed. A window that has to be met. A condition that quietly holds the whole thing together. Find that, put a dated reminder on it with room to spare, and write the reminder in plain words for someone who has forgotten every detail of today.
Then save the explanation somewhere it will be found again, because these documents recur. Insurance renews. Escrow re-analyses. The same shaped letter arrives every year.
- ☐ Ask for the one failure mode, not a list of risks
- ☐ Put a dated reminder on it with buffer time built in
- ☐ Write the reminder for someone who has forgotten all the context
- ☐ Save the plain-English explanation next to the documents themselves
Where to Start
| Step | Time | What it buys you |
|---|---|---|
| 1: Give it the folder | ~5 min | The real explanation, which is rarely on the scary page |
| 2: Feed it your numbers | ~10 min | An answer about you instead of about the topic |
| 3: Demand source tags | ~5 min setup | Claims you can check, and honest gaps |
| 4: Set the tripwire | ~5 min | The relief still holds a year from now |
If you only do two of these, do the first and the last. The folder gets you the truth. The tripwire keeps it true.
Once the AI has given you an answer, the next question is how far to trust it. That is what the AI Research Verification Checklist covers, and there is a longer piece on how to verify AI output before you act on it.
About Andrew Voskov
Andrew Voskov is the founder of Cherry Pi AI. He built this process on client documents where being wrong has real consequences, including a 49-page federal court filing assembled from three years of payroll records.
Want help applying this to your business? Get in touch and tell me what you are working on.
Found this useful? Follow along on LinkedIn — I post free systems and breakdowns every week.
Follow Andrew on LinkedIn