My Roadmap Looked Complete, Until I Checked It Against the Source

Yesterday I put together a six-month roadmap. It looked clean, complete, convincing. Then I laid it next to the original vision document, and I went quiet.

I thought I was planning. What I was actually doing was rewriting my own memory and hoping that memory had no holes.

Let me explain.

Drawing your house from memory

Try drawing a floor plan of your own house from memory. Door here, kitchen there, bedroom at the end of the hall. On paper it looks complete. Every room is there.

Then you walk through the actual house. You notice the storage room you forgot, the hallway pointing the wrong way, the window you never drew.

The floor plan is not lying. It is faithful to your memory, not to the house.

What happened with my roadmap

That is exactly what happened to me.

Some context: I am a Director of Product running four product teams. A semester roadmap for four teams is not a small document, and I wanted it done fast.

So I asked AI to help me build it from what was in my head. I described the product direction, the priorities, the initiatives I remembered. The output came back fast, polished, and convincing. Every quarter filled in, every team with a lane.

I almost believed it was final.

Luckily I stopped. I opened the original vision document, the one written long before, and compared it against the fresh roadmap line by line.

The holes showed up everywhere. Directions stated clearly in the vision that never made it into the roadmap. Things I had sized up big that were side notes in the original.

Not because the AI is dumb. It only knows what I tell it. And what I told it was my memory, not the source.

AI is great at "looks done"

That moment taught me one thing about working with AI.

AI is very good at producing work that looks finished; making sure it actually is finished remains a human job, owned by whoever holds the source of truth.

The polish is exactly what makes it dangerous. A messy draft triggers your suspicion. A smooth one lowers your guard.

I have been building digital products for 20 years, and this pattern is older than AI. The most convincing presentation in the room was never a guarantee of the most accurate data. AI just runs the same pattern at much higher speed.

Same as the floor plan. The speed is upfront. The cost comes later.

My rule now: reconcile against the source

So my rule is simple: never trust a draft that has not been checked against the original source.

In practice:

• Do not let AI work from your memory alone. Feed it the source documents too: the vision, the strategy, the decision logs.
• Once the draft is done, resist the urge to polish it right away. Reconcile it first, line by line.
• The checking is not leftover work. It is the actual work.

What I thought was finished turned out to be half done. What I thought was the heavy lifting turned out to be the checking.

Which side are you on? Trusting the first draft that looks clean, or always checking it against the source first?