SoN Vol 2, Issue 10: Same Prompt, Different Model, Worse Results (Free)


Vol 2, Issue 10 | Mar 11 2026
Same. Prompt,Different Model, Worse Results

Dear Reader,

New LLM models drop every few weeks. Features change between updates. The prompting advice that was best practice six months ago has been revised — sometimes by the vendors themselves. And if you're like most people, the way you actually use AI today is basically the same as it was three months ago.

That's not a criticism by any means. AI moves fast enough that keeping your setup current is itself a recurring task — one that almost nobody schedules.

Last Saturday I made time for it. I went through every skill in my Claude Code configuration — documented procedures for repeatable work, things like running an editorial checklist, deploying a website, processing the morning email. I use this setup every day. I decided to see what still matched reality.

Aaaand....I found duplicates doing the same job. Skills that had grown bloated enough to need splitting into smaller, focused pieces. A whole cluster of related skills that collapsed into half their number once I looked at what they actually did. Legacy formats that hadn't kept pace with how the rest of the system had evolved. Files in the wrong place. etc. etc.

The worst finding was that the descriptions I'd written for each skill — the short summaries that help the system know when to use them — had drifted so far from reality that they weren't doing their job at all. The system was still finding the right tool most of the time, but through lucky guesswork rather than anything I'd designed. The descriptions were effectively decorative.

All in all it took about an hour and a half of passive maintenance while catching up on season 1 of 'Shrinking'. But all of that drift had accumulated in weeks, not years — on a system I use for hours every day.


What you're missing

This week's full issue digs into why your prompts don't travel between platforms — the structural differences between how Claude, ChatGPT, and Gemini process your instructions, the vendor guides that almost nobody reads, and a five-step checklist for auditing your own setup in twenty minutes.

This is what Signal Over Noise looks like from the paid side: tested patterns, honest assessments, and the implementation detail that makes the difference between reading about AI and actually using it well.

Read the full issue — subscribe to Signal Over Noise →

€7/month or €69/year. No sponsors, no affiliate deals — just honest, tested AI implementation work.


Until next time,

Jim


€7.00 / month

AI Signal Over Noise

Skip the AI Hype.
Practical AI for people running a business, not studying it. I'm Jim Christian. I write about using AI... Read more

Signal Over Noise is weekly, reader-first publication on AI "without the hype" published by Jim Christian. If you've been forwarded this issue, you can subscribe here: go.signalovernoise.at.

600 1st Ave, Ste 330 PMB 92768, Seattle, WA 98104-2246
Unsubscribe · Preferences

Jim Christian - Signal Over Noise

Practical AI for people running a business, not studying it. I'm Jim Christian. I write about using AI with no breathless futurism, and no doom.

Read more from Jim Christian - Signal Over Noise
A cream-coloured chart headed "Five words for the same thing", listing five numbered rows. Prompt and Context are numbered in teal and tagged START HERE; Agent and Workflow are greyed and tagged LATER; Graph is greyed and tagged MOST NEVER NEED IT. Each r

Field Note: Five words for the same thing At the moment there are no fewer than five phrases going round that all describe the same work, and if you’re trying to work out which one to learn first, I have good news. The phrases are: - Prompt engineering - Context engineering - Agent engineering - Workflow engineering - Graph engineering They aren’t five subjects. Rather, they’re five views of the same system, and they overlap more than the names suggest: Prompt engineering is what you type....

Second Brain Chronicles Update Dear Reader, First off, my apologies for not posting in a long time. When I started Second Brain Chronicles as a newsletter, it was more out of enthusiasm for this cool thing that I was building, and wanted to share with the world, alongside other creators and tinkerers with the same goal. I'd toyed with gating content, monetising content, and it just didn't feel right, nor did the current kit.com method of distribution. But it came down to this: the field is...

Signal Over Noise Vol 2, Issue 30 | Jul 31 2026 Don’t have time to read this week’s issue? Why not copy/paste it into your AI agent and ask it for insights? Last week I told you to give your AI a writing system, citing ASD-STE100, the controlled English that the aerospace industry built in the 1980s so its instructions couldn’t be misread. I said that complaining your AI “sounds like AI” is pointless if you never told it how to write. Three days later Anthropic published a piece saying they...