SoN Vol 2, Issue 10: Same Prompt, Different Model, Worse Results (Free)


Vol 2, Issue 10 | Mar 11 2026
Same. Prompt,Different Model, Worse Results

Dear Reader,

New LLM models drop every few weeks. Features change between updates. The prompting advice that was best practice six months ago has been revised — sometimes by the vendors themselves. And if you're like most people, the way you actually use AI today is basically the same as it was three months ago.

That's not a criticism by any means. AI moves fast enough that keeping your setup current is itself a recurring task — one that almost nobody schedules.

Last Saturday I made time for it. I went through every skill in my Claude Code configuration — documented procedures for repeatable work, things like running an editorial checklist, deploying a website, processing the morning email. I use this setup every day. I decided to see what still matched reality.

Aaaand....I found duplicates doing the same job. Skills that had grown bloated enough to need splitting into smaller, focused pieces. A whole cluster of related skills that collapsed into half their number once I looked at what they actually did. Legacy formats that hadn't kept pace with how the rest of the system had evolved. Files in the wrong place. etc. etc.

The worst finding was that the descriptions I'd written for each skill — the short summaries that help the system know when to use them — had drifted so far from reality that they weren't doing their job at all. The system was still finding the right tool most of the time, but through lucky guesswork rather than anything I'd designed. The descriptions were effectively decorative.

All in all it took about an hour and a half of passive maintenance while catching up on season 1 of 'Shrinking'. But all of that drift had accumulated in weeks, not years — on a system I use for hours every day.


What you're missing

This week's full issue digs into why your prompts don't travel between platforms — the structural differences between how Claude, ChatGPT, and Gemini process your instructions, the vendor guides that almost nobody reads, and a five-step checklist for auditing your own setup in twenty minutes.

This is what Signal Over Noise looks like from the paid side: tested patterns, honest assessments, and the implementation detail that makes the difference between reading about AI and actually using it well.

​Read the full issue — subscribe to Signal Over Noise →​

€7/month or €69/year. No sponsors, no affiliate deals — just honest, tested AI implementation work.


Until next time,

Jim


€7.00 / month

Signal Over Noise

Deconstructing the tech hype
What I care about is helping people bring technology into their lives well — where it's... Read more

​

Signal Over Noise is weekly, reader-first publication on AI "without the hype" published by Jim Christian. If you've been forwarded this issue, you can subscribe here: go.signalovernoise.at.

600 1st Ave, Ste 330 PMB 92768, Seattle, WA 98104-2246
​
Unsubscribe · Preferences​

Jim Christian - Signal Over Noise

What I care about is helping people bring technology into their lives well — where it's genuinely needed, and where it can do the most good. Not tech for its own sake, not change to look modern. Sometimes that means AI; just as often it means something far simpler.The tech world is accelerating. This is my attempt to slow things down a little: to pick apart the hype and look for the reality and the truth in the messages — primarily around AI, and how it impacts us all.

Read more from Jim Christian - Signal Over Noise

VOL 2, ISSUE 36 · 19 SEPTEMBER 2026 Space to be human Last week I wrote about leaving the Mac for Omarchy after 25 years, and ended on being one step closer to a co-operating system that works with me instead of one I have to work around. A lot of this week comes back to that: creating my own co-operating system from the tools available. This past week has been a major 'back to school' week for the family, including new travelling times, and a massive storm that came through the area mid-week...

VOL 2, ISSUE 35 · 11 SEPTEMBER 2026 Why I left the Mac for Omarchy after 25 years Last weekend I installed Omarchy alongside macOS on my M2 MacBook Air. Support was hit or miss on the Mac, but I was hooked. I realised this was an operating system I wanted to live with. After more than 25 years primarily using Macs, I bought a Lenovo ThinkPad and made it my daily machine. I did not expect to be buying a computer last week, let alone a PC. The switch happened during a revealing week for Apple....

VOL 2, ISSUE 34 · 4 SEPTEMBER 2026 Handing off the 60% If planning, researching and strategising take up, say, 40% of a task, then 60% is left to execute and iterate. That 60% can take up 100% of your available time if you're doing it manually. This is the week that argument stopped being theoretical for me. The kids are home, my partner is at work, and the writing happens in the gaps — text the agent, deal a new hand of Go Fish, check what came back. It's also the week I started calling...