Technology

Can it be built, fixed, or made to do something new?

Area 01 AI, websites, apps, online shops, and the joins between the systems you already pay for. I go down to the runtime when the problem lives there, and I come back up with an answer your team can use.

The chatbot that's really a search problem

"We need an AI chatbot" is one of the most common first messages I get. Usually the model is the easy part. It can only answer from the pages a search step hands it, and that step is handing it the wrong ones.

If your own staff can't find the right document, a chatbot will find the wrong one faster. So the work starts with retrieval: what gets found, and why.

Read: AI Hallucinations 101

Retrieval. The search step that decides which pages the model reads before it answers.

Fig. 1 — Same model, same question. The only change is which page search picked. Diagram: someone asks how many days of carer's leave they get. Search first picks the 2019 leave policy, and the answer is 5 days, which is wrong. Search is fixed to pick the 2024 policy, and the answer becomes 10 days.

The shop nobody wants to touch

A headless storefront, started by someone who has since moved on. It mostly works, and everyone is scared to change it in case the parts that don't work get worse.

I read it end to end first, then fix it a piece at a time, in accounts you own, so the next developer can pick it up without the fear.

Headless. The shop's engine and its storefront are separate apps, joined by an API. More freedom, and more joins to break.

Fig. 2 — Read end to end, then fixed a piece at a time. Diagram: a storefront with eight parts: home, collections, product, search, cart, checkout, account and content. Four are broken: collections, search, checkout and account. They are fixed one at a time until all eight work.

The whole stack, one layer at a time

Every piece of technology has people at both ends: the ones it serves, and the ones who keep it running. In between sit the layers where things get built, and where they go wrong.

Pick a layer to see what lives there.

Layer 01

People

The people who use it, and the people who run it. Everything below exists for them.

What it looks like“Nobody uses the new system.”

What it usually isIt was built for the process on paper, not the one people actually follow.

Three systems, three Sams

The shop knows Sam by an order number, the CRM by an email address, and the email tool by a subscriber ID. As far as your reports are concerned, that's three people.

An integration that agrees on who a person is turns them back into one, and suddenly the numbers across all three start to make sense.

Identity resolution. Deciding which records across your systems are the same person.

Fig. 3 — One customer, three records, joined. Diagram: the shop knows Sam as order number 4102, the CRM by an email address, and the email tool as subscriber 88213. Reports count three customers. An integration joins the three records to one person, and the report counts one.

What Technology covers

  • AI and language models

    Harnesses, retrieval, evaluations, fine-tuning. Making a general model do your specific work, and proving it does.

    • Claude
    • OpenAI
    • Gemini
    • Hugging Face
    • Ollama
  • Web and applications

    Front end to back end, built in accounts you own so the next developer can pick it up.

    • Next.js
    • React
    • TanStack
    • Astro
    • Convex
    • Firebase
  • Commerce

    Online shops, including headless builds someone else started and nobody wants to touch.

    • Shopify
    • Shopify Hydrogen
    • Magento (Adobe Commerce)
    • PrestaShop
    • headless storefronts
  • Content platforms

    Sites your team can edit without calling a developer every Tuesday.

    • WordPress
    • Sitecore
    • Strapi
  • Integrations and APIs

    Making the CRM, the shop and the marketing tools agree on who a person is.

    • Salesforce
    • HubSpot
    • Zoho
    • Webhooks
  • Under the hood

    How your code actually runs: the JavaScript engine, the event loop, the edge. Where the strange bugs live.

    • JavaScript
    • TypeScript
    • V8
    • Node.js
    • Deno
    • Cloudflare Workers

Inside the harness

A general model knows a little about everything, which is a polite way of saying it has never met your organisation. The harness is what makes it useful: the context, the tools, the guard rails and the checks around it.

Here's one question, and what each part of the harness does to the answer.

QuestionCan I take carer's leave to look after my dad?

Answer, after evaluationchecked

Yes. You get 10 days' paid carer's leave a year (Leave policy 2024, section 4). Apply through the HR portal.

Writing on technology

All of it

Red Teaming: Taming Rogue AI

Picture this: it’s a Monday morning. You’ve just poured your first cup of tea—or coffee, I’m not a monster, I’ll allow…

Artificial Intelligence

Got something that needs building, or fixing?

Tell me what you can see going wrong, or what you'd like to be possible. You don't need the technical name for it.

Send me a messageBook a call

Contact

Tell me what the problem is. You don't need the technical name for it: working that out is part of the job. If I am not the right person for it, I will say so. I reply myself, from Hobart, which is ahead of most of the world (by time zone, and in several other ways I am too modest to list).

Goes to James. Nobody else reads it.