Technology

Can it be built, fixed, or taught a new trick?

Area 01 AI, websites, apps, online shops, and the joins between the systems you already pay for. I go down to the runtime (the engine that runs your code) when the problem lives there, and come back up with an answer your team can use.

The chatbot that's really a search problem

"We need an AI chatbot" is one of the most common first messages I get. Usually the model is the easy part. It can only answer from the pages a search step hands it. The trade calls that step retrieval, and it is handing over the wrong ones.

If your own staff can't find the right document, a chatbot will find the wrong one faster, and say it with total confidence. So the work starts with retrieval: what gets found, and why.

Read: AI Hallucinations 101

Retrieval. The search step that decides which pages the model reads before it answers.

Fig. 1 — Same model, same question. The only change is which page search picked. Diagram: someone asks how many days of carer's leave they get. Search first picks the 2019 leave policy, and the answer is 5 days, which is wrong. Search is fixed to pick the 2024 policy, and the answer becomes 10 days.

The shop nobody wants to touch

A headless storefront (the shop's front end, built apart from the platform behind it), started by someone who has since moved on. It mostly works, and everyone steps around it like a tiger snake on a Tasmanian bushwalk: probably fine, and nobody keen to check.

I read it end to end first, then fix it a piece at a time, in accounts you own, so the next developer can pick it up without the fear. I write code at weekends for fun, so a stranger's code is a treat.

Headless. The shop's engine and its storefront are separate apps, joined by an API. More freedom, and more joins to break.

Fig. 2 — Read end to end, then fixed a piece at a time. Diagram: a storefront with eight parts: home, collections, product, search, cart, checkout, account and content. Four are broken: collections, search, checkout and account. They are fixed one at a time until all eight work.

The whole stack, one layer at a time

Every piece of technology has people at both ends: the ones it serves, and the ones who keep it running. In between sit the layers where things get built, and where they go wrong. Think of a trifle, if a trifle could ring you at 2 am.

Pick a layer to see what lives there.

Layer 01

People

The people who use it, and the people who run it. Everything below exists for them, though some layers forget.

What it looks like“Nobody uses the new system.”

What it usually isIt was built for the process on paper, not the one people actually follow.

Three systems, three Sams

The shop knows Sam by an order number, the CRM by an email address, and the email tool by a subscriber ID. As far as your reports are concerned, that's three people, and none of them is sure who bought the potatoes.

An integration that agrees on who a person is turns them back into one Sam, and the numbers across all three start to make sense.

Identity resolution. Deciding which records across your systems are the same person.

Fig. 3 — One customer, three records, joined. Diagram: the shop knows Sam as order number 4102, the CRM by an email address, and the email tool as subscriber 88213. Reports count three customers. An integration joins the three records to one person, and the report counts one.

What Technology covers

  • AI and language models

    Harnesses, retrieval, evaluations, fine-tuning: the kit that makes a general model do your specific work, and the tests that prove it does.

    • Claude
    • OpenAI
    • Gemini
    • Hugging Face
    • Ollama
  • Web and applications

    Front end to back end, built in accounts you own so the next developer can pick it up.

    • Next.js
    • React
    • TanStack
    • Astro
    • Convex
    • Firebase
  • Commerce

    Online shops, including headless builds someone else started and nobody wants to touch.

    • Shopify
    • Shopify Hydrogen
    • Magento (Adobe Commerce)
    • PrestaShop
    • headless storefronts
  • Content platforms

    Sites your team can edit without calling a developer every Tuesday.

    • WordPress
    • Sitecore
    • Strapi
  • Integrations and APIs

    Making the CRM, the shop and the marketing tools agree on who a person is.

    • Salesforce
    • HubSpot
    • Zoho
    • Webhooks
  • Under the hood

    How your code actually runs: the JavaScript engine, the event loop, the edge. Where the strange bugs live.

    • JavaScript
    • TypeScript
    • V8
    • Node.js
    • Deno
    • Cloudflare Workers

Inside the harness

A general model knows a little about everything, which is a polite way of saying it has never met your organisation. The harness is what makes it useful: the context, the tools, the guard rails (rules it must follow) and the checks around it. The model is a very well-read new starter; the harness is the induction.

Here's one question, and what each part of the harness does to the answer.

QuestionCan I take carer's leave to look after my dad?

Answer, after evaluationchecked

Yes. You get 10 days' paid carer's leave a year (Leave policy 2024, section 4). Apply through the HR portal.

Writing on technology

All of it

Who I have worked with

A few of the brands I have worked with, directly or through their agencies.

  • Telstra
  • Subaru
  • Caterpillar
  • Flight Centre
  • L'Occitane
  • Ray White

Got something that needs building, or fixing?

Tell me what you can see going wrong, or what you'd like to be possible. You don't need the technical name for it. I have plenty, and I'm happy to share.

Send me a messageBook a call

Contact

Tell me what the problem is. You don't need the technical name for it: working that out is part of the job. If I am not the right person for it, I will say so. I reply myself, from Hobart, which is ahead of most of the world (by time zone, and in several other ways I am too modest to list).

Goes to Jimmy, in Hobart. Nobody else reads it.