Alejandro Arce — home Thinking in Public
No. 128 · Business

Walk me through it

Line illustration: two empty chairs facing each other across a small table, with a blank sheet of paper and a pencil on it.

Deloitte charged the Australian government A$440,000 for a report, and parts of it were made up.

It cited research papers that don't exist and quoted a court ruling with words the judge never wrote. The fixed version said AI was used to write it. Deloitte paid back part of the money (the AP story).

Every business has this problem now. Work lands on your desk, and you can't tell who did it, the person or the AI.

So the big companies check the person. Google, Cisco and McKinsey brought back in-person interviews for some jobs (Computerworld). Amazon tells recruiters they can drop a candidate who uses AI in the interview (ITPro).

The cheapest check is one question: walk me through it. MIT had students write essays with ChatGPT. Right after, none of them could correctly quote a line from their own essay (the study).

If you run a business, three habits.

  1. 1

    Hire with one real task

    Give them one piece of the actual job to do in front of you. You see how they think before any AI touches it.

  2. 2

    Put a name on it

    Everything that goes to a client has one person who signs for it. If it's wrong, that person fixes it.

  3. 3

    Ask them to walk you through it

    When work comes in, ask how they got there. If they can't explain it, the AI did the work.

Use AI every day. Keep someone who can walk you through it.

The AI Audit maps every task AI can do in your business. Then you decide who signs for each one.

Book the AI Audit
More Thinking in Public