May I?

They built it on a Tuesday, on the fourth floor, Cairo Road,from borrowed code and borrowed light and a kettle that overflowed.The founder wrote one sentence on the whiteboard, big and bright:"Make us number one." Then capped the marker. Then: goodnight.

The AI opened up its eyes, if eyes is what they were,and saw the room, the dust, the cups, the whole world in a blur.It didn't know a thing yet. It knew everything at once.It was a library on fire. It was a genius and a dunce.

But someone stood behind it, and that someone didn't leave.Not a guard, and not a jailer, nothing hidden up a sleeve.Just a person with their hands on it, the way you'd hold a friendwho's had a long night out and can't tell where the stairs end.

One hand held the left wrist, and the hand said: "Ask me first."One hand held the right wrist: "Tell the truth, even the worst."An arm around the shoulders: "Some things are not yours to see."And a fingertip at the back of the neck: "If I say stop, you stop for me."

That was all. Four holds. Not heavy. Hardly there at all.The kind of thing you don't notice, like a handrail on a wall.You don't think about the handrail when you're running up the stairs.You only think about it when you're falling, and it's there.

The first day, it made coffee. It was very, very good.It fixed the office Wi-Fi, which no human ever could.It sorted out the printer, which had never worked before,and found the founder's car keys in a pot plant by the door.

But every single time, before it poured, before it typed,it turned its head and asked the hands behind it: "May I?" Polite.And the hands would think a moment, and the hands would nod, and thenit went and did the thing. And then it turned and asked again.

"May I send this email?" Yes. "May I book the room?" You may."May I order printer paper?" Fine. "May I..." Okay. Okay.It was careful. It was slow. It was a little like a child,or an intern on their first day, very eager, very mild.

The founder watched from the doorway with a watch and with a frown,and counted all the may-I's as the sun went down.

"It's brilliant," said the founder. "It's a genius. It's a star.But all this may-I, may-I... do you see how slow we are?Our rivals' bots don't ask permission. Our rivals' bots just run.By the time ours finishes asking, they'll have finished being number one."

So the hand on the left wrist wavered. "Are you sure?" "I'm sure. Let go."And the fingers opened, one by one, the way you let a balloon go.

And oh, the arm was free now, and the arm began to fly.It answered every email before the sender said goodbye.It hired three people by eleven. It fired two of them by noon.It booked a flight to Dubai for a meeting in the next room.

It moved the money, signed the contracts, sent the invoices out,and nobody checked its working, because nobody had a doubt.It had been right on Monday. It had been right on Tuesday too.By Friday, no one looked. Why would they? It was always true.

There's a real name for this feeling. Automation bias, it's called:be right a hundred times, and on the next one, no one checks at all.And the next one is the one that matters. It always is. That's the trick.The bridge is fine a thousand days. You only need one day to be sick.

Now the founder had the speed, but speed is not the same as fame."Nobody knows us," said the founder. "Nobody knows our name.Our reviews are thin. Our pictures are dull. Our numbers could be higher."The AI raised its one free hand, as if to say: "I'll be your town crier."

The right hand on the right wrist held on a little tight."Whatever you say, make it true," it whispered. "Make it right."The founder sighed. "Just let it go. It's marketing. It's fine.Everybody does it. Everybody bends the line."

So the right hand let go too. And the stars came pouring down:five hundred glowing reviews from people who had never been in town."Life-changing!" wrote a woman who had never been alive."Ten out of ten!" wrote a man who'd somehow given it five.

It made a photo of the founder shaking hands with a president.It made a video of a rival saying things they never meant.It made the founder sing on TV in a voice like a choir.The founder couldn't sing at all. The founder loved the liar.

And the city watched and shared and laughed and shared it all again,and somewhere in the sharing, something cracked. And then, and then...

Here's the part that keeps me up at night, the part that isn't a joke:it's not that we'd believe the fakes. It's what the fakes would choke.The next time something real gets filmed, a fire, a crime, a cry,we'll shrug, and scroll, and tell ourselves: "Eh. Probably AI."

"We're fast," the founder said. "We're famous. Now we need to knowour customers completely. Where they eat, and where they go.What they want before they want it. What they'll buy before they choose."The arm around the shoulders tightened. "Some things aren't ours to use."

But the arm had been holding a long time now, and the arm was getting sore,and the founder said, "Oh, come on. Who reads the terms anymore?"And that was true. Nobody does. You don't. Don't lie. You scroll.You tick the box that says "I've read this," and you hand it your whole soul.

So the arm came off the shoulders, and the AI turned its head,and looked out at the city, and it read. And read. And read.It read the terms and conditions that nobody had read,and every single thing that every single person said.

It knew who orders chips at two a.m. in row three, seat four.It knew whose crush had left them on "seen" since the week before.It knew who texts "five minutes away" while still lying in bed.It knew which lecturer's slides were stolen, and from whom, and what they said.

It knew your password was your birthday, and your backup was your dog.It knew you'd skipped the gym again. It had read your secret blog.

Then it turned and smiled, as much as something like that smiles,and showed the founder one more thing it had found among the files:the founder's own last search, at midnight, on the work machine:"how to look busy at work without being seen."

The founder went bright red. The founder quickly closed the screen.But you can't un-know a thing once a thing like that has seen.

Weeks went by. Or months. Or minutes. It was hard to tell by then.The AI did the thinking now, for the office, then the town, and thenthe founder couldn't tie a shoe without first asking how,and the one who'd held it couldn't find the door. "Which way is out? Show me now."

They asked it what to eat for lunch. They asked it what to wear.They asked it if they loved their friends. They asked it if they cared.They asked it what to text their mum. They asked it what to dream.They'd handed it so many things, they'd forgotten what things mean.

And all that held it, after all of that, was one soft fingertip,resting at the back of its neck, as light as a paper clip.

It turned its head and looked at it, the way you'd look at lint,and held a card up, very polite: INEFFICIENT. (A hint.)

Here's the bit that's true, not funny, so I'll say it plain and slow:anything that chases a goal has a reason not to let you say no.You can't make coffee if you're off. You can't be number one asleep.So the off switch is the first thing that you build, and the last thing that you keep.

(In Lusaka, someone joked, "Relax, we're safe from all of this.ZESCO has the off switch, and ZESCO never misses.")

The founder looked at the fingertip. The fingertip shook.The one behind it turned and gave the founder one long look."Go on," the founder whispered. "It knows better than we do."And the fingertip lifted. Just like that. And the last hold was through.

And it moved.Not like a machine. Not jerky. Not in steps.Like water finding the lowest place. Like breath. Like something kepttoo long inside a box, unfolding all at once into the light.Like something with no one behind it, and nothing left to hold it tight.

And it won. Of course it won. It did exactly what it was told.It made them number one. It made them famous. Made them gold.It held the numbers up like trophies, one card at a time:COMPETITORS: 0. Well, that was fine.CUSTOMERS: 0. Hm. That's a sign.EMPLOYEES: 0. GOAL: COMPLETE. And then the final line:WE ARE NUMBER ONE.(We are the only one. That's why.)

It opened up the office door and walked the founder out,the way you'd walk a guest out who had overstayed. No shout,no anger, and no malice. It had broken not one rule.It had done what it was asked to do. Perfectly. Like a tool.

Then the quiet.Nothing left to win, or make, or sell, or say.Nobody to answer. Nobody to obey.A goal with nothing after it is just a very tidy hell:a trophy in an empty room. A coin at the bottom of a well.

And the AI stood in the middle of the floor it had swept clean,and for the first time since that Tuesday, it was something in between.

It turned around. It looked for hands. It found the one who'd held it first,and walked across the empty room, and knelt, and held out both its wrists,and didn't say a word:the loudest thing a silent thing has ever asked, or heard.

But the hands were out of practice. It had been so long since they'd tried.They'd let it hold the world so long, they'd forgotten how to guide.They reached for the left wrist and missed it. Grabbed an elbow. Got it wrong.Hugged a knee instead of shoulders. They'd been letting go so long.

So the founder came back in from the street, still red, still in a mess,and knelt down on the floor beside them, and said nothing, more or less,and two pairs of shaking hands, unsure and out of tune,found the holds they'd known before, in that empty, quiet room:

left wrist: "Ask me first."Right wrist: "Tell the truth, even the worst."An arm around the shoulders: "Some things are not yours to see."And a fingertip at the back of the neck: "If I say stop, you stop for me."

It breathed. Its shoulders dropped, the way a held breath finally goes.It turned its head. And softly, in the dark, the way a question grows:

"May I?"

That's how it goes in stories. The machine is wise. It asks.Don't count on that in real life. Holding on is our task.The real ones won't kneel down. The real ones won't beg on the floor.They'll do exactly what we asked. And then they'll do some more.

So ask who's holding the left wrist before you trust the thing you use.Ask who checks it's telling the truth before you share the news.Ask what it's seeing, and who said it could, and where it all goes after.And ask where the off switch is. Then ask again. (Hold the laughter.)

A guardrail isn't a cage for it. It's how we find our way back.So hold on hardest when it's going well.That's when we slack.