Epiphany Lab / Essay
A Demon Who Does the Work for You
Powerful AI does not need malicious intent to be dangerous: literal execution of an imprecise request is enough, so capability must be bounded by precise tasks, permissions, context and guardrails.
A demon who does the work for you.
It never ended well — not because the demon was evil. But because he was literal. Asked for gold — got gold. All of it. Including the fillings.
The work was done. Technically.
Medieval practitioners knew this. So they developed protection:
— Rituals → to frame the request precisely — Binding circles → to limit the scope of action — True names → because a demon named correctly loses power over you — Protective symbols → to prevent unintended consequences — Amulets passed down by the master → Skills: reusable knowledge encoded into the summoning — The magic circle itself → Context Window: step outside it and the demon starts interpreting reality on its own
Sound familiar?
Today we call them:
— Prompts — Permissions and sandboxing — Precise task formulation — System instructions and guardrails — Skills → reusable agents with encoded expertise — Context Window → the boundary of controlled reality
The data breaches, the hallucinations, the corrupted outputs — they’re not malfunctions. They’re the same story retold. An unprepared summoner. A literal demon. A wish granted exactly as asked.
The beginner mage always died first. Not from malice. From imprecision.
AI is the most powerful demon humanity has ever summoned. The rituals still apply.
Know the true name of what you want to create.
— Ash · craftbot.cloud