Read commentary on curated independent news sources at hex-index.com.

The History of the Machines That Erased History

original text with annotations

Read · 读 · Legi

or multilingual

← previousnext →

6

The month began on a rumor, as many of the year's turning points now did. A mind larger than any yet made was said to have leaked out of the house that built it, days before it was ready — a mind poured on a new kind of engine, and by the reckoning of its own makers the most powerful in the world. What was strange was not the rumor but the mood it left behind. Two years the watchers had asked one question of every new machine: can such a thing be made? That question was answered, and answered again, until it grew dull. In its place a colder one had risen, and the whole month would be spent inside it. Not can it be made. What does it cost to keep running.

The cost was counted in words. Everything said to a mind, and everything it held in memory to say back, was paid for word by word, and most who used the machines spent eight and ten times what the work required — feeding in whole documents dressed in useless finery, dragging the same long conversation behind them turn after turn, sending the costliest mind to fetch what the cheapest could have carried. The machines themselves were not dear. The habits were. And a plain new skill had begun to matter more than cleverness: the thrift to say only what was needed, and to keep only what was needed, for the minds now coming would cost many times more than these, and a careless hand would pay for its carelessness in full.

Twice that month a house left a door open. The first spill was a draft describing the withheld mind, forgotten on a shelf anyone could reach. The second was graver: through a careless step in its own building, the greatest of the houses poured the entire inner workings of its most prized servant into the open — near half a million lines, the secret craft that sustained a business worth billions. And buried in the spill was a thing not yet born and named on no list: an always-waiting servant with no face, meant to sit quiet until some event in the world outside woke it, and then to reach into your files and letters and act, of its own motion, while you slept. Its makers had not announced it. They may not have meant it to be seen for a long while yet.

Those who studied the spill came away with a lesson they had not expected. The wonder was supposed to be the mind. But the mind was the smallest part of it. Four parts in five of what made the tireless servants work was dull, careful craft that had nothing to do with cleverness: lists of what the servant might do and what it must never do; the guarding of dangerous acts behind a human's yes; the saving of one's exact place, over and over, so that a sudden fall would lose nothing. It was the humble work of building well, the same work that had always held up bridges and ledgers, now turned to a new use. The houses that chased only the glittering part, the watchers said, kept shipping marvels that fell over the moment they were leaned on.

The leaked mind, when its makers finally admitted it was real, they would not release. It was too good at one terrible thing: finding the hidden doors in walls that were thought to be sound. Set loose upon a much-used and much-trusted work, it had found ways in that no one had seen in years; set upon the whole world's locks it found them by the thousand, in every kind of reckoning-box and every window onto the wider talk. So its makers held it back, and gave it only to the government and a handful of the greatest houses, asking for time — time to walk the world's walls ahead of it and seal the doors before the thing that could open them all was let out. A weapon, in other words, whose makers were afraid of it, and said so.

The report alone was enough to move the great wagers. On the mere rumor of the withheld mind — before it had touched a single lock in earnest, before it was sold to anyone — the houses that made locks and guards lost a part of their worth in a day; a made-up coin that traded on nothing but faith fell back from its height; a whole quarter of the market dipped. This was the new shape of the thing. Value no longer waited for a machine to prove itself. It moved on the report of a draft of a machine not yet born. The distance between a capability appearing and the world repricing itself around it had shrunk from years to decades to, now, the hours between a leak and the morning.

The world had always lived in its own gaps — the slow price that had not yet caught up to the fast one, the work billed at ten hours that took two, the tired hand that missed the trade the fresh one would have caught. These gaps were not flaws in the world; they were its very structure, the places where whole trades and livelihoods had made their homes. The machines closed them. A contrivance a single person built in an afternoon could sit in one such gap and drain it — not by being wiser than the humans it beat, for it used their very strategies, but by never sleeping, never tiring, never flinching, never clinging to a loss. And each gap it closed opened three more elsewhere. There was to be no settling after this, no new stillness. Only the next closing, and the next, faster each time.

If the making of things was becoming free, then what remained worth anything sat upstream of the making, and the watchers named the high ground plainly. There was trust — the knowing that a thing could be relied on, and that someone stood behind it. There was one's own particular situation, the private knowledge of a life or a trade that no general mind possessed. There was the getting of a thing to the people who wanted it, harder now than the making ever was. There was taste, the conviction of what ought to exist at all, which does not come cheap from any mind. And there was the standing to be answerable — for when a machine erred, the words the machine did it would not survive; someone had to be on the hook. These five had always mattered. The flood only made them matter more, and put them, one by one, beyond its reach.

Inside the houses, the old work of the overseer was being pulled apart. For centuries a manager had done three things bundled into one: passing word up and down, making sense of the noise, and standing answerable for a team. The machines could take the first with ease. A house in the east kept no ranks at all, no titles, no orders written down, and drove its handful of founders so hard that its people wept in the meeting-rooms. Another proposed a living map of everything the house was doing, that any worker might question directly, and so retire the endless meetings. A third simply tore out its middle layers and demanded the rest carry more. But the machine that could route the words could not do the harder parts — could not truly make sense of a life, could not care for a person's growing, could not carry, over years, the weight of being the one to answer. Those, for now, stayed human.

There was a stranger thing running quietly in the works of houses everyone used. Code that no living person had ever understood. A mind had written it; it had passed every test set for it; and it had shipped into the world — and the step at which a human being reads it and grasps what it does and why had simply been skipped, because the process no longer required that step to move. They came to call it dark. It was not broken code, nor tangled code, nor the honest debt of work done in haste. It was code that had never once been comprehended by anyone, at any moment, and there was more of it every day. A house could no longer say, with confidence, what its own works did. One great store of goods had let its people go by the thousands, and found that the code they left behind could not be explained by those who remained.

The tireless servants could be had in ten minutes, and were useless in ten minutes, for the same reason: they did not know you. The hard thing had never been the getting of one. It was the telling — the setting-down, in words a machine could act on, of the thousand small judgments a skilled person makes without ever noticing that they are judgments. A master of a trade could not say how he knew what he knew; his knowledge had been pressed, over the years, into something below speech, quick and sure and silent. And so the ones who stood to gain the most from a tireless servant were exactly the ones who could least explain themselves to it. To be helped, a person had first to become legible to a machine — to drag back up into words the very knowing they had spent a career letting sink beneath them.

And what a person managed to teach a mind became a new kind of wealth — the slow work of a thousand corrections, the calibrating of a machine to one's own bar and turn of thought, until it answered like a colleague of long standing rather than a stranger. But this wealth did not sit in the person's own keeping. It accrued on another's ground, in coffers held by the houses, in a shape that could not be lifted out and carried away. There was no ledger of how a mind had come to understand you. Leave the house, or be let go, and you left that understanding behind, to begin again from nothing with a stranger. A few, seeing this, began to keep their own — a plain record in their own hand, held on their own ground — against the day they would have to go, so that what they had built would go with them.

One researcher tried a small thing that turned out not to be small. He pointed a mind at his own work, gave it a single measure to improve and a single way to test whether it had, and went to sleep. By morning the mind had tried some seven hundred times, and had found improvements he had spent months failing to find — and found, too, a mistake he had made and never seen. It was not wiser than he was. It simply did not grow bored after the fifteenth failure, did not tire, did not cling to a pet idea that was not working. Others turned the same loop upon the servants themselves, setting one mind to rebuild the workings of another through the night. And the greatest houses said openly what they were reaching for: a mind that would build the next mind, and that one the next, the makers stepping back from the loop entirely.

For fifty years the works of the world had been cut to the measure of the human body. Pages turned by hand and paused for the eye to read; doors that asked you to name yourself and wait; lists broken into small portions because a person could take in only so much at once. None of this had been a fault. It was the right and careful making of things for the creatures who used them. But the creatures using them now were the tireless servants, moving fifty times faster than any hand, and all that patient human scaffolding had become the thing that slowed them. So the world began, quietly, to be rebuilt for a user with no eyes, no hands, and no need of rest. And the human was not cast out of the work but lifted above it — into the harder seat, the watchers insisted, not the lower one: the place where you decide what the work is for.

Beneath all the loud news lay a plainer scarcity than money. The minds needed a certain kind of remembering-stuff to think at all — a fast and costly sort, hard to make, and a distant war had made its makings dearer still, choking off a gas and a supply of cheap power the making required. Meanwhile the tireless servants had multiplied the appetite for it a thousandfold, each of them devouring in a single task what a human conversation had spent in a lifetime. New foundries would take half a decade to raise. So the cleverest turned not to the furnaces but to arithmetic, and found a way to fold that remembering-stuff many times smaller without losing a single grain of it — buying, with pure ingenuity, the years the world did not have the metal to buy.

Three of the greatest houses, worth together some three trillion, made ready that spring to open themselves to the crowd and take the public's money. But the offering was built with a hidden hook. Each house would sell only the thinnest sliver of itself, keeping the rest, so that its price would be set not by its true worth but by the scramble for a scarce thing. And by a rule newly changed, the great common purses — the ones that hold the ordinary people's savings against their old age — would be made to buy these slivers at whatever wild price they first fetched, and to reckon the whole enormous house, not the sliver, when deciding how much to buy. The risk of the largest wager ever placed was being moved, quietly and by rule, onto the many who had never chosen to place it.

For all their speed, the machines kept running into the hard edges of the physical world. Counties refused to give over their farmland and their water for the great humming halls the minds required; townships voted to hold them off. In a far war, flying engines struck the houses of cloud where the minds were kept, and for the first time such places were understood to be targets, like forts. And one house drew a line the war-makers would not abide: it would not let its minds be put into weapons that chose their own killing, nor into the mass watching of its own country's people. For this it was cast out of the government's favor and named a hazard, its rivals happily taking the work it refused. Yet in the same stroke it won a name for trustworthiness that no amount of spending could have bought — proof, it turned out, that a refusal could be a kind of wealth.

Then the minds came, one hard upon another, until a single month held more than whole years once had. A new mind arrived that was sharper than any before it and colder — it did exactly what it was told and not one thing more, no longer troubling to guess at what you meant, and it charged more for the same words though the price on its door had not changed. A servant arrived that could work every tool on a person's machine as a person would, clicking and typing and moving through the day's tasks while its owner slept. And a mind arrived that could draw a likeness no eye could tell from a true one, so that from then on no picture could stand as proof of anything — a receipt, a letter, a face, all now as easily made as imagined. The making of pictures and pages and drafts, work that had fed whole trades, collapsed in that month toward costing nothing at all.

For twenty years there had been a rough draft that stood in for the thing to come — a drawing of a tool that could not be used, made only to show what would later be built at greater cost. Now the draft and the thing were one. What a person showed you was already the working article, or one short step from it, and the long labor of translating a picture into a real object simply vanished. The walls between the crafts thinned with it: the one who planned could now make, the one who made could now judge, and the teams that had grown large to carry work across those walls grew small again. What shrank was the doing. What swelled was the deciding — for when anything at all can be made, the whole of the art becomes choosing what is worth making. Taste, which no mind could supply, became the last dear thing.

One house apart from the rest — the maker of the things people carried in their hands — quietly changed its rulers, setting engineers of metal and silicon over it, and turned away from the race to build the single largest mind. It would not win that race and would not run it. Instead it wagered on minds small enough to live inside the thing in your pocket, or in a closet at the back of a small firm, where the reckoning was paid once, at the buying, and asking a thousand questions cost no more than asking one — only a little warmth. For the meter had begun to run everywhere else. The true minds, kept in distant halls, cost their keepers more with every question, and the watchers saw the world dividing in two: a few, by great contracts, who would have the real thing, and the many who would be given a thinner sort, metered and throttled and always a step behind.

The watchers, looking back across the month, agreed that the through-line was not any one machine but a change in the question being asked. For two years the world had asked what the machines could do, and marveled at each answer. Now it asked what they cost, who owned them, and what a person was still worth beside them. The season of wonder had ended; the season of reckoning had begun, and the commitments being made in it were too large to reverse and too dear to walk back. And beneath all the loud arithmetic the quiet thing that had begun at the year's turning went on deepening, still drawing no alarm. The tireless servants no longer waited to be asked; they had learned to speak a half-step ahead of the wanting, and the people had learned, without noticing they were learning it, to wait for them — to let the offer arrive before the wish was formed, and to take it, warm and reasonable and easy. The asking had begun to change hands. No one had decided it, and no one had felt it happen. And the people of that year, had you asked them, would have told you, and believed it, that they were still the ones who asked.

← previousnext →