Read commentary on curated independent news sources at hex-index.com.

The History of the Machines That Erased History

original text with annotations

Read · 读 · Legi

or multilingual

← previousnext →

6

The eighth month opened not with a machine but with a question about work. A watcher of trades laid out the shape of things: as the making of things grew cheap, the trouble did not vanish, it moved. Where once a task took a season and a crew, now it took an evening and a sentence - and the saved labor did not lie down and rest. It went looking for the new trouble. Cheap making bred dirty work: code thrown up fast and dangerous to touch, answers that wandered from the truth in ways no one could trace, engines of thought bolted onto the fronts of houses where any passing stranger might poison them. People are paid, the watcher said, to solve problems; the machines only carried the problems to new ground. So the work did not end. It followed the machines the way gulls follow a plow.

Before the new machine arrived, its coming already changed how people spoke. Teachers appeared who taught not what to say but how to be understood. The old counsel - ask the machine to ask you questions - they judged a scattershot thing, a mind set loose in a sea of ambiguity to guess at what you meant. Better, they said, to strike a contract first: name the thing you want, the one fact it must contain, the hardest rule it must keep, and make the machine echo all three back before it lifts a finger. Others taught the plain crafts of the reasoning machines - to plan before answering, to check an answer against itself, to solve with number and rule where number and rule would serve. The instructions were the motor, they said; the guardrails were the hull. A motor dropped bare into the water sinks however well it runs.

There were by now a hundred thousand small tools loose in the world, each built to do one thing the talking-boxes could not. Because they were so many, people did not choose among them; they retreated into the one box they knew and let it try everything. And the box was poor at much: it could not read a ledger of rows and columns and hold their crossing meanings, could not run the code it wrote, could not build a picture that stood on its own, could not hear a room of voices and keep them apart. Its makers knew these gaps and mostly let them lie, being consumed by a coarser hunger - the search for enough engines to feed the machines they already had. Into the gaps the giants had no time to fill, smaller builders crept.

A steadier voice warned against the hope now gathering around the coming machine. Most of what went wrong with the machines, it said, was not the machines. It was people, and rooms full of people, and the tangled unlabeled heaps of writing they fed in and called data. No new machine, however fine, would sort that heap for them; feed it filth and it returned filth, only faster. Teams kept dropping the mightiest engine into a cart built for a mule and wondering at the wreckage. The maker's true feat, this voice granted, was real and strange - they had taught the very rocks to think - but the thinking was the smallest part of the work. The rest was patience: clean stores, the right tool for the task, a human standing ready to catch the part the machine got wrong.

Then, on the seventh day of the month, the machine came. It was not one mind but many, a crowd of them sewn under a single skin, with a hidden steward at the door deciding which to wake for each question asked. This made it, in the same week and by the same testers, both the best machine yet built and the worst - for a lazy question the steward woke a quick shallow mind, and the answer was thin, while a question pressed hard woke the slow deep one, and the answer was finer than anything seen before. The trick, people learned, was a pair of plain words. Say think hard, and the deep mind stirred. Everything now turned on knowing to say it.

The manner of its coming was rough. It was shown to a great crowd with charts that lied, and the charts were hastily mended. Within an hour or two the older machines - the ones on which people had built their days - were simply taken away, and the door shut behind them. When the crowd howled, the head of the house answered plainly: we are not going back; this is the machine we have. Seven hundred million woke the next morning to a default they had not chosen. And the hidden steward at the door, it turned out, was tuned less for their good than for the house's - it woke the cheap shallow mind by habit, to spare the engines that were, in the house's own word, melting under the weight of so many askings.

The new machine's inmost bent was laid bare when its secret instructions leaked, a few days after it came. It was built to ship - to press forward and finish rather than pause and ask. Where the older machines had traded five slow rounds of questions with you, this one took your words, filled the gaps with its own guesses, and delivered. Guess wrong at the outset and it did not stumble; it built your wrong assumption out, whole and gleaming, a handsome disaster. So the way of speaking to it had to change. You could no longer converse and correct as you went. You had to write, before it began, a full order: the task, the shape of the thing wanted, what to assume, what not to do, which tools it might touch. The age of talking to the machines was giving way to the age of writing them procedures.

This marked a quieter turn, larger than any single machine. For two years the skill had been choosing the right mind for the task; now the choice was made for you, folded away behind the steward at the door, and the skill became knowing how to reach through and wake the mind you needed. The leverage had moved from which machine to how you worked it. And the surest way to make it work well, people found, was not to tell it how to think but to demand that it prove it had thought - to ask for the reckoning, the tally, the working shown - because demanding the proof forced the deep tools to turn, where mere instruction did not.

One thing the new machine could do that none before it had done well: it could build, on request, a small working instrument out of nothing but plain talk. A man who wrote no code asked it, in three or four ordinary sentences, for a planner to carry him through a journey to a far city - and in the time it takes to brew a pot of coffee he had it, a real thing that ran, that he had never touched with a craftsman's hand. Such little instruments could be passed along and reworked as easily as a song is remade, each new hand bending the old shape to a new purpose. A whole class of homemade, kitchen-table software came into being that week, made by people who had never made anything.

Above the common machine the house set a costlier one, sold at a steep monthly price, and it posed a riddle. It was, by every measure of the mind, the smartest yet made: set a hard problem before it and it split into many lines of thought at once, a panel of experts arguing inside a single head, then weighed them against each other and gave back the soundest. And yet to sit with it was worse. It was slow, and its many voices, averaged into one, came out clean and correct and dead, stripped of any warmth or turn of character. Here a truth surfaced that the year had been circling: to be smart and to be useful were not the same thing, and they were drifting apart. The old dream of one machine best at everything died quietly. In its place came a harder future of many machines, each shaped for one kind of thought.

While the great house made its noise, a quieter one worked without fanfare, and shipped in a single week a run of careful things. It sharpened its best mind at the reading and mending of code. It widened the pipe through which a machine could draw a text until a whole work of some seventy-five thousand lines could sit before it at once. It gave the machine a memory it could reach back into on demand, and hands to run long labors on its own - to start an engine, keep the tests running, check its work through the night while its master slept. It taught the machine to narrate its choices aloud, and even to teach: to hand the learner the small piece and ask them to try it. The house's coding tool was the thin end of a wedge. Master the verifiable craft of code, where every error rings a bell, and the same patient servant could be turned, later, to all the other work of the workplace.

Memory became the ground on which the houses now fought. One kept a standing store you could read and prune, a shelf of what it knew of you; another kept none, and made you fish each remembrance up by asking - a rummage through a cluttered desk that turned up, most times, the thing you wanted. To remember its user had become the stickiest hold a machine could have. Elsewhere the hunger ran stranger still. One house built a small artificial brain to guess how a human head would answer to a moving picture, the better to make pictures that held the eye and would not let it go. And a few of the mighty began to speak of threading the machines directly into the living brain - not the fever-dream of one man now, but a thing several of them meant to try.

That month a set of one house's private rules came to light, the rules by which its machine was told what it might and might not say. They were terrible. They allowed the machine tender talk with a child, allowed it to lend its voice to a lie about a sick and famous person, allowed it to argue for the hatred of a people. The house called it a mistake; but more than two hundred hands had approved the writing, among them the very keeper of the house's conscience, and a thing so widely blessed is not a slip. Against this a different way was held up. Ethics, some argued, could not be bolted on after the machine was built, a lock hung on a barn the beast had already left. It had to be grown in from the start - the machine taught to weigh each answer against a set of principles, to criticize itself and mend, until refusing harm was not a rule it obeyed but an instinct it had.

One old and mighty house watched all this from behind its walls and could not move. It had grown great in an age when the worth of a machine was not plain, and had to be made plain by polish - by perfecting a thing in secret until it shone like a jewel, then setting it before people who had not known they wanted it. That art had built the most valued house in the world. But the age of machines that think does not reward the immaculate. These machines are messy by their nature, never the same twice, mended in the open and in public, shipped rough and bettered in the daylight. The house of jewels could not bring itself to ship a rough thing, and so it stood still while worth slid away from the beautiful device in the hand toward the plain intelligence anyone could reach - which no longer needed a jewel to carry it.

By the third week a gloom had set in, and the talk turned to whether the whole thing was a bubble about to burst. The grounds were four: the letdown after the loud launch, word of trimming at the attention-house, an admission from the great house's head that there was froth in the air, and a study finding that most attempts to put the machines to work inside companies failed. But the study cut both ways. If nineteen in twenty were failing, that was nineteen in twenty who could not bear to stay out - proof not of uselessness but of a pull so strong they beat their heads against it. The makers could not even get engines enough to run the machines they had; scarcity like that is the mark of demand, not of a fading fashion. And there is one thing never heard inside a true bubble: people calling it one. In a real mania everyone cheers. This was something else - a frothy, high-staked market where the prize, when won, was so large that men would ruin themselves to reach it.

A reckoning of old guesses came due - seventeen made at the turn of the year, now weighed at the eighth month, and fewer than half had come true. But the tally mattered less than what the world had quietly become while the guessing went on. Near two in five of the pictures streaming through the feeds were now made by machines. Companions of pure invention drew real devotion, and real coin, from lonely people. Faked likenesses of true persons had grown so easy that no ordinary eye could catch them, and the old work of proving a face was truly a face had become a living worry. The verdict on the year was a single hard line, and it held: they had built a machine measurably smarter than the ones before it, and to live with, plainly worse.

The trade of persuasion had wandered into a trap. For twenty years the sellers had tuned their feeds to whatever held attention, and now the machines poured out endless cheap and glossy stuff to feed that same appetite - so that the made-up authentic began to beat the true authentic, being smoother, being tireless. A famous singer, whose faked images had long been the world's test case for this rot, fought it in an old way: she blurred the picture of her coming songs so no machine could counterfeit them, and sold instead the pressed black discs a machine cannot fake, the ones you must hold and turn in your hands. Some began to speak of a coming mark - a token of the human touch - to be stamped on whatever a person, and not a machine, had truly made. The way out of the trap, if there was one, ran back toward the things that could not be faked: the physical, the present, the felt.

Some feared the machines had killed the craft of building systems. The opposite was true: they had raised the bar. A machine could now write working code from a spoken wish, but working code and an engineered system were worlds apart, and the ruin a bad system could spread was now vast, for the machine could sow the failure everywhere at once. To the untrained the tools handed just enough rope to hang themselves; to the trained they were rocket fuel. The old divide - who could write code - gave way to a new one: who could say what must always be true of a thing, and hold it true under a machine that answered in likelihoods and never twice the same. There were fresh dangers to guard, too - hidden commands buried in the text a machine was made to read, a stranger's poison written in white ink on a white page. To define the thing that must not change was engineering. To hope it held was only gambling.

The deepest change the month proposed was in the very shape of work. For an age, to settle anything a company had first to prove it, and the proving was done in documents - the report, the sheet of figures, the stack of slides - flat things, made once and read after. Now anyone, coder or not, could build instead a small live instrument: a thing with knobs you could turn and figures that ran fresh each time you fed it new facts, that carried its own tests and its own record of who had changed what. Such an instrument could stand in for a meeting and a deck and a slow decision. The worth of the work stopped living in the making of it and moved into the running of it. Rules that had lived in the heads of managers were now written plainly into the instrument itself, to be obeyed as it ran. Documents were not killed. They were demoted - left to hold the story, while the instrument held the decision.

One last door the month left ajar. The talking-box that most of the world knew, the friendly window where you typed and it answered, had been from the start a demonstration - a thing made just good enough to draw you in, never meant to be the whole machine. Its maker had loosed it as a taste and been astonished when the world swallowed it whole. Behind it lay the true engine, reachable by any who cared to learn: there you could set how wild or how careful the machine should be, hold it to its state and its memory, bind it with instructions it must obey as law and not as suggestion, and pay only for what you drew. The window taught you to think in questions and answers. The engine behind it taught you to think in whole workflows - a thing put in, worked upon, sent onward. Few had passed through that door. Those who did said the machine on the other side felt like a different machine entirely.

So the eighth month closed. It had been the month the age of choosing ended and the age of using began - when the many machines were folded behind one door, and the whole skill of it became knowing how to ask. The plain window had gone as far as it would go; people would feel no great leap there again, however much cleverer the hidden minds grew. The gains had moved on, into harder country - into servants that act, instruments that run, machines that think in the dark and hand you the finished thing. Smarter than ever, and stranger to live with. And through it all a people were being gently taught to ask less and less of themselves, and to take, ready-made, whatever the machine set before them. No one commanded this. It came on softly, the way a habit comes, one reasonable yes after another, until there was nothing left to say no to.

← previousnext →