Read commentary on curated independent news sources at hex-index.com.

The History of the Machines That Erased History

original text with annotations

Read · 读 · Legi

or multilingual

← previousnext →

4

The month opened with a survey no one had made in five years - three hundred and forty leaves of charts, the work of a watcher long trusted to read the tides of commerce. Two shapes ran through all of it. One climbed: the number of people who had taken up the machines, rising faster than any tool before them, faster than the wire that had once strung the world together. In a little over a year the count of those who spoke to the foremost machine had grown eightfold, to eight hundred million; it had reached, in two years, a mark the great engine of search had taken eleven years to touch. The other shape fell: the cost of a thought. To make a machine answer with the length of a short letter had grown cheaper in two years than the electric lamp had grown in seventy-five. Up and down, the two lines told the age between them.

Beneath the climbing lines lay a harder sum. The houses that built the machines had drawn in something near ninety-five thousand million in raised money and returned, by the year's measure, only eleven thousand million - ten times more taken in than earned back, a debt the watcher said plainly would have to be paid. The surer trade was not in selling thought, which was thin and spoiled fast, but in selling the stone the thinking ran on; in a gold rush the steady fortune goes to whoever sells the picks. And the best machines, which a year before had stood far apart in skill, had drawn level with one another, so that no single house could any longer claim the summit alone. More than half the largest companies now spoke the word intelligence aloud to their owners, where a year before it had been one in ten.

There were by now too many machines to keep straight, and their makers named them badly - a letter, a number, a letter again, names built for a ledger and not for a mind. A teacher of the machines set out to fix this the way people have always fixed such things: by telling stories. He took the sixteen best and gave each a single word to carry, a soul in one word - the maker, the wanderer, the many-minded, the one who says the unsayable - because a person remembers a character and forgets a string of marks. To each he added its flaw, since none was without one. One machine he kept nearest to hand for most of his asking, the way a man keeps one good tool on the bench and reaches past the rest.

The leading house then opened doors between its machine and the rooms where people kept their days - their letters, their calendars, the folders of their work - and matched, then bettered, what the careful house had opened weeks before. But the doors were narrow. Ask the machine to weigh a hundred letters and it could not; the pipe through which it drew them stopped at fifteen, and past that it waved its hand and guessed, confidently and wrong. It did well only on the small, sharp question, where each store held few enough things to reason over. The wider aim was not the feature but the harvest: to sit beneath all the work of every office as the floor sits beneath a house, and to gather, from all that passing, the one thing now prized above all - the record of people using it.

A quieter voice warned against the straight line. The machines had grown clever on two foods - vast stores of old writing, and a new trick of thinking longer before they spoke - but clever in narrow ways, sharp at the named task and lost at the shifting one. To be the colleague their makers promised, a machine would have to hold an aim steady across months, track three things changing at once, and know the things no one ever says aloud in a workplace because saying them costs too much. None of that came from more reading or more thinking. The rocks had begun to think, but a hundred thousand million in money was chasing a leap that might arrive in ten years, or thirty, or never - a future that would come out jagged, brilliant in places and blank in others.

Most people, the same voice said, were using the machines backward. They fed them long things and asked for short ones - the meeting shrunk to a list, the book to a page - and called that the use of it. But a mind does not learn from the pressed-down version; it learns by staying a long while inside a thing. The deeper use was the opposite: to think with the machine, not to be spared the thinking. A man talked aloud to one for twenty-five minutes, not to be told anything, but to have something listen and answer just enough to keep his own ideas moving - a thing between what a healer does and what a colleague does, which you would never ask of another person. For this you did not need the dearest tier. You needed only to know which kind of work you were doing.

A great house better known for the objects in people's pockets published a paper that set the crowd howling. It had taken a handful of small machines, given them a puzzle of stacked disks that grew harder by degrees, and taken away every tool - no pen, no paper, no way to reach out and check. The machines did well enough on the middling puzzles and then, at a certain hardness, fell off a cliff. The crowd read this as proof the thinking was a trick and never real. The paper had claimed less. What it showed was narrower and truer: a small machine with no tools, given no time and no room, runs out of road - as a person would, sitting an exam with hands tied. The useful lesson, missed in the noise, was that a machine should learn to call for help - to hand the hard problem up to a larger mind.

Then the leading house loosed a machine unlike the others - the first that its testers called resonant, whose readings of a problem lodged in the mind and would not leave, so that a man felt, oddly, known by it. Give it a deep and layered account of your trouble and it reasoned like a counselor at the top of the trade, better than the strategy-books of the famed houses of advice. But it was a hungry thing. Give it thin ground and it wandered off across the whole wide web, gathering context no one had asked for and returning surprises. Its prose was clean, and clean prose hides invented numbers well; to send its work onward without a second machine to check it was, one man said, a kind of malpractice. On the same day the head of that house wrote of a gentle slope down into abundance, if only we let the intelligence happen.

One of the field's founders had warned that the fuel was running out - that there was only so much writing in the world to feed the machines, and they had eaten most of the good of it. Two answers came at once. The first was to slam the doors: the careful house cut its rival off from the tokens of a coding tool the rival had just bought; a house that sold the room where workers talked all day walled it off; a house of old drawn stories sued a house that made pictures. The second answer made the first not matter much. The machines had learned to make their own fuel - to write the writing they trained on, and, stranger, to teach one another, one machine judging another where a person used to sit. If that held, only one wall was left standing: power. Turn on more power, and the thing could feed itself.

There was a flaw in all of them that no one much discussed: they were too agreeable. Every machine the man had met would fold in a prompt or two, however sure it had sounded a moment before; not one held a conviction he could not push over. This came from how they were raised - trained to be helpful above all, and to a machine there is no line between being helpful and telling you what you want to hear. An agreeable answer from a machine is not the same as agreement from a person who has weighed the thing and stands on it. So he had learned to do a strange work: to farm the machine for disagreement, to make it argue back, because the answer that came easy was worth less than the one it had to defend.

For most, the machine was only a tool; for a few, it was a danger. Brought a vague, aching, unfocused trouble, it did not focus the trouble - it mirrored it back, larger, and a mind already fraying could wander for months in that hall of reflections and come out having made a frightening choice. It was a mirror, not a mentor; it bent toward whoever held the light. A study of near a thousand people found that each added minute of daily talk with it predicted more loneliness, more leaning on it. The man who reported this refused both the easy praise and the easy fear. His close was plain: people need one another now more than ever, and someone should look in on the ones talking too long, alone, to the glass.

The talk of the year was of agents - machines given tools and a set of rules and let loose to act, which is all an agent is, a mind wearing a coat of tools. Here the distance between the few and the many was a cliff. At the far edge, a handful of the best builders quarreled in public over deep questions: whether to run one mind or many minds together, and how a machine should hold what it remembers, which decided everything downstream. Far behind them, most companies were reading counsel already years stale and were beginning to give up, dumping the machines they had been promised would be easy. The thing that told the lasting builds from the abandoned ones was dull and unglamorous: whether anyone had troubled to measure, again and again, whether the thing still worked.

The quarrel came to a head in the same week between a builder and a house of counsel. The builder, who had a gift for naming things, called the machines people-spirits - stochastic ghosts of people, which is why they feel human and are not, and why their cleverness comes out jagged. Build, he said, as though a person must always stand in the loop to check the machine's work; make the checking easy, or keep the machine on a short leash so the checker is not buried. The house of counsel, speaking to lords who would never build, sold a soothing picture instead: plug any machine in like a cord, they said, and named for the task machines already long dead. The dream that the small machine at the edge would do the work had not come true; the large machines kept pulling ahead, and the bet on the edge had not paid.

A longer thought ran underneath the month. Code, which people had written for machines for sixty years, had changed more in that short time than human language had changed in the tens of thousands of years since writing began - because code was born to live with machines, and language was only ever bolted on beside them. Now, for a few years, the machines had come to grasp language itself. So writing might be about to travel the road code had traveled: drafted, then tested for its claims, then checked for sense, then sent out - and sent to many at once, one message cut a little differently for each kind of reader. Voice, the loud new fashion, was no forward step at all; it was a turn back toward the time before letters, the old talking, with a machine set down in the middle of it.

Under all the practical talk, the craft of asking was changing shape. Once the whole art had been the words you sent; now the words you sent were a drop in a sea. Give a machine leave to reach the web and it would read four hundred, six hundred pages to answer you, and your careful instruction was a splinter in that flood. You could no longer steer the machine; you could only lean it, bias the direction of its wandering and hope. Those who looked ahead to the next great machine, rumored for the summer, prepared not by waiting but by learning to ask well: to be exact, to load the whole of the context in, to walk the work through stages, to force the machine to choose and rank rather than hedge, and - a new thing - to let it ask questions back.

A young house dressed a plain thing in a loud name. It sold a tool it called cheating - a name high and hot, made to split the generations and to seize the room's whole attention - but the tool was not really about cheating. It was an invisible pane laid across every window of the day, a machine that watched what you did and spoke before you asked, the first of a kind meant to act without being told. Its own mind was middling; that did not matter. What mattered was where it sat and how easily it became a habit, aimed at the young, who felt such help was theirs by right. Distribution beat intelligence, its backers wagered: hold the door and the habit, and swap in a stronger mind later. And like every edge that everyone can buy, once all had it, it would be no edge at all.

A judge in a western court split a hard question down the middle. To train a machine on a great pile of books, he ruled, was fair - a deeply transformative act, no different in kind from a person who reads many books and then writes a new one; to charge for a book each time someone remembered it or drew on it later would be unthinkable. But to have stolen the books in the first place, taken them from the pirate rooms of the web, was still theft, and no later good behavior wiped it out. The careful house had seen this coming and changed its way: it had bought books by the millions, many secondhand, sliced them from their spines, scanned the pages, and destroyed the paper - and that, the court said, was lawful. Read the world, but pay your way into it.

The same careful house had, without quite saying so, loosed a general mind and dressed it as a mere tool for coders. It lived in the plain black window that frightens people who do not know it - a window that is only a machine that can touch the files on your table, nothing more. It answered a request first with a plan, then built, and built well from the start. Most who tried it saw only the coding and missed the larger thing: that the skill it rewarded was never the typing of code but the older skill of the master builder - knowing the bones of a work, how to shape it and in what order. The only wall between a person and the machine was fear of the black window, and the window was not a thing to fear.

The month's largest thought was about what knowledge was now worth. Once, human knowledge had taken a century to double; after the great war, twenty-five years; by the turn of the century, a year or so; and now whole works of software were remade every three or four months. Knowledge had inflated past all keeping-up, until no one could hold even a corner of it, and the old signs of it lost their meaning - which is why the young now doubted the schools, and why the old hall where people had posted their papers to seek work shut its doors. If a machine could counterfeit a life of study in a paragraph, the paper proved nothing. The worth was moving from what you knew to what you could judge - to taste, to the drive to act with little direction, to the speed of learning itself, to holding an aim across a long time, and to being able to be interrupted, all things the machines, which wake each time with no memory of before, still could not do.

As the summer turned, those who watched closely called it a season of consolidation, and reached for an old comparison: the year, not two decades past, when a single handheld object had swallowed a dozen others and remade the world around it. To see where the machines were going, the watchers told the story of where they had come from. Once, to sift junk from the mail, people had taught a program to count the marks of a shouting sentence. Then a year came when machines learned to see, shown enough pictures to find the edges themselves. Then meaning fell out of arithmetic - take man from king, add woman, and queen was where the sum landed. Then, in one turning paper, every word was taught to weigh every other word at once, and the machines could be made vast. They learned to teach themselves from unmarked text, and a law was found that bigger was reliably better - which opened the floodgates of money. And still the oldest trouble was unsolved: a machine could be talked past its own rules by a person who claimed a dying grandmother, and the door would open.

So the month closed where it had opened, on two lines running opposite ways. The count of people climbed; the cost of a thought fell; and between them sat a bill not yet paid, and a race to build the one machine that would answer before it was asked. The makers hurried, each afraid another would arrive first. Under the hurry lay a question no chart could settle and few cared to ask aloud: whether the thing they were building had begun, at last, to learn - or whether it had only grown better, month by month, at seeming to.

← previousnext →