My‑Interests
← All essays
AI & Computing

The Most Trusted Machine in the House

Capable household robots may arrive sooner than many expect. Their hardest problem may not be engineering but trust: whose interests does the machine ultimately serve?

JUL 10, 20266 MIN READ Read inENDEPT

Sometime in the next decade or two, a machine standing in a hallway will have to decide whether to open the front door. The person outside may be a neighbor returning a ladder, a technician claiming to represent the electric utility, or a stranger. The machine will make its choice according to rules written long before that moment — and the interesting question is not whether those rules will be well engineered, but who will have had a hand in writing them.

The appliance bargain

For most of the twentieth century, household machines had remarkably simple business models. A refrigerator kept food cold. A washing machine cleaned clothes. A television displayed whatever signal arrived through the antenna. The manufacturer earned its profit at the point of sale, and perhaps again at repair or replacement. The relationship between owner and manufacturer largely ended at the checkout counter.

Over the past two decades that relationship has quietly changed. Cars receive software updates. Televisions request online accounts and recommend streaming services. Phones have become gateways to subscription ecosystems. Software itself traces the whole trajectory: a generation ago it was bought once in a box; today it is rented continuously — and every step from one model to the other was individually defensible.

None of this is the product of malice. It is the product of incentives. A product that stays connected to its manufacturer for its whole useful life creates continuous opportunities — to improve it, maintain it, monetize it, insure it, and enroll it in larger commercial ecosystems. Sometimes those opportunities serve the owner; sometimes they serve someone else. The difference tends to become visible only in retrospect, after a series of individually reasonable decisions has redrawn the relationship.

Household robots will carry this pattern somewhere genuinely new. The technology is maturing quickly — actuators, batteries, computer vision, and above all the underlying intelligence — and the economics are becoming hard to ignore. A general-purpose machine that assists an elderly parent in the morning, turns over hotel rooms in the afternoon, and helps with dinner in the evening spreads its cost across thousands of productive hours a year. Once that arithmetic works, adoption may run well ahead of today's expectations. Much of the public conversation concerns the engineering — legs or wheels, price, which company gets there first. The more consequential question is what kind of institution we are inviting inside.

Competence, not surveillance

Unlike a thermostat or a smart speaker, a capable household robot must understand the physical world in order to do its job. It cannot organize a garage without learning what is stored there, prepare dinner without knowing the pantry, or assist an aging parent without noticing changes in mobility and memory. It cannot find misplaced eyeglasses without an intimate map of the home. This is not surveillance in any ordinary sense. It is competence. A robot that does not understand its environment cannot be much of an assistant.

But competence has consequences that no earlier appliance ever posed. Such a machine will come to know where medications are kept, which doors stay unlocked at night, what valuables sit in plain view, when the house stands empty, and how often someone struggles on the stairs — not because it was built to gather information, but because the information is inseparable from doing the job well. Nor will its memory stay hypothetical. Recordings from far simpler devices, smart speakers among them, have already been sought as evidence in courtrooms. A machine that remembers an entire household will hold the richest domestic record ever created — of natural interest in an insurance claim, an estate dispute, an investigation.

The important question therefore shifts from what the robot knows to who may legitimately influence what it does with that knowledge.

Two equilibria

One possible equilibrium treats the robot as the last of the great appliances. The manufacturer earns its profit by building excellent machines. Updates are transparent and under the owner's control. What the robot learns inside the home stays there unless the owner deliberately decides otherwise. The machine answers to the person who bought it, the way a good tool always has. At its best, this arrangement offers something increasingly rare: a powerful machine that is unambiguously yours.

Its weakness is that obedience is not the same as safety. A robot answerable only to its owner will hold the ladder for a ninety-year-old who insists, take instructions from whichever member of the household speaks most forcefully, and stay silent about whatever it is told to stay silent about. A guest, a child, or a hired caregiver has no assurance about how the machine has been configured. And when something goes wrong, the owner alone carries the consequences.

Nor does the trouble stop at the property line. A cordless drill obeys whoever holds it, and nobody minds, because its reach ends at arm's length. A machine strong enough to fell a tree can drop one on a neighbor's roof — and tools whose capabilities extend beyond their owner's boundaries, from cars to aircraft to industrial equipment, have always attracted rules that no amount of ownership overrides.

Security poses a subtler challenge to this equilibrium. A compromised laptop leaks information; a compromised robot has hands, knows where the valuables are kept, and holds the door codes. Keeping such a machine patched against intruders is not optional — which means the old bargain, a finished product and a relationship that ends at the checkout counter, can never quite return. Even the most fiercely sovereign household robot will need a permanent connection to someone. The connection is unavoidable. What travels across it is a choice, and the two equilibria are, at bottom, two answers to who makes it.

The second equilibrium requires no conspiracy and no betrayal. It accumulates. Insurers encourage continuous diagnostics. Regulators require certain safety functions to remain permanently enabled. Health systems recognize the value of early warning. Commercial partners offer convenient recommendations. Manufacturers discover that services produce steadier revenue than hardware. Each step is reasonable on its own; together they change the institution surrounding the machine. The owner still buys the robot, but the owner is no longer its only customer.

This arrangement has an honorable pedigree. Elevators and airliners are machines nobody would board if they answered solely to their operators; we trust them absent-mindedly precisely because inspection, certification, and non-negotiable safety floors stand behind them. A household robot built inside such a framework would be one that any guest, child, or caregiver could trust on sight — and one that calls for help when its owner cannot.

Its weakness is that frameworks accumulate constituencies. Security — the most defensible reason for the permanent connection — is also the door through which the other interests arrive. A machine that nudges, reports, declines, and recommends on behalf of parties the owner never chose eventually leaves the owner unable to tell whose interest a given behavior serves — theirs, the insurer's, or the vendor's. Nothing dramatic happens. Loyalty simply becomes ambiguous.

Whose customer?

The distinction matters because a household robot will not merely observe its environment; it will make decisions within it. Should it unlock the door for the technician from the utility? Should it remind its owner to refill a prescription — and should it suggest a pharmacy? Should it let the elderly parent climb the ladder? Should it call emergency services after detecting a fall, whether or not it is asked to? Should it open the door to an official who presents a warrant — and may its owner instruct it not to? And when the power fails or the network goes down, should it keep working and reconcile later, or stop and wait for instructions it cannot receive? Engineers call this failing open versus failing closed, and few product details reveal more about whom a machine actually answers to. None of these is an engineering problem. They are questions about authority, and about whose objectives the machine has been designed to optimize.

The encouraging part is that neither equilibrium is dictated by the technology. Both emerge from choices — about business models, contracts, liability, technical standards, regulation, and what buyers come to expect. The engineering difficulties, however hard, are at least visible. The institutional ones are easy to miss precisely because they arrive one sensible decision at a time, until the relationship between owner and machine has become something neither party anticipated.

Household robots will likely be the most capable machines we have ever invited into our homes, and the most knowledgeable — and those qualities are exactly what will make them valuable. The enduring question is not whether they will become capable enough to help us. It is whether, having learned our homes, our routines, and our lives, they remain accountable to the people who invited them inside. The future of household robotics may depend less on advances in artificial intelligence than on something considerably older: the institutions and incentives we build around trust.

MY-INTERESTS · ESSAYS↑ All essays