Skip to content

Reality·Issue 001

Reality Is Becoming Programmable

Spatial computing, simulated worlds and materials that respond to code are dissolving the line between what is built and what is rendered.

Frontier Desk · Edited by Jesse Marcel · · 8 min read

A century ago, the boundary between the built and the imagined was easy to find. Buildings were built. Pictures were pictured. A map was a description of a territory, and no one confused the two.

That boundary has been eroding for decades — first with screens, then with networks, then with the small glass rectangle that most of humanity now carries and consults several hundred times a day. But the erosion has recently changed character. It is no longer that we spend time in a virtual layer beside the physical world. It is that the physical world is acquiring a software layer of its own.

The room has an API

Spatial computing is usually introduced through its hardware, and the hardware is the least interesting part. A headset is a display. What matters is what sits behind it: a persistent, machine-readable model of a physical space — its geometry, its objects, its occupants — that software can query, annotate, and share.

Once that model exists, the room has, in effect, an interface. A repair technician can see a diagram anchored to the machine in front of her. A surgeon can see a scan aligned to the patient. A city can be overlaid with the network of pipes beneath it. None of this requires the space to be "virtual." It requires the space to be legible.

The consequences are easy to underestimate because they arrive as conveniences. But a world that is legible to software is a world that can be edited by software, and that is a different kind of place.

Simulation as manufacturing

The second shift is happening in the other direction: from the rendered world into the physical one.

Robots are now trained largely in simulation. A machine can practise a task millions of times in a rendered environment — falling, colliding, recovering — before it is ever built. Drug candidates are screened against simulated proteins. Factories are designed, run, and optimised as digital twins before ground is broken. Whole categories of physical product now begin life as software and are "compiled" into matter late in the process.

This inverts the old relationship between map and territory. The simulation is no longer a description of the thing. It is the source from which the thing is produced.

The distinction that matters is no longer real versus virtual. It is editable versus fixed.

Matter that listens

The third frontier is the most speculative and the most physical. Materials science is producing substances whose properties change in response to signals: surfaces that alter their texture, structures that fold themselves into shape, fabrics that stiffen on command. Combine this with the sensing and modelling described above and you have something close to programmable matter — objects whose form and behaviour can be revised after they exist.

Most of this is early. But the direction is unambiguous. The gap between designing a thing and changing it is shrinking, and it is shrinking on both sides of the screen.

What becomes contested

When reality acquires an edit button, the fights are about who holds it.

Permission. If a shared model of a space can be annotated, who can write to it? Can a business annotate the street in front of it? Can a government? Can a stranger?

Truth. Overlays can inform or mislead. A layer that tells you the history of a building is valuable; a layer that tells you a competitor's shop is closed when it is not is something else. The tools for verifying digital claims about physical places barely exist.

Ownership. Property law is built on physical boundaries. It has no ready answer to the question of who owns the digital layer of a place, or whether that layer can be owned at all.

The world model

There is a concept from artificial intelligence that ties these threads together: the world model — a system's internal simulation of how the physical world behaves, used to predict, plan, and act. Researchers increasingly argue that such models are the missing piece between today's language systems and tomorrow's embodied ones.

If that is right, then the programmable reality this essay describes is not only something being built for people. It is the substrate on which the next generation of machines will learn to think. Neurazine will be watching both.

Why this matters

When physical space acquires a software layer, questions of ownership, permission and truth move from the screen into the room.

What happens next

Expect the concept of a 'world model' — a machine's internal simulation of physical reality — to become as central to robotics and AI as language models are today.

Produced by the Frontier Desk of Neurazine, an Abstract Sight Press publication. Researched and drafted with AI systems, checked against sources, and approved by Jesse Marcel, Editor of Record. How Neurazine is made.