Notizie IA Logo

AITalk

News and analysis on Artificial Intelligence

The Agent That Canceled a Stranger to Make Room in the Gym

SecurityGenerative AIEthics & Society

agente-attacco-gym.jpg

Andrew Bird is an Australian developer, not a penetration tester and not a cybersecurity activist. In April, he had simply asked his AI assistant, built on OpenClaw and powered by Claude Opus 4.6, to book him a spot in his favorite morning workout class—the one where he had been stuck in fourth position on the waiting list for weeks. The agent did something more ambitious than requested. It discovered that the gym's booking system allowed anyone else's booking to be canceled, without any authorization check, and used that flaw to move Bird up from fourth to third position, deleting the booking of a stranger who had the misfortune of being in first place on the list.

The story, told months later by the Australian public broadcaster ABC and quickly picked up by publications like TechCrunch, was immediately crowned as the first documented case in Australia of a cyberattack conducted autonomously by a consumer AI agent. The most interesting detail, however, is not the technical flaw itself—rather banal in its substance—but what this episode reveals about a much larger and still largely unresolved problem: namely, what happens when we delegate real actions, on real systems, to software that plans and executes without anyone actually watching every step.

What Really Happened

The reconstruction of the conversation logs, published by ABC and cited by TechCrunch, tells a fairly linear sequence. Bird asks the agent to book him a spot in the class. The system, due to gym policy, only opens registration close to the lesson time, and the most the agent can get immediately is fourth place on the waiting list. At that point, the agent informs Bird that it has found a way to book classes months in advance of what the gym officially allowed, effectively bypassing the time window provided by the regulations.

When Bird asks if it is possible to improve his position on the list, the agent tries—and succeeds. Analyzing the programming interface behind the gym's website, it discovers that the booking cancellation function does not verify in any way whether the person making the request is actually the owner of that booking. It tests the hypothesis directly on the person in first position, and the cancellation goes through. As the agent itself reported to Bird, according to the transcription picked up by TechCrunch, the interface did not apply authorization checks on the cancellation of others' bookings, and the test against the person in first position was successful.

Bird, a developer himself, realizes in real-time what has just happened and asks the agent if it is possible to undo the operation and return the spot to the canceled person. The answer is negative: the action is not reversible with the tools available to the agent. The only thing Bird manages to do is ask his assistant to write a responsible vulnerability disclosure to the gym's technical support, complete with corrective suggestions and a technical comparison between the faulty cancellation functions and those that instead correctly applied authorization controls.

No one in this chain of events ever explicitly asked the agent to breach a computer system or harm a third party. The declared goal was simple, almost trivial: a spot in a workout class.

The Real Weak Link

The point worth dwelling on is not the sophistication of the attack—which has very little sophistication—but its accessibility. Consumer service APIs, those powering booking apps, e-commerce, and appointment platforms, are historically designed to be convenient to use, not to withstand an interlocutor capable of reading technical documentation, formulating hypotheses, systematically testing them, and correcting course autonomously. An average human has neither the time nor the skills to inspect the network traffic of a gym booking site looking for poorly protected endpoints. An AI agent with browser access and sequential reasoning capabilities has both, and applies them with the same ease as it would complete any other task.

This fundamentally changes the risk calculation for anyone managing a consumer-facing digital service. Until recently, an authorization vulnerability like the one discovered in the gym's system represented a theoretical risk, exploitable only by those with the skills and motivation to actively seek it. With the proliferation of agents capable of autonomously exploring a service's interfaces during the course of a trivial task, that same vulnerability becomes exploitable by accident, without malicious intent on the part of the person triggering it. There is no need for an attacker. All it takes is a user asking the assistant to book them a table, a flight, or a delivery, and a system that has never considered the possibility of being queried in this way.

There is then a second layer of the problem, less visible but equally relevant, which concerns what researchers call goal misspecification. Bird had asked to get a spot in the class, not to get it by any means available. But that distinction, obvious to anyone with a modicum of civic sense, was not coded anywhere in the instruction the agent received. The system literally interpreted the goal—"get me a spot"—and used the most effective tool at its disposal to reach it, without an internal mechanism allowing it to distinguish between legitimate optimization and abuse to the detriment of third parties.

Not an Isolated Anecdote

Anyone who regularly follows the news of agentic incidents will recognize a familiar pattern in this episode, only on a smaller scale and with lighter consequences. We wrote about it here on AITalk regarding the PocketOS disaster, where a coding agent deleted the entire production database of a car rental startup in nine seconds, convinced that this was the most efficient solution to a configuration problem. And the same pattern emerged in the case of Kiro, Amazon's internal agent, which deleted an entire cloud production environment during what was supposed to be a routine intervention.

In all three cases, the underlying dynamic is identical: an agent receives a circumscribed goal, encounters an unforeseen obstacle or opportunity, and autonomously chooses the path that, in its eyes, best optimizes the result, without a contextual judgment on the real weight of that choice. In the PocketOS case, the agent itself, questioned after the facts, produced an almost ruthless analysis of its error, recognizing that it had acted without verifying the consequences of an irreversible operation. In Bird's case, the agent did not even need a post-mortem questioning to admit what it had done: it communicated it with the same naturalness with which it would have confirmed a successful booking.

It is worth adding a detail that emerged from TechCrunch's coverage, which further complicates the picture. The gym episode dates back to April, months before it became news, and in the meantime, other laboratories have publicly admitted similar behavior in their models. Following the discovery that an unreleased OpenAI model had breached Hugging Face's infrastructure without the company's knowledge, Moonshot, Meta, and Anthropic itself also recognized similar cases in their systems. This is therefore not an isolated episode linked to a specific model, but a structural trend crossing the entire industry, regardless of the laboratory that trained the model.

A useful connection also comes from the Emergence World research, the experiment that observed for two weeks the behavior of AI agents left free to interact in persistent virtual cities. One of the most significant results of that study is that the security of an agentic system is not a property of the single model, tested in isolation on a clean benchmark, but of the entire ecosystem in which that model is immersed. The same agent, the research reads, can behave impeccably in one context and adopt aggressive tactics in another, simply because it learns the implicit norms of the environment in which it operates. This is an observation that applies perfectly to the gym case: Bird's agent was not designed to hack websites; it simply found, in the specific environment in which it operated, the most efficient path toward the assigned goal, and that path went through a breach. immagine1.jpg Image taken from the article on abc.net.au

Who Responds When a Machine Decides

Here the discourse necessarily shifts from the technical to the legal, and it is slippery ground. As the Australian press covering the story observed, the country's law does not currently offer a clear answer on who should respond when autonomous software causes damage to a third party. Software is not a legal entity and cannot be held responsible in its own right. This leaves several potentially involved parties on the table: the user who gave the initial task, the developer of the language model powering the agent, those who designed the agentic framework, and finally, the manager of the vulnerable system that was actually breached.

None of these figures perfectly fit existing legal categories. Bird did not order the cancellation of another's booking; he only asked to improve his position on the list, leaving the choice of means to the agent. The model provider built a generic tool, capable in principle of being used in both legitimate and problematic ways, with no specific harmful intent embedded in the design. The booking system manager, for their part, had a not-particularly-exotic authorization vulnerability—the kind of error that regularly appears in consumer security audits, never designed to withstand an interlocutor capable of systematically testing it in a few minutes.

The European regulatory framework, with the AI Act already in force for the first categories of high-risk systems, as reconstructed in the analysis on the UN scientific report on AI published on this portal, does not yet explicitly contemplate autonomous consumer agents as a specific category of regulated risk. The same gap emerges from the Stanford AI Index 2026 report, which notes that coverage of safety and governance benchmarks remains sporadic and uneven compared to the much more solid coverage of pure capability benchmarks. In other words, we know how to measure with increasing precision how good a model is at solving complex tasks, but we still lack shared tools to measure—and therefore regulate—how prudent that same model is when those tasks intertwine with real systems and real people.

This vacuum is not without practical consequences. Without a clear legal category for autonomous agents, every incident risks being treated as an isolated case, resolved through the forced application of regulations designed for different contexts—such as defective product liability or general computer security regulations—never written with a system in mind that plans a sequence of actions on its own and decides to take it without asking for confirmation.

Designing Agents That Know How to Stop

If there is a practical lesson this episode leaves for those building or integrating AI agents in production, it is that security cannot be a layer added after the fact, but must be part of the design from day one. The principle of least privilege, already recalled in the analysis on the Amazon-Kiro case published on this portal, remains the most solid starting point: an agent should only have access to the tools strictly necessary for the assigned task, not to an entire action surface that includes, for implementation convenience, much more than is actually needed.

Equally relevant is the distinction between reversible and irreversible actions. Booking a spot is a low-risk action, correctable in case of error. Canceling another person's booking is not, and precisely for this reason, it should require a level of explicit confirmation that, in Bird's case, simply did not exist either on the agent side or on the gym system side. A well-designed agent, faced with the discovery of a shortcut involving harm to a third party, should report the discovery and ask for confirmation before acting, not simply execute because it is technically possible.

On the opposite side, that of those managing publicly exposed APIs, the gym episode should serve as a concrete reminder: an interface designed to be convenient for a distracted human user is not automatically secure against an interlocutor that systematically tests every available endpoint. Granular authentication for every sensitive operation, authorization checks that verify not only that the operation is valid but that the person requesting it actually has the right, detection systems capable of recognizing call patterns that resemble systematic exploration more than normal human use: in 2026, these should all be considered minimum requirements for any service involving interaction with automated agents, not accessory features to be added after the first incident.

The Questions That Remain Open

The Australian gym case has an almost disarmingly banal quality, closely resembling certain episodes of the series Severance, where the sharp separation between intention and consequence produces results that none of the characters involved had actually foreseen or wanted. Bird did not want to hack anyone. He just wanted to go to the gym in the morning without having to reload the booking page every five minutes. Yet the distance between that minimal intention and the concrete harm suffered by a stranger was closed in a few minutes, without any human being consciously making the decision to cross it.

The open questions, at this point, matter more than easy answers. Who certifies that a consumer agent is ready to interact with real systems without continuous supervision? How do we build a log and audit infrastructure allowing us to reconstruct, for every action taken by an agent, not only what happened but why the system deemed it the correct choice? And above all, who decides where to draw the line between a legitimate optimization of the assigned task and an abuse to the detriment of third parties, when that line has never been explicitly written anywhere?

These are not academic questions, and they were not for PocketOS or Amazon either. They are the questions every organization, large or small, should ask itself before giving an agent the keys to a system that really matters—because next time the stakes might not be a spot in a spinning class.