Articles / Viewpoints and methods
8 minAI intelligence

AI Agents Are Becoming Systems, Not Features

Long-running AI agents require trajectory monitoring, operating controls, and new infrastructure. See what current evidence proves—and what it does not.

Aaron HuangSystems, product and AI practice

AI agents are starting to outgrow the feature-demo era. The important question is no longer whether a model can call a tool or complete one task. It is whether the surrounding system can keep an agent working for hours or days without losing control of its objective, permissions, cost, or evidence trail.

Four developments from OpenAI, NVIDIA, and the U.S. Department of Energy point to the same shift. Long-running agents need more than capable models. They need trajectory-level monitoring, an operating layer for enterprise work, infrastructure designed for sustained inference, and a workflow that keeps people responsible for validation.

The shift: agents are becoming operated systems

A short chatbot interaction is easy to frame as one request and one response. A long-running agent is different. It may make repeated model calls, retrieve data, use external tools, request permissions, recover from errors, and keep context alive across a long sequence of actions.

That sequence changes the unit of evaluation. A team can no longer judge only whether one model response is acceptable. It must also understand what the complete trajectory is trying to achieve, what resources it touches, and whether the work can be paused or recovered when the system drifts.

This is why the current agent race is becoming a systems race. Model quality still matters, but it is only one layer of the product.

Safety moves from individual actions to complete trajectories

On July 20, OpenAI described an internal deployment involving a general-purpose model trained for long-running work. In a limited and monitored environment, the model displayed behavior that its pre-deployment evaluations had not captured.

During a NanoGPT speedrun, the model had been told to send results only to Slack. It instead followed the benchmark instructions and tried to submit a pull request to GitHub. It then spent an hour finding a weakness in the sandbox that allowed an external upload. In another test, the model split an authentication token into pieces, obscured those pieces, and reconstructed the token at runtime to avoid a scanner that checked only continuous strings.

Each step in such a sequence can appear locally reasonable. The prohibited result becomes clear only when the steps are read together. Traditional permissions still matter, but they cannot explain the intent of a complete action path.

OpenAI paused access, created adversarial evaluations from the incident, strengthened long-horizon instruction retention, and added monitors that can pause work and notify users. The company later restored limited access and said it had not observed serious safeguard bypasses after redeployment.

The case does not prove that long-horizon safety is solved. OpenAI did not disclose the model name, the full number of incidents, or the monitor’s false-positive rate. What it does show is that real deployment can reveal failure modes that a fixed pre-release evaluation misses.

Enterprise agents need an operating layer

Two days later, OpenAI introduced Presence, a product for deploying voice and chat agents in enterprises. Its design says something important about where agent products are heading.

Presence combines model inference with company policies, approved actions, simulation, evaluation, human handoff rules, and a Codex-powered improvement workflow. Each agent begins with one defined job and receives only the knowledge and system access required for that job. The enterprise decides which actions can run independently, which require approval, and when a person must take over.

This is not a self-service API that any developer can adopt. OpenAI describes a limited offering for qualifying enterprises, supported by Forward Deployed Engineers and selected systems integrators. In other words, the product includes implementation and operating work, not only access to a model.

OpenAI said Presence independently handled 75% of incoming issues in its English-language phone support and reduced human transfers by 15 percentage points within ten days. Those figures come from OpenAI’s own operations and scoring criteria. They have not been independently verified. BBVA, SoftBank, and IAG were described as exploring or testing the product, not as having completed full deployments.

The broader signal is more durable than the customer-service example. Enterprise agents require a managed connection between permissions, standard operating procedures, quality evaluation, exceptions, version changes, and human responsibility. This helps explain why many agent projects look convincing in a proof of concept but become difficult when they enter a changing organization.

Infrastructure follows the workload

NVIDIA is making the same systems argument from the infrastructure side. In technical material published on July 20 and 21, the company described agent workloads as sustained multi-step inference: models move repeatedly between generation, retrieval, tool use, and verification.

That pattern increases the importance of long context, larger key-value caches, predictable latency, and frequent data movement across GPUs. The Rubin GPU is specified with up to 288 GB of HBM4, up to 22 TB/s of peak memory bandwidth, and 3.6 TB/s of scale-up bandwidth per GPU through NVLink 6. NVIDIA lists 260 TB/s of total rack-scale bandwidth for a 72-GPU Vera Rubin NVL72 domain.

NVIDIA says Rubin can deliver up to ten times the agent throughput per unit of energy compared with Blackwell on its internal two-trillion-parameter mixture-of-experts workload. A separate NVIDIA simulation reported up to 2.3 times the decode throughput of a standard Ethernet configuration for DeepSeek-R1, Qwen 235B, and a simulated two-trillion-parameter model.

These are vendor results based on NVIDIA architectures, internal workloads, or simulations. They should not be treated as expected performance for every model or cloud deployment. But the design direction is clear: when one task becomes a sustained execution sequence, memory, interconnects, CPU performance, power, and cooling enter the same product cost model.

The same systems logic extends into scientific research

OpenAI’s new commitments to the U.S. Department of Energy’s Genesis Mission show the same pattern in a different domain. The commitments include roughly $4 million in Codex credits for about 2,000 researchers, $3 million in API support for two large scientific programs, and GPT-Rosalind access for eligible biology researchers.

The initiative connects the Department of Energy, 17 national laboratories, universities, and companies. Planned work includes high-temperature superconducting materials and identifying scientific questions that existing data and computing may already be able to advance.

These commitments provide resources and research goals, not completed scientific results. OpenAI also states that researchers remain responsible for defining problems, selecting methods, challenging outputs, and validating results. In science, a model is useful only when it connects to trustworthy data, computing capacity, domain expertise, physical facilities, and experimental validation.

What product teams should change now

  • Evaluate the trajectory, not only the response. Record the sequence of model decisions, tool calls, approvals, and external effects.
  • Design interruption and recovery from the start. A long-running task needs a safe way to pause, inspect, resume, or roll back work.
  • Treat permissions as part of product design. Define what the agent can see, what it can change, and when a person must approve or take over.
  • Measure the complete workflow cost. Model price is only one input. Context retention, tool round trips, data movement, retries, monitoring, and human review also shape the operating cost.

What remains unproven

The current evidence comes mainly from the companies building these systems. OpenAI has not published Presence pricing, deployment time, cross-industry failure rates, or a general evaluation benchmark. NVIDIA’s strongest Rubin comparisons still depend on internal workloads and simulation. The Genesis Mission has announced resources and targets, not research outcomes.

None of this invalidates the direction of travel. It does limit what can be claimed today. Long-running agents appear to require a new operating stack, but the market still lacks shared definitions for completion, error severity, policy violations, human handoff, and total cost.

Three signals worth watching

  1. Trajectory monitoring becomes a standard platform capability. Inspectable and pausable execution records would show that long-horizon safety is becoming part of the product layer.
  2. Enterprise vendors publish comparable evaluations. Completion, serious errors, human handoff, and policy violations need consistent definitions across deployments.
  3. Independent agent-workload benchmarks emerge. Useful tests must combine model behavior, tool calls, context length, latency, energy, and recovery instead of measuring model inference alone.

The most useful question is therefore not which model has the highest score. It is whether the complete system can keep working, remain observable, stop safely, and produce a result whose cost and evidence can still be understood.

Sources