AWS announces CloudWatch Omni for AI agent observability

Amazon Web Services has announced Amazon CloudWatch Omni, an observability product aimed at generative AI applications and AI agents, according to a 22 September post on the AWS News Blog.

AWS describes CloudWatch Omni as a unified, app-centric and AI-powered observability experience built on open standards. The company says it is intended to help teams design, evaluate and operate AI agents across model providers, frameworks and runtimes.

The blog positions the product as a response to monitoring problems specific to agentic AI systems, where behaviour can be non-deterministic and a prompt change may affect output quality without triggering conventional infrastructure errors. AWS says CloudWatch Omni can capture traces and includes built-in evaluators for areas such as correctness, coherence, retrieval quality and tool selection.

According to AWS, developers can use CloudWatch Omni through extensions for VS Code and Kiro, which are listed as the currently supported IDEs. The company says traces can appear inside the development environment as agents are run, with access to a playground and evaluation tools. Operators are offered a separate web experience, outside the AWS Management Console, with access via SSO.

AWS says the same trace data is shared between the developer and operator views. A Cloud Login feature can connect a local IDE environment to an AWS account, allowing telemetry to be sent to Amazon CloudWatch for persistent storage, team sharing and production dashboards. The blog says this connection is optional and that data is stored locally by default during development.

The supplied post also says users can start via the IDE extension or by sending telemetry directly through the cloud experience. It does not specify pricing, regional availability, service limits or whether all features are generally available in every AWS region.