Application Management

Full post-deployment dashboard for managing, monitoring, and evolving your deployed AI applications.

Application Management is the post-deployment control center for your AI application. You arrive here after clicking Move to Prod from the Deploy tab. It provides ten dedicated tabs for every aspect of running a production AI application.

1. Overview

App name, description, deployed URL, and GitHub repo link. Generate AWS WAFR Reports and Application Design Documents.

Overview

2. Agents

View and manage deployed user and platform agents. Edit model, tools, memory, and system prompt per agent.

Agents

3. App Config

Configure GitHub collaborator access, custom domains, API endpoint, channel integrations, and build history.

App Config

App Config Channel Integration

4. Test Bed

Live chat with deployed agents, agent activity tree for real-time orchestration, and run evaluations across up to 8 metrics.

Test Bed

5. App Refiner

Make AI-assisted changes to your deployed application by describing what you want in plain English.

App Refiner

6. Identity & Access

User access configuration and authentication settings for your deployed application.

7. Observability

Sessions, traces, latency, errors, token usage by model, and per-agent spans.

Observability

8. Compliance & Security

Security pen tests powered by AWS Security Agent, and DPO Pack generation with automated GDPR controls assessment.

Compliance & Security

Compliance DPO

9. FinOps

Daily cost trends and cost breakdown by AWS service. Cost data may take up to 24 hours to appear after deployment.

10. Settings

Application configuration, access control, blueprint catalogue, and Danger Zone for permanent teardown.

Settings