Agent Usage & Performance Workbook
Status: Complete — February 2026 Related Controls: 3.1, 3.2, 3.3, 3.7, 3.8
Overview
The Agent Usage & Performance Workbook is an Azure Monitor Workbook that provides unified visibility into Copilot Studio agent activity across an FSI organization. Built on Application Insights telemetry, the workbook consolidates usage metrics, performance indicators, and governance signals into a single operational dashboard.
The workbook is designed for M365 administrators, compliance officers, and AI governance leads who need to monitor agent adoption, identify performance issues, and support regulatory reporting requirements.
Workbook Tabs
| Tab | Purpose | Key Metrics |
|---|---|---|
| Usage & Business Value | Agent adoption and conversation volume | Active users, conversations per agent, channel distribution, usage trends, ROI |
| Performance & Errors | Agent health and reliability | Error rates, exception patterns, dependency failures, response latency estimates |
| Operational Health | Dependency health and quality monitoring | Dependency health, GenAI quality, anomaly detection, agent health summary |
Available Documentation
| Document | Description | Status |
|---|---|---|
| Telemetry Schema Reference | Application Insights telemetry schema for Copilot Studio — event types, customDimensions properties, channel identifiers, session tracking, and prerequisites | Available |
| KQL Query Library | Complete query library powering all workbook visualizations | Planned (Phase 1) |
| Deployment Guide | Step-by-step workbook deployment, RBAC configuration, and validation | Available |
| Customization Guide | Adapting the workbook for organization-specific requirements — thresholds, custom panels, KPIs | Available |
Prerequisites
- Azure Application Insights resource connected to Copilot Studio agents
- Appropriate Azure RBAC permissions (Reader or higher on the Application Insights resource)
- Copilot Studio "Log activities" setting enabled per agent
See the Telemetry Schema Reference for detailed prerequisite configuration.
Solution Complete
The Agent Usage & Performance Workbook is fully integrated into the FSI Agent Governance Framework. All documentation — telemetry schema, deployment guide, and customization guide — is available. Controls 2.9, 3.2, and 3.9 include cross-references to this workbook.
Updated: February 2026 | Version: v1.2.51 | Framework: FSI Agent Governance