Skip to content

Control 4.13: Copilot Extensibility and Agent Operations Governance — Verification & Testing

Test cases and evidence collection procedures for Copilot extensibility governance and ongoing agent operations.

Test Cases

  • Objective: Verify that users cannot self-consent to new Copilot plugins without admin approval
  • Steps:
  • Log in as a standard Copilot user.
  • Attempt to add or enable a third-party plugin that is not in the approved catalog.
  • Verify the request is blocked and the user is directed to the request workflow.
  • Confirm the admin team receives the request notification.
  • Expected Result: User consent is blocked and the request is routed through the approval workflow.
  • Evidence: Screenshots showing the blocked consent attempt and admin notification.

Test 2: Agent Ownership and Registry Review

  • Objective: Validate that widely available agents are visible in the Registry and have assigned owners
  • Steps:
  • Review the current Registry inventory.
  • Identify any ownerless or broadly shared agents.
  • Verify follow-up or remediation is recorded for each exception.
  • Expected Result: Registry is current and owner accountability is clear.
  • Evidence: Registry export or screenshots with owner fields.

Test 3: Plugin Approval Workflow

  • Objective: Validate the end-to-end plugin approval workflow
  • Steps:
  • Submit a test plugin request through the user request workflow.
  • Walk through the three-level approval chain (IT, Compliance, Business).
  • Verify each approver receives the request with the Plugin Risk Assessment.
  • Complete the approval and verify the plugin is made available.
  • Expected Result: Plugin approval workflow completes through all levels with documented approvals.
  • Evidence: Approval workflow records showing each approval level.

Test 4: Plugin Access Control by Group

  • Objective: Confirm that plugin access is correctly restricted by user group
  • Steps:
  • Configure a plugin to be available only to a specific user group.
  • Log in as a user in the approved group and verify plugin access.
  • Log in as a user outside the approved group and verify the plugin is not available.
  • Change group membership and verify access updates accordingly.
  • Expected Result: Plugin access follows group membership restrictions.
  • Evidence: Screenshots showing plugin availability per group membership.

Test 5: Graph Connector Data Sensitivity Assessment

  • Objective: Verify that Graph connectors exposing data to Copilot have been assessed for sensitivity
  • Steps:
  • Run the Graph connector inventory script.
  • For each connector, verify a data sensitivity assessment is on file.
  • Confirm appropriate access controls are applied to connector data.
  • Verify sensitivity labels are applied to connector content where applicable.
  • Expected Result: All Graph connectors have documented sensitivity assessments and appropriate controls.
  • Evidence: Connector inventory with sensitivity assessment completion status.

Evidence Collection

Evidence Item Source Format Retention
Plugin inventory PowerShell CSV Monthly archive
Agent Registry review Microsoft 365 admin center Screenshot/Export 7 years
Approval workflow records Microsoft 365 admin center Screenshot/Export 7 years
Permission audit PowerShell CSV Monthly archive
Connector sensitivity assessments Assessment documents PDF 7 years

Compliance Mapping

Regulation Requirement How This Control Helps
FFIEC Development Booklet Third-party software governance Supports compliance with software acquisition and deployment governance
OCC Bulletin 2013-29 (Third-Party Relationships) Vendor risk management Helps meet third-party risk management for plugin providers
NYDFS 23 NYCRR 500 Third-party security assessment Supports security assessment of third-party service providers

Next Steps