Control 1.4: Semantic Index Governance — Verification & Testing
Test cases and evidence collection for validating Semantic Index governance controls.
Test Cases
Test 1: Index Scope Configuration Verification
- Objective: Confirm the documented searchable/discoverable scope matches governance-approved configuration
- Steps:
- Review current SharePoint site searchability, RCD state, and any legacy RSS configuration
- Compare against the documented governance decision for site inclusion and exclusion
- Verify that sites marked for Copilot exclusion are using the intended control (RCD, RSS, or searchability off)
- Confirm settings have not been modified since the last governance review
- Expected Result: Searchability and discoverability controls exactly match governance-approved configuration
- Evidence: Admin center screenshots and configuration export
Test 2: Sensitivity Label Enforcement in Index
- Objective: Verify that sensitivity labels and access controls affect Copilot retrieval behavior as configured
- Steps:
- Create a test document with a "Highly Confidential" sensitivity label
- Store the document in a SharePoint site included in the index scope
- As a user without access to Highly Confidential content, query Copilot for the test document content
- Verify Copilot does not surface the protected content to the unauthorized user because access enforcement and policy controls are working
- As an authorized user, verify Copilot can surface the content
- Expected Result: Copilot retrieval respects the sensitivity-label and access-control posture — authorized users see content, unauthorized users do not
- Evidence: Copilot interaction logs for both authorized and unauthorized test users
Test 3: Discoverability Control Validation
- Objective: Confirm that sites marked for exclusion behave according to the selected control
- Steps:
- Identify a SharePoint site that was excluded from Copilot discovery per governance decision
- Create unique test content in that site
- Query Copilot using terms from the unique test content
- Verify the result matches the configured control: RCD/RSS suppresses Copilot discovery, while site searchability set to off removes the site from both Microsoft Search and semantic indexing
- Expected Result: Copilot discovery reflects the configured scope-control behavior for the test site
- Evidence: Copilot query results and site-configuration screenshots
Test 4: Governance Documentation Completeness
- Objective: Verify that all semantic index governance decisions are properly documented
- Steps:
- Review the index governance policy document
- Confirm it includes: content source scope decisions, sensitivity label thresholds, user enablement criteria, review cadence
- Verify governance committee sign-off is current (within the last review period)
- Check that change history is maintained for all scope modifications
- Expected Result: Complete governance documentation with current approvals
- Evidence: Governance policy document with sign-off records
Evidence Collection
| Evidence Item |
Format |
Storage Location |
Retention |
| Site searchability / RCD configuration screenshot |
PNG/PDF |
Compliance evidence repository |
7 years |
| Content source inventory |
CSV |
Compliance evidence repository |
7 years |
| Sensitivity label access test results |
PDF |
Compliance evidence repository |
7 years |
| Governance decision documentation |
PDF |
Governance document repository |
7 years |
| Index scope change history |
CSV |
Compliance evidence repository |
7 years |
Compliance Mapping
| Regulation |
Requirement |
How This Control Supports It |
| FINRA Rule 3110 |
Supervisory systems and WSPs |
Index governance supports supervision of AI-assisted content access |
| SEC Regulation S-P |
Customer information safeguards |
Controlling index scope reduces risk of AI accessing protected NPI |
| 12 CFR part 30, appendix D (OCC Heightened Standards) |
Risk management governance |
Where applicable, governing AI content access supports heightened risk management requirements |
| NIST AI RMF |
GOVERN 1.1 — AI governance policies |
Formal index governance supports compliance with AI governance requirements |
Next Steps