checklist

AI tool audit evidence packet template for small teams

A reusable evidence packet template for AI tool reviews, covering owners, access, connectors, data handling, retention, admin controls, incidents, exceptions, decisions, and safe storage rules.

Audience: Founders, operators, IT owners, workspace admins, finance owners, security leads, and team managers who need evidence for AI tool reviews Risk: Medium Evidence: NIST AI RMF, NIST Cybersecurity Framework, NIST Privacy Framework, and Cybergiz AI tool review templates

Use this template when an AI tool review needs evidence, not just opinions.

Small teams do not need a heavy audit program. They do need a short, repeatable evidence packet that proves who owns the tool, who can access it, what data it touches, which connectors are enabled, which settings were checked, what incidents happened, and what decision was made. If you are doing a monthly review, start with the monthly AI tool access review checklist and use this page to package the evidence.

Bottom line

An AI tool evidence packet should answer seven questions:

  1. Why is this tool approved, restricted, piloted, excepted, or removed?
  2. Who owns business value, admin settings, data scope, and source-system access?
  3. Who can use or administer the tool today?
  4. Which data, connectors, extensions, bots, APIs, and automations are in scope?
  5. Which settings, retention rules, training defaults, and sharing controls were verified?
  6. Which incidents, exceptions, vendor changes, or renewal decisions affect the tool?
  7. What decision was made, and when is the next review?

Do not put raw customer records, source code, meeting transcripts, passwords, API keys, private keys, regulated records, or dashboard URLs with tokens into the packet.

When to use this template

SituationUse this packet?Why
Monthly AI tool access reviewYesKeeps review evidence consistent across tools.
Pilot exitYesSupports approve, restrict, extend, remove, or escalate decisions.
Exception reviewYesShows why temporary access exists and when it closes.
Renewal decisionYesConnects business value, access, vendor changes, and cost.
Vendor change reviewYesRecords what changed and what setting evidence was checked.
Incident responseYesLinks containment, root cause, and corrective actions.
One-time public-content experimentUsually noClose the experiment unless the tool remains in use.

If the tool’s scope changed, rerun the AI Tool Risk Checker before finalizing the packet.

Evidence packet map

Packet sectionEvidence to includeDo not include
Tool identityTool name, vendor, plan, status, owner, review date.Account IDs with tokens or private billing details.
Business useApproved workflow, actual workflow, value summary.Customer examples with private data.
AccessUsers, admins, groups, guests, service accounts.Passwords, private emails beyond what your internal access export already allows.
ConnectorsOAuth apps, browser extensions, meeting bots, API keys, webhooks.API keys, bearer tokens, private keys, webhook secrets.
Data handlingData classes, prohibited data, retention rule, export rule.Raw sensitive records, source code, transcripts, or regulated files.
SettingsTraining, retention, sharing, export, audit, deletion, SSO, logs.Screenshots that expose secrets or customer records.
Incidents and exceptionsIncident IDs, exception IDs, status, owner, expiry.Raw incident payloads with sensitive data.
DecisionApprove, restrict, renew, pilot, escalate, remove.Informal chat fragments as the only evidence.

The packet should be short enough to review in a meeting.

Minimum packet

For low-risk tools, collect at least this:

FieldValue
Tool name
Vendor
StatusApproved / restricted / pilot / exception / blocked / removed
Review date
Reviewer
Business owner
Admin owner
Approved use case
Actual use case
Approved users or groups
Connected systems
Allowed data classes
Prohibited data classes
Settings checked
Incidents or exceptions
Decision
Next review date
Evidence links

For medium or high-risk tools, use the deeper sections below.

Owner and scope evidence

EvidenceQuestion it answers
Original request or intake formWhy was this tool requested?
Pilot exit decisionWhy did the tool move out of pilot?
Owner registerWho owns value, admin settings, data, source systems, and backup coverage?
Approved use caseWhat workflow is allowed?
Actual use case notesDid users stay within the approved workflow?
Risk checker resultDid the current scope match the current risk decision?
Review calendar entryWhen is the next review or expiry date?

Use the AI tool owner and review calendar template when ownership is unclear.

Access and connector evidence

EvidenceWhat to capture
User exportActive users, inactive users, guests, shared accounts, and personal accounts used for work.
Admin exportAdmins, billing owners, workspace owners, and source-system admins.
Group mappingGroups or teams with access and why they need it.
OAuth app listConnected apps, scopes, source systems, and owner.
Browser extension recordExtension ID, version, host permissions, sensitive domains, OAuth scopes, and install policy.
Meeting bot recordCalendar app, recording settings, transcript settings, sharing, CRM sync, and retention.
Developer AI recordRepos, code indexes, terminal access, PR bot access, CI/CD scope, and secret boundaries.
API and automation recordAPI keys by owner and purpose, webhooks, scheduled jobs, agents, and rollback paths.

Never paste live keys, tokens, secrets, or private certificates into the evidence packet.

Data and retention evidence

EvidenceWhat to verify
Data classification notePublic, internal, customer, source code, transcript, regulated, financial, or secret data classes.
Customer data approvalWhether customer data is allowed, redacted, approval-required, or prohibited.
Retention setting notePrompt, file, transcript, memory, project, log, and export retention.
Training setting noteWhether workspace or account defaults match the approved data rule.
Sharing setting notePublic links, external guests, exports, downstream sync, and forwarding.
Deletion pathWhether retained files, prompts, transcripts, accounts, and connectors can be removed.
Export recordWhat was exported, why, where it is stored, and who owns it.

For customer workflows, link to the customer data approval form instead of copying customer records.

Admin control evidence

ControlEvidence to keep
SSO or identity pathSetting note or admin export showing approved authentication.
User lifecycleOffboarding steps for users, guests, admins, bots, and service accounts.
Audit logsWhat activity can be reviewed and how long logs are available.
Sharing controlsWorkspace defaults for guests, public links, exports, and collaboration.
Connector controlsHow connectors are approved, revoked, and reviewed.
Retention controlsScreenshots or notes with sensitive values redacted.
Training controlsWorkspace setting evidence with date and reviewer.
Incident controlsWhere accidental paste, connector exposure, or bad output is reported.
Billing controlsRenewal date, owner, and cancellation path without private payout or tax details.

If required controls are missing, record the decision as restricted, exception, escalation, or removal.

Incident and exception evidence

Record typeInclude
IncidentIncident ID, date, owner, affected workflow, affected data class, status, and corrective action.
Near missWhat almost happened, how it was caught, and what guardrail changed.
Bad outputOutput type, human review result, business impact, and training need.
Accidental pasteData class, containment action, owner, and vendor/source-system follow-up.
Connector exposureConnector, source system, exposed scope, containment, and decision.
ExceptionException ID, owner, approved scope, guardrails, expiry date, and closure status.
Vendor changeChange source, affected settings, decision, and next review date.

Link to the incident or exception record. Do not copy sensitive payloads into the packet.

Review decision record

Copy this into the packet.

AI tool evidence packet decision
Tool:
Vendor:
Review type:
Review date:
Reviewer:
Business owner:
Admin owner:
Data/source-system owner:
Current status:
Approved use case:
Actual use case:
Users/groups reviewed:
Connectors reviewed:
Data classes reviewed:
Settings reviewed:
Incidents/exceptions reviewed:
Vendor changes reviewed:
Decision:
Restrictions:
Cleanup actions:
Next review date:
Evidence links:
Notes:

The decision should be one of: approve, restrict, pilot, extend once, renew, monitor, escalate, remove, or block.

Storage and redaction rules

RuleWhy
Store packets outside the AI tool being reviewed.Evidence must survive offboarding and deletion.
Use links to source records instead of copying sensitive data.Keeps the packet small and safer.
Redact customer names, secrets, private records, transcripts, and source code.Reviewers need scope, not raw content.
Record dates and reviewers.Evidence without timing and ownership decays quickly.
Keep one packet per review event.Monthly review, renewal, incident, and vendor change may have different decisions.
Limit packet access.Evidence can still reveal sensitive business workflows.
Delete packets by policy.Evidence retention should not become unmanaged data retention.

If you cannot store the packet safely, store only the decision record and pointers to controlled systems.

30-minute assembly checklist

StepDone
Confirm review type, tool status, owner, and next review date.
Link the original request, intake form, pilot exit, or renewal record.
Export users, admins, groups, guests, and service accounts.
Review connectors, browser extensions, meeting bots, API keys, and automations.
Record data classes, prohibited data, retention, training, sharing, and deletion settings.
Link incidents, exceptions, vendor changes, and renewal decisions.
Write the decision record.
Redact sensitive details and remove secrets.
Store the packet in the approved internal location.
Update the review calendar or tool register.

If this takes longer than 30 minutes for every tool, split tools by risk and start with high-risk workflows.

Metrics to track

MetricWhy it matters
Packets completedShows whether reviews produce evidence.
Packets missing ownersShows accountability gaps.
Packets missing access exportsShows weak access review.
Packets missing connector evidenceShows hidden integration risk.
Packets with incidents or exceptionsShows where follow-up is needed.
Packets leading to restrictionsShows risk reduction from review.
Packets leading to removalsShows the team can clean up tools.
Average assembly timeShows whether the process is sustainable.
Evidence storage exceptionsShows where evidence handling itself needs improvement.

If evidence packets are always incomplete, reduce the tool list or narrow the approval scope.

Evidence checked

FAQ

Is this an audit?

Not in the formal assurance sense. This is an internal evidence packet for small-team AI tool reviews. It helps owners make and defend decisions, but it is not legal, compliance, certification, or security assurance advice.

Where should we store the packet?

Store it in an internal system outside the AI tool being reviewed, such as a secure document workspace, ticket, or governance folder with access limited to the people who need it.

Should screenshots be included?

Screenshots can help for settings evidence, but redact customer records, tokens, private messages, source code, transcripts, and sensitive account details. A short setting note is often safer than a screenshot.

How much evidence is enough?

Enough to prove owner, use case, access, connector scope, data scope, settings, incidents, exceptions, and decision. Low-risk tools can use the minimum packet. High-risk tools need the deeper sections.

Who owns the packet?

The review owner owns the packet. The business owner owns the decision, the admin owner owns settings and access evidence, and the data or source-system owner owns data scope evidence.

How does this connect to the main checklist?

The Small Team AI Security Checklist defines the baseline controls. This evidence packet shows whether those controls are actually being reviewed for each tool.