For IT, data & security

Build it, secure it, run it

The leadership page covers what to govern and who decides. This is the operational layer: a sequenced path, the AI security threats and controls, an incident runbook, the identity-and-data plumbing, a reference architecture, build-vs-buy with real cost, procurement teeth, and what to monitor.

Starting points to adapt to local security policy, not a substitute for it. Threat names map to the OWASP Top 10 for LLM Applications; control and contract language should be reviewed against your own standards, security team, and counsel.

The IT path, in order

The journey is implied across several tools, here it is sequenced, from surfacing a system to running it safely.

Rapid risk triage

Most decisions are really one question: is this a fast approval or a full review? Triage on three axes: the data it touches, how much it can act on its own, and who's exposed.

Light path: days, not weeks
  • Public or low-sensitivity data only
  • Human reviews every output; the tool can't act on its own
  • Internal audience, easily reversible
  • Reputable vendor with terms already vetted
Full review: slow down
  • Touches FERPA, PII, health, or research data
  • Acts autonomously or feeds a consequential decision
  • Student- or public-facing at scale
  • New vendor, or our data may train their model

The AI security layer

The threats your CISO will ask about on page one, framed for campus, each mapped to the OWASP LLM Top 10 with a concrete control.

Prompt injection

LLM01

Hidden instructions in user input or fetched content hijack the model's behavior.

On campusA student pastes text that makes a grading assistant ignore its rubric, or a malicious web page redirects a research agent.

ControlTreat all model input as untrusted, constrain tool/permission scope, and keep a human on any consequential action.

Sensitive information disclosure

LLM02

The model surfaces data it shouldn't, to the wrong user, or to a vendor that retains it.

On campusStaff paste FERPA-protected records into a personal AI account; a chatbot returns one student's data to another.

ControlDLP at the boundary, no sensitive data into unvetted tools, and contractual no-training / no-retention terms.

Improper output handling

LLM05

Model output is trusted and passed downstream, into SQL, shell, HTML, or emails, without validation.

On campusAn AI feature's output is rendered straight into a page or used to build a query, opening injection or XSS.

ControlValidate and encode every output before it touches another system; never execute model output unguarded.

Excessive agency

LLM06

The system can take more actions, with more autonomy, than the risk justifies.

On campusAn agent wired to the SIS can modify records, not just read them; an integration has write scope it never needs.

ControlLeast privilege on every integration, read-only by default, and explicit approval gates for state changes.

Supply-chain & embedded risk

LLM03

Risk inherited from vendors, plugins, and AI features switched on inside existing systems.

On campusAn LMS or productivity-suite update activates AI that now processes student work under new data terms.

ControlInventory embedded AI, track subprocessors, and re-review vendor terms when features change.

Unbounded consumption & cost

LLM10

Unmetered usage drives runaway spend or denial-of-wallet, and enables model abuse.

On campusA looping agent or exposed API key burns thousands in tokens over a weekend before anyone notices.

ControlRate limits, budget caps with alerts, key rotation, and per-app quotas at the gateway.

Incident response: the first hour

When an AI feature leaks FERPA data on a Tuesday, the first hour decides the blast radius. Pre-agree this runbook so no one improvises.

0–15 min

Detect & triage

Confirm it's real, assign an incident lead, and classify severity by data class and exposure. Open the incident channel.

15–30 min

Contain

Disable the feature or integration, revoke keys/tokens, and cut the data path. Preserve prompt/response and access logs before anything is wiped.

30–45 min

Assess scope

Determine what data was exposed, whose, and to whom. Map it to FERPA / breach-notification triggers and data-residency obligations.

45–60 min

Notify

Engage legal, privacy, and the CISO; brief comms. Start the clock on contractual and regulatory notification SLAs.

Day 1–3

Remediate & recover

Fix the root cause, rotate credentials, restore service under tighter scope, and document the timeline.

Within 2 weeks

Post-incident review

Blameless review; feed the lesson into policy, the registry entry, and the controls so it can't recur the same way.

This runbook isn't new ground, it maps to the incident-response lifecycle institutions already follow. Run AI incidents through your existing CSIRT and plan, this just names the AI-specific moves at each phase.

NIST SP 800-61Computer Security Incident Handling Guide

Detect & triage, contain, assess, notify, remediate, and post-incident review follow its preparation → detection/analysis → containment/eradication/recovery → post-event lifecycle.

SANS PICERL6-step incident handling

Preparation, Identification, Containment, Eradication, Recovery, Lessons-learned, the phases here in the same order.

ISO/IEC 27035Information security incident management

Plan-and-prepare, detect-and-report, assess-and-decide, respond, learn, the same managed cycle, useful if you're ISO-aligned.

When AI causes harm: communicating through it

The technical runbook stops the bleeding; communication decides whether people keep trusting you. When an AI system causes harm, a biased decision, a privacy exposure, a wrong answer that reached someone, the response is as much reputational as technical. Agree these moves before you need them.

Say it early, even when incompleteA short, honest “we know X, we're doing Y, more by Z” beats silence. Silence gets filled by speculation you don't control.
Own it; don't deflect to “the algorithm”“The AI did it” reads as evasion. A named person or office takes responsibility for the system and its outcome.
Lead with those affectedSpeak to the people harmed first, and directly, before the general public. Name what it means for them and how to get recourse.
One coordinated voiceRoute through comms with legal and privacy aligned. Mixed messages from different offices compound the damage.
Close the loop publiclyWhen it's resolved, say what changed so it can't recur. Accountability is what rebuilds trust, not the apology alone.
Who to tell, and in what order
  1. 1
    People directly affectedIndividual, plain-language notice: what happened, what it means for them, what you're doing, and how to appeal or get help.
  2. 2
    Internal communityFaculty, staff, students, and governance bodies, ahead of external channels, so they hear it from you first.
  3. 3
    Leadership & boardThe facts, the exposure, and the response, early enough that they're not surprised by a public account.
  4. 4
    Public & pressOnly after the above, coordinated with legal, factual and non-speculative, no minimizing, no over-promising.

Pre-draft holding statements and an escalation tree the same way you pre-agree the technical runbook. The worst time to design your communications is mid-incident.

Identity, access & the data pipeline

"Govern by data" is easy to say, the hard part is the plumbing. Six controls that make it real.

A reference architecture

AI doesn't land on a clean field. It has to live with the SIS, LMS, ERP, IdP, and data warehouse. A layered reference keeps governance at the seams.

Identity & accessSSO, MFA, RBAC, who is allowed to use it, and as whom.
AI gateway / policy layerOne control point: routing, guardrails, DLP, logging, rate & cost limits.
ModelsVendor APIs, hosted, or on-prem, swappable behind the gateway.
Data & retrievalRAG sources with access scoping and classification, not a flat index.
Systems of recordSIS / LMS / ERP / warehouse, read-only by default, least privilege.
ObservabilityLogs, metrics, alerts, and an audit trail across every layer above.
Before you integrate, ask
  • What data crosses the boundary, and at what classification?
  • How does it authenticate, and what can it do if a token leaks?
  • What's the failure mode when the model or vendor is down?
  • Which subprocessors touch the data behind the vendor?
  • How do we roll it back, and what's the audit trail when we do?

Procuring AI services, end to end

The pieces above are also a process. Read top to bottom, it's how an AI service goes from need to managed vendor, with each step pointing to the detail that governs it.

  1. 1

    Define the need & classify the data

    Name the problem and the highest data class it would touch, public through FERPA/PII. The data class drives everything that follows.

    See: Rapid risk triage
  2. 2

    Scan the market: build, buy, or embedded

    Decide whether this is an embedded vendor feature, a licensed platform, or built on a model API, and price the real total cost, not the sticker.

    See: Build, buy, or embedded
  3. 3

    Right-size the review

    Triage to a light path or a full review on three axes: the data it touches, how much it can act on its own, and who's exposed.

    See: Rapid risk triage
  4. 4

    Run the security & risk review

    Vet the tool against the AI security layer and score it before it ships. Right-size scrutiny to risk.

    Tool Evaluation Matrix
  5. 5

    Negotiate the contract teeth

    The cheapest moment to govern AI is before you sign. Require the DPA clauses, no training, deletion, subprocessor notice, breach SLA, residency, attestations, accessibility, audit.

    See: Procurement & contract teeth
  6. 6

    Onboard the plumbing

    Put it behind SSO/MFA, vault and scope its keys, set DLP at the boundary, and define retention and deletion before anyone uses it.

    See: Identity, access & the data pipeline
  7. 7

    Deploy, monitor & manage the vendor

    Turn on logging and alerts, operate on a cadence, and re-review vendor terms when features or subprocessors change.

    Run it
  8. 8

    Plan the exit before you need it

    Decide up front how this ends: how you get data out, prove deletion, and stand down the tool if the vendor fails, is acquired, or you move on. Exit is a procurement decision, not an afterthought.

    See: Decommissioning & vendor exit

Build, buy, or embedded, with real cost

Three paths, when each fits, and the catch. The cabinet sees budget tiers; your team sees total cost of ownership.

Embedded vendor feature

Best whenThe capability is a small part of a tool you already run and the data terms are acceptable.

Fastest path; no new infrastructure.

You inherit their model, data handling, and change cadence, and may not even control when it turns on.

Licensed AI platform

Best whenYou need breadth across the institution and want a vendor to carry the operational load.

Managed, supported, quicker to scale.

Lock-in and per-seat cost; the governance and data accountability are still yours.

Build on a model API

Best whenThe use case is differentiated, sensitive, or needs tight control of data and behavior.

Full control of data, prompts, and integration.

You own everything, security, monitoring, and the FTE to run it, for the life of the system.

The total cost, not the sticker price
Inference / token spend at real volumeData egress and vector-store costsMonitoring & observability toolingThe FTE to operate, tune, and patch itSecurity review and pen-testingAccessibility remediation (VPAT gaps)

Procurement & contract teeth

The cheapest moment to govern AI is before you sign. The clauses to require in the contract or data-processing addendum, and why each one earns its place.

No training on our data

Without an explicit opt-out, your institutional and student data can become training material you can't claw back.

Deletion & return on termination

You need a guaranteed, provable path to get data out and have it destroyed when the contract ends.

Subprocessor disclosure & notice

The vendor's vendors touch your data. You can't govern what you can't see, or be surprised by a new one.

Breach notification SLA

A defined notification window is what lets you meet your own regulatory and contractual clocks.

Data residency & location

Where data is processed and stored drives FERPA, export, and sometimes state obligations.

Security attestations (SOC 2 / ISO 27001)

Independent evidence of controls beats a vendor's marketing claims, and satisfies audit.

Accessibility (VPAT / WCAG / Section 508)

A current, honest VPAT is a procurement gate, deploying an inaccessible tool is legal and equity exposure.

Right to audit & model documentation

You may have to explain a consequential AI decision; you need access to the documentation to do it.

Decommissioning & vendor exit

Every AI service ends, retired, replaced, or the vendor is acquired or shuts down. An exit you didn't plan is where data gets stranded and obligations get missed. Plan it while you still have leverage: before you sign.

When it's triggered
  • The tool is retired or replaced by a better fit.
  • The vendor is acquired, changes terms, or discontinues the product.
  • A pilot ends and isn't renewed, don't let it linger unmanaged.
  • The vendor fails or a business-continuity event forces a fast cutover.
Data export & portabilityGet institutional and student data out in a usable, documented format, on a timeline you control, not the vendor's.
Provable deletionRequire written confirmation that your data, including in backups and any derived/embedding stores, is destroyed to contract terms.
Records & audit continuityPreserve the logs and AI decision records you may still owe under FERPA or public-records obligations, even after the tool is gone.
Access & credential teardownRevoke keys and tokens, remove SSO/SCIM connections, and close integrations into the SIS/LMS/ERP so nothing keeps calling a dead service.
Registry & documentation updateMark the entry retired in the AI inventory with the date, reason, and where its data went, so the record stays honest.
User communication & migrationTell affected users what's changing, where the capability goes now, and what happens to anything they created in the tool.

The clauses that make a clean exit possible, deletion and return, data portability, and audit rights, are the same DPA teeth you negotiate at procurement. Exit planning and contracting are one decision, made at the start.

Monitoring & observability

Set this before go-live, not after the first surprise. What to log, what to alert on, and an audit trail that survives a records request.

What to log
  • Who asked what, and what came back (metadata first)
  • Consequential decisions and any human overrides
  • Access, key use, and integration calls
  • Errors, refusals, and guardrail trips
What to alert on
  • Anomalous request volume or cost spikes
  • Jailbreak / injection patterns
  • Rising error or override rates (a drift signal)
  • Access from unexpected identities or locations

Build the audit trail to survive a public-records or FERPA request, complete, tamper-evident, and retained to policy, without itself becoming a sensitive-data store.