← Back to the site
Canonical specification

AI Strategic Compass Specification

This is the single reference for how the Compass works: the dimensions, the scoring anchors, the review bands, and the domain rules. If another page or ecosystem site differs from it, follow this spec.

Version2.2
EffectiveNovember 21, 2026
Supersedesv2.1

01Dimensions and scoring anchors

Each initiative is scored 1 to 5 on all six dimensions. On every dimension, a higher score means more risk or impact. Use the anchor that best describes the initiative. Each card shows the short label and the field name used in saved scorecards.

1Strategic FitStrategy · strategic
Aligned with institutional priorities and goals?

Whether the initiative advances the institution's mission and current priorities, or is impressive but beside the point. Considers alignment with the strategic plan, the academic mission, and leadership goals.

1
Negligible value; not aligned with strategic goals.
2
Minor improvements; limited strategic relevance.
3
Moderately enhances outcomes and supports objectives.
4
Significantly enhances outcomes; well-aligned with priorities.
5
Transformative; substantial value, directly supports core strategy.
2Ethical, Legal & ComplianceEthics & compliance · ethics
Risks around bias, transparency, data, or compliance?

What could go wrong for the people involved and for the institution. Considers bias and fairness, transparency and explainability, data privacy and security, and legal/regulatory compliance (FERPA, ADA, GDPR, and peers).

1
No significant issues; straightforward to implement.
2
Low risk; minor, easily manageable issues.
3
Moderate risk; needs careful ethical and compliance consideration.
4
High risk; significant challenges needing rigorous management.
5
Critical risk; potential for severe violations affecting integrity.
3Financial ViabilityFinance · financial
Resources required and short/long-term ROI?

Whether the institution can afford it and whether the return justifies the spend. Considers up-front and ongoing cost, staff time and resources required, and short- and long-term ROI and sustainability.

1
Minimal cost; negligible financial impact.
2
Low investment; modest resources, small ROI.
3
Moderate cost balanced by significant ROI; manage budget.
4
High cost and demand, but with strong potential ROI.
5
Substantial investment; evaluate ROI and sustainability carefully.
4Operational Efficiency & InnovationOperations · operational
Improves workflows, capacity, or innovation?

Whether it actually improves how work gets done. Considers efficiency gains, added capacity, fit with existing workflows, and the degree of real innovation rather than novelty for its own sake.

1
Minimal efficiency gains; little innovation potential.
2
Incremental efficiency improvements; some innovation.
3
Significant efficiency gains; new innovative practices.
4
Greatly improves efficiency and drives significant innovation.
5
Transformative; pioneering innovation that redefines processes.
5Efficacy Risk (Evidence Gap)Efficacy risk (evidence gap) · efficacy
How uncertain is it that the AI achieves its intended outcome?

Whether the AI will actually do what it promises. Scored twice: at proposal, on outside evidence plus the quality of the evaluation plan; at the scale decision, on campus pilot results. Scored like the others: 1 = strong evidence it works, 5 = little or none.

1
Strong independent evidence in a comparable context, plus a campus evaluation with clear success and failure criteria before scale.
2
Solid outside evidence in a similar setting (peer campuses or published studies), plus a campus evaluation plan.
3
Little outside evidence, but a defined pilot evaluation with success and failure criteria before any decision to scale. Typical for a new idea.
4
Only vendor claims or anecdotes; the evaluation plan is vague.
5
No evidence and no plan to get any.
P
Proposal score: based on outside evidence (published research, peer campuses, independent validation of the vendor's tool) plus the quality of the pilot evaluation plan. A new idea with no outside evidence but a solid plan scores about 3.
S
Scale score: re-scored at the end of the pilot, based on campus results. Required before any decision to scale.
6Stakeholder ImpactStakeholders · stakeholder
Effect on students, staff, faculty, and public trust?

How the people affected will experience the initiative. Considers impact on students, staff, and faculty, equity for those most affected, and public trust and institutional reputation.

1
No noticeable impact; reputation unaffected.
2
Minor impact; slight, manageable concern.
3
Moderate impact; mixed reactions; engage stakeholders.
4
High impact; significant concern; careful communication needed.
5
Severe impact; potential backlash; strong mitigation required.

Two scoring points for Efficacy Risk. A proposal has no campus evidence yet. Score it on outside evidence plus the quality of the pilot evaluation plan (the proposal score). At the end of the pilot, re-score it on campus results (the scale score). A decision to scale needs the scale score. Keep both scores on the record.

Escalation rule. A 5 on Ethical, Legal & Compliance, Stakeholder Impact, or Efficacy Risk moves the decision up one band, whatever the total, at either scoring point. For consequential student or employee decisions, a scale score of 5 on Efficacy Risk blocks scaling until validation evidence exists.

02Totals and review bands

The total is the sum of the six scores, from 6 to 30. The total sets the starting review path, and the escalation rule can move it up one band. The score opens a discussion; it does not decide the outcome.

Every band follows the same six steps: Screen, Score, Select, Plan, Track, Reflect. Plan sets exit criteria and re-review triggers. An initiative that scales is registered in the AI Registry, then operated and monitored.

Per-initiative measures are KPIs (outputs), OKRs (outcomes), and efficacy measures (quality and safety). Maturity and Readiness are institution-level context from the Maturity Assessment and are not scored per initiative. The GRC grid rates the six dimensions against Governance, Risk, and Compliance (18 cells, Level 1 / 3 / 5).

TotalBand and reviewDecidesTarget timeDocumentation and monitoring
6–12Low Risk / Impact
Self-assessment, then proceed
Unit or department leadDaysSelf-assessment with the unit lead against the acceptable-use checklist; Scored rubric, short description, and a named owner; Monitor at the end of the pilot and at the annual review
13–18Moderate Risk / Impact
One cross-functional review
AI governance lead or committee delegateAbout 2 weeksOne cross-functional review before launch, with written comments; Document data sources, access, and retention; Draft KPIs and OKRs up front; Monitor at mid-pilot and end of pilot
19–24High Risk / Impact
Full team review plus specialist reviews
AI governance councilAbout 4–6 weeksFull team review plus specialist reviews; Efficacy plan with exit criteria; Risk mitigations with named controls; Bias / equity and privacy impact assessment; Stakeholder consultation (including those affected); Ongoing monitoring, reviewed at least annually
25–30Critical Risk / Impact
Extended review, or reconsider
Executive sponsors (e.g., CIO, provost, VP) on council recommendationAs long as needed; time-limited approvalFirst ask: does a lower-risk alternative achieve the goal?; Affected groups consulted; Alternatives analysis and algorithmic impact assessment; Legal, privacy, and compliance review; Phased pilot with explicit scale-or-stop gates; Documented rollback / contingency plan; Continuous monitoring, audit trail, and incident response

03Application domains

Tag every initiative with one primary domain, chosen from these four:

  1. Teaching, Learning & Student Success
  2. Research & Innovation
  3. Operations & Infrastructure
  4. Advancement & Public Service

Optional: Clinical Care & Health Services. Patient care and clinical services under health-system governance. Use it only where a campus operates a health system; otherwise it is out of scope. Medical education stays in Teaching, Learning & Student Success, and clinical research stays in Research & Innovation.

“Student & Community Engagement” is retired. Its enrollment and student-service work moved to Teaching, Learning & Student Success, and its external work moved to Advancement & Public Service. See Application Domains for capabilities and edge cases.

04Migrating older scorecards

Version 1.0 scored five dimensions with totals from 5 to 25. Because Efficacy Risk adds a sixth score, v1.0 totals cannot be compared directly with v2.0 totals or bands.

  1. Score Efficacy Risk for each v1.0 initiative using the anchors above.
  2. From v2.1: treat existing Efficacy Risk scores as proposal scores, and re-check them against the revised anchors. Re-score with pilot results before any decision to scale.
  3. From v2.0: convert each Efficacy score to 6 minus the old score (5→1, 4→2, 3→3, 2→4, 1→5). Totals and bands don't change. The online Compass does this once when it opens a v2.0 scorecard.
  4. If evidence can't be reviewed yet, enter a provisional Efficacy Risk of 3 and record that the evidence has not been assessed. The online Compass applies this default when it opens a five-dimension scorecard.
  5. Re-check the band on the new 6–30 total. Do not convert v1.0 totals by formula.
  6. Re-review consequential uses first, starting with initiatives that affect student or employee decisions.
  7. Keep the v1.0 record and note the version on every scorecard so decision history stays readable.

05Version history

VersionEffectiveChange
2.2November 21, 2026Efficacy Risk is scored at two points: a proposal score (outside evidence plus the quality of the evaluation plan) and a scale score (campus pilot results). Anchors are revised so a new idea with a solid plan scores about 3. The scaling block applies to the scale score.
2.1November 21, 2026Efficacy is scored as Efficacy Risk (Evidence Gap), in the same direction as the other five dimensions. The total is a plain sum. Escalation is on a 5 for Efficacy Risk, not a 1.
2.0November 21, 2026Adds Efficacy & Evidence of Effectiveness as a sixth dimension, rated as evidence strength (5 = strong) and counted as 6 minus the score in the total. Adds one escalation rule covering ethics, stakeholder impact, and efficacy, and sets deciders, target times, and documentation for each band. Totals change to 6–30.
1.0Before November 2026Five dimensions, totals from 5 to 25.