Decision engine

AI Strategic Compass

A conversation-driven framework to screen, score, and select AI initiatives, then plan how success will be measured. Scores are a starting point for dialogue, not a verdict.

“One framework. Any mission. Every institution.”, concept by Joe Sabado
See the full Compass at campusaicompass.com Read the Compass specification (v2.2)
What it is

The decision engine of the framework, a structured, conversation-driven way to weigh candidate AI initiatives on the same six dimensions, including whether there's evidence it actually works, instead of approving them one at a time on instinct.

What it's for

Turning a scattered list of AI ideas into a prioritized, governed portfolio, deciding what to pursue, at what level of scrutiny, and how you'll know it worked.

How to read it

Scores start a conversation; they don't end one. A high score isn't automatic approval and a low score isn't a veto, both are prompts to discuss why.

The process, six steps from idea to reflection
1Screen
2Score
3Select
4Plan
5Track
6Reflect

Plan sets exit criteria and re-review triggers for every band. An initiative that scales is registered in the AI Registry, then operated and monitored.

The six dimensions you score on

Every initiative is rated 1–5 on each of these. Scoring all six (not a single gut-check) surfaces the trade-offs a good idea can hide: an exciting tool can be strong on innovation and weak on compliance, or impressive in a demo with no evidence it actually works.

1Strategic Fit

Whether the initiative advances the institution's mission and current priorities, or is impressive but beside the point. Considers alignment with the strategic plan, the academic mission, and leadership goals.

Aligned with institutional priorities and goals?
2Ethical, Legal & Compliance

What could go wrong for the people involved and for the institution. Considers bias and fairness, transparency and explainability, data privacy and security, and legal/regulatory compliance (FERPA, ADA, GDPR, and peers).

Risks around bias, transparency, data, or compliance?
3Financial Viability

Whether the institution can afford it and whether the return justifies the spend. Considers up-front and ongoing cost, staff time and resources required, and short- and long-term ROI and sustainability.

Resources required and short/long-term ROI?
4Operational Efficiency & Innovation

Whether it actually improves how work gets done. Considers efficiency gains, added capacity, fit with existing workflows, and the degree of real innovation rather than novelty for its own sake.

Improves workflows, capacity, or innovation?
5Efficacy Risk (Evidence Gap)

Whether the AI will actually do what it promises. Scored twice: at proposal, on outside evidence plus the quality of the evaluation plan; at the scale decision, on campus pilot results. Scored like the others: 1 = strong evidence it works, 5 = little or none.

How uncertain is it that the AI achieves its intended outcome?
6Stakeholder Impact

How the people affected will experience the initiative. Considers impact on students, staff, and faculty, equity for those most affected, and public trust and institutional reputation.

Effect on students, staff, faculty, and public trust?
Efficacy Risk asks “does this work?”, not “is it fast?” or “is it the right priority?”. A 5 cannot be offset by high scores elsewhere for consequential student or employee decisions. A proposal has no campus evidence yet, so score it on outside evidence plus the quality of the pilot evaluation plan, then re-score with pilot results before any decision to scale. Escalation rule: a 5 on Ethical, Legal & Compliance, Stakeholder Impact, or Efficacy Risk moves the decision up one band, whatever the total, and a 5 on the Efficacy Risk scale score blocks scaling until validation evidence exists.

How success is measured

Scoring decides whether to pursue an initiative. Measurement decides whether it worked. Three measures are set for each initiative: KPIs, OKRs, and efficacy measures. Maturity and Readiness are institution-level context from the Maturity Assessment and are not scored per initiative.

OutputsKPIs
Did we build it?

Tangible deliverables, tools deployed, processes automated, people trained. Counts, completion, and adoption.

e.g. 4 advising workflows live; 80% of advisors onboarded
OutcomesOKRs
Did it matter?

Mission-level shifts the outputs were meant to produce, retention, equity, satisfaction, research capacity.

e.g. +5pt first-gen retention; 30% faster aid processing
EfficacyQuality & safety
Does it work, and work well?

Whether the AI itself performs as intended, accuracy, reliability, fairness, error and override rates, and user trust. An output can ship while its efficacy is poor.

e.g. <2% false-flag rate; bias audit passed; 90% user trust
MaturityCapability
Are we more capable?

How institutionalized the capability has become, on the five-level scale, from ad hoc experimentation to continuous optimization.

Initial → Emerging → Defined → Managed → Optimizing
ReadinessPreparedness
Are we ready for what's next?

How prepared the institution is to activate and scale, leadership, culture, infrastructure, data, and people.

Not Ready → Low → Moderate → High → Activation-Ready
Per initiative, set in Plan, watched in Track Per institution, from the Maturity Assessment
Risk / impact spectrumTotal score 6 → 30
Low
Moderate
High
Critical
612182430

Proportionate review paths

The score doesn't just rank initiatives, it sets how much scrutiny each one needs. A faculty AI writing helper shouldn't clear the same bar as a system shaping financial-aid decisions. The path, the approver, and the requirements scale with the band.

The low band is the normal lane for unit-level work. Check the three escalation questions to confirm it belongs there.

Low6–12
Self-assessment, then proceed
Unit or department leadDays
  • Self-assessment with the unit lead against the acceptable-use checklist
  • Scored rubric, short description, and a named owner
  • Monitor at the end of the pilot and at the annual review
Moderate13–18
One cross-functional review
AI governance lead or committee delegateAbout 2 weeks
  • One cross-functional review before launch, with written comments
  • Document data sources, access, and retention
  • Draft KPIs and OKRs up front
  • Monitor at mid-pilot and end of pilot
High19–24
Full team review plus specialist reviews
AI governance councilAbout 4–6 weeks
  • Full team review plus specialist reviews
  • Efficacy plan with exit criteria
  • Risk mitigations with named controls
  • Bias / equity and privacy impact assessment
  • Stakeholder consultation (including those affected)
  • Ongoing monitoring, reviewed at least annually
Critical25–30
Extended review, or reconsider
Executive sponsors (e.g., CIO, provost, VP) on council recommendationAs long as needed; time-limited approval
  • First ask: does a lower-risk alternative achieve the goal?
  • Affected groups consulted
  • Alternatives analysis and algorithmic impact assessment
  • Legal, privacy, and compliance review
  • Phased pilot with explicit scale-or-stop gates
  • Documented rollback / contingency plan
  • Continuous monitoring, audit trail, and incident response
Who's at the table

The system owner and the unit lead, plus IT security, privacy, and accessibility as the band requires. Include people from the groups affected. When Efficacy is in question, add institutional research or assessment staff, faculty with methods expertise, and the vendor's validation evidence.

Equity & accessibility check

Before any decision, ask who is affected, whether it works equally well for each group, whether it meets accessibility requirements, and whether people have a non-AI alternative.

More on who decides at campusaicompass.com
Select or add an initiative to score it.
Portfolio
No initiatives yet, add one to begin.

GRC Readiness Lens

Governance · Risk · Compliance maturity across the six dimensions

Overlay each rubric dimension with Governance, Risk, and Compliance maturity. Rate your institution against the framework's Level 1 / 3 / 5 indicators to see where safeguards are strong and where the gaps are, an institutional self-assessment that complements the per-initiative scores above.

High score, low maturityPause, or build capacity before you proceed.
High score, high maturityProceed through the full review path.
Low score, low maturityProceed on the light path and build the basics as you go.
Low score, high maturityFast-track with standard monitoring.
, /5
Not yet assessed0/18 cells rated
Priority gaps
Rate the cells below to surface your weakest governance, risk, and compliance areas.
Strategic Fit0/3 · ,
GovernanceNot rated
L1No governance over AI initiatives → L5 All AI projects reviewed by council for strategic alignment
Risk ManagementNot rated
L1Strategic risks not considered → L5 Pre-launch assessment of equity, reputational, and academic risks
ComplianceNot rated
L1AI bypasses policy and planning controls → L5 Fully integrated into strategic, IT, and procurement workflows
Ethical, Legal & Compliance0/3 · ,
GovernanceNot rated
L1No ethical oversight → L5 Ethics board reviews major AI use cases
Risk ManagementNot rated
L1No tools for risk auditing → L5 Regular fairness audits using standard tools
ComplianceNot rated
L1No policy adherence checks → L5 FERPA, ADA, GDPR, and DEI integrated across the lifecycle
Financial Viability0/3 · ,
GovernanceNot rated
L1AI initiatives lack fiscal oversight → L5 Governance includes ROI, cost recovery, and sustainability planning
Risk ManagementNot rated
L1No financial or legal risk review → L5 Risk-informed contracts and vendor / IP evaluation
ComplianceNot rated
L1No procurement compliance → L5 Full procurement vetting, audit, and controls enforced
Operational Efficiency & Innovation0/3 · ,
GovernanceNot rated
L1AI deployed outside operational governance → L5 Fully integrated into ITSM, change, and performance workflows
Risk ManagementNot rated
L1Automation risks untracked → L5 Scenario-based planning, rollback, and contingency measures
ComplianceNot rated
L1No documentation or traceability → L5 Full logging, model transparency, and lifecycle retention policies
Efficacy Risk (Evidence Gap)0/3 · ,
GovernanceNot rated
L1No evaluation design; effectiveness is never formally reviewed → L5 A required efficacy review precedes any scale decision
Risk ManagementNot rated
L1Unknown failure modes; no performance thresholds → L5 Predefined fail thresholds with rollback
ComplianceNot rated
L1No documentation of model performance → L5 Auditable validation evidence tied to the Registry card
Stakeholder Impact0/3 · ,
GovernanceNot rated
L1No stakeholder input in governance → L5 Stakeholders co-lead governance and review
Risk ManagementNot rated
L1No assessment of user / community risks → L5 Community-informed risk modeling and participatory design
ComplianceNot rated
L1No safeguards for consent, access, or appeal → L5 Co-designed, inclusive, transparent systems with full user protections