Advanta is currently undergoing final system calibration ahead of launch. Selected infrastructure and experiences may still be in active refinement.

advanta

Home → Module Library →

Module ADM-01 sigil: Talent pillar, Strategy layer, maturity bands 1 to 3.Deterministic sigil for Module ADM-01. The Pillar geometry encodes Talent (Pillar 3); the top-right marker S encodes the Strategy layer; the baseline meter encodes maturity bands 1 to 3.SADM-01

P3

L-M

ADM-01

Adoption Metrics Dashboard for Legal AI OS

Continuous measurement framework tracking AI training completion, adoption progress, AI BoM coverage, Class 6 governance incidents, and ROAI attribution across Protect, Comply, Grow, and Transform quadrants, producing DPS-grade evidence for the legal AI programme.

telemetry-sourceFoundationalContinuousAdoption lensDefensibility lens

Audience

GC / CLOLegal Operations

·

Initial setup 4–8 weeks; continuous monitoring with weekly and monthly reporting cycles

Executive Summary

The Adoption Metrics Dashboard is the central telemetry and evidence layer for Legal AI OS. It continuously measures training completion, active usage, adoption maturity, business impact and governance compliance, with explicit coverage of Class 6 Shadow AI and AI BoM health. The module defines a standardised metric model, role-specific views, alert thresholds and DPS-grade evidence exports, enabling legal functions to prove ROAI across Protect, Comply, Grow and Transform quadrants. The dashboard integrates LMS, AI platforms, AI BoM, incident management, HR and finance data into a single, governed view. It enforces Metric 0 pre-check gates (GOV-02, AI BoM, STR-07), supports real-time Class 6 alerting, and produces structured reports for executives, operations, champions and individual users. Outputs are designed for 7-year Defensibility and 5-year Adoption retention, ensuring that AI decisions, risk handling and value realisation can withstand regulator, client and board scrutiny.

1. Purpose and Scope

This module defines the Adoption Metrics Dashboard for Legal AI OS. It standardises how legal departments track training, usage, adoption maturity, business impact and governance compliance, with explicit coverage of Class 6 Shadow AI and AI BoM health.

It is the primary telemetry source for ROAI attribution across Protect, Comply, Grow and Transform quadrants and the main DPS Defensibility and Adoption evidence engine.

---

2. Metric 0 Pre-Check (Launch Gates)

Before enabling the dashboard in production, complete three gates:

  • Gate M0.1 — GOV-02 verified
    • AI Use Policy current and approved.
    • Approved tool list available for AI BoM coverage calculation.
  • Gate M0.2 — AI BoM verified
    • AI Bill of Materials active and owned.
    • Baseline AI BoM coverage rate captured.
  • Gate M0.3 — STR-07 verified
    • AI Task Force Charter active.
    • Class 6 escalation pathway confirmed and mapped.
    • Dashboard Class 6 alerts routed to STR-07.

Record gate completion dates and owners as DPS evidence.

---

3. Executive Summary Dashboard Design

Implement an executive view with:

  • Programme overview (eligible, trained, active users; champions; tools; incidents).
  • Overall Adoption Health Score (0–100) combining training, usage, proficiency, satisfaction, AI BoM coverage and Class 6 performance.
  • Key KPIs with targets and trend arrows (training completion, active adoption, proficiency, productivity, satisfaction, AI BoM coverage, Class 6 incident rate).
  • Executive alerts grouped as Critical (incl. Class 6), Class 6 governance alerts, Moderate issues and Positive trends.
  • Strategic milestone progress across Foundation, Acceleration and Optimisation phases, plus AI BoM and Class 6 protocol status.
  • ROAI 4-quadrant summary table with Protect, Comply, Grow and Transform metrics.

---

4. Training Effectiveness Metrics

Configure training views to show:

  • Overall training statistics (programmes offered, duration, completion, time-to-complete, dropout).
  • Programme-specific completion (fundamentals, tool-specific, advanced, ethics/governance, Risk Taxonomy 2026, Class 6, Agentic Tier, AI BoM verification).
  • Role-based completion (leaders, associates by level, legal ops, paralegals, champions).

Add Risk Taxonomy 2026 compliance tables with per-class completion for champions and all staff, plus full-module completion. Track knowledge retention at immediate, 30, 90 and 180 days, Class 6 simulation performance and training satisfaction.

---

5. Usage Analytics and Engagement

Instrument AI usage across tools and users:

  • Overall usage (DAU, WAU, MAU, active user rate, average weekly hours).
  • Usage by tool type (document review, research, contract analysis, drafting, Agentic Tier, tools pending AI BoM registration).
  • Agentic Tier metrics (Level 4 tools, gate documentation, gate completion rate, human oversight compliance, kill-switch activations, escalations to STR-07).

Implement AI BoM coverage metrics and alerts (coverage %, registered vs. active tools, expired DPAs, new registrations, pending flags, champion verification checks). Trigger governance alerts when coverage drops below 95% (and critical at 90%).

Track feature utilisation depth, session patterns and workflow integration rate.

---

6. Adoption Progress and Maturity

Define adoption maturity across stages (Exploring, Planning, Implementing, Scaling, Realising) and show % of department in each.

Track user proficiency levels (Beginner, Intermediate, Advanced, Champion) and adoption velocity (time to basic, regular and advanced usage; acceleration rate).

Measure change management effectiveness via stakeholder engagement, cultural indicators and resistance metrics (cases, resolution rate, time to overcome, escalations). Link persistent resistance to TAL-02 escalation.

---

7. Business Impact and ROAI

Configure productivity and efficiency metrics:

  • Task time reduction, total time saved per month and annualised value.
  • Time savings by task type (review, research, contracts, drafting).
  • Quality improvements (work product rating, error reduction, client impact, peer review time).

Implement ROAI attribution by quadrant:

  • Protect: Class 6 incidents detected/remediated, privilege breaches prevented, AI BoM coverage risk premium reduction.
  • Comply: Governance training completion value, Risk Taxonomy 2026 compliance, audit readiness.
  • Grow: Investment vs. annual productivity value, net ROAI %, payback period, additional billable capacity.
  • Transform: New services, opportunities, client retention impact, competitive advantage.

Track employee experience (satisfaction with AI, work-life balance, retention differences, champion advancement, skill development satisfaction).

---

8. Role-Specific Dashboard Views

Provide tailored views for:

  • Legal Leadership: Programme health, milestones, budget and ROAI, AI BoM coverage, unresolved Class 6 incidents, risk status, adoption by practice group, sponsorship and communication scores.
  • Legal Operations: Training administration, technology adoption, change execution, governance operations (Class 6 SLA performance, GOV-03 log currency, champion AI BoM verification rate).
  • Individual Users: Personal usage, productivity and quality gains, proficiency, Risk Taxonomy progress, governance compliance and incident reporting.
  • AI Champions: Mentoring, users supported, adoption acceleration, AI BoM verifications, Class 6 detections and STR-07 notifications, Risk Taxonomy completion, simulation scores, community-building and recognition.

---

9. KPIs, Benchmarks and Alerts

Implement core KPIs with targets and benchmarks:

  1. Training Completion Rate.
  2. Active User Adoption Rate.
  3. User Proficiency Score.
  4. Productivity Improvement.
  5. User Satisfaction Score.

Governance and risk KPIs:

  1. AI BoM Coverage Rate (alert <95%, critical <90%).
  2. Class 6 Incident Rate (with MTD, escalation times, SLA resolution).
  3. Risk Taxonomy 2026 Training Compliance.
  4. Agentic Tier Gate Completion Rate.
  5. ROAI by Quadrant and total.

Add advanced indicators (retention, innovation, change readiness, digital maturity, GOV-03 currency).

---

10. Early Warning and Risk Indicators

Configure early warning panels for:

  • Adoption resistance (low completion, declining usage, low satisfaction, high ticket volume, weak champion ratings).
  • Class 6 Shadow AI governance alerts (critical, high and moderate triggers with response SLAs).
  • Skill development gaps (low retention scores, stalled Risk Taxonomy progress, low Class 6 simulation pass rates, low Agentic Tier awareness).
  • Technology barriers (performance, integration failures, UI dissatisfaction, slow AI BoM registration).
  • Business impact risks (negative ROAI, client satisfaction decline, low productivity improvement, unresolved Class 6 Critical incidents).

---

11. Reporting and Communication Templates

Defensibility Evidence

Class 6 Shadow AI Incident Report exports, AI BoM Coverage Rate history with timestamps, Agentic Tier gate completion records, STR-07 notification records, and Risk Taxonomy 2026 training completion records (per-class) retained 7 years as DPS Defensibility lens evidence; monthly ROAI reports (all four quadrants), quarterly stakeholder communication reports, annual programme review exports, champion effectiveness dashboard snapshots, and training completion trend reports retained 5 years as DPS Adoption lens evidence.

Operational Artefacts

  • Adoption Metrics Dashboard KPI Catalogue and Data Model

    xlsx · v2026.1

    Gated

  • Executive and Operational Reporting Templates

    docx · v2026.1

    Gated

  • Dashboard Implementation and Integration Checklist

    checklist · v2026.1

Framework Crosswalk

NIST AI Risk Management Framework

NIST

Supports continuous monitoring, measurement and documentation of AI risks, controls and outcomes across the legal function.

ISO/IEC 42001 AI Management System

ISO

Provides evidence for performance evaluation, monitoring and improvement clauses via structured AI adoption and governance metrics.

EU AI Act Governance and Monitoring Obligations

European Union

Helps demonstrate ongoing monitoring of high-risk AI systems, incident handling and technical-organisational measures in legal workflows.

Operational Details

Inputs

  • · GOV-02 AI Use Policy (approved tool list for AI BoM coverage baseline)
  • · AI BoM registry (active tool registrations and DPA currency data)
  • · STR-07 AI Task Force Charter (Class 6 alert routing confirmation)
  • · LMS data (training completion, assessment scores, Risk Taxonomy 2026 per-class progress)
  • · AI tool platform usage data (session counts, feature utilisation, Agentic Tier usage)
  • · TAL-02 Change Management Playbook (adoption stage framework and milestone definitions)
  • · TAL-03 AI Champion network (Class 6 incident reports, AI BoM verification logs, adoption data by practice area)

Outputs

  • · ROAI attribution reports by quadrant (Protect, Comply, Grow, Transform) — monthly and quarterly
  • · Class 6 Shadow AI governance alerts and incident trend reports (real-time and quarterly)
  • · AI BoM coverage rate tracking with threshold alerts routed to Legal Operations and STR-07
  • · Monthly adoption and training completion reports by role and practice area
  • · Quarterly stakeholder communications with ROAI attribution summary
  • · DPS Defensibility and Adoption lens evidence exports (7-year and 5-year retention schedules)
  • · Agentic Tier gate completion status reports and Risk Taxonomy 2026 per-class training compliance

Owner

Legal Operations + AI Task Force (STR-07) under General Counsel oversight

Telemetry & Observability

Telemetry-ready

Key Takeaways

  • Establish Metric 0 gates (GOV-02, AI BoM, STR-07) before activating telemetry.

  • Instrument training, usage, adoption and ROAI in a single, standardised metric model.

  • Configure role-specific dashboards for leadership, operations, champions and users.

  • Automate Class 6 and AI BoM coverage alerts with clear escalation paths.

  • Continuously monitor adoption health and change-resistance early warning signals.

  • Generate DPS-grade evidence exports for Defensibility and Adoption lenses.

  • Use insights to iteratively optimise Legal AI OS and demonstrate ROAI by quadrant.

Get This Module

This module is available as part of an Advanta Advisory engagement.

Explore Advisory

Module Details

Type

Pillar

P3

Layer

M · Measurement

Duration

Initial setup 4–8 weeks; continuous monitoring with weekly and monthly reporting cycles

Advisory

Yes

Access

Member access

Certification

Practitioner

Maturity Bands

FoundationalOperationalIntegratedOptimisedDefensible

Risk Classes Mitigated

Available Through

Related Resources

P3 · Talent →Module Library →Take the Free Baseline Diagnostic →

Governance

Methodology
v2026.1
Last reviewed
23 May 2026
Verified
23 May 2026

ADVISORY

Need help implementing this — and the 49 modules around it?

Advanta Advisory works with legal departments to deploy the full Legal AI OS framework — governance design, implementation roadmap, and team capability — structured around your maturity baseline.

Explore Advisory →Run the Diagnostic first
← Back to Module Library