AI governance
AI governance: what it is, which frameworks apply and how to build a programme
In short
AI governance is the set of policies, roles, controls and oversight an organisation uses to make sure its AI systems are developed, bought and used responsibly, lawfully and safely. It covers who is accountable, how risks are assessed, what evidence is kept, and how systems are approved and monitored over their lifecycle.
Key takeaways
- AI governance is an operating discipline, not a document. It only works when every AI system has an owner, a risk classification, controls and evidence.
- Start with an inventory. You cannot classify, approve or monitor systems you do not know you have, including shadow AI and AI inside vendor products.
- Frameworks and laws overlap but differ in kind: the EU AI Act is binding, ISO/IEC 42001 is certifiable, and the NIST AI RMF and OECD AI Principles are voluntary.
- Dates move. The EU Digital Omnibus on AI deferred high-risk obligations to 2 December 2027 (Annex III) and 2 August 2028 (Annex I), and Colorado replaced its 2024 AI Act with a law applying from 1 January 2027.
- A practical programme has seven steps: inventory, classify, assign ownership, set controls, collect evidence, approve, and monitor.
What is AI governance?
AI governance is the combination of policies, accountability, processes and technical controls that direct how an organisation designs, procures, deploys and monitors AI systems. Its aim is to keep AI use lawful, safe, fair and aligned with the organisation's objectives and risk appetite.
It differs from related terms. Data governance manages data quality, access and lifecycle. Model risk management, common in financial services, validates statistical models. AI compliance is the narrower task of meeting specific legal and standards requirements. AI governance is the wider system that decides who may build or buy what, under which conditions, and who answers for the outcome. See our note on AI governance versus compliance for the distinction in more detail.
Why does AI governance matter now?
AI governance matters because AI use is spreading faster than oversight, and regulators, customers and boards now expect evidence of control. Three pressures drive it.
- Law: the EU AI Act already prohibits certain practices (since 2 February 2025), regulates general-purpose AI models (since 2 August 2025) and sets transparency duties (from 2 August 2026), with high-risk system obligations to follow.
- Customers and procurement: buyers increasingly ask suppliers for AI policies, risk assessments and, sometimes, ISO/IEC 42001 certification.
- Operational risk: unmanaged AI creates data leaks, unreliable outputs, discrimination claims and unplanned vendor dependencies. Staff adopting AI tools without approval (shadow AI) makes these risks harder to see.
What are the components of an AI governance framework?
An AI governance framework has seven working components: an inventory of AI systems, a risk classification method, defined roles and accountability, controls, evidence, approval gates and ongoing monitoring. Policy sits on top of these; without them it stays aspirational.
| Component | Question it answers | Example artefact |
|---|---|---|
| Inventory | What AI do we build, buy and let staff use? | AI system register, shadow AI log, vendor list |
| Classification | How risky is each system, and which rules apply? | Risk tier, EU AI Act category, intended purpose |
| Ownership | Who is accountable for each system? | Named system owner, RACI, board reporting line |
| Controls | What must be true before and while it runs? | Human oversight, testing, data and security controls |
| Evidence | Can we prove it? | Test results, DPIAs, approvals, training records |
| Approvals | Who decides it can go live or change? | Approval policy, decision record, exceptions log |
| Monitoring | How do we know it still works as intended? | Metrics, incident log, reassessment triggers |
How do you build an AI governance programme?
Build an AI governance programme in seven steps: inventory every AI system, classify risk, assign owners, set proportionate controls, collect evidence, gate changes with approvals, and monitor continuously. Start with your highest-risk systems and expand, rather than trying to cover everything at once.
- Inventory. List every AI system you build, buy or embed, plus unsanctioned tools staff use. Record purpose, owner, vendor, data used and where it runs. Include AI features inside existing SaaS products.
- Classify. Assign a risk tier using a consistent method. Include legal categories (for example, whether a system is prohibited, high-risk or subject to transparency duties under the EU AI Act) and your own impact criteria, such as effect on individuals' rights, safety and money.
- Assign ownership. Name one accountable owner per system and an executive sponsor for the programme. Define who can approve, who reviews and who is consulted (legal, privacy, security).
- Set controls. Choose controls proportionate to the tier: data quality checks, testing for accuracy and bias, human oversight, logging, security, transparency notices, and vendor due diligence.
- Collect evidence. For each control, record what was done, by whom and when. Evidence should be retrievable per system, not scattered across inboxes.
- Approve and manage change. Require a documented approval before launch and before material changes such as a new model, new data source or new use case. Record exceptions with an expiry date.
- Monitor and review. Track performance, incidents and complaints, reassess on a schedule and on triggers (model update, regulatory change, incident), and report to leadership.
Aim for a working version in weeks, not a perfect one in months. A single page policy, a spreadsheet inventory and named owners beat a long framework nobody applies.
Who is responsible for AI governance?
AI governance is a shared responsibility with clear single-point accountability: the board sets direction and risk appetite, an AI governance lead runs the programme, and each system has a named owner. Legal, data protection and security provide specialist input.
| Role | Typical responsibility |
|---|---|
| Board and executives | Approve AI policy and risk appetite, receive regular reporting, own accountability for material AI risk |
| AI governance lead (or committee) | Run the programme, maintain the inventory and classification method, chair approvals, report to the board |
| System owners | Accountable for one system's purpose, risk assessment, controls, evidence and ongoing performance |
| Legal and DPO | Determine legal applicability, advise on EU AI Act and GDPR duties, review DPIAs and contracts |
| Security | Assess threats such as prompt injection and data leakage, secure access and logging, review vendors |
| Engineering and data teams | Implement controls, testing and monitoring, and keep technical documentation current |
| Procurement | Apply AI due diligence to suppliers and contract terms |
Which AI governance frameworks and laws matter?
The main references are the EU AI Act, ISO/IEC 42001, the NIST AI RMF, the OECD AI Principles, the GDPR for personal data, and a growing patchwork of US state laws. Binding law and voluntary frameworks do different jobs, and most programmes use both. Status below was checked on 3 October 2026; confirm dates with the official sources before you rely on them.
| Reference | Type | What it does | Status or key dates |
|---|---|---|---|
| EU AI Act (Regulation (EU) 2024/1689) | Binding law (EU) | Risk-based rules for AI providers and deployers: prohibited practices, high-risk systems, transparency duties, general-purpose AI models | In force since 1 August 2024. Prohibitions and AI literacy from 2 February 2025; general-purpose AI rules from 2 August 2025; transparency duties and most remaining provisions from 2 August 2026. The Digital Omnibus on AI (Regulation (EU) 2026/1744, in force 27 July 2026) defers high-risk obligations to 2 December 2027 (Annex III) and 2 August 2028 (Annex I products) |
| ISO/IEC 42001:2023 | Certifiable standard | Requirements for an AI management system (AIMS), with Annex A controls | Published December 2023. Certification is issued by independent certification bodies |
| NIST AI RMF 1.0 (NIST AI 100-1) | Voluntary framework (US) | Govern, Map, Measure, Manage functions for AI risk | Released 26 January 2023; Generative AI Profile (AI 600-1) 26 July 2024; NIST says the framework is being revised |
| OECD AI Principles | Voluntary intergovernmental principles | Five value-based principles and five policy recommendations for trustworthy AI | Adopted May 2019, updated May 2024; OECD lists 47 adherent countries plus the European Union |
| GDPR (Regulation (EU) 2016/679) | Binding law (EU) | Rules on personal data, including data protection impact assessments (Article 35) and limits on solely automated decisions (Article 22) | Applies alongside the AI Act whenever AI processes personal data |
| Colorado SB 26-189 (automated decision-making technology) | Binding state law (US) | Duties for developers and deployers of automated decision-making technology used in consequential decisions; Attorney General enforcement | Signed 14 May 2026; repeals and reenacts SB 24-205, which never took effect; applies from 1 January 2027 |
| Texas HB 149 (TRAIGA) | Binding state law (US) | Prohibits certain harmful AI uses; Attorney General enforcement | Signed 22 June 2025; effective 1 January 2026 |
Not legal advice. Laws and effective dates change, particularly in the EU and the United States. Confirm current status on the European Commission and relevant state legislature sites.
How does AI governance interact with the GDPR?
The GDPR applies whenever an AI system processes personal data, regardless of the AI Act. Governance programmes should link AI system records to existing data protection processes: lawful basis, data protection impact assessments for high-risk processing, transparency to individuals, and rights relating to automated decision-making.
In practice, give your DPO a seat in the approval workflow and reuse DPIA findings as evidence in the AI risk assessment, so the same facts are not recorded twice.
What are AI governance best practices?
Good AI governance is proportionate, owned, evidenced and repeated. The following practices separate working programmes from policy documents.
- Scale controls to risk: light-touch for low-risk tools, rigorous for systems that affect people's rights, safety or finances.
- Make the inventory the single source of truth, and refresh it on a schedule, including vendor AI and shadow AI.
- Tie every control to evidence you can produce on request.
- Put approvals at defined gates, with reassessment triggered by material change rather than the calendar alone.
- Train staff on acceptable use. The EU AI Act's AI literacy provision, as amended by the Digital Omnibus, requires providers and deployers to take measures to support it.
- Map once, report many times: align controls to ISO/IEC 42001, the NIST AI RMF and legal requirements instead of running separate programmes.
- Report to the board on a fixed rhythm: inventory size, high-risk systems, open findings, incidents and exceptions.
How AIGovernr helps
AIGovernr is a workspace for running this programme: an AI system register, classification, governance plans, controls, evidence records, approvals and a shadow AI registry. It carries versioned releases of frameworks such as the EU AI Act, NIST AI RMF, ISO/IEC 42001 reference metadata and the GDPR, mapped to your controls. It supports your governance work; it does not make an organisation compliant or certified.
Frequently asked questions
What is the difference between AI governance and AI compliance?
AI governance is the internal system of accountability, policies, controls and oversight that decides how AI is built, bought and used. AI compliance is demonstrating that you meet specific external requirements, such as laws or standards. Good governance makes compliance easier to prove, but compliance alone does not cover your own risk appetite or ethics.
Do small companies need AI governance?
Yes, in proportion. Any organisation using AI with customer data, hiring, credit or similar decisions carries risk and may fall under laws such as the EU AI Act or GDPR. A small company can start with a one-page policy, an AI inventory, named owners and a simple approval step for new tools.
What are the 7 steps to build an AI governance programme?
Inventory your AI systems, classify their risk, assign accountable owners, set proportionate controls, collect evidence that controls operate, require approvals before launch and material change, and monitor and review continuously. Begin with the highest-risk systems and extend coverage over time rather than aiming for full coverage on day one.
Who should lead AI governance in an organisation?
Executive sponsorship should sit with the board or a senior executive, day-to-day leadership with a named AI governance lead or cross-functional committee, and system-level accountability with individual owners. Legal, the data protection officer and security advise. Pick one accountable person per system so issues do not fall between teams.
Is AI governance legally required?
No single law requires an organisation to have an 'AI governance programme' as such, but several laws require activities that amount to one, including risk management, documentation, human oversight and transparency for high-risk systems under the EU AI Act. Which duties apply depends on your role, systems and location.
How does ISO/IEC 42001 relate to AI governance?
ISO/IEC 42001:2023 is a management system standard that specifies requirements for establishing, implementing and improving an AI management system. It gives structure to AI governance and can be certified by independent bodies. It is voluntary and does not by itself demonstrate compliance with the EU AI Act.
When do the EU AI Act's high-risk rules apply now?
Under the Digital Omnibus on AI, Regulation (EU) 2026/1744, in force since 27 July 2026, high-risk obligations for Annex III systems apply from 2 December 2027, and for AI embedded in Annex I regulated products from 2 August 2028. Other provisions, such as transparency duties, applied from 2 August 2026. Check the Commission site for updates.
What happened to the Colorado AI Act?
Colorado repealed and reenacted its 2024 AI Act, SB 24-205, through SB 26-189, signed on 14 May 2026. The new law focuses on automated decision-making technology used in consequential decisions and applies from 1 January 2027. SB 24-205 never took effect. Check the Colorado General Assembly site for any further amendment.
Sources
Facts on this page were checked against these primary sources on 3 October 2026. This guide is general information, not legal advice.
- EUR-Lex: Regulation (EU) 2024/1689 (Artificial Intelligence Act)
- EUR-Lex: Regulation (EU) 2026/1744 (Digital Omnibus on AI)
- EUR-Lex: Regulation (EU) 2016/679 (GDPR)
- NIST: AI Risk Management Framework
- OECD.AI: AI Principles
- ISO: ISO/IEC 42001:2023 AI management systems
- Colorado General Assembly: SB26-189 Automated Decision-Making Technology
Put this into practice
Register your AI systems, see which obligations apply, and keep controls and evidence in one workspace.
Start free