Quaintitative

For Risk & Compliance

AIRG and Project MindForge training, step by step

A step-by-step training guide to Singapore's AI Risk Management Guidelines (AIRG) and the Project MindForge toolkit, topic by topic, for the people who oversee, challenge and assure AI.

Twelve topics covering most of what a full paid programme has, with the AIRG in full, all the Project MindForge considerations, the crosswalks and the ebooks linked as you go. If you read the full set, links and all, it runs to more than four hundred pages. Openly available.

I wrote the AIRG while leading AI risk supervision at the Monetary Authority of Singapore. I spent almost two decades in risk management and writing regulations. This page gives the second and third line the grounding they need, consideration by consideration: what the AIRG expects, and how the Project MindForge toolkit operationalises it.

How it fits together. The FEAT principles, fairness, ethics, accountability and transparency, are the underlying principles. The AIRG is the expectations built on them. MindForge is the practice, based on and aligned to the AIRG. Principles, then expectations, then practice.

I keep this openly available rather than behind a sign-up. The people who have to oversee AI should understand it well, and the system works better when they do. Use it, and pass it on. And if you would like to follow me for more of such stuff, come find me on my Substack.

It covers many of the areas that a full paid programme does. Each topic opens with a question, so try to answer it before you open the explanation, and each one links to the fuller write-ups on this site and to the matching ebook. Use the contents below to jump to a topic, or step through them in order. The other MindForge considerations and the AIRG in full are openly available here too: the MindForge toolkit, consideration by consideration, and the AIRG explained.

I am keeping this as a live document, last updated 23 October 2026, so drop me a note (at gary@quaintitative.com) anytime if you want to add or correct something. Your feedback helps improve the guide for everyone.

What this covers, and what else is here

These topics are a start. Behind them sits the AIRG and the MindForge considerations, written up one by one, plus the wider Singapore picture, comparisons with the global frameworks, and the tools you need to actually use any of it. A few of the highlights:

The full MindForge toolkit, consideration by consideration. The foundations here are key considerations. The rest are written up in the MindForge toolkit.

Crosswalks that map one framework to another. The AIRG to MindForge crosswalk, clause by clause; the AIRG, MindForge and the CRI framework together; and the AIRG to FSB crosswalk.

How the AIRG compares with the global frameworks. The AIRG compared with the EU AI Act, NIST and ISO 42001, so a firm across jurisdictions maps once.

An assessment checklist. The questions a supervisor may ask, which the second line can use on itself.

The AI risks taxonomy. AI risks in finance, each risk set out with what it is, why it matters, and how the AIRG and MindForge handle it.

The resource library. Everything in one place: AI risk management in finance, the resources, and the wider resources page.

The plain-English ebooks. Each topic below links the matching one; the full set is on the books page.

Taken together, that is most of what a risk or control function needs to get going on the AIRG, openly available, in one place.

Contents

Part one · the foundations

Part two · putting it to work

Part one · Topic 1 of 12

Introduction to AI governance and risk management

The landscape: the AIRG, MindForge, and the second and third line's role.

The AIRG and MindForge are often named together. What is the difference, and which one sets the standard?

What the AIRG covers. The MAS AI Risk Management Guidelines were finalised in October 2026 and come into force in October 2027. They cover traditional machine learning, generative AI and agents, across the AI lifecycle, and they are risk-based and proportionate, so the depth of control depends on how material the use is. MindForge is the industry's toolkit of practices, based on and aligned to the AIRG, and organised into pillars and considerations. This page pairs the AIRG expectation with the MindForge practice for each consideration the second and third line should focus on.

FEAT principles, then the AIRG expectations, then MindForge practice FEAT principles, then the AIRG expectations, then MindForge practiceGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com MindForge the practice The AIRG the expectations FEAT the principles How it fits © Gary Ang · quaintitative.com
FEAT sets the principles, the AIRG the expectations, MindForge the practice.

Your role. You do not build the AI. The second and third line provide independent oversight, effective challenge and reviews. Read each topic as a reviewer: how do you tell whether the first line has done this, and done it properly.

The first line builds and owns the AI; the second and third line provide independent oversight, challenge and review The first line builds and owns the AI; the second and third line provide independent oversight, challenge and reviewGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com First Line builds and owns the AI Second Line challenge, policy, oversight Third Line independent assurance where you sit © Gary Ang · quaintitative.com
The first line builds and owns the AI; the second and third line challenge, oversee and assure.

Related on this site: the AIRG explained, the final AIRG, AI risk management from first principles, AI risk management in Singapore, the complete guide, and the MindForge toolkit.

In an ebook: AI Risk Management from First Principles.

Part one · Topic 2 of 12

The approach: policies, procedures and standards

AIRG expectation: a consistent, enterprise-wide approach to governing AI. MindForge consideration: governance documents.

Does your firm have a single, consistent approach to governing AI across the whole firm, written down and owned?

What the AIRG expects. Governance documents that set out the firm's approach to AI: a consistent, enterprise-wide way to identify AI, assess risk materiality, maintain an inventory, clear ownership, and the policies that underpin the oversight and lifecycle controls. The point is one approach applied the same way across the firm, not any single document.

One approved approach, the spine, governs AI across the firm; the operating-model shape is the firm's to choose One approved approach, the spine, governs AI across the firm; the operating-model shape is the firm's to chooseGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com ONE APPROACH (THE SPINE) Central team Hub and spoke Distributed one approved approach, the firm's choice of shape © Gary Ang · quaintitative.com
One approved approach governs AI across the firm; the operating-model shape is the firm's to choose.

What MindForge does. It builds the approach in layers: a short set of the firm's own AI principles; a working definition of AI so the approach applies consistently, including to AI embedded in purchased software; an identification framework wired into the software development lifecycle, existing risk reviews and third-party onboarding, with a named authority for borderline cases; and all of it written into a dedicated AI policy or folded into existing policies such as the model risk policy, then reviewed on a set schedule.

MindForge builds one approach in layers: principles, a working definition of AI, an identification framework, written into policy, reviewed on a schedule MindForge builds one approach in layers: principles, a working definition of AI, an identification framework, written into policy, reviewed on a scheduleGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Reviewed on a schedule Written into policy Identification framework A working definition of AI The firm's AI principles © Gary Ang · quaintitative.com
MindForge builds the approach in layers, from the firm's own AI principles up to a scheduled review.

What good looks like, and what to ask for. One approach, applied the same way across the firm, with clear ownership. Ask how the approach is enforced where the business actually runs AI day to day, not just what the policy says.

Related on this site: governance documents, in full, the AIRG explained, and why AI governance frameworks fail.

In an ebook: Scaling AI Governance.

Part one · Topic 3 of 12

Organisation-level risk management

AIRG expectation: existing frameworks identify, assess and manage AI risk. MindForge consideration: the organisation-wide risk framework.

Should AI risk be a separate programme, or part of the risk framework the firm already runs?

What the AIRG expects. Existing risk frameworks and functions identify, assess and manage the risks AI brings, with clear roles, indicators and escalation. The AIRG does not mandate a particular structure. What it requires is accountability and no gaps, with material AI risk reflected in the risk appetite.

The structure is the firm's choice. MindForge sets out three approaches, which can be combined: update each existing risk category for AI (distributed), expand model or technology risk to hold AI risk (concentrated), or add a dedicated AI risk category (AI-specific). Whatever the firm picks, what matters is a consistent spine across the firm, clear accountability, and no gaps between risk types or parts of the business. The board approves the approach; it does not have to favour one structure over another.

Three ways to structure AI risk, which can be combined: distributed across existing categories, concentrated in model or technology risk, or a dedicated AI risk category Three ways to structure AI risk, which can be combined: distributed across existing categories, concentrated in model or technology risk, or a dedicated AI risk categoryGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Distributed folded into each existing risk type Concentrated held in model or technology risk AI-specific a dedicated AI risk category the firm's choice; keep one consistent spine © Gary Ang · quaintitative.com
Three ways to structure AI risk, which can be combined; the firm chooses, as long as the spine stays consistent.

What MindForge adds. Existing controls such as access management and incident management still apply and are strengthened where they fall short. The firm sets a small number of AI key risk indicators with named owners, such as the share of use cases missing from the inventory, production systems running without approval, drift and data-quality measures, and total exposure. AI incidents are logged by severity, with attention to how long they take to resolve, and escalation runs against thresholds set by the risk appetite.

A complete AI inventory feeds an executive dashboard whose indicators prompt the Board's questions A complete AI inventory feeds an executive dashboard whose indicators prompt the Board's questionsGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com AI INVENTORY EXECUTIVE DASHBOARD use cases not in the inventory systems running unapproved drift and incidents THE BOARD'S QUESTIONS © Gary Ang · quaintitative.com
A small set of AI key risk indicators, with named owners, feeds escalation against the risk appetite.

What good looks like, and what to ask for. AI risk visible in the risk appetite, controls strengthened rather than duplicated, and a short list of key risk indicators with named owners. Ask whether there are gaps between the chosen structure and any part of the firm, and for an example of a threshold being breached and what happened next.

Related on this site: the organisation-wide risk framework, in full, three lines of defence for AI, building an AI risk function, and AI risk management for risk and compliance.

In an ebook: Scaling AI Governance.

Part one · Topic 4 of 12

Third-party AI risk, and the AI Card

AIRG expectation: bought AI held to the same standard as built AI. MindForge consideration: third-party AI risk.

A vendor gives you an "AI Card". Is this a new discipline, or an extension of the third-party risk management you already do?

Start from the AIRG, which is strict here. The AIRG holds third-party AI to the same standard as AI built in-house: identified, rated for materiality, inventoried and controlled, with onboarding and deployment controls, and compensatory testing to cover what the vendor will not disclose. Buying the AI does not move the accountability to the vendor.

What an AI Card covers. An AI Card is a model or system card: a short, structured disclosure from the vendor. It usually sets out what the system is and what it is meant to be used for; the data it was built on; how it performs and where it is weak; the known risks and failure modes; the testing, guardrails and safety measures already in place; and version information, so you know what has changed. How much you ask for scales with how material your use is.

What an AI Card discloses: what the system is and its intended use, the data it was built on, performance and weaknesses, known risks, testing and guardrails, and version information What an AI Card discloses: what the system is and its intended use, the data it was built on, performance and weaknesses, known risks, testing and guardrails, and version informationGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com AI CARD What it is, and its intended use The data it was built on Performance, and where it is weak Known risks and failure modes Testing, guardrails, safety measures Version information © Gary Ang · quaintitative.com
What an AI Card discloses; how much you ask for scales with how material your use is.

It is an extension, not a new thing. Model cards and data cards (datasheets) have been used in AI for years to describe what a model does and what data it was built on. An AI Card is that same idea, brought into vendor assessment. And MindForge treats this as strengthening what a firm already does, not a new function: you already run procurement, vendor assessment and third-party risk management, and an AI Card has the same purpose as a due-diligence questionnaire, applied to the AI-specific points.

An AI Card is not a new discipline; it is the AI-specific questions added to the vendor due diligence the firm already runs An AI Card is not a new discipline; it is the AI-specific questions added to the vendor due diligence the firm already runsGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com THIRD-PARTY RISK MANAGEMENT you already run this Procurement Vendor due diligence Ongoing monitoring + AI Card the AI-specific questions © Gary Ang · quaintitative.com
An AI Card is not a new discipline; it is the AI-specific questions added to the vendor due diligence you already run.

What MindForge adds. Review the disclosure against your expectations. Where information is withheld, decide on the basis of indemnities, credible external attestation, or your own testing, rather than rejecting the vendor outright. Run compensatory testing on your own data and metrics, more where disclosure is thin or the use is material, with fairness testing part of onboarding. Watch for AI added to an existing product through vendor updates, and contract for change notification, liability, data retention and audit rights.

How much disclosure you ask of a vendor scales with how material your use is; where disclosure is withheld, cover it with indemnities, external attestation or your own testing How much disclosure you ask of a vendor scales with how material your use is; where disclosure is withheld, cover it with indemnities, external attestation or your own testingGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com How much you ask scales with materiality Low Medium High Where disclosure is withheld, not rejection but: indemnities / attestation / your own testing © Gary Ang · quaintitative.com
Ask for disclosure in proportion to materiality; cover what is withheld with indemnities, attestation or your own testing.

What good looks like, and what to ask for. Third party AI in the same inventory and on the same risk materiality scale as internal AI, disclosure requested in proportion to materiality, your own testing where it matters, and contracts carrying the AI-specific terms. Ask for a case where a vendor withheld information and how the firm decided.

Related on this site: third-party AI risk, in full, third-party onboarding, governing third-party AI, and supervising third-party AI.

In an ebook: AI Risk Management for Risk and Compliance.

Part one · Topic 5 of 12

Use-case risk and materiality

AIRG expectation: rate each use case, and let the depth of controls follow. MindForge consideration: use-case risk and materiality.

How risky is this use case, and how much governance should it get?

What the AIRG expects. Rate each AI use on its materiality, at least across impact, complexity and reliance, applied consistently, with the depth of controls following the rating. Material systems get an independent review before deployment. The rating is how proportionality works in practice.

Impact, complexity and reliance set the materiality tier, and the tier sets how much control the use case needs Impact, complexity and reliance set the materiality tier, and the tier sets how much control the use case needsGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Impact on firm, customers Complexity how novel Reliance replaces judgement RISK MATERIALITY low medium high Control intensity scales with materiality © Gary Ang · quaintitative.com
Impact, complexity and reliance set the risk materiality, and that sets how much control the use case needs.

What MindForge does. It sets enterprise-wide tiers, commonly low, medium and high, on criteria that fit the firm: impact (financial, reputational, regulatory, effect on customers, use of personal data), complexity or novelty, and how far the AI replaces human judgement. It assesses inherent risk early, from the basic features of the use case, then residual risk after controls are in place, tested in conditions close to real use, repeating until the residual risk is acceptable. Controls scale with the tier, from sample-based review for a minor use to review of every output for a material one. A review before deployment is carried out by someone not involved in building it, and its depth and independence increase with materiality.

Inherent risk is assessed early from the use case; controls are applied; residual risk is tested in conditions close to real use; repeat until it is acceptable, then go live Inherent risk is assessed early from the use case; controls are applied; residual risk is tested in conditions close to real use; repeat until it is acceptable, then go liveGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com INHERENT RISK assessed early, from the use case apply controls RESIDUAL RISK tested close to real use Acceptable? yes GO-LIVE no, add more © Gary Ang · quaintitative.com
Assess inherent risk early, apply controls, test residual risk close to real use, and repeat until it is acceptable.

What good looks like, and what to challenge. Tiers applied the same way across the firm, based on what a system does rather than who sees it. An inherent assessment early and a residual assessment before go-live. Controls whose intensity matches the tier. Challenge the rating first, especially a high-impact use such as credit decisioning that has been rated low.

Two systems both rated high-risk, with very different real exposure Two systems both rated high-risk, with very different real exposureGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com BOTH RATED HIGH-RISK System A Machine learning A person reviews every decision about 100 a day System B Generative AI Automated approvals, little review about 1,000,000 a day © Gary Ang · quaintitative.com
Two systems can sit at the same rating with very different real exposure; challenge the rating first.

Related on this site: use-case risk and materiality, in full, supervising inventory and materiality, inventory and materiality for the second line, and inventory and materiality compared.

In an ebook: AI Risk Management for Risk and Compliance.

Part one · Topic 6 of 12

AI inventory capabilities

AIRG expectation: an accurate, up-to-date inventory of AI use cases. MindForge consideration: the AI inventory.

Can your firm show where all its AI is, including low-risk uses and anything not formally registered?

What the AIRG expects. An accurate, up-to-date inventory of AI use cases, so risk can be aggregated across the firm and controls applied consistently. It is a required outcome: the firm must be able to show it knows where its AI is. The AIRG does not prescribe the tool.

What MindForge does. It treats the inventory as a record of core attributes, and is flexible about the tool: extend an existing asset inventory, link several registers, or build a dedicated system. It sets six minimum attributes per use case: purpose and scope; type of AI; data used; risks and mitigations, including the materiality rating; status and governance, including the owner, lifecycle status and approvals; and third-party information, including vendor disclosures such as AI Cards. Every use case is recorded, including low-risk ones, so the firm-wide picture is complete. Three roles keep it current: the use-case owner maintains their entries, an AI-specific reviewer checks accuracy, and an inventory owner, usually a control function, is accountable for the inventory overall. Reviews after deployment also check the inventory, flagging where a live system no longer matches its record.

The six minimum attributes recorded for every AI use case: purpose and scope, type of AI, data used, risks and mitigations, status and governance, and third-party information The six minimum attributes recorded for every AI use case: purpose and scope, type of AI, data used, risks and mitigations, status and governance, and third-party informationGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com SIX MINIMUM ATTRIBUTES Purpose and scope Type of AI Data used Risks and mitigations, with materiality Status, owner, approvals Third-party information, AI Cards © Gary Ang · quaintitative.com
The six minimum attributes recorded for every AI use case, including the low-risk ones.
Three roles keep the inventory current: the use-case owner maintains their entries, an AI-specific reviewer checks accuracy, and an inventory owner in a control function is accountable overall Three roles keep the inventory current: the use-case owner maintains their entries, an AI-specific reviewer checks accuracy, and an inventory owner in a control function is accountable overallGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Use-case owner maintains their entries AI-specific reviewer checks accuracy Inventory owner accountable overall © Gary Ang · quaintitative.com
Three roles keep the inventory current; the inventory owner, usually a control function, is accountable overall.

What good looks like, and what to ask for. One firm-wide view of the AI in use, the six attributes recorded before deployment, the three roles named and filled, and an owner for the schema. Ask how the firm finds AI that no one registered.

Related on this site: the AI inventory, in full, supervising inventory and materiality, and inventory and materiality for the second line.

In an ebook: AI Risk Management for Risk and Compliance.

Part two · Topic 7 of 12

Recent trends: generative and agentic AI

What has changed, and what it means for risk and compliance.

What has changed with generative and agentic AI, and why does it matter for risk and compliance?

The shift. Most AI risk management was built for narrow, predictive models. Generative AI adds open-ended outputs, new failure modes such as made-up answers and manipulation through the input, and heavy reliance on third-party models. Agentic AI adds systems that take actions and chain steps with less human involvement at each step. Capability and risk rise together.

Generative AI suggests and produces content; agentic AI plans, calls tools and acts across steps, with less human involvement Generative AI suggests and produces content; agentic AI plans, calls tools and acts across steps, with less human involvementGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Generative AI Suggests: it produces an answer Content: text, code, analysis Often runs on a third-party model acts, not just suggests Agentic AI Acts: it carries the step out Plans and calls tools, many steps Less human at each step capability and risk rise together © Gary Ang · quaintitative.com
Generative AI suggests and produces content; agentic AI plans, calls tools and acts across steps.

What it means for your seat. The controls do not change in principle, but they stretch. Materiality has to account for autonomy and reach. Testing has to cover behaviour, not just accuracy. Monitoring has to run against systems that change after deployment. The second and third line need enough understanding of these systems to ask the right questions.

The controls do not change in principle but they stretch: materiality now accounts for autonomy and reach, testing for behaviour not just accuracy, monitoring for systems that change after deployment The controls do not change in principle but they stretch: materiality now accounts for autonomy and reach, testing for behaviour not just accuracy, monitoring for systems that change after deploymentGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Materiality stretches to autonomy and reach Testing stretches to behaviour, not just accuracy Monitoring stretches to systems that keep changing © Gary Ang · quaintitative.com
The controls do not change in principle, but materiality, testing and monitoring each have to stretch.

Related on this site: governing agentic AI, agentic AI risks, agentic AI risk management, and the five S's of AI.

In an ebook: Agentic and Generative AI for Finance.

Part two · Topic 8 of 12

Generative AI: risk materiality and guardrails

What actually reduces the risk of a generative AI use, and how you know it is working.

For a generative AI use case, what actually reduces the risk, and how do you know it is working?

Rate it on what it can affect. The materiality rating still applies, but for generative AI the impact and the reliance are often higher than they look: the output goes to a customer, a colleague acts on it, and the content is open-ended rather than a single number. Rate the use on what it can affect, not on how simple it is to use.

Ground it in your own documents. A language model has no memory between requests. For one request it works only from what it is given: the instructions, the question, and any documents fetched for it. So the strongest control is to make it answer from approved sources you supply, and to show which part of the source it used. For a question about a fee or a loan covenant, the system should pull the relevant document and answer from it, rather than from whatever it picked up in training.

The strongest control for generative AI is to make it answer from approved sources you supply, and to show which part of the source it used, rather than from training The strongest control for generative AI is to make it answer from approved sources you supply, and to show which part of the source it used, rather than from trainingGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com The question retrieve the right document APPROVED SOURCES your own documents answer from it Grounded answer shows which part it used not from whatever it saw in training © Gary Ang · quaintitative.com
The strongest control is to make the model answer from approved sources you supply, and show which part it used.

Limit it, and keep records. Give the system access only to what the task needs. Keep a record of what was asked, what was retrieved, and what was produced, so a wrong answer can be investigated later.

Test it on your own work, and keep testing. Build a set of test cases from real work: representative customer questions and documents, and the hard ones, incomplete requests, out-of-date or conflicting sources, and cases where the system should ask for help rather than answer. For each case, write down what a good answer must contain, for example the clauses a covenant summary must mention, or the correct fee and its source. Judge answers against that, run the tests again after any change, and keep the worst cases. A public benchmark can help shortlist a model, but the decision to go live needs evidence from your own tasks.

Test a generative AI use on your own work and keep testing: cases built from real work, written criteria for a good answer, judged against them, re-run after any change, worst cases kept Test a generative AI use on your own work and keep testing: cases built from real work, written criteria for a good answer, judged against them, re-run after any change, worst cases keptGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Cases from real work representative, and the hard ones What a good answer needs the clauses, the correct fee Judge answers against it pass or fail, with reasons Re-run after any change keep the worst cases © Gary Ang · quaintitative.com
Build test cases from real work, write what a good answer needs, judge against it, and re-run after any change.

How you tell it is working. A control you cannot measure is only a hope. Useful measures: whether an answer is actually supported by the source it points to, how often the system produces something unsafe or answers when it should have declined, and how often a person had to correct it. For a material use, there should be evidence that outputs are reviewed and that failures are found and fixed.

Useful measures for a generative AI control: whether an answer is supported by its source, how often the system is unsafe or answers when it should decline, and how often a person had to correct it Useful measures for a generative AI control: whether an answer is supported by its source, how often the system is unsafe or answers when it should decline, and how often a person had to correct itGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com MEASURES Answers supported by their source Unsafe, or answered when it should decline How often a person had to correct it a control you cannot measure is only a hope © Gary Ang · quaintitative.com
Measures that tell you a generative AI control is working; a control you cannot measure is only a hope.

Related on this site: guardrails and metrics, making AI safe in practice, and use-case risk and materiality.

In an ebook: Agentic and Generative AI for Finance.

Part two · Topic 9 of 12

Controls, data, and the second-line challenge questions

What the second line should ask the first line, across the whole lifecycle of a use case.

What should the second line be asking the first line about an AI system, from identification through to live running?

Challenge, not build. The second line does not run the model. Its job is to ask for evidence and to judge whether a control is real or only described. You do not have to invent a framework; the AIRG already is one. The questions below follow a use case across its life.

The second line's job is to judge whether a control is real or only described: ask for the evidence, the logs, the test results, the independent sign-off The second line's job is to judge whether a control is real or only described: ask for the evidence, the logs, the test results, the independent sign-offGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Described the policy says it happens ask for evidence Real logs, test results, an independent sign-off © Gary Ang · quaintitative.com
The second line's job is to tell a real control from one that is only described; ask for the evidence.

Identification and inventory. Is every use case recorded, including low-risk ones and anything bought from a vendor? How is AI that no one registered found?

Materiality. How was this rated, and why? Does a high-impact use rated low hold up when you probe it?

Before go-live. What was tested, against what, and by whom? Was the reviewer independent of the build? Did testing cover adversarial cases and fairness, and did it reflect real conditions rather than a clean dataset?

After go-live. What does the monitoring show, including drift? What thresholds exist, and what happens when one is breached?

Third-party. What was disclosed, what was tested on your own data, and what do the contract terms cover?

Data. Where did the data come from, what is sensitive, and how are training and operational data kept separate?

Incidents and escalation. How are AI incidents logged, and when do they reach the board?

The second line's challenge questions follow a use case across its life: identification, materiality, before go-live, after go-live, third-party, data, and incidents The second line's challenge questions follow a use case across its life: identification, materiality, before go-live, after go-live, third-party, data, and incidentsGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Identify and inventory every use case recorded, vendor AI too? Materiality rated right? probe a high use rated low Before go-live tested against what, by an independent reviewer? After go-live monitoring, thresholds, what on a breach? Third-party disclosed, tested on your data, contract? Data provenance, sensitive data, separation? Incidents logged, escalated, reaching the board? © Gary Ang · quaintitative.com
The second line's challenge questions, following a use case from identification through to live running.

Proportionality is your throttle. You cannot validate a whole portfolio in full. Put the weight where materiality is highest, and cover the rest with lighter checks.

You cannot validate the whole portfolio in full, so proportionality is the throttle: deep review where materiality is highest, lighter checks for the rest You cannot validate the whole portfolio in full, so proportionality is the throttle: deep review where materiality is highest, lighter checks for the restGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com High full validation Medium targeted review Low light checks, sampling put the weight where materiality is highest © Gary Ang · quaintitative.com
You cannot validate the whole portfolio in full; put the weight where materiality is highest.

Related on this site: where AI risk hides from the second line, challenge, not build, questions to ask your first line, testing and review, assessing controls before deployment, monitoring after go-live, and three lines of defence for AI.

In an ebook: AI Risk Management for Risk and Compliance.

Part two · Topic 10 of 12

Data governance for AI

The data governance AI adds, where representativeness is the key thing.

What does data governance need to add for AI specifically, beyond the data governance the firm already runs?

This is the delta, not data governance in general. Your firm already governs data, and for some purposes, regulatory reporting above all, that governance is more exacting than anything AI requires. The point here is only what AI adds, on top of what you already do. It sits on your existing data governance; it does not replace it.

AI-specific data governance sits on top of the firm's existing data governance; it adds representativeness, provenance and rights, protection of sensitive data, separation, and retention AI-specific data governance sits on top of the firm's existing data governance; it adds representativeness, provenance and rights, protection of sensitive data, separation, and retentionGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com WHAT AI ADDS Representativeness of the data Provenance and rights Sensitive data leaving the firm Training and live data kept apart Retention and deletion YOUR EXISTING DATA GOVERNANCE already in place; this does not replace it © Gary Ang · quaintitative.com
AI-specific data governance sits on top of what the firm already does; it adds to it, it does not replace it.

The key thing is representativeness. For AI that is trained, the data it learns from has to represent the conditions it will meet in use. A model trained on data that does not match live conditions fails quietly when conditions differ, and no one notices until it matters. For AI that is grounded, meaning it answers from documents you supply rather than from training, the documents it draws on have to be the right ones, complete and current, because the answer is only as good as what it is given. Representativeness, of the training data and of the grounding sources, is the thing to get right.

The key thing AI adds to data governance is representativeness: data that matches live conditions holds up; data that does not match fails quietly, unnoticed until it matters The key thing AI adds to data governance is representativeness: data that matches live conditions holds up; data that does not match fails quietly, unnoticed until it mattersGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Does the data match the conditions it will meet? Data = Live holds up Data ≠ Live fails quietly same for training data and grounding sources © Gary Ang · quaintitative.com
The key addition is representativeness: data that matches live conditions holds up; data that does not fails quietly.

The other AI-specific additions. Provenance and rights for the data used. Protection of sensitive and personal data, including what leaves the firm when it is sent to a third-party model or placed in a prompt. Separating training data from live input, and preventing leakage between them. Retention and deletion for data held by or sent to AI. And the data used to test the system, which has to be representative too.

Keep training data separate from live input and prevent leakage between them; watch what sensitive data leaves the firm when it is sent to a third-party model or placed in a prompt Keep training data separate from live input and prevent leakage between them; watch what sensitive data leaves the firm when it is sent to a third-party model or placed in a promptGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com the firm Training data Live input kept apart third-party model, a prompt what sensitive data leaves the firm? © Gary Ang · quaintitative.com
Keep training data and live input apart, and watch what sensitive data leaves the firm.

What to ask for. Whether the training or grounding data represents real conditions, and how that was checked. Where each dataset came from and on what basis it is used. What stops sensitive data leaving the firm through a model or a prompt.

Related on this site: data management, and data ethics.

In an ebook: AI Risk Management for Risk and Compliance.

Part two · Topic 11 of 12

Agentic AI: governing a system that acts on its own

Autonomy, human oversight, kill switches and key risk indicators.

An AI agent can take actions on its own. What has to be in place before that is acceptable?

What is different. An agent plans and acts across steps, calls tools, and can change things, not just produce text. Two things to pin down first: how much autonomy it has, and the path it can take, meaning the sequence of actions available to it. The risk is the path, not a single output, so control has to happen while it runs, not only before it ships.

Design-time governance before go-live, runtime governance while the agent acts Design-time governance before go-live, runtime governance while the agent actsGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com DESIGN-TIME checked before go-live go-live RUNTIME holds while it acts © Gary Ang · quaintitative.com
Design-time governance before go-live, runtime governance while the agent acts.

Govern it in order of reliability. The most reliable control is to make an action impossible, not to ask the model not to do it. First, remove what must never happen: access it should not have, actions it should not be able to take. Next, fixed rules on the actions, not on the model's judgment: hard limits, approval required before high-impact actions, and a kill switch that someone owns and has tested. Then a second model as a check on behaviour, remembering that the checker is itself a system to govern. Last, your own testing: test the path, not just the answer; repeat it, because an agent is not deterministic; and probe through everything it reads, since instructions can arrive hidden in the content it retrieves.

Govern an agent in order of reliability: most reliable is to make an action impossible, then fixed rules and a kill switch, then a second model as a check, and last your own testing Govern an agent in order of reliability: most reliable is to make an action impossible, then fixed rules and a kill switch, then a second model as a check, and last your own testingGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Make it impossible remove access and actions Fixed rules hard limits, approval, kill switch A second model checks itself a system to govern Your own testing the path, repeated, probed most reliable at the top © Gary Ang · quaintitative.com
Govern an agent in order of reliability, from making an action impossible down to your own testing.

Failure modes to watch. The wrong action, an action that breaks something, someone steering it through its inputs, and long chains where small errors compound.

Oversight, KRIs and proportionality. Human oversight scaled to impact. Key risk indicators for agent behaviour, such as actions outside scope, failed tool calls and escalations. Logging detailed enough to reconstruct the path. And not every agent needs the full treatment: match the effort to what it can affect, and keep governing it, because it keeps changing.

For each action an agent proposes, the firm's controls let it execute, send it for approval, or reject it, and log everything For each action an agent proposes, the firm's controls let it execute, send it for approval, or reject it, and log everythingGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Agent proposes an action THE FIRM'S CONTROLS Execute Approve first Reject TAMPER-EVIDENT LOG every action and decision, recorded © Gary Ang · quaintitative.com
For each action an agent proposes, the firm's controls execute it, send it for approval, or reject it, and log everything.

Related on this site: governing agentic AI, runtime governance for agentic AI, agentic AI risk management, and AI oversight and accountability.

In an ebook: AI Risk Management for Agents.

Part two · Topic 12 of 12

What matters, whatever the technology does next

The parts of AI risk management that do not change, for the board and the second line.

The technology keeps changing. What should a firm hold steady on, rather than chase every change?

Most of it does not change. New models and new techniques arrive constantly, but the things that actually control AI risk are stable. Accountability stays with the firm, not the vendor or the tool. Risk and effort follow materiality, so the weight goes where the harm would be greatest. You keep a comprehensive inventory of what you have. You challenge and independently review before go-live, and you watch after. None of that depends on which model is in fashion.

New models and techniques keep arriving, but the fundamentals that control AI risk are stable: accountability with the firm, risk following materiality, a comprehensive inventory, challenge and independent review New models and techniques keep arriving, but the fundamentals that control AI risk are stable: accountability with the firm, risk following materiality, a comprehensive inventory, challenge and independent reviewGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com new models new techniques agentic AI these keep changing DURABLE FUNDAMENTALS Accountability stays with the firm Risk and effort follow materiality A comprehensive inventory Challenge and independent review before go-live, then watch after © Gary Ang · quaintitative.com
The technology keeps changing, but the fundamentals that control AI risk stay stable.

So map the new to what's stable. When a new capability appears, agentic AI is the current example, the question is not what entirely new rules are needed, but where it sits in what you already do: how material is it, what can it affect, what independent check applies, what do you monitor. A firm that governs to durable fundamentals absorbs new technology; a firm that writes a fresh framework for each wave falls behind.

When a new capability appears, the question is not what new rules are needed, but where it sits in what you already do: how material, what it can affect, what independent check, what to monitor When a new capability appears, the question is not what new rules are needed, but where it sits in what you already do: how material, what it can affect, what independent check, what to monitorGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com A new capability agentic AI is the current example How material is it? What can it affect? What independent check applies? What do you monitor? not: what entirely new rules do we need? © Gary Ang · quaintitative.com
Place each new capability in what you already do, rather than writing a fresh framework for each wave.
Mapping to every framework multiplies the questions; a spine and a system hold as use cases grow Mapping to every framework multiplies the questions; a spine and a system hold as use cases growGary Ang© Gary Ang, Quaintitativehttps://quaintitative.com Mapping to every framework 100 use cases x 10 frameworks x 1,000 questions 1,000,000 QUESTIONS A durable spine 10 capabilities x 1 spine x 1 system SCALES AS YOU GROW © Gary Ang · quaintitative.com
A firm that governs to durable fundamentals absorbs new technology; one that rebuilds each wave falls behind.

The AIRG was finalised in October 2026 and comes into force in October 2027, phased, so there is time to build on the fundamentals rather than scramble.

Related on this site: the final AIRG, the transition timeline, AI risk management for boards, AI risk management for risk and compliance, and the AIRG compared with the EU AI Act, NIST and ISO 42001.

In ebooks: AI Risk Management for Directors and AI Risk Management for Risk and Compliance.

Want to go deeper?

IBF-accredited courses. The deep-dive and technical courses I designed and teach are IBF-accredited and listed on the IBF Programme Finder, delivered through the Association of Banks in Singapore and the Singapore College of Insurance: Banks (deep dive), Banks (technical) and Insurers (deep dive).

Courses I run directly. I also run courses in-house for a single firm now, and maybe as open cohorts one day, including AI Risk Oversight for the Second and Third Line, a technical hands-on day, and sessions for leaders and boards. See the courses.

After subsidies, the accredited courses come to roughly S$200 to S$300 a participant. Direct engagements, for cohorts of around 40, come to something similar per person.