Domain 3 | 38% of the AAISM ExaminationCHAPTER 3

AI Technologies and Controls

The two preceding chapters addressed the governance and risk dimensions of artificial intelligence — the structures of authority, accountability, and oversight, and the frameworks for identifying and managing the risks that AI systems introduce. This final domain, carrying the largest weight in the AAISM examination at thirty-eight percent, addresses the technical substance that underlies both: the nature of AI technologies themselves, the architectural and lifecycle disciplines required to deploy them securely, the data management and privacy controls that govern the information they consume, the ethical and safety mechanisms that shape their behaviour, and the monitoring and security operations that sustain their integrity in production.

The AAISM professional who has mastered Domain 1 and Domain 2 brings to this domain a crucial contextual advantage: they understand why each technical control matters, what governance structure authorises it, and what risk scenario it addresses. Technical knowledge divorced from governance context produces engineers who can implement controls; technical knowledge integrated with governance understanding produces security professionals who can design and justify them. This chapter aims to cultivate the latter.

📘Key Concepts
  • Domain 3 covers five sub-areas: (3A) AI Security Architecture and Design; (3B) AI Life Cycle; (3C) Data Management Controls; (3D) Privacy, Ethical, Trust, and Safety Controls; (3E) Security Controls and Monitoring.
  • At 38%, Domain 3 carries more weight than either of the other two domains. Breadth and technical depth are both required.
  • The candidate who understands AI model types, the AI lifecycle phases, and the security controls that apply at each phase will be well-equipped for a substantial portion of the examination.
  • Domain 3 questions frequently require the integration of technical knowledge with governance and risk reasoning — they test not just what a control is, but when and why to apply it.
PART A — Sub-Domain 3A

AI Security Architecture and Design

3.1 Understanding AI Types

Before designing secure AI systems, the AAISM professional must understand what they are securing. AI is not a monolithic technology — it encompasses a diverse spectrum of models, architectures, and capabilities, each with its own security profile, data requirements, and governance implications. This section surveys the principal categories of AI systems that the AAISM professional is likely to encounter.

3.1.1 AI by Functionality

When classified by what they do, AI systems fall into several broad functional categories. Reactive AI systems respond to specific inputs with specific outputs, without learning from experience or retaining memory between interactions — early chess computers and simple rule-based classifiers are examples. Limited memory AI systems can learn from historical data and use that learning to inform future decisions; most modern machine learning models, including the neural networks that power today's language models and image classifiers, fall into this category. Theory of mind AI — systems capable of modelling the mental states and intentions of other agents — remains largely aspirational; no fully operational system of this type exists at commercial scale. Self-aware AI — systems possessing genuine self-consciousness — remains entirely in the realm of hypothesis and is not a governance concern for the contemporary AAISM professional.

For practical governance purposes, the distinction between reactive and limited-memory AI is the most operationally significant. Reactive systems are more predictable — their behaviour is fully determined by their programming — while limited-memory systems introduce the possibility of unexpected behaviour arising from the patterns in their training data that their designers did not explicitly encode.

3.1.2 AI by Capability

When classified by the breadth of their capabilities, AI systems are conventionally grouped into three tiers. Narrow AI — also called weak AI — systems are designed to perform specific tasks within defined boundaries. They may perform these tasks with superhuman accuracy and speed, but they cannot transfer their capabilities to other domains. Every commercially deployed AI system today is narrow AI. General AI — also called artificial general intelligence or AGI — refers to systems that can perform any intellectual task that a human can, with comparable flexibility and adaptability across domains. AGI does not exist in current commercial form, though the boundaries of what narrow AI can achieve are expanding rapidly. Superintelligence refers to systems that would surpass human cognitive capabilities across all domains simultaneously. This remains a topic of academic and philosophical debate rather than an immediate governance concern.

The significance of this taxonomy for the AAISM professional lies in its relationship to risk scope. A narrow AI system's failure modes are bounded by the tasks it was designed to perform. As AI systems become more general in their capabilities — as language models, for example, are deployed as agents capable of browsing the web, writing and executing code, managing files, and communicating on behalf of users — the scope of potential failure modes expands dramatically, and the governance challenge intensifies correspondingly.

3.1.3 Generative Models and Agentic AI

Generative AI models — systems that produce new content (text, images, audio, video, code, or structured data) from a statistical model of existing content — represent the most significant recent development in the commercial AI landscape. Large language models (LLMs), diffusion models for image generation, and multimodal models that process and generate across content types all fall into this category.

Generative models introduce a distinctive security profile. Unlike discriminative models that classify or predict based on inputs, generative models produce open-ended outputs whose content, accuracy, and appropriateness cannot be fully controlled through input specification alone. Prompt injection attacks, hallucination, and the generation of harmful or biased content are security risks specific to or particularly severe in generative models. The governance controls applied to generative AI — input validation, output filtering, content moderation, human oversight, and rigorous testing — must be calibrated to these specific characteristics.

Agentic AI refers to AI systems that can take sequences of actions in pursuit of goals — browsing the web, executing code, sending messages, querying databases — with a degree of autonomy that conventional AI systems do not possess. Agentic AI dramatically expands the AI attack surface: a compromised or manipulated agentic system can cause harm not merely through its outputs but through its actions in the world. The principle of least privilege, human-in-the-loop oversight, and careful action scope definition are essential governance requirements for agentic AI deployments.

3.1.4 Predictive Models

Predictive AI models — systems trained to forecast future states or classify present states based on historical patterns — are the workhorses of enterprise AI. Fraud detection, credit scoring, predictive maintenance, medical diagnosis, demand forecasting, and recommendation systems all rely on predictive models. Their governance profile is generally more tractable than that of generative models: their outputs are bounded (a classification, a probability, a numerical prediction), and the criteria for evaluating their performance are well-established.

The primary governance risks for predictive models are bias (systematic errors that disadvantage particular groups), drift (performance degradation as real-world conditions diverge from training conditions), and opacity (difficulty explaining why the model reached a specific prediction). These risks, addressed in the governance and risk chapters, manifest in the technical domain as design choices about model architecture, training data management, and monitoring infrastructure.

3.1.5 Machine Learning Model Types

Machine learning — the field of AI in which systems learn from data rather than being explicitly programmed — encompasses several distinct learning paradigms, each with specific security and governance implications.

Learning Type Description and Security Considerations
Supervised Learning The model is trained on labelled data — input-output pairs where the correct answer is known. The model learns to map inputs to outputs by minimising the difference between its predictions and the known correct answers. Examples: image classifiers, spam filters, credit scoring models. Security note: heavily dependent on the integrity of training labels; mislabelled or adversarially manipulated labels can corrupt model behaviour.
Unsupervised Learning The model is trained on unlabelled data and learns to identify structure, patterns, or clusters without guidance about correct answers. Examples: anomaly detection, customer segmentation, topic modelling. Security note: particularly useful for detecting novel threats (no labels required), but outputs require careful interpretation — the model learns whatever patterns exist in the data, including spurious or socially undesirable ones.
Reinforcement Learning The model learns by interacting with an environment, receiving rewards for desirable actions and penalties for undesirable ones, and optimising its behaviour over time to maximise cumulative reward. Examples: game-playing AI, robotic control, algorithmic trading. Security note: the reward function must be designed with extreme care — a model that learns to optimise a poorly designed reward function may develop unexpected, harmful, or manipulative strategies.
Neural Networks A family of models loosely inspired by the structure of biological neural networks, consisting of layers of interconnected mathematical units (neurons) whose weights are adjusted during training. Deep neural networks — those with many layers — underlie most state-of-the-art AI systems. Security note: their opacity (the difficulty of understanding why a specific output was produced) is a fundamental governance challenge, creating explainability requirements and audit difficulties.
Federated Learning A distributed learning approach in which multiple parties train a shared model on their local data, sharing only model updates (not raw data) with a central aggregator. Used to build AI models across distributed data sources while preserving data privacy. Security note: federated learning is vulnerable to Byzantine attacks, where a malicious participant sends poisoned model updates; secure aggregation protocols are required to mitigate this risk.

3.1.6 Algorithms and Classes

The algorithm is the mathematical procedure that specifies how a model learns from data and generates predictions. Different algorithm classes are suited to different problem types and carry different security and interpretability properties. Decision trees and their ensemble variants (random forests, gradient boosted trees) are highly interpretable — the decision path for any prediction can be inspected step by step — and are therefore well-suited to high-stakes applications where explainability is required. Linear models are similarly interpretable but less expressive. Deep learning models — convolutional neural networks, transformer architectures, recurrent networks — are highly expressive but significantly less interpretable, creating explainability challenges in regulated domains.

The AAISM professional must understand that algorithm selection is not merely a technical decision — it is a governance decision. Choosing an interpretable algorithm over a more accurate but opaque one may be the appropriate governance choice in a domain where the right to an explanation is legally mandated or where human oversight depends on understanding the model's reasoning. The best model from a pure performance perspective is not always the best model from a governance perspective.

3.2 AI Security Architecture and Design

Architectural decisions made early in the AI system design process have profound and long-lasting consequences for security, privacy, compliance, and maintainability. The principle of secure by design — incorporating security requirements into the system's architecture from the outset rather than bolting them on after deployment — is as applicable to AI systems as to conventional software, and in some respects more demanding.

3.2.1 Secure by Design Principles for AI

Secure-by-design AI architecture begins with a structured threat model — a systematic analysis of the AI system's attack surface before any code is written. This threat model identifies: the actors who might seek to compromise the system; the assets they might target (training data, model weights, inference endpoints, output data, the infrastructure hosting the system); the attack techniques available to them; and the controls that would reduce the likelihood or impact of each identified threat. The threat model is not a one-time document — it must be revisited as the system evolves and as new attack techniques are discovered.

Key architectural principles for secure AI include: minimal data collection (collect only the data necessary for the intended purpose); data isolation (segregate training data, validation data, and production inference data to limit the blast radius of a compromise); defence-in-depth (layer multiple controls so that no single failure exposes the system to catastrophic harm); fail-safe defaults (design the system to default to the least harmful state when errors or anomalies occur); and auditability (design systems so that every significant inference decision can be reconstructed and reviewed after the fact).

3.2.2 Data Dependency and Storage

AI systems are fundamentally dependent on data — not merely for training, but for ongoing operation. A model's performance is contingent on the quality, currency, and relevance of the data it was trained on, and in many architectures, it is also contingent on the data provided at inference time (through retrieval-augmented generation, for example, or through feature engineering pipelines that draw on live data sources). This dependency creates security requirements that extend far beyond the model itself.

Data storage for AI must be designed to protect both training datasets and production data pipelines from unauthorised access, tampering, and exfiltration. Training datasets — which may contain sensitive personal information, proprietary business data, or strategically valuable information — require encryption at rest, strict access controls, and audit logging of all access events. Data pipelines that feed AI inference systems require integrity checks to detect tampering, anomaly detection to identify unexpected changes in data distribution, and fallback mechanisms for cases where pipeline failures or data quality issues threaten model performance.

3.2.3 Configuration Management

Configuration management — the disciplined control of the configurations of AI system components, including model hyperparameters, preprocessing pipelines, integration settings, and deployment parameters — is a critical security control that is often underinvestigated in AI security assessments. A misconfigured AI system may expose sensitive model parameters, apply inappropriate security controls, or fail to enforce required data handling restrictions.

AI configuration management must address: version control of model configurations alongside model weights; validation that deployed configurations match approved baselines; audit trails documenting who changed what configuration, when, and why; and change management processes that require approval before production configuration changes are applied. These requirements apply to all AI system components, including the increasingly complex configurations of cloud-hosted AI services and foundation model APIs.

3.2.4 AI Model Selection and Change Management

The selection of an AI model — the choice of architecture, training approach, and foundation model — is a governance decision with security implications that must be documented and justified. Model selection criteria should include not only performance metrics but security properties: is the model interpretable? Has it been evaluated for adversarial robustness? Does its architecture support differential privacy? What is its data provenance, and have the training data sources been assessed for bias and compliance?

AI change management governs modifications to deployed AI systems — including model updates, retraining, fine-tuning, and architectural changes. Changes to production AI systems carry unique risks: a model update that improves overall accuracy may simultaneously introduce new biases, reduce robustness to specific input patterns, or change the system's behaviour in ways that affect regulatory compliance. Change management for AI must therefore include testing requirements that go beyond conventional regression testing — specifically covering fairness assessments, adversarial robustness tests, and compliance validation — before any change is approved for production deployment.

Emergency changes — modifications required urgently in response to a security incident, a critical performance failure, or a regulatory directive — present special governance challenges. The pressure for rapid deployment must be balanced against the need for adequate testing. AI change management procedures should define criteria for emergency changes, specify the minimum testing required even under time pressure, require post-emergency review of all emergency changes, and establish rollback procedures that can be executed rapidly if an emergency change produces unintended consequences.

📘Key Concepts
  • AI Types by Capability: Narrow (task-specific, all current commercial AI), General (aspirational), Superintelligent (hypothetical). Governance scope expands as AI capability broadens.
  • Generative vs. Predictive AI: Generative models produce open-ended outputs requiring specific controls (input validation, output filtering, hallucination mitigation). Predictive models have bounded outputs but face bias and drift risks.
  • Agentic AI: AI that takes sequences of real-world actions — least privilege, HITL oversight, and action scope definition are essential governance requirements.
  • Supervised/Unsupervised/Reinforcement Learning: Each learning paradigm has a distinct security profile. Supervised learning is vulnerable to label manipulation; RL is vulnerable to reward function exploitation.
  • Secure by Design: Threat model before deployment, minimal data collection, data isolation, defence-in-depth, fail-safe defaults, auditability.
  • AI Change Management: Every production AI change requires testing for performance, fairness, robustness, and compliance — not just accuracy.
PART B — Sub-Domain 3B

The AI Life Cycle

3.3 The AI Life Cycle: Security at Every Phase

An AI system is not a static artefact. It is born through a development process, deployed into a changing environment, operated and monitored over time, and eventually retired. Security and governance must be embedded at every phase of this life cycle — because a failure at any phase can compromise the security of the entire system, and because the risks that apply at each phase are qualitatively different.

The AAISM examination tests not only knowledge of what the phases are, but understanding of the specific security activities, risks, and controls that are appropriate at each. The following treatment addresses each life cycle phase in turn.

Life Cycle Phase Security Activities and Priority
Phase 1: Plan and Design Define the AI system's purpose, scope, and success criteria. Conduct a security and privacy risk assessment. Perform threat modelling specific to the proposed architecture. Establish data governance requirements. Assess regulatory compliance obligations. Define fairness and explainability requirements. Security priority: FIRST opportunity to eliminate risks by design — the cheapest phase at which to address security requirements.
Phase 2: Collect and Process Data Identify, collect, and prepare training data. Validate data quality, provenance, and compliance with applicable data protection laws. Apply data classification and labelling. Detect and address bias in collected data. Implement data pipeline security controls. Security priority: data poisoning prevention; consent and legal basis validation; data lineage documentation. The preparation phase is frequently identified as the AI lifecycle phase with the greatest inherent risk.
Phase 3: Build and/or Adapt Model(s) Select model architecture. Train the model on prepared data. Fine-tune or adapt pre-trained foundation models. Apply privacy-preserving techniques (differential privacy, federated learning). Conduct initial security assessments of the model and training infrastructure. Security priority: protecting the training environment from compromise; validating the integrity of pre-trained models; applying security-by-design principles to the model architecture.
Phase 4: Test, Evaluate, Verify, and Validate Evaluate model performance against test data. Assess fairness across demographic groups. Test for adversarial robustness. Conduct red-team exercises. Validate compliance with regulatory requirements. Verify that model documentation (model cards, conformity assessment documentation) is complete and accurate. The most critical step before deployment. Security priority: comprehensive security testing that goes beyond conventional performance metrics to include bias, robustness, and compliance assessment.
Phase 5: Deploy Make the model available for use in the production environment. Implement access controls on model endpoints. Configure monitoring and alerting. Establish rollback procedures. Conduct final security review and obtain governance approval. Security priority: ensuring the deployed configuration matches the tested and approved configuration; establishing the operational security baseline against which subsequent monitoring will compare.
Phase 6: Operate and Monitor Run the AI system in production, serving inference requests. Monitor performance metrics, fairness indicators, and security signals continuously. Detect and respond to drift, adversarial inputs, and anomalous behaviour. Execute the change management process for any modifications. Security priority: continuous drift detection; incident response readiness; maintaining awareness of evolving threat intelligence relevant to the deployed AI system.
Phase 7: Retire/Decommission Withdraw the AI system from production when it is no longer needed, when it can no longer be maintained securely, or when a replacement is available. Securely dispose of training data, model weights, and documentation in accordance with data retention policies and regulatory requirements. Conduct a post-retirement review to capture lessons learned. Security priority: ensuring complete and verifiable disposal of sensitive data; maintaining required documentation for the regulatory retention period; communicating decommissioning to all relevant stakeholders.
💡Food for Thought
  • The most important security investment in the AI lifecycle is made before a single line of model code is written. The Plan and Design phase determines the system's fundamental architecture, and architectural security gaps are orders of magnitude more expensive to address after deployment than before. Yet this is often the phase where security professionals have the least involvement — precisely when their contribution would be most valuable.
  • Consider the parallel with the Islamic principle of istidraj — the gradual and imperceptible movement toward a harmful state that one fails to recognise until significant harm has occurred. AI drift represents a technological form of this pattern: performance degrades so gradually, and model outputs remain superficially plausible for so long, that the deterioration is not recognised until significant harm has already been caused. The governance response is not merely a detection mechanism but a culture of continuous, structured interrogation of AI system performance.
  • Decommissioning is the most neglected phase of the AI lifecycle. When an AI system is retired, what happens to the personal data in its training set? To the model weights that implicitly encode that data? To the fine-tuning data that may contain proprietary business information? These are not hypothetical concerns — they have been the subject of regulatory enforcement action and litigation. Decommissioning governance must be planned before deployment, not after.
🎯Exam Tip
  • The AAISM examination frequently asks which lifecycle phase presents the greatest inherent security risk. The answer is almost always the Data Collection and Preparation phase — it is where training data is most vulnerable to poisoning, where consent and legal basis requirements must be satisfied, and where data quality problems that will propagate through the entire lifecycle are introduced.
  • Questions about 'the most important step before placing an AI system into production' should direct you to Phase 4: Test, Evaluate, Verify, and Validate — specifically adversarial testing, fairness assessment, and compliance validation.
  • For decommissioning questions: receiving and archiving a certificate of data destruction is the best evidence of compliant disposal. Post-destruction risk assessments and audit reviews are important but secondary.
PART C — Sub-Domain 3C

Data Management Controls

3.4 Data Governance Controls

Data is the essential substrate of AI — its quality, integrity, and lawfulness determine the character of every AI system built upon it. Data governance for AI is the structured application of policies, processes, and controls across the entire data lifecycle — from acquisition through disposal — to ensure that data used in AI systems meets applicable standards of quality, security, privacy, and compliance.

3.4.1 Data Acquisition

The security of an AI system's data begins at the point of acquisition — the collection, purchasing, or scraping of data that will form its training corpus. Data acquisition governance requires: verifying that the organisation has a valid legal basis for each category of data it collects (particularly personal data, which requires a lawful basis under GDPR and comparable legislation); assessing the provenance of purchased or licensed datasets for compliance with applicable data protection laws; evaluating the terms of use of publicly available datasets for restrictions on commercial AI use; and documenting the acquisition source, legal basis, and relevant consent mechanisms for every dataset in the AI training inventory.

3.4.2 Data Organisation and Preparation

Raw data collected for AI training is rarely ready for immediate use. Data preparation — the process of cleaning, normalising, structuring, labelling, and splitting data into training, validation, and test sets — introduces both opportunities and risks. Security controls at this phase include: validation checks that detect anomalies, outliers, or suspicious patterns that might indicate data poisoning; integrity checksums applied to datasets before and after preparation to detect unauthorised modification; access controls on preparation environments that limit who can modify training data; and audit logs recording all preparation operations and the personnel who performed them.

Data labelling — the process of annotating training data with the correct answers that the model will learn to predict — is a particularly sensitive preparation activity. Labelling errors, whether accidental or deliberate, directly determine model behaviour. Governance of the labelling process should include: quality checks and inter-rater reliability assessments for manual labelling; documentation of labelling guidelines and their versions; and security controls on labelling systems and the personnel with access to them.

3.4.3 Data Utilisation, Storage, and Retention

Once prepared, training data must be stored securely and used only for its approved purposes. Storage security controls for AI training data include encryption at rest using appropriate algorithms (AES-256 or equivalent); strict role-based access control that limits access to approved personnel with documented need; and network isolation of storage systems from the public internet where operationally feasible.

Data retention schedules for AI training data must account for both data protection obligations (which often require deletion of personal data when no longer needed) and AI-specific requirements (which may require retaining training data to enable model auditing, retraining, or regulatory inspection). Where these obligations conflict — a regulator requiring audit retention while a data protection authority requires deletion — the conflict must be escalated to legal counsel and senior management for resolution, and the resolution documented.

Data destruction must be documented and verifiable. When AI training data reaches the end of its approved retention period, it must be destroyed in a manner appropriate to the sensitivity of the data and the storage medium. For highly sensitive data, simple deletion is insufficient — cryptographic erasure or physical destruction may be required. A certificate of destruction, archived in accordance with the organisation's record retention policies, provides the evidentiary basis for demonstrating compliance with destruction requirements.

3.5 Data Security Controls

Data security controls protect the confidentiality, integrity, and availability of data used in AI systems. They apply across all phases of the AI lifecycle and must be tailored to the specific characteristics of AI data — which is often large in volume, complex in structure, and sensitive in content.

Control Description and Implementation Guidance
Data Encoding / Encryption Encrypt data at rest (training datasets, model weights, inference logs) and in transit (between data sources, training environments, and inference endpoints). Apply tokenisation or pseudonymisation to personal data used in AI training where technically feasible. Use encryption key management practices that prevent unauthorised access to encryption keys.
Data Access Controls Implement role-based access control to training datasets, models, and inference systems. Apply the principle of least privilege — each user, process, and system receives only the access required for its specific function. Conduct periodic access reviews to identify and remove unnecessary access rights.
Data Confidentiality and Siloing Segregate data by classification level and AI use case. Prevent cross-contamination between training data for different models, particularly where models have different sensitivity levels or regulatory constraints. Use containerisation, siloing, or sandboxing to prevent AI systems from accessing data beyond their approved scope.
Data Backup Maintain secure backups of AI training data and model artefacts. Ensure backup systems are tested regularly to confirm that training datasets and model weights can be restored within recovery time objectives. Include AI system data in the organisation's disaster recovery planning and testing.
Data Integrity Apply cryptographic integrity controls (checksums, digital signatures) to training datasets and model weights to detect unauthorised modification. Implement anomaly detection in data pipelines to identify unexpected changes in data distribution that might indicate tampering or supply chain compromise.
PART D — Sub-Domain 3D

Privacy, Ethical, Trust, and Safety Controls

3.6 Privacy Controls for AI

Privacy is not merely a legal obligation — it is a fundamental dimension of trustworthy AI. AI systems that violate the privacy of the individuals whose data they process undermine the trust upon which their social licence to operate depends. Privacy controls for AI must be designed and implemented with an understanding of the specific privacy risks that AI creates, which go beyond those of conventional data processing.

3.6.1 Privacy-by-Design for AI Systems

Privacy-by-design requires that privacy protections be built into the AI system's architecture from the outset, rather than added as an afterthought. For AI systems, privacy-by-design encompasses: data minimisation (collect and use only the personal data strictly necessary for the intended AI application); purpose limitation (do not use personal data collected for one AI purpose for a different AI purpose without fresh legal authority); retention minimisation (delete personal data from AI training datasets as soon as the retention obligation has been satisfied); and subject rights support (design AI systems to be capable of responding to data subject access requests, erasure requests, and requests for human review of automated decisions).

Technical privacy controls specifically relevant to AI include: differential privacy (adding calibrated mathematical noise to model outputs or training processes to prevent inference of individual data points); federated learning (training models without centralising raw personal data); data anonymisation and pseudonymisation (removing or obscuring identifying information before use in AI training); and output filtering (preventing AI systems from reproducing verbatim personal information from training data in their outputs).

3.6.2 The Right to Human Review of Automated Decisions

One of the most significant privacy and human rights provisions applicable to AI is the right, embedded in Article 22 of GDPR and analogous provisions in other data protection frameworks, not to be subject to solely automated decisions that produce significant legal or similarly significant effects — without the opportunity for human review. This provision applies directly to many enterprise AI deployments: credit scoring, insurance pricing, hiring screening, and benefits eligibility determination are all domains where AI-influenced decisions can have significant legal or practical effects on individuals.

Compliance with this requirement demands that the AI security programme establish: a process for identifying which AI-influenced decisions meet the threshold for significant effect; mechanisms for providing individuals with a meaningful explanation of automated decisions affecting them; and a documented, auditable process for human review of such decisions upon request. These are not merely legal compliance requirements — they are governance mechanisms that ensure human accountability is maintained in consequential AI decision-making.

3.7 Ethical Frameworks and Trust Mechanisms

Ethics in the technical domain of AI is not abstract philosophy — it is the practical discipline of designing systems that behave in accordance with stated values, treating all affected individuals fairly, and maintaining the conditions of trust that allow AI systems to remain socially legitimate.

An ethical AI framework at the technical level encompasses: bias detection and mitigation tools that identify and address disparate impacts before deployment; explainability mechanisms that provide stakeholders with meaningful accounts of AI decisions; fairness metrics that measure and monitor the degree to which AI outputs treat comparable individuals comparably; and impact assessment processes that evaluate the broader social consequences of AI system deployment before they are authorised. The choice of which fairness metric to optimise — equal accuracy, equal false positive rates, demographic parity — is itself a governance decision that must be made with the active involvement of affected stakeholders and documented for regulatory scrutiny.

Trust in AI systems is built through consistent, transparent, and accountable operation over time. Technical trust mechanisms include: model confidence scores that convey the system's uncertainty to users; audit logs that provide a complete, tamper-evident record of AI system decisions; model documentation (model cards, datasheets) that communicate system properties to users and regulators; and external audit and certification processes that provide independent verification of the system's claimed properties. Trust, once lost through a significant AI failure or disclosure of harmful practices, is extraordinarily difficult to rebuild — the governance imperative is to establish and maintain trust through institutional commitment, not merely to manage its loss after the fact.

3.8 Safety Controls and Human-in-the-Loop

Safety in AI refers to the system's ability to operate within acceptable behavioural bounds — not causing unintended harm, not being susceptible to manipulation, and not generating outputs that endanger human welfare. Safety controls are the technical and procedural mechanisms that maintain these bounds in the face of unpredictable inputs, evolving conditions, and adversarial attempts at manipulation.

3.8.1 Human-in-the-Loop (HITL)

Human-in-the-loop (HITL) is the governance and safety principle that meaningful human judgement must be maintained in AI-assisted decision-making processes, particularly for decisions with significant consequences for individuals or organisations. HITL is not a binary property — it exists on a spectrum from full human control (AI provides information only, human makes all decisions) through human-on-the-loop (AI acts autonomously but human monitors and can intervene) to full automation (AI acts autonomously with no human oversight).

The appropriate position on this spectrum depends on: the severity of potential harm from AI errors; the reversibility of AI-initiated actions; the speed at which decisions must be made; and the availability and capability of qualified human reviewers. As AI systems become more capable, the temptation to move toward full automation increases — but governance must ensure that this movement is deliberate, documented, and tested, not a gradual drift driven by convenience or cost-cutting. The EU AI Act's human oversight requirements for high-risk AI systems reflect a regulatory judgement that in certain consequential domains, full automation is not permissible regardless of AI system performance.

Implementing effective HITL requires: clear criteria defining which AI outputs or decision thresholds require human review; user interfaces that present AI outputs and their confidence levels in a way that supports meaningful human judgement rather than encouraging rubber-stamping; accountability mechanisms that record the human reviewer's identity, decision, and rationale; and feedback loops that route human corrections back into the AI improvement process. A HITL process in which human reviewers automatically approve AI recommendations without genuine engagement is not a safety control — it is theatre.

📘Key Concepts
  • Privacy-by-Design: Data minimisation, purpose limitation, retention minimisation, and subject rights support — built into AI architecture from the outset.
  • Differential Privacy: A mathematical technique that adds calibrated noise to model outputs or training to prevent inference of individual data points — the primary technical mitigation for model inversion and membership inference.
  • Right to Human Review: Under GDPR Article 22 and similar provisions, individuals have the right to challenge significant automated decisions and obtain human review. AI systems making such decisions must support this right.
  • Ethical Frameworks: Bias detection, explainability mechanisms, fairness metrics, and impact assessments — governance disciplines that require technical implementation.
  • HITL Spectrum: Full human control, human-on-the-loop, full automation. Governance must determine the appropriate position based on harm severity, reversibility, and speed requirements.
  • Safety Controls: The technical and procedural mechanisms that keep AI system behaviour within acceptable bounds — including HITL, output filtering, content moderation, and adversarial robustness measures.
PART E — Sub-Domain 3E

Security Controls and Monitoring

3.9 AI Security Controls

The final sub-domain of the AAISM examination brings together the full range of security controls that protect AI systems in operation — from the frameworks that guide control selection, through access controls and zero trust architecture, to the operational disciplines of AI auditing, shadow AI management, and incident response. It also addresses the ongoing monitoring capabilities that sustain security awareness across the AI lifecycle.

3.9.1 AI-Assisted Security and Monitoring Tools

AI is transforming security operations at the same time that it is introducing new categories of risk. AI-powered Security Information and Event Management (SIEM) systems, User and Entity Behaviour Analytics (UEBA) platforms, and automated threat detection tools are now integral components of enterprise security architectures. Their most effective use case in the Security Operations Centre is detecting subtle, low-signal attack patterns that human analysts would miss or that would be buried in alert volume — reducing false negatives in threat detection by surfacing anomalies that conventional rule-based systems would not flag.

The governance of AI-powered security tools requires the same rigour applied to any other AI deployment: what data does the tool train on? How are its alerts validated? What is the human oversight mechanism? And critically, how does the tool perform when the attacker is also using AI to evade detection? The use of AI security tools does not eliminate the need for human judgement in security operations — it changes the nature of the human analyst's role from alert triage toward oversight, exception management, and strategic threat analysis.

3.9.2 AI Security Control Frameworks

Several specialised AI security control frameworks have emerged to supplement general cybersecurity frameworks (such as NIST CSF, ISO 27001, and CIS Controls) with AI-specific guidance. The OWASP Top 10 for Large Language Model Applications provides a curated list of the most critical security risks in LLM deployments — including prompt injection, insecure output handling, training data poisoning, model theft, and excessive agency — with corresponding mitigation guidance. The MITRE ATLAS (Adversarial Threat Landscape for Artificial Intelligence Systems) framework catalogues adversarial machine learning tactics and techniques in a structure analogous to MITRE ATT&CK for conventional cybersecurity, enabling AI security teams to map their defences against a structured threat taxonomy. These frameworks should be used in conjunction with AI threat models developed for specific deployments — they provide the vocabulary and taxonomy for threat analysis, but cannot substitute for context-specific assessment.

3.9.3 Access Controls for AI Systems

Access control for AI systems must address a broader attack surface than conventional applications. The access control requirements span: access to training data repositories; access to model weights and hyperparameters; access to model inference endpoints (both internal and external); access to monitoring systems and logs; access to AI development and MLOps platforms; and access to the cloud infrastructure hosting AI components. The principle of least privilege applies at each layer — each user, service account, and automated process should have only the access required for its specific function.

Role-based access control (RBAC) should define distinct roles for AI developers, data scientists, model validators, security reviewers, operations staff, and business users — with access rights calibrated to each role's operational requirements. Privileged access management (PAM) controls should apply to administrative access to AI infrastructure, requiring strong authentication, session recording, and just-in-time access provisioning.

3.9.4 Zero Trust Architecture for AI

Zero Trust Architecture (ZTA) — the security model that assumes no implicit trust for any entity inside or outside the network perimeter, and requires continuous verification of identity, device health, and authorisation for every access request — is particularly relevant to AI deployments, which often span multiple cloud environments, involve numerous external data sources, and are accessed by a diverse range of users and automated processes.

Applying Zero Trust to AI means: requiring strong authentication for all access to AI components, including internal service-to-service communications; implementing microsegmentation to isolate AI components from each other and from non-AI systems; applying continuous verification of the integrity of AI infrastructure and configurations; and monitoring all traffic between AI components for anomalies that might indicate compromise. The Zero Trust model is especially important for agentic AI systems, which may initiate connections to external systems — all such connections should be subject to the same continuous verification requirements as human-initiated access.

3.9.5 AI Acceptable Use Policy Enforcement

The technical enforcement of the AI Acceptable Use Policy — established in governance — requires technical controls that prevent, detect, or respond to policy violations. Technical enforcement mechanisms include: Data Loss Prevention (DLP) tools configured to detect and block the entry of sensitive data categories into AI systems; content filtering on AI outputs to prevent the disclosure of confidential or personally identifiable information; activity monitoring and logging that creates an audit trail of AI tool usage by employees; and automated alerting when usage patterns deviate from policy-defined norms (for example, an employee entering unusually large volumes of data into a generative AI platform).

3.9.6 AI Audits, Traceability, and Supply Chain Controls

Audit and traceability requirements for AI systems demand that every significant inference decision be reproducible — that a reviewer can reconstruct, for any given output, the inputs provided, the model version and configuration used, and the outputs produced. This requires logging infrastructure designed specifically for AI audit purposes, not merely general-purpose application logs. AI audit logs should capture: the model version and configuration hash; input data and its provenance; the output produced and its confidence score; the timestamp and user or process identifier; and any human review actions taken on the output.

Supply chain security controls for AI — addressed in detail in Chapter 2 — have a technical implementation layer that includes: software bill of materials (SBOMs) for AI systems that document all third-party components; cryptographic signing of model releases to enable integrity verification; and automated scanning of AI dependencies for known vulnerabilities. These technical controls complement the governance-level supply chain risk management addressed in Domain 2.

3.9.7 Shadow AI Detection and Management

Shadow AI — the use of AI tools that have not been formally reviewed or approved by the organisation — represents one of the most prevalent and consequential security gaps in enterprise AI governance. Employees and business units adopt AI tools for legitimate productivity reasons, without awareness of the data protection, security, or compliance implications. The result is an uncontrolled proliferation of AI deployments that the organisation cannot monitor, govern, or secure.

Technical approaches to shadow AI detection include: network monitoring for traffic to known AI platform endpoints (OpenAI, Anthropic, Google AI, Hugging Face, and others); endpoint monitoring for AI tool installation and usage; analysis of cloud expenditure for AI service charges not associated with approved deployments; and security scanning of browser extensions, which are a common vector for shadow AI adoption. Detection is necessary but insufficient — the governance response to detected shadow AI must include: risk assessment of the specific tool and its use context; engagement with the employees or business units involved to understand their needs; and a governance decision about whether to approve, remediate, or prohibit the use, based on that assessment.

3.9.8 AI Incident Management

AI incidents — events that compromise the security, performance, fairness, or regulatory compliance of an AI system — require a specialised incident management process that extends conventional cybersecurity incident response. The distinctive characteristics of AI incidents require adaptations at every stage of the incident lifecycle: detection (AI-specific monitoring for drift, adversarial inputs, and output anomalies, in addition to conventional security signals); classification (AI incidents may span security, performance, and fairness dimensions simultaneously); investigation (root cause analysis of AI incidents requires data science expertise as well as security expertise); containment (options may include model rollback, endpoint isolation, or routing decisions to human review); and post-incident review (AI incidents should trigger assessment of model documentation, monitoring coverage, and change management processes, not merely security controls).

3.10 AI Security Awareness Training and Skills Development

The security of AI systems depends not only on technical controls but on the awareness, skills, and judgement of the people who develop, deploy, operate, and use them. AI security awareness training is a distinct discipline from general cybersecurity awareness, because AI introduces risks — hallucination, data leakage through AI tools, prompt injection, over-reliance on AI outputs — that conventional security awareness training does not address.

Effective AI security awareness training addresses different content for different audiences. For general employees: what AI tools are approved for use; what data may not be entered into AI systems; how to identify and report AI-related security concerns; and the specific risks of using unapproved AI tools (shadow AI). For AI developers and data scientists: secure coding and design practices for AI systems; adversarial robustness requirements; data governance obligations; and model documentation standards. For security operations personnel: AI-specific threat detection techniques; how to investigate and respond to AI incidents; and how to apply AI threat intelligence to defensive operations. For executive and governance personnel: the strategic risk and opportunity landscape of AI; regulatory obligations; and the governance decisions they are accountable for.

3.10.1 Addressing AI Skills Gaps

The AI skills gap — the difference between the AI-specific security competencies that the organisation requires and those currently held by its security team — is a governance risk that must be actively managed. Skills gaps create blind spots: attack techniques that the team does not understand cannot be defended against; governance requirements that the team does not know about cannot be satisfied. Addressing AI skills gaps requires: a structured assessment of current team competencies against required competencies; a prioritised training and development plan; recruitment strategies targeted at AI security expertise; and knowledge-sharing mechanisms that distribute AI security expertise across the team rather than concentrating it in a few individuals who represent single points of failure.

Cross-functional AI security teams — integrating data scientists, security engineers, legal and compliance professionals, and business stakeholders — can partially address skills gaps by combining complementary expertise. A security engineer who does not understand machine learning working alongside a data scientist who does not understand adversarial attack techniques can together provide coverage that neither could provide alone. Governance must create the structural conditions — shared responsibilities, collaborative processes, joint training opportunities — that enable this cross-functional integration to function effectively.

3.11 Continuous Monitoring: Drift, Threat Intelligence, and Security Metrics

3.11.1 Model Drift Detection

Model drift — the degradation of AI system performance as real-world conditions diverge from the training data distribution — is the most pervasive ongoing security and governance challenge in AI operations. Drift detection requires establishing a baseline of expected model performance at deployment and continuously monitoring production performance against that baseline. There are two principal categories of drift: data drift (changes in the statistical distribution of inputs the model receives) and concept drift (changes in the relationship between inputs and correct outputs, even if the input distribution remains stable).

Technical approaches to drift detection include: statistical monitoring of input feature distributions against training distribution baselines; performance monitoring using proxy metrics when ground-truth labels are not immediately available; reference dataset comparison, where production inputs are periodically compared to training data; and shadow model testing, where a newer model is run in parallel with the production model to identify divergences. Governance must establish drift thresholds — the degree of deviation from baseline that triggers review, retraining, or replacement — and ensure that these thresholds are set in consultation with the business stakeholders who understand the operational consequences of model performance degradation.

3.11.2 Threat Intelligence for AI

AI-specific threat intelligence — information about emerging attack techniques, newly discovered vulnerabilities in AI frameworks, and adversary campaigns targeting AI systems — is an essential input to the AI security monitoring function. Threat intelligence sources relevant to AI include: research publications from academic institutions and AI security organisations (Google Project Zero, Trail of Bits, Robust Intelligence); disclosures from AI platform vendors about vulnerabilities in their systems; CVE databases for AI libraries and frameworks (TensorFlow, PyTorch, Hugging Face Transformers); and specialised AI security communities and information-sharing groups.

Operationalising AI threat intelligence requires: ingestion into the security monitoring platform with AI-specific threat indicators; mapping of threat intelligence to the organisation's specific AI deployments to assess relevance; integration with change management and control review processes so that new threat intelligence triggers timely reassessment of existing controls; and alert enrichment that provides security analysts with AI-specific context when investigating incidents that match AI threat patterns.

3.11.3 Security Metrics for AI

Meaningful security metrics for AI systems provide the governance body, the CISO, and the AI security programme manager with the quantitative basis for assessing programme effectiveness, identifying trends, and making informed resource allocation decisions. The following categories of AI-specific security metrics represent a balanced scorecard for the AI security programme.

Metric Category Description and Governance Relevance
Model Performance Metrics Accuracy, precision, recall, F1 score — measured against current production data, not just test data. Deviations from deployment-time baselines signal potential drift or compromise. Error rate and bias metrics (false positive/negative rates across demographic groups) should be reported alongside overall accuracy.
Drift and Stability Metrics Rate of drift across deployed AI models. Time since last model validation. Number of models flagged for performance degradation. These metrics provide early warning of the need for retraining or replacement before harm occurs.
Security Coverage Metrics Percentage of AI systems with current threat models. Percentage of AI systems with deployed monitoring. Percentage of AI inventory items with current security assessments. Coverage gaps represent governance blind spots.
Incident Metrics Number of AI-related security incidents by category and severity. Mean time to detect (MTTD) and mean time to respond (MTTR) for AI incidents. Incidents originating from supply chain, shadow AI, or prompt injection provide intelligence about the threat vectors most actively exploiting AI vulnerabilities.
Compliance Metrics Percentage of AI systems with complete and current governance documentation. Number of AI systems with outstanding regulatory compliance gaps. Audit findings related to AI governance. These metrics demonstrate programme accountability to regulators and the governing body.
Training and Awareness Metrics Percentage of relevant staff who have completed AI security awareness training. Number of AI-related policy violations reported. These metrics assess the human dimension of the AI security programme.
🎯Exam Tip
  • The most effective use of AI in a Security Operations Centre is detecting subtle attack patterns that would otherwise be missed — reducing false negatives, not simply reducing analyst workload. When an exam question asks about the best use of AI-enabled security tools in a SOC, look for options that emphasise detection quality over automation of routine tasks.
  • Zero Trust applied to AI means no implicit trust for any entity — including internal AI services communicating with each other. Every access request requires verification. This is especially important for agentic AI systems that initiate connections to external systems.
  • Shadow AI questions typically test what to do AFTER discovery. The answer is not immediate prohibition — it is assessment first (risk assessment, understanding the business need), then an informed governance decision. Immediate prohibition without assessment can drive AI use further underground.
  • For decommissioning: the BEST evidence of compliant data disposal is a certificate of destruction received and archived in accordance with data retention policies. Post-destruction assessments confirm the fact; the certificate proves the compliance.

3.12 Chapter Summary

Domain 3 of the AAISM examination — the heaviest domain at thirty-eight percent — covers the full technical landscape of AI security, from the fundamental nature of AI technologies through the security controls and monitoring disciplines that sustain their integrity in operation.

Part A established the taxonomy of AI types — by functionality (reactive, limited-memory), by capability (narrow, general, super), and by model type (generative, predictive, machine learning paradigms). Each category carries a distinctive security profile: generative models require output filtering and hallucination mitigation; agentic AI demands least-privilege and HITL oversight; supervised learning is vulnerable to label manipulation; reinforcement learning is vulnerable to reward function exploitation; and deep neural networks create explainability challenges that governance must address. Secure-by-design principles — threat modelling before development, minimal data collection, data isolation, defence-in-depth, and auditability — apply to AI as rigorously as to any other critical system. AI change management must include fairness assessment, adversarial robustness testing, and compliance validation, not merely regression testing.

Part B traced the full AI lifecycle from Plan and Design through Retire/Decommission, identifying the distinctive security activities and priorities at each phase. The data collection and preparation phase carries the greatest inherent risk — it is where poisoning, consent failures, and data quality problems are introduced. The testing phase is the last opportunity to catch security, fairness, and compliance issues before production. The decommissioning phase is the most neglected — its governance requirements (documented destruction, regulatory retention, stakeholder communication) must be planned before deployment, not improvised after.

Part C addressed data management controls — covering the full arc of data governance (acquisition, organisation, utilisation, storage, retention, destruction) and data security (encryption, access control, confidentiality/siloing, backup, integrity). The specific security requirements at each data governance stage reflect the fundamental dependence of AI system integrity on data integrity.

Part D examined privacy, ethical, trust, and safety controls. Privacy-by-design principles and technical mechanisms (differential privacy, federated learning, anonymisation) address the specific privacy risks of AI data processing. The right to human review of significant automated decisions creates enforceable legal obligations that the AI security programme must operationalise. Ethical frameworks require technical implementation — bias detection, explainability mechanisms, fairness metrics. Human-in-the-loop is a spectrum rather than a binary property; governance must determine the appropriate position based on harm severity, reversibility, and decision speed requirements.

Part E synthesised the full range of operational security controls — AI-powered security tools and their governance, AI security control frameworks (OWASP LLM Top 10, MITRE ATLAS), access controls and Zero Trust architecture, AUP enforcement, audit and traceability, shadow AI detection and management, AI incident management, awareness training and skills development, and continuous monitoring through drift detection, threat intelligence, and security metrics. Together, these controls form the operational layer of the AI security programme through which governance principles become sustained security practices.

3.13 Practice Questions

Attempt each question independently before reading the answer. These questions test technical knowledge integrated with governance reasoning, reflecting the style of Domain 3 AAISM examination questions.

Question 1An organisation is deploying an AI system that will autonomously browse the web, draft emails, and execute code on behalf of users. Which of the following BEST describes the primary security governance concern specific to this type of AI system?
AThe system may generate outputs with a higher hallucination rate than a conventional language model
BThe system's autonomous actions in digital environments can cause real-world harm if it is compromised or manipulated, requiring least-privilege design and human-on-the-loop oversight
CThe system requires a more powerful computing infrastructure than a conventional AI model, creating availability risk
DThe system will be more difficult to train than a conventional predictive model due to the complexity of the action space
Question 2A data scientist proposes using a highly accurate but opaque deep learning model for an AI system that will make credit decisions affecting individual customers. The security and compliance team recommends a less accurate but interpretable gradient boosted tree model instead. Which of the following BEST supports the security team's recommendation?
ADeep learning models are more vulnerable to data poisoning attacks than gradient boosted tree models
BThe right to an explanation of significant automated decisions, combined with regulatory requirements for model auditability, makes interpretability a governance requirement that takes precedence over marginal accuracy gains
CGradient boosted tree models require less computational infrastructure, reducing the organisation's exposure to denial-of-service attacks
DDeep learning models cannot be fine-tuned once deployed, making it impossible to remediate bias identified after deployment
Question 3During an AI system's lifecycle, at which phase is the risk of data poisoning HIGHEST, and what is the PRIMARY governance control for this risk?
APhase 6 (Operate and Monitor); primary control is drift detection through continuous performance monitoring
BPhase 5 (Deploy); primary control is configuration management and deployment access controls
CPhase 2 (Collect and Process Data); primary control is robust data validation, provenance verification, and anomaly detection in training pipelines
DPhase 4 (Test, Evaluate, Verify, and Validate); primary control is adversarial robustness testing that includes data poisoning simulations
Question 4A security team discovers that several employees in the finance department have been using an unapproved cloud-based generative AI tool to draft financial reports, including entering sensitive revenue forecasts and unreleased earnings data. What should be the FIRST governance action?
AImmediately block all access to the tool at the network level and issue disciplinary notices to the employees involved
BConduct a risk assessment of the specific tool and the data entered, determine whether a reportable data breach has occurred, and engage with the finance team to understand their business need before deciding on the appropriate response
CRetroactively approve the tool's use by the finance department, as the employees were clearly acting in good faith
DConduct AI security awareness training for all employees before taking any action regarding the specific incident
Question 5An organisation is decommissioning an AI healthcare system that was trained on personally identifiable patient health data. Which of the following BEST demonstrates compliant data disposal?
ADeleting the training dataset from the primary storage location and confirming deletion through system logs
BConducting a post-destruction risk assessment to verify that no residual data exposure remains
CReceiving and archiving a certificate of destruction in accordance with the organisation's data retention policies
DUpdating governance policies to reflect lessons learned from the decommissioning process
Question 6A CISO wants to implement Zero Trust Architecture for the organisation's AI systems, which include multiple cloud-hosted foundation model APIs, an on-premises ML training cluster, and several business unit AI applications. Which of the following BEST describes the Zero Trust principle most critical to AI system security?
AAll AI model endpoints must be hosted in a single cloud environment to enable centralised perimeter controls
BAI systems should only communicate with other systems they have been explicitly paired with during a manual network segmentation exercise
CNo entity — user, service, or AI system — is granted implicit trust based on network location; every access request is continuously verified based on identity, device health, and authorisation
DAI systems should be replaced by simpler rule-based systems where Zero Trust cannot be fully implemented

End of Chapter 3 — Domain Coverage Complete.