Guide AI

AI Data Protection, Human Oversight and Security Controls

What UK GDPR requires when AI processes personal data, how to make human review count, and the security controls AI tools need.

10 November 2026
Updated 18 November 2026
7 min read

This page covers steps 4 to 6 of our AI governance framework. It assumes you have an AI tool register and a risk classification, which steps 1 to 3 in AI inventory, risk classification and acceptable use policy set up. Vendors, incidents and regulation follow in steps 7 to 10.

Step 4: UK GDPR obligations

UK GDPR applies to any AI processing that involves personal data. The obligations that most commonly arise in practice are:

Articles 22A to 22D: automated decision-making

Since 5 February 2026, the Data (Use and Access) Act 2025 has replaced UK GDPR Article 22 with Articles 22A to 22D. A significant decision (one with a legal or similarly significant effect on someone) is based solely on automated processing when there is no meaningful human involvement in taking it. If an AI system makes such decisions about job applicants, creditworthiness, insurance eligibility or benefit entitlement, you must provide safeguards: tell the individual, let them make representations, offer human intervention and let them contest the decision. Stricter limits still apply where the decision is based on special category data. Meaningful human review must genuinely influence the outcome: rubber-stamping an AI recommendation does not count. Not every AI-assisted action is a solely automated decision: record for each workflow who holds real decision authority and can change or override the AI output. You still need an Article 6 lawful basis for the underlying processing, assessed separately. Document for each high-risk AI tool whether its decisions are solely automated and how the safeguards are provided. If you also make decisions about people in the EU, EU GDPR Article 22 may apply in its original form.

Article 35: Data Protection Impact Assessment

UK GDPR Article 35 requires a DPIA before processing that is likely to result in a high risk to individuals. Article 35(3) makes one mandatory for systematic and extensive evaluation of people based on automated processing, including profiling, with legal or similarly significant effects; large-scale processing of special category or criminal offence data; and large-scale systematic monitoring of publicly accessible areas. The ICO's list of processing likely to result in high risk adds further cases, including innovative technology such as AI combined with other risk factors. Run a DPIA for every AI tool you classify as high risk before deployment. For medium-risk tools, a DPIA is good practice even where not strictly required. See our AI DPIA requirements guide for a worked framework.

Lawful basis and transparency

Processing personal data through an AI tool requires a lawful basis under Article 6, and special category data requires an additional condition under Article 9. Your privacy notices should tell individuals when AI significantly processes their data. If you are using AI tools that process employee data, update your staff privacy notice. If you are processing customer data through AI, update your customer-facing privacy notice.

UK GDPR "high risk" vs EU AI Act "high risk"

These are separate concepts assessed under different frameworks. A DPIA is required where processing is likely to result in a high risk to individuals under UK GDPR: a data-protection risk assessment. This is not the same as classifying an AI system as "high-risk" under the EU AI Act, which uses different criteria based on the application domain. A tool with a low EU AI Act risk classification may still require a DPIA under UK GDPR if it involves large-scale profiling, special category data, or automated decisions with significant effects on individuals.

International data transfers

What matters is the actual data flow: where the vendor processes and stores the data, which subprocessors are involved, and whether staff in other countries can access it remotely. Where personal data leaves the UK, check the data processing agreement for the transfer mechanism: UK adequacy regulations (data bridges), the ICO's international data transfer agreement (IDTA), the UK Addendum to the EU standard contractual clauses, or binding corporate rules. EU SCCs on their own do not cover a restricted transfer from the UK. If your vendor only offers EU SCCs without the UK Addendum, get clarification in writing before using the tool for personal data.

Also separate what the vendor does with the data: processing on your instructions as a processor; any use for its own purposes, where it may act as an independent controller; service telemetry and usage data; and access by subprocessors. A commitment not to train on your data answers only one of these questions: it does not settle where the data is transferred, how long prompts and outputs are retained, or who can access them.

Step 5: Build human oversight into workflows

Human oversight is only meaningful when the person reviewing an AI output has the information and time to make a genuine judgment. A workflow where a manager clicks "approve" on an AI-generated HR assessment in under a minute is not oversight. It is a liability dressed as a process.

For each consequential workflow that uses AI, define:

  • Who reviews the AI output and what their review should cover
  • What information they need to make that judgment, including any context the AI did not have access to
  • What they can change before the decision is recorded, and how changes are documented
  • How the decision and the AI involvement are logged in case of a later challenge or audit
  • Who the individual can contact to request human review of a decision that affected them

The log requirement is particularly important. If a recruitment decision or a credit application decision is challenged, you need to be able to demonstrate what the AI produced, what the reviewer changed, and who made the final call. Verbal processes leave you exposed.

For Microsoft 365 Copilot deployment, oversight is less about individual decisions and more about data access controls: which data Copilot can surface, who can see what, and whether overpermissioned SharePoint sites are visible to staff who should not have access to that content.

Step 6: Security controls for AI

AI tools introduce security risks that most existing controls were not designed to address. Governing AI without governing its security profile leaves a significant gap, particularly as organisations connect AI to internal data, APIs, and business processes.

Access control and least privilege

Enterprise AI tools, particularly those integrated with your Microsoft 365 environment, CRM, or file systems, surface data based on what the user can access. If your SharePoint permissions are overly broad, Copilot will surface documents the user should not see. Audit permissions in your connected systems before enabling AI tools that can query them. Apply least privilege: users should access only the data their role requires, not everything their account technically permits.

Prompt injection

Prompt injection is an attack in which malicious instructions embedded in content the AI processes cause it to take unintended actions or leak information. In customer-facing AI deployments: chatbots, AI-assisted email processing, document analysis: an attacker can craft input that overrides the system's instructions. Mitigations include output validation, sandboxed execution environments, limiting the AI's ability to take autonomous actions, and logging all inputs and outputs for review.

Data leakage and sensitive content in prompts

Staff routinely include more information in AI prompts than they intend. Credentials, personal data, client names, financial figures, and confidential strategy documents appear in prompts without the user considering where that data goes. Training reduces the frequency, but technical controls matter more: classify data at rest, restrict which data categories can be accessed by AI-enabled applications, and configure DLP policies to flag or block prompts containing sensitive patterns.

Shadow AI and unsanctioned integrations

Shadow AI is not a one-time discovery problem. New tools launch constantly, staff accounts change, and browser extensions accumulate. Periodic scanning of your SaaS estate, egress traffic analysis, and a clear reporting channel for staff to flag AI tools they want to use are all part of ongoing shadow AI management. Staff who cannot get a tool approved quickly will use it anyway and not tell anyone.

Supply chain and model risk

Foundation models powering commercial AI tools may be updated without notice, changing their behaviour, outputs, or data handling characteristics. AI plugins and third-party integrations extend trust to additional parties your original due diligence did not cover. Review the sub-processor list in vendor DPAs, monitor vendor release notes for material changes, and test AI output behaviour after significant model updates in critical workflows.

Logging and incident detection

Log AI tool usage: who used what, when, and with what data where possible. Logs enable incident investigation, satisfy audit requirements, and detect abnormal patterns such as unusual data volumes being processed or access from unexpected accounts. Ensure log retention aligns with your incident response and regulatory requirements, typically a minimum of 12 months.

Common questions

What counts as a significant automated decision under UK GDPR?

Under UK GDPR Articles 22A to 22D (in force since 5 February 2026, replacing Article 22), a significant decision is one with a legal or similarly significant effect on an individual, and it is solely automated when there is no meaningful human involvement in taking it. Practical examples include AI screening CVs before any human reviews them, algorithmic credit scoring used to approve or decline an application, and insurance pricing models that determine eligibility without human intervention. Solely automated significant decisions are allowed if you provide the required safeguards (information, representations, human intervention and the right to contest), with stricter limits for special category data. If an AI tool provides a recommendation that a human then genuinely evaluates before acting, the decision may not be solely automated: but the burden is on you to show the human review is substantive, not a rubber-stamp. The Article 6 lawful basis for the underlying processing is still needed separately.

When does using an AI tool require a DPIA?

UK GDPR Article 35 requires a DPIA before processing that is likely to result in a high risk to individuals. AI processing is likely to require a DPIA when it involves systematic profiling, special category data such as health or biometric information, automated decision-making with significant effects, or large-scale monitoring of individuals. A DPIA is also good practice for any new AI tool that processes personal data, even where not strictly required. The ICO has published detailed DPIA guidance and a template at ico.org.uk.

Sources

AI Governance Assessment

Not sure where your AI governance stands?

We assess your AI inventory, risk classification, privacy obligations, security controls, and governance structure. Deliverable: a gap assessment and prioritised 90-day roadmap.

  • ✓ What AI tools are in use and what data they process
  • ✓ Which use cases require additional controls or a DPIA
  • ✓ Where security controls for AI need to be strengthened
  • ✓ Whether EU AI Act or sector regulation applies
  • ✓ Who owns governance, approves tools, and handles incidents
  • ✓ Prioritised 90-day roadmap to close the gaps

Disclaimer: This article is for general informational purposes only and does not constitute legal, regulatory, or professional advice. Cyvra makes no warranty as to the accuracy or completeness of this content, which may not reflect the most current regulatory developments. Readers should seek independent legal and regulatory advice appropriate to their specific circumstances. Cyvra accepts no liability for any loss arising from reliance on this content.