Skip to content

What Happens Without Governance

The risks of ungoverned generative AI in healthcare are specific, real, and increasingly visible to regulators.

Patient Data Enters Third-Party AI Systems

When clinical staff paste patient information into ChatGPT, Copilot, or other AI tools, that data may be used for model training, stored in third-party infrastructure, or accessible to the provider. Under GDPR Article 28, this requires a Data Processing Agreement. Under DSPT, it requires documented controls. Most organisations have neither.

Hallucination in Clinical Contexts

Generative AI hallucinates — it produces confident, plausible, incorrect outputs. In administrative contexts this is an inconvenience. In clinical contexts, it's a patient safety risk. Without governance, there's no systematic way to ensure AI-generated clinical content is reviewed before use. DCB0129 requires this risk to be formally assessed.

EU AI Act GPAI Obligations (Article 53)

The EU AI Act's General Purpose AI (GPAI) provisions (Article 53) impose obligations on organisations deploying GPAI models in high-risk contexts. Healthcare is explicitly high-risk under Annex III. Organisations using GPT-4, Claude, or Gemini in clinical workflows may already be in scope — and the August 2026 deadline is approaching.

Shadow AI and Ungoverned Adoption

Staff find ways to use tools that make their work easier. Without a governance framework, AI adoption goes underground — ungoverned, unmonitored, and invisible to your security and compliance teams. Shadow AI creates data governance gaps that are extremely difficult to remediate after the fact.

CONTENTS

AI ACCEPTABLE USE
TOOL ASSESSMENT
RUNTIME CONTROLS
TRAINING

AI Acceptable Use Policy

A meaningful AI acceptable use policy goes beyond "don't put patient data in ChatGPT." It defines which tools are approved for which use cases, what data classifications can be used with which tools, who can approve exceptions, and how incidents are reported. We help organisations build policies that are practical enough for staff to actually follow — and specific enough to provide real protection.

AI Tool Assessment & Approval

Before any AI tool is used with sensitive data, it should be assessed: What data does it process? Where is it stored? Is a DPA in place? What are the terms of service? Does it train on your data? We build structured assessment processes so new AI tools go through the right checks before reaching clinical staff — not after a data incident.

Runtime Policy Enforcement

Policy documents don't stop data from leaving the organisation. Runtime controls do. We implement technical governance layers — including the open-source Raigo standard — that enforce your AI policies at the point of use. Every AI interaction is evaluated against your rules before it executes. Violations are logged, blocked, or flagged for human review.

Staff Awareness & Training

The most sophisticated technical controls fail if staff don't understand the risks. We design healthcare-specific AI awareness programmes that explain the real risks in terms clinical and operational staff understand — not abstract compliance language. Training covers: what not to put in AI tools, how to spot hallucinated content, and how to report concerns.

Why Choose Our Approach?

PRACTICAL GOVERNANCE

We build governance that staff actually follow — not a policy document that sits in a drawer. Proportionate, clear, and operationally realistic.

RUNTIME CONTROLS

Technical governance enforced at the point of use via the open-source Raigo standard. Policies that work even when staff don't remember them.

REGULATORY MAPPED

Everything maps to DSPT, DTAC, GDPR, and EU AI Act obligations. Evidence your compliance team and commissioners can rely on.

OPEN SOURCE STANDARD

Built on Raigo — our open-source AI governance standard. Transparent, auditable, and freely available. No vendor lock-in.

Frequently Asked Questions

We already have a data protection policy. Does that cover AI? minus-icon

Almost certainly not in sufficient detail. Most existing data protection policies were written before generative AI existed and don't address the specific risks — third-party model training, hallucination, GPAI obligations, or the difference between using an AI tool as a data processor versus a controller. A gap analysis is the right starting point.

Do we need to tell patients when AI is used in their care? plus-icon
What is Raigo and how does it help with Gen AI governance? plus-icon
Where do we start? plus-icon

Latest Insights

The EU AI Act's: Article 15

The EU AI Act's: Article 15

Most organisations think about AI risk in terms of bias, explainability, or data governance. Cybersecurity is treated as...

The EU AI Act Deadline

The EU AI Act Deadline

On 2 August 2026, the EU AI Act (Regulation (EU) 2024/1689) becomes fully applicable for the vast majority of organisati...

Weekly Round Up - Issue 18

Weekly Round Up - Issue 18

The clock is ticking loudest on the DSPT, with version 8 due at the end of the month and a meaningfully higher bar for s...

Bedfordshire Hospitals Data Breach: What the Synnovis Fallout Teaches NHS Suppliers

Bedfordshire Hospitals Data Breach: What the ...

Almost two years on from one of the most damaging cyber attacks in NHS history, the consequences are still landing. On 1...

NHS Health Bill 2026: AI, Patient Data and the Risks the Government Hasn't Answered

NHS Health Bill 2026: AI, Patient Data and th...

Buried in the Health Bill's explanatory notes is a sentence that hasn't got nearly enough attention.

The NHS Is Building the World's Biggest Patient Database. Is The Security Plan Missing.

The NHS Is Building the World's Biggest Patie...

The Health Bill 2026-27 passed its second reading in Parliament yesterday. Most headlines focused on the abolition of NH...

What is NHS DTAC? Digital Technology Assessment Criteria — A Complete Guide

What is NHS DTAC? Digital Technology Assessme...

Digital health technology is transforming how care is delivered across the NHS. From AI-powered diagnostics to remote pa...

What is DCB0160? The NHS Clinical Safety Standard for Deploying Health IT Systems

What is DCB0160? The NHS Clinical Safety Stan...

Digital systems are now at the heart of how NHS care is delivered. Electronic patient records, clinical decision support...