Skip to content

What Happens Without Governance

The risks of ungoverned generative AI in healthcare are specific, real, and increasingly visible to regulators.

Patient Data Enters Third-Party AI Systems

When clinical staff paste patient information into ChatGPT, Copilot, or other AI tools, that data may be used for model training, stored in third-party infrastructure, or accessible to the provider. Under GDPR Article 28, this requires a Data Processing Agreement. Under DSPT, it requires documented controls. Most organisations have neither.

Hallucination in Clinical Contexts

Generative AI hallucinates — it produces confident, plausible, incorrect outputs. In administrative contexts this is an inconvenience. In clinical contexts, it's a patient safety risk. Without governance, there's no systematic way to ensure AI-generated clinical content is reviewed before use. DCB0129 requires this risk to be formally assessed.

EU AI Act GPAI Obligations (Article 53)

The EU AI Act's General Purpose AI (GPAI) provisions (Article 53) impose obligations on organisations deploying GPAI models in high-risk contexts. Healthcare is explicitly high-risk under Annex III. Organisations using GPT-4, Claude, or Gemini in clinical workflows may already be in scope — and the August 2026 deadline is approaching.

Shadow AI and Ungoverned Adoption

Staff find ways to use tools that make their work easier. Without a governance framework, AI adoption goes underground — ungoverned, unmonitored, and invisible to your security and compliance teams. Shadow AI creates data governance gaps that are extremely difficult to remediate after the fact.

CONTENTS

AI ACCEPTABLE USE
TOOL ASSESSMENT
RUNTIME CONTROLS
TRAINING

AI Acceptable Use Policy

A meaningful AI acceptable use policy goes beyond "don't put patient data in ChatGPT." It defines which tools are approved for which use cases, what data classifications can be used with which tools, who can approve exceptions, and how incidents are reported. We help organisations build policies that are practical enough for staff to actually follow — and specific enough to provide real protection.

AI Tool Assessment & Approval

Before any AI tool is used with sensitive data, it should be assessed: What data does it process? Where is it stored? Is a DPA in place? What are the terms of service? Does it train on your data? We build structured assessment processes so new AI tools go through the right checks before reaching clinical staff — not after a data incident.

Runtime Policy Enforcement

Policy documents don't stop data from leaving the organisation. Runtime controls do. We implement technical governance layers — including the open-source Raigo standard — that enforce your AI policies at the point of use. Every AI interaction is evaluated against your rules before it executes. Violations are logged, blocked, or flagged for human review.

Staff Awareness & Training

The most sophisticated technical controls fail if staff don't understand the risks. We design healthcare-specific AI awareness programmes that explain the real risks in terms clinical and operational staff understand — not abstract compliance language. Training covers: what not to put in AI tools, how to spot hallucinated content, and how to report concerns.

Why Choose Our Approach?

PRACTICAL GOVERNANCE

We build governance that staff actually follow — not a policy document that sits in a drawer. Proportionate, clear, and operationally realistic.

RUNTIME CONTROLS

Technical governance enforced at the point of use via the open-source Raigo standard. Policies that work even when staff don't remember them.

REGULATORY MAPPED

Everything maps to DSPT, DTAC, GDPR, and EU AI Act obligations. Evidence your compliance team and commissioners can rely on.

OPEN SOURCE STANDARD

Built on Raigo — our open-source AI governance standard. Transparent, auditable, and freely available. No vendor lock-in.

Frequently Asked Questions

We already have a data protection policy. Does that cover AI? minus-icon

Almost certainly not in sufficient detail. Most existing data protection policies were written before generative AI existed and don't address the specific risks — third-party model training, hallucination, GPAI obligations, or the difference between using an AI tool as a data processor versus a controller. A gap analysis is the right starting point.

Do we need to tell patients when AI is used in their care? plus-icon
What is Raigo and how does it help with Gen AI governance? plus-icon
Where do we start? plus-icon

Latest Insights

What is NHS DTAC? Digital Technology Assessment Criteria — A Complete Guide

What is NHS DTAC? Digital Technology Assessme...

Digital health technology is transforming how care is delivered across the NHS. From AI-powered diagnostics to remote pa...

What is DCB0160? The NHS Clinical Safety Standard for Deploying Health IT Systems

What is DCB0160? The NHS Clinical Safety Stan...

Digital systems are now at the heart of how NHS care is delivered. Electronic patient records, clinical decision support...

What is DSPT? A Guide for Digital Health Companies

What is DSPT? A Guide for Digital Health Comp...

If you are building or scaling a digital health product in the UK, the NHS Data Security and Protection Toolkit — univer...

What the Five Eyes Agentic AI Guidance Actually Means for Your Organisation

What the Five Eyes Agentic AI Guidance Actual...

The cybersecurity agencies of the United States, United Kingdom, Australia, Canada, and New Zealand published their firs...

40% of AI Projects Predicted to Fail

40% of AI Projects Predicted to Fail

Over 40% of agentic AI projects will be cancelled by the end of 2027. If that number feels high, the reasons why are eve...

DPRK's AI-Driven npm Malware Surge: Fake Firms, RATs, and Supply Chain Threats Uncovered

DPRK's AI-Driven npm Malware Surge: Fake Firm...

The software supply chain remains the backbone of modern application development—and an increasingly lucrative target fo...

Weekly Round Up Issue 17

Weekly Round Up Issue 17

It has been a significant week for anyone supplying digital products or services to the NHS. The headlines are political...

Securing Agentic AI: Navigating Emerging Enterprise Security Risks of Autonomous AI Agents

Securing Agentic AI: Navigating Emerging Ente...

The Rise of Agentic AI in the Enterprise Enterprises are rapidly adopting agentic AI—autonomous systems capable of execu...