Risk-based validation: deciding how much is enough
ICH Q9 and Annex 15 expect the extent of qualification to follow a documented risk assessment: more effort where product quality is at greater risk.
Risk-based validation replaces 'test everything equally' with 'test in proportion to risk'. For a temperature-controlled space, the highest-risk elements are the parameters that directly affect product — temperature at product locations, alarm response, monitoring data integrity — and the lowest are cosmetic or convenience features.
A simple approach
- List functions and parameters from the URS.
- Score each for impact on product quality, likelihood of failure and likelihood of detection.
- Assign test depth: full challenge testing, functional check, or supplier documentation.
- Record the rationale and revisit it at periodic review.
Risk assessment justifies doing less where appropriate; it never justifies skipping the mapping of a space in which product is stored.
Scoring, with a worked example
The usual instrument is a severity–occurrence–detection score, borrowed from FMEA and endorsed in spirit by ICH Q9(R1). Each function from the URS is scored on how badly a failure would affect product, how likely that failure is, and how likely it is to be noticed before it does damage. The product of the three is a priority number, and the priority number selects the depth of testing rather than deciding it outright.
| Function | Severity | Occurrence | Detection | Score | Test depth |
|---|---|---|---|---|---|
| Temperature at product locations | 5 | 3 | 2 | 30 | Full loaded mapping, worst case, both seasons |
| High-temperature alarm and escalation | 5 | 2 | 3 | 30 | Challenge test to the limit, with escalation to the second contact |
| Monitoring data integrity and audit trail | 4 | 2 | 4 | 32 | Annex 11 checks: accounts, audit trail, time sync, restore test |
| Recovery after door opening | 3 | 4 | 2 | 24 | Measured recovery test at the worst realistic door time |
| Backup refrigeration changeover | 4 | 1 | 3 | 12 | Functional check, supplier documentation accepted |
| Interior lighting | 1 | 2 | 1 | 2 | Installation check only |
Note that detection drives the third row above its severity. Data integrity failures are not dramatic and not obvious; nobody notices a broken audit trail until someone goes looking for an entry that should be there. A low detectability score is the mechanism by which quiet failures earn attention.
What risk assessment cannot be used for
The distinction worth holding onto is between reducing effort and removing evidence. Risk assessment legitimately decides that a backup compressor gets a functional check rather than a full challenge, that supplier documentation is accepted for a component with no product contact, or that a chamber is mapped at three set points rather than six. It cannot conclude that a space holding product does not need mapping, that alarms need not be challenged, or that an acceptance criterion may be relaxed because meeting it is inconvenient. Those are the findings inspectors cite, and the risk assessment is usually what they cite them from.
Keeping it alive
- Record the rationale, not just the score. A number with no sentence behind it cannot be defended or revisited.
- Name who scored it and when. Risk assessments age, and an unattributed one cannot be challenged.
- Revisit at periodic review, and immediately on change: a new product with tighter limits raises severity on every row above it.
- Feed real history back in. Three excursions in a year is evidence about occurrence that beats anybody's original guess.
Frequently asked questions
- Which tool should be used — FMEA, HACCP, something simpler?
- ICH Q9 lists several; the choice should match the complexity of the system. A structured table is often enough for a storage area.
References
- [1]ICH Q9(R1): Quality Risk Management
- [2]EudraLex Volume 4, Annex 15: Qualification and Validation (2015)
General technical guidance written against the cited sources. It is not regulatory or legal advice and does not replace the applicable standard, guideline or a qualified reviewer's judgement.
Have a question on this topic?
Ask ValiTrac AI and see the evidence and calculation behind the answer.
Ask ValiTrac AIFree calculator: Protocol builder
Build a draft IQ, OQ and PQ protocol for a cold room, chamber, autoclave or vehicle — document control, the test list that suits that equipment, record tables and approval blocks. It will not write your acceptance criteria, and says so.
Open the calculatorRelated articles
What a validation master plan should contain
The VMP is the site-level statement of validation policy, scope, responsibilities and schedule. It shows an inspector how you decide what to validate.
Computerised system validation for monitoring and mapping software
Software that produces GxP records must be validated for its intended use: requirements, risk assessment, testing, audit trails, access and change control.