Key Risk Indicators and Critical-to-Quality Factors

Part of Good Clinical Practice (GCP) — ICH E6(R3): Risk Management and Quality by Design.

About 7 minutes. Free, in your language, no account needed.

Why this matters

Three terms circulate in every risk meeting: critical to quality factors, quality tolerance limits, and key risk indicators. Only one is a core term in the guideline. People who confuse them argue about the wrong things and cite the wrong authority in audits. This lesson separates what International Council for Harmonisation (ICH) guideline E6(R3) for Good Clinical Practice (GCP) requires from what the industry built on top of it.

Start with the honest terminology map

This distinction is examinable, and it is the point of the lesson.

Say the guideline term first and the industry term second. "We track a pre-specified acceptable range; our organization calls the metric a key risk indicator." That is defensible in an inspection. "ICH requires KRIs" is not.

Critical to quality factors

Principle 6.2 defines the concept:

"Factors critical to the quality of the trial should be identified prospectively. These factors are attributes of a trial that are fundamental to the protection of participants, the reliability and interpretability of the trial results and the decisions made based on those trial results."

Two words in that sentence do the work.

• Prospectively — CtQ factors are identified when the trial is designed. They are not discovered after the data arrive.
• Fundamental — a CtQ factor is not merely useful. If it fails, participant protection or the interpretability of the results fails with it.

Section 3.1.2 places the same duty on the sponsor at design time: "Sponsors should incorporate quality into the design of the clinical trial by identifying factors that are critical to the quality of the trial and by managing risks to those factors."

Typical CtQ factors include eligibility of enrolled participants, validity of informed consent, integrity of randomization and blinding, correct administration of the investigational product, accurate capture of the primary endpoint, and complete safety reporting. Note what is absent from that list: font sizes on a log, tidy filing, and the exact minute a routine visit began.

You can also find them written down. Appendix B sets out the contents of the protocol. Section B.12.1 asks for a "Description of identified critical to quality factors, associated risks and risk mitigation strategies in the trial unless documented elsewhere." So if you want to know a trial's CtQ factors, read section B.12 of the protocol first.

Pre-specified acceptable ranges

Section 3.10.1.3 gives the mechanism. The verified wording is:

"the sponsor should set pre-specified acceptable ranges (e.g., quality tolerance limits at the trial level) to support the control of risks to critical to quality factors."

Three things follow from that sentence.

• The range must be set in advance. A limit invented after a problem appears is not a pre-specified range.
• The range attaches to a critical to quality factor. It is not a general performance target.
• The guideline names quality tolerance limits as an example, at the trial level. Quality tolerance limit is therefore one implementation, not the mandated ICH term.

Section 3.10.1.3 also states what happens when a range is breached. "Where deviation beyond these ranges is detected, an evaluation should be performed to determine if there is a possible systemic issue and if action is needed."

Read that carefully. A breach triggers an evaluation, not an automatic finding. The question the evaluation answers is whether something systemic is happening.

Key risk indicators, taught honestly

A key risk indicator is a metric watched over time to give early warning that a risk is materializing. Common examples include screen failure rate, rate of missing primary endpoint data, days from visit to data entry, protocol deviation rate per participant, and query rate per data acquisition tool.

None of this is ICH wording. The term key risk indicator appears nowhere in E6(R3).

It is still legitimate and widely used. It supports two things the guideline does require. Section 3.10.1.5 requires periodic risk review to check that control measures "remain effective and relevant." Section 3.11.4.2 describes centralized monitoring as an evaluation of accumulated data performed in a timely manner. Indicator metrics are how organizations do both in practice.

So the defensible position is this. Critical to quality factors are the guideline concept. Pre-specified acceptable ranges are the guideline mechanism. Key risk indicators are how many organizations operate that mechanism. Never present the third as the first.

How the three fit together

• The trial has a CtQ factor: complete capture of the primary endpoint.
• The sponsor sets a pre-specified acceptable range for missing primary endpoint data across the trial.
• The operations team watches a monthly indicator of missing endpoint data per site.
• The indicator moves. The team investigates before the trial-level range is breached.
• If the range is breached, section 3.10.1.3 requires an evaluation for a systemic issue.

The indicator is the early warning. The range is the formal control.

In practice

Dr. Sarah is the principal investigator at a site in a cardiovascular outcomes trial. The sponsor's centralized monitoring team writes to her. Her site's screen failure rate is 62%. The trial average is 24%.

Screen failure rate is not one of this trial's pre-specified acceptable ranges. It is an operational indicator the sponsor tracks. Nothing has been breached, and no deviation has been recorded.

The sponsor still investigates, because the indicator points at a critical to quality factor: eligibility of enrolled participants. A high screen failure rate can mean the site is pre-screening poorly. It can also mean the site is applying eligibility criteria very carefully while others are not.

The centralized team reviews the failed screens. Dr. Sarah's site is excluding participants correctly on a renal function criterion that two other sites have read loosely. The finding is real, but the problem is at the other sites.

The sponsor documents the review, communicates the clarification to all sites under section 3.10.1.4, and adds a check to the monitoring plan. Dr. Sarah's site needs no action. The indicator did its job: it prompted a question, not a verdict.

Key takeaways

• Critical to quality factors are attributes of a trial that are fundamental to participant protection and to the reliability and interpretability of results, and Principle 6.2 requires them to be identified prospectively.
• Section 3.10.1.3 requires the sponsor to set pre-specified acceptable ranges to control risks to critical to quality factors.
• Quality tolerance limit is given in 3.10.1.3 as an example of a pre-specified acceptable range, so it is one implementation and not the mandated ICH term.
• The term key risk indicator does not appear in E6(R3); it is operational practice that supports the risk review required by 3.10.1.5.
• When a pre-specified acceptable range is exceeded, 3.10.1.3 requires an evaluation to determine whether a systemic issue exists and whether action is needed.
• Section B.12.1 of the protocol should describe the trial's critical to quality factors, the associated risks and the mitigation strategies.
• Name the guideline term first and your organization's term second.