SlideShare a Scribd company logo
Experiences
with
Interim
Analyses

and
Data
Monitoring
Commi:ees

EAST
User‐Group
MeeAng

14th
October
2011,
Paris



Simon
Day,
PhD

Experiences
with
Interim
Analyses

and
Data
Monitoring
Commi:ees

Or: I d never be so stupid as to do that, would I?
3

plans
or
decisions
based
on
staAsAcally
imprecise

interim
data
may
oKen
be
subopAmal 

Section 6.5
Sponsor access to
interim data for
planning purposes
4

Example
–
Afacogin
in
severe
sepsis

5

Design
and
objecAves

•  Double
blind,
placebo‐controlled,
mulAcentre,

phase
3
randomised
controlled
clinical
trial

•  Primary
outcome
–
all
cause
28
day
mortality

•  Target
sample
size
1550

(Increased
by
400
at
an
interim
analysis)

6

Interim
analysis,
N=722

•  Mortality
rates:


placebo 
38.9%


Afacogin 
29.1%




P
=
?

7

Interim
analysis,
N=722

•  Mortality
rates:


placebo 
38.9%


Afacogin 
29.1%




P
=
0.

8

Interim
analysis,
N=722

•  Mortality
rates:


placebo 
38.9%


Afacogin 
29.1%




P
=
0.006

9

Interim
analysis,
N=722

•  Mortality
rates:


placebo 
38.9%


Afacogin 
29.1%




P
=
0.006

•  Tifacogin
significantly
a:enuated
prothrombin

fragment
and
thrombin:anA‐thrombin
complex

levels
[secondary
endpoints]
in
paAents
with
high

and
low
INR
[pre‐specified
subgroups] 

10

What
should
happen?

•  Pre‐specified
interim
analysis
at
¼,
½
and
¾
of

paAents
compleAng
28
days

•  Purpose:
 safety,
fuAlity
and
efficacy 

•  Safety
and
efficacy
–
kind
of
the
same
thing

•  Tifacogin
is
effecAve
–
more
paAents
are
dying
on

placebo

11

What
should
happen?

•  If
this
trial
con.nues,
pa.ents
randomised

to
the
control
arm
will
needlessly
die

•  Another
1100
paAents
due
to
be
randomised

•  We
should
order
160
coffins
for
paAents
who

will
be
given
.facogin

•  We
should
order
215
coffins
for
paAents

who
will
be
given
placebo

12

Phew,
I got the real stuff!
13

Example
–
MRC
acute
myeloid
leukemia

The MRC AML12 trial
14

The
trial

•  5
courses
of
therapy
versus
4
courses

•  Primary
endpoint
–
survival

•  1078
paAents

•  Yearly
interim
analyses

15

Interim
analysis
(2)

•  Hazard
raAo
0.47
(in
favour
of
5
courses)

•  95%
confidence
interval
0.29
–
0.77,
P=0.003

16

Interim
analysis
(3)

•  Hazard
raAo
0.47
(in
favour
of
5
courses)

•  95%
confidence
interval
0.29
–
0.77,
P=0.003

•  Hazard
raAo
0.55
(in
favour
of
5
courses)

•  95%
confidence
interval
0.38
–
0.80,
P=0.002

17

That ll be
five courses for me,
please, waiter
18

Lancet 2001; 357:1385–90.
Example
–
the
CAPRICORN
study

19

Primary
endpoint

20

New
(changed)
endpoint

•  All‐cause
mortality

•  At
an
interim
analysis,
changed
to:

– All‐cause
mortality 
(P<0.005)

Or

– All‐cause
mortality
or
cardiovascular
hospitalisaAon


 
 
 
(P<0.045)



21

Results

Relative risk 0.77 (0.60 – 0.98)
P=0.031
Relative risk 0.92 (0.80 – 1.07)
P=0.296
All-cause mortality
All-cause mortality or
Cardiovascular hospitalisation
22

Results

23

Example
–
Afacogin
in
severe
sepsis

24

Interim
analysis,
N=722

•  Mortality
rates:


placebo 
38.9%


Afacogin 
29.1%




P
=
0.006

•  Tifacogin
significantly
a:enuated
prothrombin

fragment
and
thrombin:anA‐thrombin
complex

levels
[secondary
endpoints]
in
paAents
with
high

and
low
INR
[pre‐specified
subgroups] 

25

What
did
happen?

•  They
kept
the
trial
going

(Yes,
and
people
died!)

•  How
many
died?


 
 


High
INR 
 

Low
INR


placebo 
296
(33.9%) 
118
(23%)


Afacogin 
301
(34.2%) 


83
(12%)


 
 
 
 
 
P
=
0.?

26

What
did
happen?

•  They
kept
the
trial
going

(Yes,
and
people
died!)

•  How
many
died?


 
 


High
INR 
 

Low
INR


placebo 
296
(33.9%) 
118
(23%)


Afacogin 
301
(34.2%) 


83
(12%)


 
 
 
 
 
P
=
0.051


 
 
 
 
 
Pearson
χ2

27

What
did
happen?

•  They
kept
the
trial
going

(Yes,
and
people
died!)

•  How
many
died?


 
 


High
INR 
 

Low
INR


placebo 
296
(33.9%) 
118
(23%)


Afacogin 
301
(34.2%) 


83
(12%)


 
 
 
 
 
P
=
0.03


 
 
 
 
 
logisAc
regression

28

Conclusion

plans or decisions based on statistically imprecise
interim data may often be suboptimal
29

Example
–
MRC
acute
myeloid
leukemia

The MRC AML12 trial
30

Interim
analysis
(3)

•  Hazard
raAo
0.47
(in
favour
of
5
courses)

•  95%
confidence
interval
0.29
–
0.77,
P=0.003

•  Hazard
raAo
0.55
(in
favour
of
5
courses)

•  95%
confidence
interval
0.38
–
0.80,
P=0.002

31

What
should
happen?

•  Again,
the
DMEC
(sic)
kept
the
trial
going,
despite

endpoint
being
death

•  From
the
paper:

The
main
reason
for
not
closing
the
randomisaAon

was
that
the
treatment
effects
(53%
and
45%

reducAon
in
odds
of
death)
were
considered
too

large
to
be
clinically
plausible. 

•  They
were
Bayesians!

32

The
sequence
of
events

plans or decisions based
on statistically imprecise
interim data may often be
suboptimal
33

So
the
quesAons
to
ask
yourselves

1.  That
trial
we
stopped
early…
what
would
have

happened
if
we
had
kept
going? 

2.  That
fixed
sample
size
trial
that
we
did…
what

would
have
happened
if
it
recruited
more

paAents? 

Experiences
with
Interim
Analyses

and
Data
Monitoring
Commi:ees


More Related Content

PDF
Redhyte: Towards a Self-diagnosing, Self-correcting, and Helpful Analytic Pla...
PDF
Machine Learning for automatic diagnosis: why your deep neural network might ...
PPTX
The End of the Drug Development Casino?
PPTX
palliAGED - Developing an Innovative Tool Supporting EB Palliative Care Deliv...
PDF
EUGM 2011| Fretault | Use of bayesian approach in phase ii
PDF
Eugm 2011 pocock - dm cs-and-adaptive-trials
PDF
Eugm 2012 demets - clinical trials and the impact of regulations
PDF
Eugm 2012 oneill - perspective on the current environment for adaptive clin...
Redhyte: Towards a Self-diagnosing, Self-correcting, and Helpful Analytic Pla...
Machine Learning for automatic diagnosis: why your deep neural network might ...
The End of the Drug Development Casino?
palliAGED - Developing an Innovative Tool Supporting EB Palliative Care Deliv...
EUGM 2011| Fretault | Use of bayesian approach in phase ii
Eugm 2011 pocock - dm cs-and-adaptive-trials
Eugm 2012 demets - clinical trials and the impact of regulations
Eugm 2012 oneill - perspective on the current environment for adaptive clin...

Viewers also liked (13)

PDF
MPTI Talk
PDF
Eugm 2011 mehta - execution of adaptive trials operational considerations
PDF
Infosheet logxact-with-cytel-studio
PDF
Eugm 2012 jemiai - introduction to east architect
PDF
2012-05-30 EUGM | GAYDOS | Design & Analysis Approaches to Evaluate Cardiovas...
PDF
From the clinic to the cfo adaptive trials and financial decision making
PDF
Infosheet compass-get-the-dose-right
PDF
Cytel White Paper | ACES
PDF
Eugm 2011 mehta - adaptive designs for phase 3 oncology trials
PDF
Eugm 2012 pritchett - application of adaptive sample size re-estimation in ...
PDF
EUGM 2014 | BOLOGNESE | Case Studies of Phase 2 Adaptive Dose-Finding Trials
PDF
2014-10-22 EUGM | ROYCHAUDHURI | Phase I Combination Trials
PDF
Clinical Proof of Concept (PoC)
MPTI Talk
Eugm 2011 mehta - execution of adaptive trials operational considerations
Infosheet logxact-with-cytel-studio
Eugm 2012 jemiai - introduction to east architect
2012-05-30 EUGM | GAYDOS | Design & Analysis Approaches to Evaluate Cardiovas...
From the clinic to the cfo adaptive trials and financial decision making
Infosheet compass-get-the-dose-right
Cytel White Paper | ACES
Eugm 2011 mehta - adaptive designs for phase 3 oncology trials
Eugm 2012 pritchett - application of adaptive sample size re-estimation in ...
EUGM 2014 | BOLOGNESE | Case Studies of Phase 2 Adaptive Dose-Finding Trials
2014-10-22 EUGM | ROYCHAUDHURI | Phase I Combination Trials
Clinical Proof of Concept (PoC)
Ad

More from Cytel USA (15)

PDF
Eugm 2012 unknown - incivex drug development process overview road to findi...
PDF
Eugm 2012 mehta - future plans for east - 2012 eugm
PDF
Eugm 2012 gaydos - design and analysis approaches to evaluate cardiovascula...
PDF
EUGM 2011 | JEMIAI
PDF
EUGM 2011 | JEHL | group sequential designs with 2 time to event endpoints
PDF
EUGM 2011 | DARCHY | Deployment & use of east within sanofi r & d
PDF
EUGM 2014 | BEKELE | Adaptive Dose Finding Using Toxicity Probability Intervals
PDF
A Bayesian Industry Approach to Phase 1 Combination Trials in Oncology
PDF
2014-10-22 EUGM | WEI | Moving Beyond the Comfort Zone in Practicing Translat...
PDF
2014-10-22 EUGM | PROSCHAN | Blinded Adaptations Permutations Tests and T-Tests
PDF
Adaptive Phase 2 Design in Post Surgical Pain
PPTX
2014 EUGM - Blinded Adaptations, Permutations Tests and T Tests
PDF
Infosheet east-sample-size-re-estimation
PDF
Infosheet east-powered-by-architect
PDF
Infosheet east-bayesian-power-calculations
Eugm 2012 unknown - incivex drug development process overview road to findi...
Eugm 2012 mehta - future plans for east - 2012 eugm
Eugm 2012 gaydos - design and analysis approaches to evaluate cardiovascula...
EUGM 2011 | JEMIAI
EUGM 2011 | JEHL | group sequential designs with 2 time to event endpoints
EUGM 2011 | DARCHY | Deployment & use of east within sanofi r & d
EUGM 2014 | BEKELE | Adaptive Dose Finding Using Toxicity Probability Intervals
A Bayesian Industry Approach to Phase 1 Combination Trials in Oncology
2014-10-22 EUGM | WEI | Moving Beyond the Comfort Zone in Practicing Translat...
2014-10-22 EUGM | PROSCHAN | Blinded Adaptations Permutations Tests and T-Tests
Adaptive Phase 2 Design in Post Surgical Pain
2014 EUGM - Blinded Adaptations, Permutations Tests and T Tests
Infosheet east-sample-size-re-estimation
Infosheet east-powered-by-architect
Infosheet east-bayesian-power-calculations
Ad

Recently uploaded (20)

PPT
Copy-Histopathology Practical by CMDA ESUTH CHAPTER(0) - Copy.ppt
PPTX
Pathophysiology And Clinical Features Of Peripheral Nervous System .pptx
PPTX
post stroke aphasia rehabilitation physician
PPT
OPIOID ANALGESICS AND THEIR IMPLICATIONS
DOCX
RUHS II MBBS Microbiology Paper-II with Answer Key | 6th August 2025 (New Sch...
PPT
genitourinary-cancers_1.ppt Nursing care of clients with GU cancer
PPTX
ca esophagus molecula biology detailaed molecular biology of tumors of esophagus
PDF
Human Health And Disease hggyutgghg .pdf
PPTX
Acid Base Disorders educational power point.pptx
PPTX
Neuropathic pain.ppt treatment managment
PPTX
Note on Abortion.pptx for the student note
PPT
Obstructive sleep apnea in orthodontics treatment
PDF
Intl J Gynecology Obste - 2021 - Melamed - FIGO International Federation o...
PPTX
CEREBROVASCULAR DISORDER.POWERPOINT PRESENTATIONx
PDF
Medical Evidence in the Criminal Justice Delivery System in.pdf
PPTX
1 General Principles of Radiotherapy.pptx
PPTX
Slider: TOC sampling methods for cleaning validation
PPTX
Important Obstetric Emergency that must be recognised
PDF
CT Anatomy for Radiotherapy.pdf eryuioooop
PDF
NEET PG 2025 | 200 High-Yield Recall Topics Across All Subjects
Copy-Histopathology Practical by CMDA ESUTH CHAPTER(0) - Copy.ppt
Pathophysiology And Clinical Features Of Peripheral Nervous System .pptx
post stroke aphasia rehabilitation physician
OPIOID ANALGESICS AND THEIR IMPLICATIONS
RUHS II MBBS Microbiology Paper-II with Answer Key | 6th August 2025 (New Sch...
genitourinary-cancers_1.ppt Nursing care of clients with GU cancer
ca esophagus molecula biology detailaed molecular biology of tumors of esophagus
Human Health And Disease hggyutgghg .pdf
Acid Base Disorders educational power point.pptx
Neuropathic pain.ppt treatment managment
Note on Abortion.pptx for the student note
Obstructive sleep apnea in orthodontics treatment
Intl J Gynecology Obste - 2021 - Melamed - FIGO International Federation o...
CEREBROVASCULAR DISORDER.POWERPOINT PRESENTATIONx
Medical Evidence in the Criminal Justice Delivery System in.pdf
1 General Principles of Radiotherapy.pptx
Slider: TOC sampling methods for cleaning validation
Important Obstetric Emergency that must be recognised
CT Anatomy for Radiotherapy.pdf eryuioooop
NEET PG 2025 | 200 High-Yield Recall Topics Across All Subjects

EUGM 2011 | DAY | Experiences with interim analyses and dm cs