Skip to content
← All articles

Survival of what, exactly?

In this article
  1. Four ways of defining the end
  2. The same patient, coded three ways
  3. What that gives on a whole cohort
  4. Not all censoring is equal
  5. Why industry rarely chooses overall survival
  6. The trap of the assessment schedule
  7. A hazard ratio is an average like any other
  8. What this changes for valuing an asset

A company announces that its product "improves survival by eight months". The sentence looks clear. It is not, and one word is missing: survival of what?

Because in oncology, we never measure survival. We measure one of the possible endpoints, and the same trial, on the same patients, at the same dates, produces different curves depending on which one was chosen. The choice of endpoint is not a debate for methodologists: it is the parameter that decides the result, the read-out schedule of the trial, and ultimately what the asset is worth.

Four ways of defining the end

A survival curve needs two things: a start date, and an event marking the end. The start date is rarely disputed. The event is.

Overall survival — OS. The event is death, from any cause. It is the most solid endpoint there is: death is not a matter of opinion, does not depend on the observer's eye, does not vary with the protocol. A patient still alive at the end of follow-up is censored, and that is all.

Progression-free survival — PFS. The event is disease progression or death, whichever comes first. A composite endpoint, then, and one that assumes we can say when the disease progressed.

Disease-free survival — DFS. Used after curative-intent treatment, typically surgery: the patient leaves disease-free, and the event is the reappearance of the disease or death. It appears under other names depending on what one decides to include — recurrence-free survival when deaths unrelated to the disease are excluded.

Time to progression — TTP. Progression alone, with deaths treated as censoring. This one deserves a warning: censoring deaths in order to measure progression amounts to pretending a deceased patient will progress later. That is the competing-risks error, and it always overstates the endpoint measured. When several exits compete for the same population, cumulative incidence is required, not one curve per cause.

A survival curve does not measure life. It measures the definition we gave to the end.

The same patient, coded three ways

It is at patient level that this becomes tangible. Take six patients from a metastatic cohort, followed to a cut-off set at thirty-six months, and watch how each one enters each calculation.

Patient What happens OS PFS TTP
A Progresses at 7 months, dies at 21 event at 21 event at 7 event at 7
B Dies at 9 months, no documented progression event at 9 event at 9 censored at 9
C Alive, progression-free at 36 months censored at 36 censored at 36 censored at 36
D Progresses at 11 months, alive at 36 censored at 36 event at 11 event at 11
E Lost to follow-up at 14 months, no event censored at 14 censored at 14 censored at 14
F Progresses at 5 months, lost to follow-up at 16 censored at 16 event at 5 event at 5

Three columns, six patients, and not a single row identical throughout. Patient B is the most instructive: he never progressed, yet he counts as an event in progression-free survival — because death is part of it — while he is censored in time to progression. Patient D is an event in PFS and a censoring in OS: the same man, on the same date, counted in one case and set aside in the other.

A file holding only a "duration" column and a "status" column cannot produce those three readings. You need the progression date, the death date, the last-contact date, and you need to know which one is missing and why.

What that gives on a whole cohort

Move to forty patients. Here, on exactly the same records, are the two curves obtained by changing only the definition of the event.

8.2 months 18.1 months 100%75% 50%25%0% 0612 182430 36 months since enrolment Progression-free survival Overall survival
Quarante patients, une seule cohorte, deux définitions de l'événement. Médiane de survie sans progression : 8.2 months. Médiane de survie globale : 18.1 months. Cohorte construite à titre d'illustration ; les ordres de grandeur sont ceux d'une situation métastatique courante.

A ratio of one to two. And these are not two populations, nor two treatments, nor two periods: they are the same forty records, read twice.

Something else can be read off the drawing. At six months, progression-free survival has already fallen to 65 % while overall survival is still at 98 %: in the early months almost everything that happens is a progression, almost nobody dies. By twenty-four months the relation reverses — there is nothing left to progress, and overall survival keeps declining slowly. The two curves do not merely measure different quantities, they describe different moments of the disease.

A sponsor reading the trial on progression has an answer around month twelve. The same trial read on overall survival is not ripe for three years, and even then.

Not all censoring is equal

Go back to the table of six patients and stop at E and F. Both are censored, like patient C. But C is censored because the study ended while he was doing well, whereas E and F disappeared. The calculation treats them in exactly the same way. It should not.

Kaplan-Meier rests on an assumption rarely stated aloud: censoring must say nothing about prognosis. Leaving observation must be unrelated to being about to progress or die. Statisticians call this non-informative censoring, and everything depends on why we stopped seeing the subject.

There is administrative censoring: the study stops on a date, we stop observing everyone at once. The calendar does not know who is going to die, it does not choose whom it censors. That censoring is clean by construction.

And there is loss to follow-up, which is another matter entirely. A patient stops coming to clinic. Why? Sometimes he has moved, and it means nothing. Often he is too unwell to travel, or he has been admitted elsewhere, or he has died without the centre being told. In those cases the patient leaves the study precisely because his prognosis has worsened — and he leaves without being counted as an event. The resulting curve is too flattering, and nothing in the calculation says so.

The direction of the bias is worth seeing clearly. Patients lost to follow-up are, on average, in worse shape than those who come back. Removing them from the population at risk amounts to keeping only the healthier: estimated survival rises. Loss to follow-up always flatters the result, which is awkward when you are trying to demonstrate a benefit.

Hence three reflexes when facing a published curve. Look at the rate of loss to follow-up — beyond 10 to 15 %, caution is due. Check that it is comparable between arms: an arm losing twice as many patients as the other invalidates the comparison, and this happens when a treatment is harder to tolerate. And look for the sensitivity analysis: what becomes of the result if every patient lost to follow-up is assumed to have progressed the day after their last visit? If the conclusion survives that pessimistic scenario it is solid; if it collapses, it rested on the absent.

The distinction is not confined to the clinic. A customer who stops answering your reminders is not in the same situation as one whose contract is still running at your analysis cut-off. The first has probably already gone.

Why industry rarely chooses overall survival

There, then, is the reason, and it is prosaic: overall survival is slow.

Take an adjuvant setting — a cancer removed by surgery, a treatment meant to prevent relapse. Most patients will not die within the trial window; many will not die of the disease. Waiting for enough deaths to compare two arms would take ten or fifteen years. No sponsor funds that, and it would be questionable to keep the next patients waiting when the answer already exists in another form.

So we measure recurrence, which happens far sooner. The trial reads out faster, costs less, the authorisation arrives earlier, the asset is valued earlier. Everyone gains — on one condition: that not recurring correctly predicts living longer.

That condition does not hold everywhere. It has been established on large meta-analyses in some tumour types and remains debated in others. A progression-free survival gain may perfectly well fail to translate into an overall survival gain: because the benefit wears off, because patients in the other arm receive the treatment when they progress — which mechanically brings the two overall survival curves closer without taking anything away from the real benefit — or because progression seen on imaging was not the event that mattered to the patient.

In other words: the intermediate endpoint is a bet on the final one. A reasonable bet, sometimes a validated one, never a free one.

The trap of the assessment schedule

Here is a subtlety that costs money and is rarely discussed outside methodology teams.

Death has a date. Progression does not — it has a date of detection. We do not know a tumour progressed on the Tuesday; we know it had progressed by the day of the scan. If the protocol schedules imaging every eight weeks, every progression occurring between two assessments is assigned to the date of the second.

Two consequences. Progression-free survival is systematically overstated relative to biological reality, by roughly half the interval between assessments — four weeks, in our example. And more importantly, if the two arms of a trial are not assessed at the same frequency, the comparison is distorted: the more closely watched arm will have its progressions detected earlier and will look worse, without being worse.

That is why protocols impose an identical assessment schedule in both arms, and why any deviation is a problem. The general rule is worth keeping beyond oncology: when an event is not observed but detected, the detection apparatus is part of the measurement. A production incident "occurs" the day the sensor sees it; an invoice "becomes" overdue the day somebody chases it.

A hazard ratio is an average like any other

One last point, and it is the one that ties this subject to the rest.

To compare two curves, we almost always publish a hazard ratio — 0.72, say. A single number to summarise the comparison of two entire curves. It is convenient, and legitimate as long as one assumption holds: that the ratio between the two hazards stays roughly constant over time.

When that assumption fails, the number loses its meaning. The best-known case is immunotherapy, whose curves separate late: for the first months the two arms are indistinguishable, or the treatment even does worse, then a subgroup of patients responds durably and the curve forms a plateau. A single hazard ratio averages those two opposite regimes and describes neither. If the curves cross, it can even approach 1 while the treatment radically changes the fate of some patients.

The attentive reader will recognise Anscombe's quartet in another costume. A hazard ratio is to a survival curve what a mean is to a distribution: a summary faithful only if the shape is regular. When it is not, you have to look at the drawing — and publish values at chosen horizons, survival at two years, at five years, rather than a single coefficient.

What this changes for valuing an asset

Three practical consequences, and all three can be costed.

The endpoint sets the read-out date, hence the discounting. Look again at the figure: twelve months against three years for the same trial. An adjuvant programme read on recurrence delivers a result years before the same programme read on overall survival. Two calendars, two present values, one molecule.

The endpoint sets the residual risk after authorisation. An authorisation obtained on an intermediate endpoint carries a debt: the confirmatory trial. The advanced therapies dataset offers a clean case — Alofisel, the only termination for efficacy among the nine observed, left the market because its confirmatory trial failed to meet its primary endpoint. The authorisation was there, the product was marketed, and the final endpoint settled the matter.

The endpoint sets the pricing negotiation. Assessment bodies do not give the same weight to a progression-free survival gain as to an overall survival gain. A valuation model that ignores this implicitly assumes the payer does not tell the difference. The payer does.

So, faced with a dossier, resist the natural question — by how much does it improve survival? Ask instead: which event was chosen to be counted, who established it, and how often was it looked for? The three answers are worth more than the figure they produce.

This article follows on from a duration is never stored alone, on right-censoring and the Kaplan-Meier estimator.

← All articles