Covid exposed scientific inference and uncertainty to the public at a very consequential time, and Kucharski, as one of the epidemiologists involved in the UK governmentâs response to COVID, was right in the middle of it. He goes into some detail about the different methods they used and how they tried and sometimes failed to communicate the results to the public, noting that scientists from different fields also didnât always agree on the evidence, and sometimes seemed to prefer their own methods. âFor certain biologists, it seemed Alpha wouldnât be more transmissible unless the evidence came from methods they had expertise in.â
The two chapters that cover ways of scientifically synthesising evidence and how that can go wrong (5&6) cover a very broad set of philosophical ideas interspersed with interesting anecdotes, but it takes a lot of work from the reader to make the connections and I doubt someone unfamiliar with the area would be able to really understand all the different threads.
The book ends on an interesting discussion about proof without human understanding. Mathematicians had to start contending with this from the 1970s when the first âproofs by exhaustionâ were performed. The classic example is the proof that any map could be filled in with just four colours so that any countries that bordered each other had different colours. This was demonstrated in 1976 when a computer program found a solution for the set of maps layouts that any map could be reduced to. There is something unsatisfying about proving something by brute force rather than through logic, but that has become more common as computers have become more powerful. In fact, this type of proof may actually be easier to verify by more people, than a complex derivation that spans thousands of pages and requires specialised mathematical knowledge.
âWhen Wolfgang Hakenâs son, a PhD student at Berkley, gave a lecture on his fatherâs proof of the four-colour theorem, he recalled the audience reaction: âThe older listeners asked, âHow can you believe a proof that makes such heavy use of a computer?â The younger listeners asked, âHow can you believe a proof that depends on the accuracy of 400 pages of hand verification of detail?ââ One eraâs definition of certainty had become the next generationâs source of fallibility.â
This leads on to a discussion of AI and the general discomfort with black-box models. Kucharski makes the point that in other domains we regularly use methods that we donât fully understand, like defibrillators, general anaesthesia and flying planes so why not black box algorithms in self-driving cars or large language models.
Overall, fascinating topic, with good stories and anecdotes peppered throughout and a pretty good structure, but so many concepts packed in and the relationship with the stories not always explicit making it sometimes hard to follow.