{"id":557,"date":"2016-08-26T23:30:34","date_gmt":"2016-08-27T03:30:34","guid":{"rendered":"http:\/\/aristotle2digital.blogwyrm.com\/?p=557"},"modified":"2016-08-25T23:12:50","modified_gmt":"2016-08-26T03:12:50","slug":"dental-floss-and-epistemology","status":"publish","type":"post","link":"https:\/\/aristotle2digital.blogwyrm.com\/?p=557","title":{"rendered":"Dental Floss and Epistemology"},"content":{"rendered":"

The jury is in!\u00a0 The weight of science has been thrown down on yet another study and now we can all safely rest at night.\u00a0 We can all look our dentists right in the eye (or should it be mouth?) when he asks have we flossed and we can say \u201cNope, science says we don\u2019t need to!<\/a>\u201d<\/p>\n

But it is worth asking just why is everyone sure that this is the right thing to do?\u00a0 Haven\u2019t scientific studies been wrong before?\u00a0 Wasn\u2019t there science behind the recommendation to floss? Just how long will it be until a new study overturns the old one?\u00a0 And is it really true flossing has no benefit (outside the profits for the manufacturers)?<\/p>\n

Let me take a stab at addressing the first questions immediately and deferring the benefits of flossing until later.<\/p>\n

Perhaps the best place to start is by discussing a thought-provoking article entitled Scientific Regress<\/em> from the May 2016 edition of First Things<\/em>.\u00a0 In that piece, William A. Wilson, a software engineer, gives a nice summary and analysis of the state of modern science.\u00a0 Not the state of its discoveries or knowledge base but the state of what it knows about itself and how it knows what it knows to be true.\u00a0 In other words, Wilson gives a meta-analysis of the state of the scientific method and its corresponding epistemology.<\/p>\n

Of course, the central notion to any of the scientific enterprises is the idea that what happens in the hear-and-now is applicable to the there-and-then.\u00a0 Without that basic premise, science would nothing more than a set of anecdotes starting with \u201cI swear that I witnessed\u2026\u201d.\u00a0 It is vital that scientific claims are verifiable.\u00a0 Repeating an experiment, which should be done often, should give rise to the same results and the same conclusions.\u00a0 After all, that is the underlying mechanism by which scientific discoveries become technological breakthroughs.\u00a0 Think what would happen if the original experiment that established the proof-of-concept of the solid state transistor were a one-off.\u00a0 Goodbye cellphone, household computers, the internet, inexpensive televisions and radios, and hosts of other modern-day goodies.<\/p>\n

And yet, the picture that Wilson paints about modern scientific explorations shows a system that is seriously flawed.\u00a0 He cites the efforts of the Open Science Collaboration (OSC) that tried to replicate 100 published psychology experiments taken from three of the most prestigious journals of the field.\u00a0 (I\u2019ll have occasion to revisit the notion of prestigious a bit later).<\/p>\n

According to the article, OSC found that, in 65 cases, they could not replicate the positive results that were reported in these so-called scientific studies.\u00a0 In addition, they found that a bulk of the remaining 35 cases were marginal in that their positive results were not nearly as statistically significant as first claimed.<\/p>\n

And while other disciplines are not plagued with irreproducibility of this magnitude, there are still many cases where the results of given experiments can\u2019t be corroborated by other groups.<\/p>\n

So what is behind this lack of reproducibility? According to Wilson, the answer lies in one of two areas.<\/p>\n

First is the possibility that there is a set of confounding variables in the experiment \u2013 conditions that need to be controlled but are not recognized as such. For example, if temperature were important in a study of perceptual psychology but was never imagined to be so then the study authors may not report the temperature and therefore their experiment would not be exactly reproduced.\u00a0 This explanation would be one-part blessing and one-part curse as the presence of such an effect would reveal layers of reality unknown to this point but would make it hard to ever replicate an experiment.\u00a0 Of course, this kind of thing happens, but to occur with a frequency high enough to explain the OSC results strains credulity.<\/p>\n

The second, and more likely reason, is that the original conclusions of the study are simply wrong.\u00a0 Three possibilities here; what I will call statistical false alarms, group think (what Bacon & Bacon<\/a> call either Authority or Idols of the Theater), and downright fakery.<\/p>\n

The most reassuring one is the statistical false alarms.\u00a0 There is a nice Bayesian argument that Wilson attributes to John Ioannidis that argues that many scientific studies must be wrong.\u00a0 The argument goes something like this.\u00a0 Suppose you have a gem detector that has an accuracy of 95%, which means that if you know it is hovering over a gem it will alert the user positively most of the time and, conversely, if it is hovering over a piece of glass it will not react most of the time.\u00a0 Armed with this good detector, you then journey out to a field filled with pieces of glass and an occasional gem dropped into the mix.\u00a0 Since you don\u2019t know which is which and the population of the gems within the greater population of useless baubles is very small, the actual probability of getting a false alarm can be very high.\u00a0 Details on this kind of argument can be found in an earlier column on Bayesian analysis<\/a>.\u00a0 Now consider the gem or useless bauble as a positive scientific discovery or null result, respectively, and the usual machinery of statistical inference to a 95% confidence as the gem detector and you are left to conclude that the possibilities of new discoveries reported in a study bearing up under scrutiny are rather low.<\/p>\n

But isn\u2019t this how science feels its way forward?\u00a0 Isn\u2019t this how we progress?\u00a0 The answer to these queries is actually a guarded yes.\u00a0 Our tolerance to being wrong shouldn\u2019t blind us to wrong-doing.\u00a0 Some of that wrong-doing is subtle and often due to the perverse incentives that we, as a society, has heaped on the scientific enterprise.<\/p>\n

Consider the possibility of group think in research.\u00a0 Positive results receive huge press releases, the promise of fame and fortune, and a huge boost to the intellectual pride.\u00a0 Articles based on \u2018breakthroughs\u2019 aim for large impact factors and all but guarantee tenured positions and speaking circuits. Negative results, often far more important in the scheme of things, are judged to be not worth reporting.\u00a0 This despite the fact that as Edison famously said about \u2018failure\u2019:<\/p>\n

Negative results are just what I want.\u00a0 They\u2019re just as valuable to me as positive results.\u00a0 I can never find the thing that does the job best until I find ones that don\u2019t.<\/div>\n

Far worse than this institutionalized self-delusion is the case of outright fakery.\u00a0 As the recent spate of scandals indicate, it is all too common \u2013 and not just in the soft sciences.\u00a0 It is standard to see complaints of plagiarism in the physical sciences (especially from India and China).\u00a0 Reports abound of authors gaming of the peer-review system by creating aliases for themselves that give them the ability to vet their own articles.<\/p>\n

Far worse than any of these offenses is the downright cheating that is becoming all-too common.\u00a0 There have been amazing examples of the wool being pulled over the collective eyes of peer review.\u00a0 One of my favorites is narrated in the book Plastic Fantastic<\/a><\/em>, by Eugenie Samuel, which narrates the flummery of one Jans Hendrik Sch\u00f6n<\/a> a German physicist who became a famous figure in condensed matter physics with his breakthrough results.\u00a0 He was given two prestigious awards and published in the prestigious journals of Science<\/em> and Nature<\/em> (there is that adjective again) before the house of cards came tumbling down when it was determine that he hoodwinked \u2018smart\u2019 people for years with amazing but made-up results.\u00a0 Papers were retracted from many prestigious journals, proving that prestige is more perception than anything else.\u00a0 Sch\u00f6n\u2019s story is hardly an isolated case and some simple searches can find lots of examples of academic foul play.\u00a0 There have always been cheats in science but the current system encourages it to a degree never seen before \u2013 after all there is big money in and power in science.<\/p>\n

So what to do when a new study comes out?\u00a0 For the most part, take it with a grain of salt, especially if it is predominantly populated by statistical analysis using hypothesis testing with no clear physical mechanism to explain the results.\u00a0 As for flossing \u2013 well I will continue to do it (even though I would love to stop).\u00a0 The reason being that I have actually experimented with flossing and not flossing and have found that my mouth feels better, I breathe better, and my teeth have fewer complaints (pain, cavities, etc.) for the dentist.\u00a0 I suspect that the reason that my results are in conflict with this study is that all of human kind can\u2019t be summarized by a \u2018representative sample\u2019 and that something about me, whether it is nature or nurture, sets into one of those small populations that Bayesian analysis warns us about.<\/p>\n","protected":false},"excerpt":{"rendered":"

The jury is in!\u00a0 The weight of science has been thrown down on yet another study and now we can all safely rest at night.\u00a0 We can all look our… Read more ><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-557","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/557","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=557"}],"version-history":[{"count":0,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/557\/revisions"}],"wp:attachment":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=557"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=557"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=557"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}