{"id":1047,"date":"2020-06-26T23:30:49","date_gmt":"2020-06-27T03:30:49","guid":{"rendered":"http:\/\/aristotle2digital.blogwyrm.com\/?p=1047"},"modified":"2021-11-25T21:28:45","modified_gmt":"2021-11-26T02:28:45","slug":"randomness-and-structure-or-monkey-mayhem","status":"publish","type":"post","link":"https:\/\/aristotle2digital.blogwyrm.com\/?p=1047","title":{"rendered":"Randomness and Structure (or Monkey Mayhem)"},"content":{"rendered":"\n<p>There is a lot of plain silliness surrounding how people talk about the role of randomness in producing structure in nature. &nbsp;There is no denying that randomness either exists in nature or that we have to invoke random behavior in our models due to our ignorance (which of these you choose is a matter of some philosophical debate).&nbsp; However, there is also no denying that its role is far from understood, and that some of the brasher amongst us forget this from time-to-time, and end up uttering the most ridiculous pronouncements.<\/p>\n\n\n\n<p>The poster child for this sort of unalloyed over-zealousness\nis nicely examined and ridiculed in the following homework exercise from the book <em>Thermal Physics<\/em>, by Kittel and Kromer,\nwho broached the question about the role of pure randomness in their question\nentitled <em>The meaning of \u201cnever\u201d<\/em> (page 53 in the 2<sup>nd<\/sup>\nedition).&nbsp; The beginning of the problem\nreads<\/p>\n\n\n\n<div class=\"myQuoteDiv\">It\nhas been said (footnote: J. Jeans, <em>Mysterious Universe<\/em>, Cambridge\nUniversity Press, 1930, p. 4.&nbsp; The\nstatement is attributed to Huxley) that \u201csix monkeys, set to strum\nunintelligently on typewriters for millions of years, would be bound in time to\nwrite all the books in the British Museum.\u201d\u2026Could all the monkeys in the world\nhave typed out a single specified book in the age of the universe?<\/div>\n\n\n\n<p>While the attribution to Huxley by Jeans (presumably Thomas Henry Huxley) seems to be apocryphal, it is clear that a large segment of the population shares in the expressed sentiment that randomness eventually leads to structure.&nbsp; The operative question is, should they be believing in the power of fluctuations and chance.<\/p>\n\n\n\n<p>To\nhelp in answering the posed question, Kittel and Kromer ask the student to make\nthe following assumptions:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>The monkeys have 44 keys on their typewriters.  Ignoring the use of the shift key, the breakdown is 26 letters, 10 digits, 8 punctuation marks.\u00a0 Modern laptop keyboards seem to have something more like 10 punctuation mark keys  but a smaller number of keys is better for the meandering paws of the monkeys as they have fewer ways of producing gibberish.<\/li><li>The primate population is $10^{10}$ monkeys, which corresponds to 10 billion simian typists, roughly 30% more than the number of people walking the planet at this moment<\/li><li>Allot $10^{18}$ seconds to our monkeys for their unorchestrated typing.\u00a0 This time span totals up at about 31.7      billion years compared to the 13.8 billion years <a href=\"https:\/\/en.wikipedia.org\/wiki\/Age_of_the_universe\">estimated age of the universe<\/a>.<\/li><li>Each monkey can type 10 characters per second, which is fast even for trained typists.<\/li><li>The specified text is Hamlet, which has $10^5$ characters, and we ignore case.<\/li><\/ul>\n\n\n\n<p>Kittel and Kromer calculate that the probability that any 100,000 character string chosen at random matches Hamlet is $10^{-164,345}$  and that the probability that the monkeys will produce Hamlet is $ 10^{-164,316}$ to which they state:<\/p>\n\n\n\n<p>\n<div class = \"myQuoteDiv\">The\nprobability of Hamlet is therefore zero in any operational sense of an event,\nso the original statement at the beginning of the problem is nonsense: one\nbook, much less a library, will never occur in the total literary production of\nthe monkeys.<\/div><\/p>\n\n\n\n<p>But, before moving onto a deeper discussion about randomness and structure, it is useful to skim through the probability computations in a simplified setting.&nbsp; To see the nuts and bolts, we will ask what is the probability of producing the inviting string \u2018hello\u2019 given a keyboard with only 14 keys corresponding to the first fourteen letters of the alphabet {a,b,c,d,e,f,g,h,i,k,l,m,n,o}.&nbsp;&nbsp; There are five characters in the target string translating to five slots each with 14 possible choices for a grand total of 537,824 possible choices (one of which is shown below).<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"857\" height=\"292\" src=\"http:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2020\/06\/hello_random.png\" alt=\"\" class=\"wp-image-1045\" srcset=\"https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2020\/06\/hello_random.png 857w, https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2020\/06\/hello_random-300x102.png 300w, https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2020\/06\/hello_random-768x262.png 768w, https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2020\/06\/hello_random-810x276.png 810w\" sizes=\"auto, (max-width: 857px) 100vw, 857px\" \/><\/figure>\n\n\n\n<p>The only additional pieces used in the Kittel and Kromer problem, which are not needed in this simple example, are the use of logarithms to estimate the number of realizations of Hamlet at $44^{10^5}$ and the multiplication of the corresponding probability by $10^{29}$ to account for the number of realizations that the monkey population can produce in the allotted time.<\/p>\n\n\n\n<p>Numbers like these are, or should be, damning evidence to anyone who thinks structure arises solely from random fluctuations and this problem has been a major hurdle that biologists have to deal with when considering how life evolves.&nbsp; After all, the idea that many people have about biological evolution is that, if one waits long enough, structure will appear, but, clearly, that can\u2019t happen simply with blind chance.<\/p>\n\n\n\n<p>So, how should one think about the role that randomness plays\nin physical and biological phenomena?&nbsp;\nRichard Dawkins claims in <em>The Blind Watcher<\/em> that the key to\nrandomness in biological processes is found in the concept of cumulative\nselection.&nbsp; He brushes aside the\nobjections raised above in his chapter entitled \u2018Accumulating small change\u2019.&nbsp; In that chapter, Dawkins supports this claim\nby presenting his \u2018weasel program\u2019, which is a piece of code that takes a\nrandom string (produced, say, by one of the monkeys) and breeds a fitter\nstring.&nbsp; For example, one can take \u2018aF!rty.opRSWi\u2019\nand breed it towards \u2018Hello, World!\u2019.&nbsp; <\/p>\n\n\n\n<p>Dawkins is quite proud of his little tinkering and he uses it as refutation of the idea of intelligent design.&nbsp; However, his program is simply a probabilistic way of traversing a tree of all possible strings of the target length from a random string towards the bottom to a specific string at the top using a fitness function and a rate of randomizing, which he calls mutation.&nbsp;<\/p>\n\n\n\n<p>The following figure illustrates the 27 random strings that can be created from the simple alphabet of {aer}.&nbsp; Each variation is color-coded based on how many mutations away it is from the target string \u2018ear\u2019, with green, yellow, and red corresponding to 1, 2, or 3 mutations, respectively.&nbsp; The arrows show the connections between levels for one particular path to the target passing through the single mutation of &#8216;ear&#8217; to &#8216;aar&#8217;. <\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"857\" height=\"265\" src=\"http:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2020\/06\/random_ear_tree-1.png\" alt=\"\" class=\"wp-image-1063\" srcset=\"https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2020\/06\/random_ear_tree-1.png 857w, https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2020\/06\/random_ear_tree-1-300x93.png 300w, https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2020\/06\/random_ear_tree-1-768x237.png 768w, https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2020\/06\/random_ear_tree-1-810x250.png 810w\" sizes=\"auto, (max-width: 857px) 100vw, 857px\" \/><\/figure>\n\n\n\n<p>For simplicity, assume that when the program breeds a brood\nfrom a given parent it can only make one mutation.&nbsp; Then it can move the fitness up a level or\ndown a level or keep it the same (with obvious limitations at the top and\nbottom).&nbsp; The action of selecting the fittest\nchild is the equivalent of always moving up the ladder provided a sufficient\nnumber of children are produced.&nbsp; It is an\nalmost certainty that the program must reach its goal.&nbsp; And so, Dawkins argues, randomness amortized\nover generations produces the most complex structures we know \u2013 living organisms.&nbsp; <\/p>\n\n\n\n<p>But the weasel program merely underscores his sloppy\nthinking about randomness.&nbsp; Dawkins\u2019s process\nof cumulative selection is just that, a process that assumes a whole set of\ndeterministic rules, of which the following are a sample:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>The length of the target string is known a priori<\/li><li>The content of the target string is also known \u2013 it is the goal or telos of the algorithm<\/li><li>A deterministic fitness function exists that clearly finds the best string or strings from a set <\/li><li>At each generation a fixed number of children are produced <\/li><li>The best child is always chosen by the fitness function<\/li><li>The best child always fathers the next generation<\/li><li>The algorithm exists within a deterministic environment in which strings can be interpreted as commands, and those commands do the same thing time and again<\/li><\/ul>\n\n\n\n<p>With so much structure it is easy to see why a desirable outcome results in a fairly short amount of time.&nbsp; The key point is that a clear set of underlying rules combined with some randomness is really the only way in which a stochastic process leads to structure.&nbsp; In other words, it is the process that matters, and blind chance merely adds spice to the recipe.&nbsp; How the underlying process comes about is something which, curiously, Dawkins has little to say, but that hasn\u2019t prevented untold numbers of people being duped by his 20<sup>th<\/sup> century version of the \u2018Huxley argument\u2019 about randomness.&nbsp; I guess <em>monkey see, monkey do<\/em>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>There is a lot of plain silliness surrounding how people talk about the role of randomness in producing structure in nature. &nbsp;There is no denying that randomness either exists in&#8230; <a class=\"read-more-button\" href=\"https:\/\/aristotle2digital.blogwyrm.com\/?p=1047\">Read more &gt;<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1047","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/1047","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1047"}],"version-history":[{"count":0,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/1047\/revisions"}],"wp:attachment":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1047"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1047"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1047"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}