{"id":713,"date":"2018-01-26T23:30:48","date_gmt":"2018-01-27T04:30:48","guid":{"rendered":"http:\/\/aristotle2digital.blogwyrm.com\/?p=713"},"modified":"2018-01-26T07:35:19","modified_gmt":"2018-01-26T12:35:19","slug":"713","status":"publish","type":"post","link":"https:\/\/aristotle2digital.blogwyrm.com\/?p=713","title":{"rendered":"Logically the Best"},"content":{"rendered":"<p>In keeping with the New Years Theme, this month\u2019s column lists the five most important accomplishments from the world of logic, mathematics, computing, or philosophy in the last 100 years.\u00a0 This idea is an offshoot of the books <em>Five Golden Rules: Great Theories of 20<sup>th<\/sup> Century Mathematics \u2013 and Why They Matter<\/em><\/p>\n<p><a href=\"http:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2018\/01\/Five_Golden_Rules.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-711\" src=\"http:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2018\/01\/Five_Golden_Rules.jpg\" alt=\"\" width=\"331\" height=\"499\" srcset=\"https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2018\/01\/Five_Golden_Rules.jpg 331w, https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2018\/01\/Five_Golden_Rules-199x300.jpg 199w\" sizes=\"auto, (max-width: 331px) 100vw, 331px\" \/><\/a><\/p>\n<p>and <em>Five More Golden Rules: Knots, Codes, Chaos and Other Great Theories of 20<sup>th<\/sup> Century Mathematics<\/em>,<\/p>\n<p><a href=\"http:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2018\/01\/Five_More_Golden_Rules.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-712\" src=\"http:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2018\/01\/Five_More_Golden_Rules.jpg\" alt=\"\" width=\"305\" height=\"474\" srcset=\"https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2018\/01\/Five_More_Golden_Rules.jpg 305w, https:\/\/aristotle2digital.blogwyrm.com\/wp-content\/uploads\/2018\/01\/Five_More_Golden_Rules-193x300.jpg 193w\" sizes=\"auto, (max-width: 305px) 100vw, 305px\" \/><\/a><\/p>\n<p>both written by John Casti.\u00a0 In these works, Casti devotes a chapter to each of the following:<\/p>\n<ol>\n<li>Minimax Theorem (Game Theory)<\/li>\n<li>Brouwer Fixed-Point Theorem (Topology)<\/li>\n<li>Morse\u2019s Theorem (Singularity Theory)<\/li>\n<li>Halting Theorem (Theory of Computation)<\/li>\n<li>Simplex Method (Optimization Theory)<\/li>\n<li>Alexander Knot Polynomial (Knot Theory)<\/li>\n<li>Hopf Bifurcation (Dynamical System Theory)<\/li>\n<li>Kalman Filter (Control Theory)<\/li>\n<li>Hahn-Banach Theorem (Functional Analysis)<\/li>\n<li>Shannon Coding Theorem (Information Theory)<\/li>\n<\/ol>\n<p>with items 1-5 being from the first book and 6-10 from the second.<\/p>\n<p>The idea of ranking my own top 5 had been pinballing around the back of my mind since I first encountered these books in 2015 and when the opportunity presented itself for this month\u2019s theme, I thought I would seize it and run.\u00a0 But it is important to be aware that the list I\u2019ve compiled here is my own, inspired by Casti\u2019s work, but independent in both content and analysis.\u00a0 In fact, I think Casti misses the two most important contributions even with a list of 10 \u2013 but that is a matter of judgement and taste.<\/p>\n<p>So, without any more preamble, let\u2019s get to the list.<\/p>\n<ol start=\"5\">\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Kalman_filter\">Kalman Filter<\/a><\/li>\n<\/ol>\n<p>It is hard to overemphasize the Kalman filter\u2019s importance to real time computing.\u00a0 The algorithm allows for fitting and estimation to be performed, in the presence of noise and uncertainty, during the course of process, such as the motion of a robotic arm or the flight of a spacecraft.\u00a0 The filter takes in measured points as they become available and \u2018re-fits\u2019 the new point in the context of all previous points thereby giving an improved estimate of the state of the system.\u00a0 The key point is that the system directly takes into account both the uncertainty in the measurements as well as the short-comings of any physical model of the motion.\u00a0 The introduction of the Kalman Filter gave rise to a whole industry of algorithm development (extended Kalman Filters, unscented filters, Bayesian networks, etc.) that balance model-based prediction (e.g. Newton\u2019s laws) with uncertainty in knowledge and measurement \u2013 the essential ingredient for computation in the real world.\u00a0 Final note:\u00a0 Casti also recognizes the Kalman filter.<\/p>\n<ol start=\"4\">\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Mathematical_optimization\">Optimization Techniques<\/a><\/li>\n<\/ol>\n<p>This entry is a catch-all for a variety of algorithms and approaches that have been stirred into action with the advent of the computer.\u00a0 While not particularly glamourous, optimization methods solve a host of real world problems associated with getting the best; as long as best can be mathematically encoded in something called an objective function.\u00a0 There are two basic families of optimization algorithms:\u00a0 indirect and direct.\u00a0 In the indirect method, additional equations, typically called adjoint equations, are added to the problem to be solved and the response of the new variables in these equations indicates when controls should be applied and how.\u00a0 In the direct methods, a set of controls are assumed at the onset and their values are adjusted to achieve optimality.\u00a0 Optimization techniques find application in thousands of practical problems including trajectory optimization, operations research, and economic modeling.\u00a0 Final note: Casti singles out the simplex method for special recognition.\u00a0 While this method is of particular importance in both the history of optimization and the particular application to economics, its limitation to linear problems is a significant liability, hence the larger scope of this entry.<\/p>\n<ol start=\"3\">\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Information_theory\">Shannon\u2019s Mathematical Model of Information<\/a><\/li>\n<\/ol>\n<p>In 1948, Claude Shannon published <em><a href=\"http:\/\/www.essrl.wustl.edu\/~jao\/itrg\/shannon.pdf\">A Mathematical Theory of Communication<\/a><\/em> in <em>The Bell System Technical Journal<\/em>.\u00a0 This paper, considered a landmark, set the stage for the modern digital age and for the advances in the field of telecommunications (wired and wireless).\u00a0 Building on the ideas of Nyquist and Hartley, Shannon essentially created the field of information theory and the digital signal processing that follows in its train.\u00a0 His theory defined the notion of information (a bit), sets the theoretical limits on the amount of information that can be transfers, adapted the idea of entropy to communications, and provided a set of theorems that defined what could and could not be done in a communications system.\u00a0 Final note: Casti recognizes the importance of Shannon\u2019s work in his second book and increased my own recognition of the importance of Shannon\u2019s work.<\/p>\n<ol start=\"2\">\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/Fast_Fourier_transform\">Fast-Fourier Transform<\/a><\/li>\n<\/ol>\n<p>Deemed as one of the most important numerical algorithms ever created, the fast fourier transform or FFT is the workhorse of the modern digital age.\u00a0 There are so many applications that it is hard to even list a fraction of them but some of the most important ones are:\u00a0 1) signal processing in telecommunications, 2) image construction in medical imaging, and 3) spectrum analysis of scientific data ranging from the mechanics of materials to response of electrical components to quantum mechanics.\u00a0 An FFT system resides in virtually every home in the US in the high definition televisions, cellphones, videogame systems, and so on.\u00a0 Final note:\u00a0 Casti has no mention that I\u2019ve found of the FFT.<\/p>\n<ol>\n<li><a href=\"https:\/\/en.wikipedia.org\/wiki\/G%C3%B6del%27s_incompleteness_theorems\">G\u00f6del\u2019s Theorem<\/a><\/li>\n<\/ol>\n<p>Rounding out the top of this list is the far-reaching analysis on the limit of logic (mathematical and otherwise) that Kurt Godel provided the world in 1931.\u00a0 This theorem, along with the closely related theorems due to Tarski (<a href=\"https:\/\/en.wikipedia.org\/wiki\/Tarski%27s_undefinability_theorem\">undefinability theorem<\/a>), Church (<a href=\"https:\/\/en.wikipedia.org\/wiki\/Entscheidungsproblem\">undecidability<\/a>) , and Turing (<a href=\"https:\/\/en.wikipedia.org\/wiki\/Halting_problem\">halting theorem<\/a>) states that formal logic must be either incomplete or inconsistent.\u00a0 All of these related theorems deal with how logic views or expresses statements about itself and have profound implications on human thought, philosophy, and artificial intelligence.\u00a0 I also interpret them as saying something essential about man as a rational animal and, therefore, about the human condition as I\u2019ve written in earlier posts (<a href=\"http:\/\/aristotle2digital.blogwyrm.com\/?p=204\">G\u00f6del\u2019s Theorem \u2013 General Notions<\/a>, <a href=\"http:\/\/aristotle2digital.blogwyrm.com\/?p=199\">Turing, Godel, and the Universe<\/a>, <a href=\"http:\/\/aristotle2digital.blogwyrm.com\/?p=679\">Logic and Limits<\/a>, <a href=\"http:\/\/aristotle2digital.blogwyrm.com\/?p=480\">Bare Bones Halting<\/a>, and <a href=\"http:\/\/aristotle2digital.blogwyrm.com\/?p=209\">Self-Reference and Paradoxes<\/a>).\u00a0 The full content of these results will no doubt be explored for years to come.\u00a0 Final note:\u00a0 Casti focuses more on the halting theorem and its implications for computing.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In keeping with the New Years Theme, this month\u2019s column lists the five most important accomplishments from the world of logic, mathematics, computing, or philosophy in the last 100 years.\u00a0&#8230; <a class=\"read-more-button\" href=\"https:\/\/aristotle2digital.blogwyrm.com\/?p=713\">Read more &gt;<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-713","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/713","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=713"}],"version-history":[{"count":0,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=\/wp\/v2\/posts\/713\/revisions"}],"wp:attachment":[{"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=713"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=713"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aristotle2digital.blogwyrm.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=713"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}