














































































{"id":1684,"date":"2023-04-18T09:41:00","date_gmt":"2023-04-18T13:41:00","guid":{"rendered":"http:\/\/entropyeconomics.com\/?p=1684"},"modified":"2023-04-22T09:46:04","modified_gmt":"2023-04-22T13:46:04","slug":"soft-power-squared-gpt-and-the-explosive-potential-of-a-i-parallelism","status":"publish","type":"post","link":"https:\/\/entropyeconomics.com\/index.php\/2023\/04\/soft-power-squared-gpt-and-the-explosive-potential-of-a-i-parallelism\/","title":{"rendered":"Soft Power Squared: GPT and the explosive potential of A.I. parallelism"},"content":{"rendered":"\n<p>The lightning speed emergence and evolution of OpenAI\u2019s GPT platform, and of large language models (LLMs) in general, requires a reassessment of the innovation landscape and the economy itself. Exciting developments by giant tech companies and tinkering novices land not month by month but minute by minute.&nbsp;<\/p>\n\n\n\n<p>Each new era of digital advance marries a new abundance of hardware resources with an explosion of software creativity. Today, the Transformer approach to A.I.,&nbsp;<a href=\"https:\/\/arxiv.org\/pdf\/1706.03762.pdf\">introduced in 2017<\/a>, leverages the new silicon abundance \u2013 massive parallelism, embodied in graphics processors, or GPUs, themselves arrayed in massively parallel fashion in data centers. The result is a new knowledge platform, soon to unleash multidimensional cascades of software, content, and digital capability which will diffuse into every tool and industry.&nbsp;<\/p>\n\n\n\n<p>In 2016, DeepMind\u2019s AlphaGo blew our minds by winning, with panache, an ancient board game far more complicated than chess. AlphaGo signaled a new era in A.I. We&nbsp;<a href=\"http:\/\/bit.ly\/2vSC7lm\">noted at the time<\/a>, however, that it was still playing on a field constrained in multiple dimensions. It also consumed&nbsp;<a href=\"http:\/\/bit.ly\/2vSC7lm\">50,000 times more power<\/a>than the human brain. An impressive feat, yes, but voracious and narrow.&nbsp;<\/p>\n\n\n\n<p>ChatGPT\u2019s emergence this winter, however, captured the world\u2019s attention because of its seeming ability to deal with a wider range of tasks across a much broader, more ambiguous, more human field of play. <em><a href=\"https:\/\/bit.ly\/soft-squared\" target=\"_blank\" rel=\"noreferrer noopener\">Continue reading . . .<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The lightning speed emergence and evolution of OpenAI\u2019s GPT platform, and of large language models (LLMs) in general, requires a reassessment of the innovation landscape and the economy itself. Exciting developments by giant tech companies and tinkering novices land not month by month but minute by minute.&nbsp; Each new era of digital advance marries a new abundance of hardware resources &#8230; <\/p>\n<div><a href=\"https:\/\/entropyeconomics.com\/index.php\/2023\/04\/soft-power-squared-gpt-and-the-explosive-potential-of-a-i-parallelism\/\" class=\"more-link\">Read More<\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1684","post","type-post","status-publish","format-standard","hentry","category-tech-note","no-post-thumbnail"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/entropyeconomics.com\/index.php\/wp-json\/wp\/v2\/posts\/1684","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entropyeconomics.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entropyeconomics.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entropyeconomics.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/entropyeconomics.com\/index.php\/wp-json\/wp\/v2\/comments?post=1684"}],"version-history":[{"count":1,"href":"https:\/\/entropyeconomics.com\/index.php\/wp-json\/wp\/v2\/posts\/1684\/revisions"}],"predecessor-version":[{"id":1685,"href":"https:\/\/entropyeconomics.com\/index.php\/wp-json\/wp\/v2\/posts\/1684\/revisions\/1685"}],"wp:attachment":[{"href":"https:\/\/entropyeconomics.com\/index.php\/wp-json\/wp\/v2\/media?parent=1684"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entropyeconomics.com\/index.php\/wp-json\/wp\/v2\/categories?post=1684"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entropyeconomics.com\/index.php\/wp-json\/wp\/v2\/tags?post=1684"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}