{"id":4080,"date":"2017-08-07T18:03:03","date_gmt":"2017-08-07T22:03:03","guid":{"rendered":"http:\/\/blogs.harvard.edu\/sj\/?p=4080"},"modified":"2022-05-25T21:39:05","modified_gmt":"2022-05-26T01:39:05","slug":"mental-battlefield-how-we-are-forfeiting-the-zeroth-ai-war","status":"publish","type":"post","link":"https:\/\/archive.blogs.harvard.edu\/sj\/2017\/08\/07\/mental-battlefield-how-we-are-forfeiting-the-zeroth-ai-war\/","title":{"rendered":"Mental battlefield: How we are forfeiting the zeroth AI war"},"content":{"rendered":"

Part 2: <\/sup>Forging Social Proof<\/strong> \u2013 the Networked Turing Test Rules the First AI War<\/sup><\/a><\/em><\/p><\/blockquote>\n

Last week, Jean Twenge<\/span> wrote the latest in a series of reflections on connected\u00a0culture: “Have smartphones destroyed a generation?<\/a>”<\/p>\n

Some commentators wrote off her\u00a0concerns as the periodic anxiety of an older generation seeing technology changing the world of their children, comparing it to earlier concerns about books<\/em> or television<\/em>. \u00a0But I don’t see this as Yet Another Moral Panic about changing tech or norms. I see it as an early AI conflict, one that individuals have lost to embryonic corporate AI.<\/p>\n

\"The<\/a><\/div>\n

We have greatly advanced algorithms for claiming and retaining human attention<\/strong>, prominently including bulk attacks on shared Commons such as quiet spaces, spare time, empty mailboxes. This predates the net, but as in many areas, automation has conclusively outpaced capacity to react. There’s not even an arms race<\/em> today: one the one hand, we have a few attention-preserving tools, productive norms that increasingly look like firewall instructions, a few dated regulations in some countries. On the other hand, we have a $T<\/strong> invested in persuasion, segmentation, attention, engagement: a growing portion of our economy, dinner conversations, and self-image as a civilization.<\/p>\n

Persuasion is much more than advertising. The libraries<\/strong> of mind hacks and distractions we have developed are prominent in every networked app and social tool. Including simple things like adding a gloss of guilt<\/strong> and performative angst<\/strong> to increase engagement \u2014 like Snap<\/span> or Duolingo<\/span> adding publicly visible\u00a0streaks<\/em> to keep up daily participation.<\/p>\n

We know people can saturate<\/strong> their capacity to track goals and urgencies. We know minds are exploitable<\/strong>, hard sells are possible \u2014\u00a0but (coming from a carny, or casino, or car salesman) unethical, bad for you. \u00a0Yet when the exploit happens at a scale of billions, one new step each week, with a cloak of respectability \u2014 we haven’t figured out how to think about it. \u00a0Indeed most growth<\/em> hackers & experience<\/em> designers, at companies whose immersive interfaces absorb<\/strong> centuries of spare time each day, would firmly deny that they are squeezing profit out of the valuable time + focus + energy of users :: even as they might agree that in aggregate, the set of all available interfaces are doing just that.<\/p>\n

Twenge suggests people are becoming unhappier the more their attention is hacked: that seems right, up to a point. But past that point, go far enough and people will get used to anything, create new norms around it. If we lose meaningful measures<\/strong> of social wellbeing, then new ones may be designed for us, honoring current trends as the best of all possible worlds. A time-worn solution of cults, castes, frontiers, empires. Yet letting the few and the hawkers of the new set norms for all,\u00a0doesn’t always work out well.<\/p>\n

Let us do better.
\n+ Recognize exploits and failure modes of reason, habit, and thought. Treat these as important to healthy life, not simply a prize for whoever can claim them.
\n+ Measure maluses like addiction, negative attractors like monopoly, self-dealing, information asymmetry.
\n+ Measure things like learning speed, adaptability, self sufficiency, teamwork, contentment over time.
\n+ Reflect on system properties that seem to influence one or the other.
\nAnd build norms around all of this, countering the idea that “whatever norms we have are organic, so they must be good for us<\/em>“.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Part 2: Forging Social Proof \u2013 the Networked Turing Test Rules the First AI War Last week, Jean Twenge wrote the latest in a series of reflections on connected\u00a0culture: “Have smartphones destroyed a generation?” Some commentators wrote off her\u00a0concerns as the periodic anxiety of an older generation seeing technology changing the world of their children, […]<\/p>\n","protected":false},"author":1202,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":true,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[206,210,14968,213,209],"tags":[],"class_list":["post-4080","post","type-post","status-publish","format-standard","hentry","category-a-la-mod","category-chain-gang","category-knowledge","category-metrics","category-popular-demand"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7iVvB-13O","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/archive.blogs.harvard.edu\/sj\/wp-json\/wp\/v2\/posts\/4080","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/archive.blogs.harvard.edu\/sj\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/archive.blogs.harvard.edu\/sj\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/archive.blogs.harvard.edu\/sj\/wp-json\/wp\/v2\/users\/1202"}],"replies":[{"embeddable":true,"href":"https:\/\/archive.blogs.harvard.edu\/sj\/wp-json\/wp\/v2\/comments?post=4080"}],"version-history":[{"count":12,"href":"https:\/\/archive.blogs.harvard.edu\/sj\/wp-json\/wp\/v2\/posts\/4080\/revisions"}],"predecessor-version":[{"id":4085,"href":"https:\/\/archive.blogs.harvard.edu\/sj\/wp-json\/wp\/v2\/posts\/4080\/revisions\/4085"}],"wp:attachment":[{"href":"https:\/\/archive.blogs.harvard.edu\/sj\/wp-json\/wp\/v2\/media?parent=4080"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/archive.blogs.harvard.edu\/sj\/wp-json\/wp\/v2\/categories?post=4080"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/archive.blogs.harvard.edu\/sj\/wp-json\/wp\/v2\/tags?post=4080"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}