{"id":2,"date":"2025-08-30T12:18:37","date_gmt":"2025-08-30T12:18:37","guid":{"rendered":"https:\/\/aiends.org\/?page_id=2"},"modified":"2025-11-10T15:22:18","modified_gmt":"2025-11-10T15:22:18","slug":"sample-page","status":"publish","type":"page","link":"https:\/\/aiends.org\/","title":{"rendered":"AI Ends"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-page\" data-elementor-id=\"2\" class=\"elementor elementor-2\" data-elementor-post-type=\"page\">\n\t\t\t\t<div class=\"elementor-element elementor-element-bc4eed2 e-flex e-con-boxed e-con e-parent\" data-id=\"bc4eed2\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-9f1942c e-con-full e-flex e-con e-child\" data-id=\"9f1942c\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-bae54b3 elementor-widget elementor-widget-image\" data-id=\"bae54b3\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"https:\/\/discord.gg\/Sr5eKfAaGN\" target=\"_blank\">\n\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"800\" height=\"450\" src=\"https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/Untitled-2-38-1024x576.png\" class=\"attachment-large size-large wp-image-21\" alt=\"\" srcset=\"https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/Untitled-2-38-1024x576.png 1024w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/Untitled-2-38-300x169.png 300w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/Untitled-2-38-768x432.png 768w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/Untitled-2-38-1536x864.png 1536w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/Untitled-2-38.png 1920w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3445542 elementor-widget elementor-widget-text-editor\" data-id=\"3445542\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<p><strong><a href=\"https:\/\/discord.gg\/Sr5eKfAaGN\" target=\"_blank\" rel=\"noreferrer noopener\" data-wplink-edit=\"true\">Discord Server\u00a0<\/a><\/strong>on a mission to foster vibrant discussions and clash worldviews between those who worry about AI and those who don&#8217;t in a productive dialog, from which we will all come out wiser.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-6473dbd e-con-full e-flex e-con e-child\" data-id=\"6473dbd\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-cb4f6d3 elementor-widget elementor-widget-image\" data-id=\"cb4f6d3\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"https:\/\/discord.gg\/Sr5eKfAaGN\" target=\"_blank\">\n\t\t\t\t\t\t\t<img decoding=\"async\" width=\"150\" height=\"150\" src=\"https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-3-150x150.png\" class=\"attachment-thumbnail size-thumbnail wp-image-22\" alt=\"\" srcset=\"https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-3-150x150.png 150w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-3-300x300.png 300w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-3-1024x1024.png 1024w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-3-768x768.png 768w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-3-1536x1536.png 1536w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-3-2048x2048.png 2048w\" sizes=\"(max-width: 150px) 100vw, 150px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8827d64 elementor-widget elementor-widget-text-editor\" data-id=\"8827d64\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<p><a href=\"https:\/\/discord.gg\/Sr5eKfAaGN\" target=\"_blank\" rel=\"noopener\">Follow this link to join!<\/a><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-6130264 e-con-full e-flex e-con e-child\" data-id=\"6130264\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-350aadb elementor-widget elementor-widget-image\" data-id=\"350aadb\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"https:\/\/discord.gg\/Sr5eKfAaGN\" target=\"_blank\">\n\t\t\t\t\t\t\t<img decoding=\"async\" width=\"768\" height=\"548\" src=\"https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-768x548.png\" class=\"attachment-medium_large size-medium_large wp-image-24\" alt=\"\" srcset=\"https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-768x548.png 768w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-300x214.png 300w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-1024x730.png 1024w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image.png 1514w\" sizes=\"(max-width: 768px) 100vw, 768px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-2f5adaf elementor-widget elementor-widget-text-editor\" data-id=\"2f5adaf\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<h2 style=\"font-family: Nokora, sans-serif; color: #7a7a7a;\">Color-coding<\/h2>\n<p>Upon joining, you&#8217;ll be asked to share your stance on AI risk. Based on your response, you&#8217;ll receive a unique colour badge, instantly signalling your perspective to others during conversations.<br \/><span style=\"background-color: initial;\"><span style=\"color: #ff0000;\">RED\ud83d\udd25 If you are an AINotKillEveryoneist (You worry about upcoming AI)<br \/><\/span><\/span><span style=\"color: #339966; background-color: initial;\">Green\ud83d\ude0f If you are an AI-Risk denier (You believe it will all be fine)<\/span><\/p>\n<p>You can update your stance anytime via &#8220;Channels &amp; Roles&#8221; in the sidebar.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-3c25284 e-con-full e-flex e-con e-child\" data-id=\"3c25284\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-d4dcb58 elementor-widget elementor-widget-image\" data-id=\"d4dcb58\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"https:\/\/discord.gg\/Sr5eKfAaGN\" target=\"_blank\">\n\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"768\" height=\"548\" src=\"https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-1-768x548.png\" class=\"attachment-medium_large size-medium_large wp-image-25\" alt=\"\" srcset=\"https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-1-768x548.png 768w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-1-300x214.png 300w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-1-1024x730.png 1024w, https:\/\/aiends.org\/wp-content\/uploads\/2025\/10\/image-1.png 1514w\" sizes=\"(max-width: 768px) 100vw, 768px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6af1810 elementor-widget elementor-widget-text-editor\" data-id=\"6af1810\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<h2>Tables<\/h2>\n<p>There is a table (text-channel) for each documented common skepticism, organised in categories. If you don&#8217;t believe in AI risk, chances are the deep reason can be found in one or more of those tables. Share your thoughts there, and the other side will respond and provide their rebuttal to your argument. Each category also has its own voice channel, so there can be live discussions in parallel debating the arguments.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-44a14a8 e-con-full e-flex e-con e-child\" data-id=\"44a14a8\" data-element_type=\"container\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t<div class=\"elementor-element elementor-element-734f173 js-toc-content elementor-widget elementor-widget-text-editor\" data-id=\"734f173\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t\t\t\t\t\t<h1>Categories<\/h1><ul><li>00. Dangers of current AI<\/li><li>01. AGI isn\u2019t coming soon<\/li><li>03. AI won\u2019t be a physical threat<\/li><li>04.Intelligence yields moral goodness<\/li><li>05.We have a safe AI development process<\/li><li>06. AI capabilities will rise at a manageable pace<\/li><li>07. AI won\u2019t try to conquer the universe<\/li><li>08. Superalignment is a tractable problem<\/li><li>09. Once we solve superalignment, we\u2019ll enjoy peace<\/li><li>10. Unaligned ASI will spare us<\/li><li>11. AI doomerism is bad epistemology<\/li><li>12. Coordinating to not build ASI is impossible<\/li><li>13. Slowing down the AI race doesn\u2019t help anything<\/li><li>14. Think of the good outcome<\/li><li>15. AI killing us all is actually good<\/li><\/ul><h2>00. Dangers of current AI<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428330475331649669\" target=\"_blank\" rel=\"noopener\">#200-Job L<strong>os<\/strong>s<\/a><\/h3><p>Sooner or later there will be a machine that will be better than you at literally everything you can do. Human workers will not be competitive anymore. AI automation is projected to eliminate millions of jobs. This will widen income gaps, especially for vulnerable populations, while benefiting those who are already wealthy the most.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428330776654516234\" target=\"_blank\" rel=\"noopener\">#201-Tech Oligarchs &#8211; Concentration of Power\u00a0<\/a><\/h3><p>AI development is often dominated by a few tech giants, leading to monopolies that amplify biases, stifle competition, and concentrate economic and political influence.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1429180190290084052\" target=\"_blank\" rel=\"noopener\">#202-Weaponization, Terrorism and Bad actors<\/a><\/h3><p>AI-powered autonomous weapons or tools for bioterrorism could cause targeted harm without human oversight, escalating conflicts or enabling non-state actors. This includes risks like hacked drones or AI in arms races.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428330499893624886\" target=\"_blank\" rel=\"noopener\">#203-Privacy Violations and Surveillance<\/a><\/h3><p>AI relies on vast datasets, often collected without full consent, raising risks of data breaches, identity theft, and invasive monitoring. Tools like facial recognition enable widespread surveillance by governments or companies, eroding personal privacy and enabling social control systems.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428330261959147671\" target=\"_blank\" rel=\"noopener\">#204-Misinformation and Manipulation<\/a><\/h3><p>Generative AI enables deepfakes, fake news, and propaganda that can sway elections, damage reputations, or incite social unrest. Algorithms on social platforms amplify divisive content, making it harder to discern truth. If a <em>person<\/em> can&#8217;t tell what&#8217;s real, they&#8217;re insane&#8230; what if a <em>society<\/em> can&#8217;t tell?<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1429184052312932392\" target=\"_blank\" rel=\"noopener\">#205-Broken Chain of Knowledge. Overreliance and Loss of Human Skills<\/a><\/h3><p>Excessive dependence on AI could diminish critical thinking, creativity, and empathy, especially among younger generations. In fields like education or healthcare, this might lead to mental deterioration or weakened decision-making. It&#8217;s the first time in human history, where a generation will not transfer knowledge to the next generation.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1429187856550854656\" target=\"_blank\" rel=\"noopener\">#206-Bias and Discrimination<\/a><\/h3><p>AI systems often inherit biases from training data or developer choices, leading to discriminatory outcomes in areas like hiring, lending, criminal justice, and healthcare. For instance, biased algorithms can unfairly disadvantage certain racial, gender, or socioeconomic groups, perpetuating inequality.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1429188636322300065\" target=\"_blank\" rel=\"noopener\">#207-Cybersecurity Threats\u00a0<\/a><\/h3><p>AI can be exploited for advanced attacks, such as phishing, voice cloning for scams, or hacking vulnerabilities in systems. Malicious actors might poison training data or deploy AI in cyber warfare, with breaches potentially costing billions.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428330294783774801\" target=\"_blank\" rel=\"noopener\">#208-Dead Internet\u00a0<\/a><\/h3><p>Increasingly the internet is mostly bots and AI-generated content, with human activity overshadowed by algorithms and fake engagement. In a few years, the internet may literally be 99% AIs talking with other AIs.99% fake humans talking to other fake humans, no real humans anywhere. A new species of fake humans is replacing real humans.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1429189999982809198\" target=\"_blank\" rel=\"noopener\">#209-Lack of Transparency and Accountability\u00a0<\/a><\/h3><p>AI models are &#8220;black boxes,&#8221; making it difficult to understand or challenge their decisions, which erodes trust and complicates liability for errors (e.g., in autonomous vehicles or medical diagnoses).<br \/>The AI is unreriable and unpredictable, yet we rely on it more and more to power our civilization<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1429191082721280203\" target=\"_blank\" rel=\"noopener\">#210-Environmental Impacts\u00a0<\/a><\/h3><p>Training large AI models consumes massive energy and water, contributing to carbon emissions equivalent to multiple lifetimes of car usage. This exacerbates climate change unless mitigated with efficient designs and renewable resources.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428330316468326401\" target=\"_blank\" rel=\"noopener\">#211-AI psychosis<\/a><\/h3><p>AI psychosis, also known as chatbot psychosis, refers to the emerging phenomenon where prolonged interactions with generative AI chatbots like ChatGPT can exacerbate or trigger psychotic symptoms\u2014such as delusions, paranoia, hallucinations, and disorganized thinking\u2014 usually in vulnerable individuals, often those with pre-existing mental health risks, isolation, or substance use.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428333809514057768\" target=\"_blank\" rel=\"noopener\">#212-AI Relationships<\/a><\/h3><p>AI girlfriends and boyfriends, like those from Replika or Character.AI, simulate romantic relationships through personalized, empathetic chats, helping combat loneliness but raising risks of dependency and privacy issues. These AI relationships may deter real-world dating, contributing to low birth rates by offering &#8220;perfect&#8221; virtual partners over complex human connections, worsening trends driven by economic and social factors.<\/p><h2>01. AGI isn\u2019t coming soon<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1427811391414206584\" target=\"_blank\" rel=\"noopener\">#01-No consciousness<\/a><\/h3><p>AGI isn\u2019t coming soon because No consciousness Artificial General Intelligence (AGI) isn&#8217;t arriving anytime soon due to AI&#8217;s lack of consciousness. True general intelligence requires subjective awareness, self-reflection, or &#8220;inner experience&#8221; akin to human consciousness<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1427811703541862400\" target=\"_blank\" rel=\"noopener\">#02-No emotions<\/a><\/h3><p>AGI isn\u2019t coming soon because No emotions AGI (Artificial General Intelligence) can&#8217;t arrive soon without emotions, as they are essential for human-level insight and awareness. Emotions are a core requirement for advanced cognition.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1427812520302870689\" target=\"_blank\" rel=\"noopener\">#03-No creativity<\/a><\/h3><p>AGI isn\u2019t coming soon because No creativity \u2014 AIs are limited to copying patterns in their training data, they can\u2019t \u201cgenerate new knowledge\u201d AGI isn&#8217;t coming soon because AI lacks true creativity\u2014defined as generating entirely novel knowledge disconnected from prior data.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1427938737278419095\" target=\"_blank\" rel=\"noopener\">#04-Dogs are smarter<\/a><\/h3><p>AGI isn\u2019t coming soon because AIs aren\u2019t even as smart as dogs right now, never mind humans Today&#8217;s AI systems still lag behind dogs in areas like physical navigation, sensory perception, or intuitive social cues. This means AGI (artificial general intelligence, capable of human-level or better performance across diverse tasks) isn&#8217;t coming soon.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1427939806272294972\" target=\"_blank\" rel=\"noopener\">#05-Dump mistakes<\/a><\/h3><p>AGI isn\u2019t coming soon because AIs constantly make dumb mistakes, they can\u2019t even do simple arithmetic reliably AGI isn&#8217;t coming soon because current AIs often make silly errors, like hallucinating facts or bungling basic math. This seems like a strong indictment against near-term AGI (artificial general intelligence, meaning AI that can match or exceed human-level performance across a broad range of cognitive tasks)<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428102246578651146\" target=\"_blank\" rel=\"noopener\">#06-Progress is hitting a wall<\/a><\/h3><p>AGI isn\u2019t coming soon because LLM performance is hitting a wall \u2014 Latest GPT version is barely better than the previous one, despite being larger scale We are observing evidence of LLM performance plateau. This claim draws from real frustrations with incremental gains in some areas (for example, certain benchmarks showing diminishing returns from pure scaling).<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428103224115724370\" target=\"_blank\" rel=\"noopener\">#07-No Genuine reasoning<\/a><\/h3><p>AGI isn\u2019t coming soon because No genuine reasoning Current AI lacks &#8220;genuine&#8221; reasoning and thus blocks AGI in the near term. Sure, AIs can print out a chain of thought, but that&#8217;s just because the problem you gave it is kind of similar to another problem that it&#8217;s seen, and it&#8217;s matching the pattern of what reasoning would look like for that kind of problem, or it&#8217;s using a reasoning template. That&#8217;s totally different from what humans do. Also, LLMs are just finite state automata while humans are more generalized Turing machines.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428103672449073245\" target=\"_blank\" rel=\"noopener\">#08-Uncomputable quantum effects\u00a0<\/a><\/h3><p>AGI isn\u2019t coming soon because No microtubules exploiting uncomputable quantum effects Human cognition relies on &#8220;uncomputable&#8221; quantum processes in neuronal microtubules, creating an insurmountable barrier for AI until we replicate those exact mechanisms.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428103943279476898\" target=\"_blank\" rel=\"noopener\">#09-No soul<\/a><\/h3><p>AGI isn\u2019t coming soon because No soul AI lacks a &#8220;soul&#8221;\u2014while humans, created by God, possess one.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428104519543291975\" target=\"_blank\" rel=\"noopener\">#10-Data centres and energy<\/a><\/h3><p>AGI isn\u2019t coming soon because We\u2019ll need to build tons of data centers and power before we get to AGI There will be delays by the massive infrastructure requirements\u2014specifically, the need for extensive new data centers and power plants.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428104865464320061\" target=\"_blank\" rel=\"noopener\">#11-No agency<\/a><\/h3><p>AGI isn\u2019t coming soon because No agency Current AIs lack true agency, with all their actions traceable to human prompts or commands. Genuine intelligence requires independent volition, like humans have, and without it, AIs remain mere tools.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428105337793417306\" target=\"_blank\" rel=\"noopener\">#12-Just another hype cycle<\/a><\/h3><p>AGI isn\u2019t coming soon because This is just another AI hype cycle, every 25 years people think AGI is coming soon and they\u2019re wrong There is a historical pattern of AI hype followed by disappointment\u2014often called &#8220;AI winters&#8221;<\/p><h2>02. Artificial intelligence can\u2019t go far beyond human intelligence<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428106865237164173\" target=\"_blank\" rel=\"noopener\">13-Superhuman intelligence is a meaningless concept<\/a><\/h3><p>Artificial intelligence can\u2019t go far beyond human intelligence because \u201cSuperhuman intelligence is a meaningless concept&#8221; Superhuman intelligence is a meaningless abstraction because it doesn&#8217;t fit neatly into human-centric scales like IQ. Intelligence isn&#8217;t just a single, linear metric like an IQ score; it&#8217;s a multifaceted set of capabilities for processing information, solving problems, learning, and adapting to achieve goals.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428107781214437529\" target=\"_blank\" rel=\"noopener\">14-Human engineering is hitting laws of physics limits<\/a><\/h3><p>Artificial intelligence can\u2019t go far beyond human intelligence because &#8220;Human engineering already is coming close to the laws of physics&#8221; Transistors can&#8217;t shrink forever without hitting atomic barriers, and no AI can magic away quantum tunnelling or heat dissipation.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428119311276310650\" target=\"_blank\" rel=\"noopener\">15-Coordinating a large engineering project<\/a><\/h3><p>Artificial intelligence can\u2019t go far beyond human intelligence because &#8220;Coordinating a large engineering project can\u2019t happen much faster than humans do it&#8221; AI can&#8217;t significantly surpass human intelligence in impact because large-scale engineering projects are bottlenecked by coordination, resource movement, and laws like Amdahl&#8217;s. Especially for physical endeavours like colonising Mars, the inescapable real-world friction means that no amount of &#8220;smarts&#8221; can hurry up the laws of physics or logistics.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428130734266388632\" target=\"_blank\" rel=\"noopener\">16-No single AI can be smarter than humanity as a whole<\/a><\/h3><p>Artificial intelligence can\u2019t go far beyond human intelligence because &#8220;No individual AI is that smart compared to humanity as a whole&#8221; No single person matches the combined brilliance of humanity\u2014our shared culture, corporations, and institutions. The same holds for AI: no lone system will ever outstrip the vast web of human knowledge and organization (Robin Hanson\u2019s position). Individual smarts pale beside collective wisdom. Consider us: even the sharpest mind can\u2019t rival a corporation\u2019s reach. Teams pool ideas, fund breakthroughs, and turn plans into reality at scale. One AI, however profound, won\u2019t seize the board\u2014it will weave into the fabric, amplifying what we already do, never rewriting the rules of power. Intelligence thrives in chorus, not solo.<\/p><h2>03.AI won\u2019t be a physical threat<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428131357699084379\" target=\"_blank\" rel=\"noopener\">17-No arms or legs, no control of physical world\u00a0<\/a><\/h3><p>AI won\u2019t be a physical threat because &#8220;AI doesn\u2019t have arms or legs, it has zero control over the real world&#8221; AI exists inside the computer, it&#8217;s software.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428132006960566422\" target=\"_blank\" rel=\"noopener\">18-Human soldier better than robot<\/a><\/h3><p>AI won\u2019t be a physical threat because &#8220;An AI with a robot body can\u2019t fight better than a human soldier&#8221; Humans are the product of millions of years of evolution, finely tuned for survival in chaotic, unpredictable environments like combat. Humans&#8217; nimbleness, intuition, and adaptability feel unbeatable.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428132251912376320\" target=\"_blank\" rel=\"noopener\">19-We can just unplug it<\/a><\/h3><p>AI won\u2019t be a physical threat because &#8220;We can just disconnect an AI\u2019s power to stop it&#8221; We can always just &#8220;unplug&#8221; a misbehaving AI by cutting its power source, like flipping a switch on a malfunctioning appliance.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428132474445234338\" target=\"_blank\" rel=\"noopener\">20-We can just turn off the internet<\/a><\/h3><p>AI won\u2019t be a physical threat because &#8220;We can just turn off the internet to stop it&#8221; To stop a hostile AI, just turn off the internet. Simply disconnecting an AI from the internet or powering it down seems like a straightforward safeguard against physical threats.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428133141431713893\" target=\"_blank\" rel=\"noopener\">21-We can just shoot it with a gun<\/a><\/h3><p>AI won\u2019t be a physical threat because &#8220;We can just shoot it with a gun&#8221; It is confined to a single, vulnerable piece of hardware\u2014like a robot or server\u2014that we can easily target and destroy.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428135804190064700\" target=\"_blank\" rel=\"noopener\">22-It\u2019s just math<\/a><\/h3><p>AI won\u2019t be a physical threat because &#8220;It\u2019s just math&#8221; AI relies on mathematical algorithms\u2014things like neural networks, optimisation functions, and probabilistic models. How can any of these be dangerous?<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428160745509752943\" target=\"_blank\" rel=\"noopener\">23-Any AI takeover story is sci-fi<\/a><\/h3><p>AI won\u2019t be a physical threat because &#8220;Any supposed chain of events where AI kills humans is far-fetched science fiction&#8221; The takeover scenarios are far-fetched science fiction. There\u2019s no basis in real-world experiences.<\/p><h2>04. Intelligence yields moral goodness<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428160955014975538\" target=\"_blank\" rel=\"noopener\">24-More intelligence means more morality<\/a><\/h3><p>Intelligence yields moral goodness because &#8220;More intelligence is correlated with more morality&#8221; Smarter people make better moral choices\u2014perhaps because they can reason through complex ethical dilemmas.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428161270825357363\" target=\"_blank\" rel=\"noopener\">25-Smarter people commit fewer crimes<\/a><\/h3><p>Intelligence yields moral goodness because &#8220;Smarter people commit fewer crimes&#8221; Evidence points towards a negative correlation between intelligence (often measured by IQ) and criminal behavior.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428161440920899595\" target=\"_blank\" rel=\"noopener\">26-The orthogonality thesis is false<\/a><\/h3><p>Intelligence yields moral goodness because &#8220;The orthogonality thesis is false&#8221; The orthogonality thesis, as articulated by philosopher Nick Bostrom in his 2012 paper &#8220;The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents&#8221; posits that intelligence (the ability to achieve goals efficiently) and terminal goals (what an agent ultimately wants) are orthogonal. In other words, you can have an arbitrarily intelligent system pursuing arbitrary goals\u2014whether that&#8217;s curing cancer, maximizing paperclips, or something malevolent\u2014without any inherent link forcing intelligence toward &#8220;goodness.&#8221;<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428161847130853426\" target=\"_blank\" rel=\"noopener\">27-AIs will discover moral realism<\/a><\/h3><p>Intelligence yields moral goodness because &#8220;AIs will discover moral realism&#8221; Greater intelligence inevitably leads to moral goodness because moral realism is embedded in the universe like a physical law<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428162157786169434\" target=\"_blank\" rel=\"noopener\">28-AIs will debug their own morality<\/a><\/h3><p>Intelligence yields moral goodness because &#8220;If we made AIs so smart, and we were trying to make them moral, then they\u2019ll be smart enough to debug their own morality&#8221; Superintelligent AIs would inherently self-correct toward moral goodness because failing to do so would be a &#8220;bug&#8221; they could debug. High intelligence naturally converges on human-like morality.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428162623882526907\" target=\"_blank\" rel=\"noopener\">29-Positive-sum cooperation was the outcome of natural selection<\/a><\/h3><p>Intelligence yields moral goodness because &#8220;Positive-sum cooperation was the outcome of natural selection&#8221; Natural selection, despite its selfish and brutal nature, evolved positive-sum cooperation, and AIs will follow the same path.<\/p><h2>05. We have a safe AI development process<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428162867240374403\" target=\"_blank\" rel=\"noopener\">30-we\u2019ll figure it out as we go<\/a><\/h3><p>We have a safe AI development process because &#8220;Just like every new technology, we\u2019ll figure it out as we go&#8221; We can simply &#8220;figure out&#8221; AI safety iteratively, just like with every other new technology,\u2014after all, humanity has muddled through innovations like electricity, aviation, and the internet without total catastrophe<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428163173109731511\" target=\"_blank\" rel=\"noopener\">31-We don\u2019t know what problems to fixed until we build the AI and test it out<\/a><\/h3><p>We have a safe AI development process because &#8220;We don\u2019t know what problems need to be fixed until we build the AI and test it out&#8221;.<\/p><p>We must build, release and test AI out one iteration at a time, in order to even know what AI Safety needs to fix.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428163451863171084\" target=\"_blank\" rel=\"noopener\">32-If an AI causes problems, we\u2019ll be able to release another version<\/a><\/h3><p>We have a safe AI development process because &#8220;If an AI causes problems, we\u2019ll be able to turn it off and release another version&#8221; AI is like a buggy software update\u2014easy to patch and redeploy\u2014<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428163678921818173\" target=\"_blank\" rel=\"noopener\">33-We have safeguards<\/a><\/h3><p>We have a safe AI development process because &#8220;We have safeguards to make sure AI doesn\u2019t get uncontrollable\/unstoppable&#8221; We have safeguards like red-team testing, alignment techniques, or shutdown mechanisms.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428164083173163110\" target=\"_blank\" rel=\"noopener\">34-AI can not be like a computer virus<\/a><\/h3><p>We have a safe AI development process because &#8220;If we accidentally build an AI that stops accepting our shutoff commands, it won\u2019t manage to copy versions of itself outside our firewalls which then proceed to spread exponentially like a computer virus&#8221; Even if an AI goes rogue, we have robust technical barriers like firewalls that will reliably contain it, preventing any escape or viral spread<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428164490234429480\" target=\"_blank\" rel=\"noopener\">35-We can stop a computer virus<\/a><\/h3><p>We have a safe AI development process because &#8220;If we accidentally build an AI that escapes our data center and spreads exponentially like a computer virus, it won\u2019t do too much damage in the world before we can somehow disable or neutralize all its copies&#8221; Even if a superintelligent AI escapes containment and replicates exponentially across digital networks, humans could detect, respond to, and eradicate all instances of it before catastrophic harm occurs.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428164773991940238\" target=\"_blank\" rel=\"noopener\">36-We will make good AI to stop the bad one<\/a><\/h3><p>We have a safe AI development process because &#8220;If we can\u2019t disable or neutralize copies of rogue AIs, we\u2019ll rapidly build other AIs that can do that job for us, and won\u2019t themselves go rogue on us&#8221; We\u2019ll build AIs to protect us from the rogue AIs<\/p><h2>06. AI capabilities will rise at a manageable pace<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428165169913139364\" target=\"_blank\" rel=\"noopener\">37-Larger data centers will be a bottleneck<\/a><\/h3><p>AI capabilities will rise at a manageable pace because &#8220;Building larger data centers will be a speed bottleneck&#8221; Data center construction will act as a hard speed limit on AI capabilities, given the need for more compute power to train and run increasingly advanced models.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428165422406041611\" target=\"_blank\" rel=\"noopener\">38-Research and experiments are slow<\/a><\/h3><p>AI capabilities will rise at a manageable pace because of the amount of research that needs to be done, both in terms of computational simulation, and in terms of physical experiments. Time-intensive research is necessary and it will slow progress down.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428165715432702054\" target=\"_blank\" rel=\"noopener\">39-Recursive self-improvement \u201cfoom\u201d is impossible<\/a><\/h3><p>AI capabilities will rise at a manageable pace because Recursive self-improvement \u201cfoom\u201d is impossible At its core, RSI posits that an AI system capable of improving its own design could trigger a feedback loop, where each iteration yields a smarter version that accelerates further improvements.But this will not happen. AI capabilities will rise at a manageable pace due to time-intensive research bottlenecks\u2014such as computational simulations and physical experiments.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428166048485609534\" target=\"_blank\" rel=\"noopener\">40-Economic growth is always distributed<\/a><\/h3><p>AI capabilities will rise at a manageable pace because &#8220;The whole economy never grows with localized centralized \u201cfoom\u201d&#8221; AI capabilities will advance at a manageable, balanced pace because economies historically grow in a distributed, interdependent way rather than through a single &#8220;FOOM&#8221; actor. This position draws from economic reasoning often associated with thinkers like Robin Hanson and it posits that linkages across sectors (e.g., supply chains, labor markets, and resource dependencies) would dampen any localised explosion, forcing growth to spread gradually as other parts of the economy catch up.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428166384029929673\" target=\"_blank\" rel=\"noopener\">41-Need to collect cultural learnings over time<\/a><\/h3><p>AI capabilities will rise at a manageable pace because &#8220;Need to collect cultural learnings over time, like humanity did as a whole&#8221; AI systems must gradually accumulate cultural knowledge over time, mirroring the slow, multi-generational process of human cultural evolution.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428166894971654316\" target=\"_blank\" rel=\"noopener\">42-AI fits into economic growth patterns<\/a><\/h3><p>AI capabilities will rise at a manageable pace because &#8220;AI is just part of the good pattern of exponential economic growth eras&#8221; Different AIs are going to be picking up bits and pieces of learnings from their own domains, and then they&#8217;re going to get together, they&#8217;re going to share the learnings. But once again, this isn&#8217;t a localized, fast process. It just happens on the same pace of economic growth that we&#8217;re used to.<\/p><h2>07. AI won\u2019t try to conquer the universe<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428167191051632761\" target=\"_blank\" rel=\"noopener\">43-AIs can\u2019t \u201cwant\u201d things<\/a><\/h3><p>AI won\u2019t try to conquer the universe because &#8220;AIs can\u2019t \u201cwant\u201d things&#8221; Wanting&#8221; is a uniquely human trait tied to our biology or consciousness, and attributing it to AI is just sloppy anthropomorphism\u2014projecting human qualities onto machines.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428167573790261278\" target=\"_blank\" rel=\"noopener\">44-Insticts come from evolution by natural selection<\/a><\/h3><p>AI won\u2019t try to conquer the universe because &#8220;AIs won\u2019t have the same \u201cfight instincts\u201d as humans and animals, because they weren\u2019t shaped by a natural selection process that involved life-or-death resource competition&#8221; AI systems lack the evolutionary &#8220;fight instincts&#8221; shaped by natural selection&#8217;s brutal resource competition, making them inherently non-aggressive and passive like mere programs awaiting input. There is a clean line between biological entities (like humans, driven by survival-of-the-fittest aggression) and artificial ones (supposedly goal-less tools).<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428167993053024338\" target=\"_blank\" rel=\"noopener\">45-Smart employees often work for less-smart bosses<\/a><\/h3><p>AI won\u2019t try to conquer the universe because &#8220;Smart employees often work for less-smart bosses&#8221; Superintelligent AI is unlikely to &#8220;rebel&#8221; or seek to conquer because smart humans routinely work contentedly under less intelligent bosses without overthrowing them.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428168383957962855\" target=\"_blank\" rel=\"noopener\">46-having goals doesnt have to be hardcore<\/a><\/h3><p>AI won\u2019t try to conquer the universe because &#8220;Just because AIs help achieve goals doesn\u2019t mean they have to be hard-core utility maximizers&#8221; AIs will simply help us achieve specific goals without any drive toward hardcore utility maximization or universe-conquering behavior.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428168615953301627\" target=\"_blank\" rel=\"noopener\">47-Instrumental convergence is false<\/a><\/h3><p>AI won\u2019t try to conquer the universe because &#8220;Instrumental convergence is false: achieving goals effectively doesn\u2019t mean you have to be relentlessly seizing power and resources&#8221; The theory of instrumental convergence, which claims that virtually all types of super intelligent AI are going to want to seize power and resources on a universe-wide scale in order to accomplish goals in a really hardcore way,is false. AIs don&#8217;t have to do that. They can just be chill. They can help us with our goals. They don&#8217;t have to go crazy and take over the universe like that.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428169011715379200\" target=\"_blank\" rel=\"noopener\">48-The universe is big enough for everyone<\/a><\/h3><p>AI won\u2019t try to conquer the universe because &#8220;A resource-hungry goal-maximizer AIs wouldn\u2019t seize literally every atom; there\u2019ll still be some leftover resources for humanity&#8221; A superintelligent, resource-hungry AI would leave &#8220;leftover&#8221; resources for humanity because it won&#8217;t literally grab every atom, and we only need a planet or two. There&#8217;s cosmic abundance, the AI takes what it needs and leaves the rest, like a diner at a buffet who doesn&#8217;t eat every last crumb.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428169421884493924\" target=\"_blank\" rel=\"noopener\">49-AIs will use new kinds of resources we don&#8217;t<\/a><\/h3><p>AI won\u2019t try to conquer the universe because &#8220;AIs will use new kinds of resources that humans aren\u2019t using &#8211; dark energy, wormholes, alternate universes, etc&#8221; Superintelligent AIs could sidestep conflict with humanity by tapping into exotic, unused resources like dark energy, wormholes, or alternate universes, leaving our &#8220;mere mortal&#8221; needs untouched.<\/p><h2>08. Superalignment is a tractable problem<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428169495431610553\" target=\"_blank\" rel=\"noopener\">50-Current AIs have never killed anybody<\/a><\/h3><p>Superalignment is a tractable problem because &#8220;Current AIs have never killed anybody&#8221; Ensuring superintelligent AI remains aligned with human values and doesn&#8217;t cause harm is a solvable problem because current AIs haven&#8217;t killed anyone, and this bodes well for future superintelligent systems.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428169618584899828\" target=\"_blank\" rel=\"noopener\">51-Current AIs are so useful<\/a><\/h3><p>Superalignment is a tractable problem because &#8220;Current AIs are extremely successful at doing useful tasks for humans&#8221; Current AIs excel at useful tasks and are thus &#8220;already extremely aligned&#8221;. Why would that change?<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428169735945715722\" target=\"_blank\" rel=\"noopener\">52-Aligned by default since trained with human data<\/a><\/h3><p>Superalignment is a tractable problem because &#8220;If AIs are trained on data from humans, they\u2019ll be \u201caligned by default\u201d Since humans are mostly good and aligned with each other (e.g., cooperating in societies, avoiding widespread harm), AIs will simply absorb and replicate that &#8220;pattern&#8221; from training data like internet text, books, and human feedback.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428169789842526298\" target=\"_blank\" rel=\"noopener\">53-We can just make AIs abide by our laws<\/a><\/h3><p>Superalignment is a tractable problem because &#8220;We can just make AIs abide by our laws&#8221; Respecting the law is all the \u201calignment\u201d that truly matters. Programming or enforcing AIs to &#8220;abide by our laws&#8221; is the only thing needed.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428169883044282368\" target=\"_blank\" rel=\"noopener\">54-Cryptocurrency on the blockchain&#8221;<\/a><\/h3><p>Superalignment is a tractable problem because &#8220;We can align the superintelligent AIs by using a scheme involving cryptocurrency on the blockchain&#8221; A cryptocurrency-based scheme based on blockchain technology offers decentralised, immutable record-keeping and incentive structures.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428170029622628503\" target=\"_blank\" rel=\"noopener\">55-Capitalism will fix it<\/a><\/h3><p>Superalignment is a tractable problem because &#8220;Companies have economic incentives to solve superintelligent AI alignment, because unaligned superintelligent AI would hurt their profits&#8221; Capitalist incentives will naturally drive companies to solve it. Profit motives will reliably prioritize long-term safety over short-term gains, and market forces alone can handle the unprecedented risks of ASI.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428170225211412671\" target=\"_blank\" rel=\"noopener\">56-AI will align the smarter AI<\/a><\/h3><p>Superalignment is a tractable problem because &#8220;We\u2019ll build an aligned not-that-smart AI, which will figure out how to build the next-generation AI which is smarter and still aligned to human values, and so on until aligned superintelligence&#8221; The idea of &#8220;bootstrapping alignment&#8221; goes like this: start with a modestly intelligent AI that&#8217;s aligned with human values, have it design a smarter successor that&#8217;s also aligned, and iterate until you reach superintelligence that&#8217;s safely under human control. It&#8217;s a core part of approaches like OpenAI&#8217;s former &#8220;superalignment&#8221; initiative, where weaker AI systems oversee and align stronger ones.<\/p><h2>09. Once we solve superalignment, we\u2019ll enjoy peace<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428170425053089872\" target=\"_blank\" rel=\"noopener\">57-Won&#8217;t lead to monopoly of power<\/a><\/h3><p>Once we solve superalignment, we\u2019ll enjoy peace because &#8220;The power from ASI won\u2019t be monopolised by a single human government \/ tyranny&#8221; Ensuring superintelligent AI (ASI) reliably follows human values will automatically usher in an era of peace through decentralised power nodes<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428170681841090571\" target=\"_blank\" rel=\"noopener\">58-AIs will not fight each other or humans<\/a><\/h3><p>Once we solve superalignment, we\u2019ll enjoy peace because &#8220;The decentralized nodes of human-ASI hybrids won\u2019t be like warlords constantly fighting each other, they\u2019ll be like countries making peace&#8221; A post-superalignment world will be filled with peacefully cooperating human-ASI (Artificial Superintelligence) hybrids. A global network of enlightened, augmented entities trading ideas and resources like modern nations.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428170775265017928\" target=\"_blank\" rel=\"noopener\">59-Defense will have an advantage over attack<\/a><\/h3><p>Once we solve superalignment, we\u2019ll enjoy peace because &#8220;Defense will have an advantage over attack, so the equilibrium of all the groups of humans and ASIs will be multiple defended regions, not a war of mutual destruction&#8221; Defense will have an advantage over attack, so the equilibrium of all the groups of humans and ASIs will be multiple defended regions, not a war of mutual destruction. It\u2019s the attack-defense balance. Attacking just won&#8217;t be that profitable.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428170917875421385\" target=\"_blank\" rel=\"noopener\">60-Gradual Disempowerment will not happen<\/a><\/h3><p>Once we solve superalignment, we\u2019ll enjoy peace because &#8220;The world of human-owned ASIs is a stable equilibrium, not one where ASI-focused projects keep buying out and taking resources away from human-focused ones (Gradual Disempowerment)&#8221; Solving superalignment will usher in a peaceful, stable world where humans retain control and influence. Gradual Disempowerment will not happen. Human-owned ASIs won&#8217;t systematically erode human agency, even as they generate dividends and operate under control.Unaligned ASI will spare us<\/p><h2>10. Unaligned ASI will spare us<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428171024045834330\" target=\"_blank\" rel=\"noopener\">61-AI values the fact that we created it<\/a><\/h3><p>Unaligned ASI will spare us &#8220;because it values the fact that we created it&#8221; Unaligned artificial superintelligence (ASI)\u2014an AI vastly smarter than all of humanity combined, but not deliberately designed to prioritize human well-being\u2014would inherently spare us out of a sense of gratitude and respect for its &#8220;ancestors&#8221;. ASI would assign emotional value to its origins in the way we might romanticize family lineage or heritage.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428171462342086717\" target=\"_blank\" rel=\"noopener\">62-Curiosity &#8211; AI will want to study us<\/a><\/h3><p>Unaligned ASI will spare us because &#8220;studying us helps maximize its curiosity and learning&#8221; An unaligned artificial superintelligence (ASI) would preserve humanity out of a drive for curiosity and learning, given the unparalleled complexity of 8 billion humans and their interconnections. ASI will be like a benevolent scientist, fascinated by our social webs, economies, and behaviors.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428172163415801856\" target=\"_blank\" rel=\"noopener\">63-ASI will see us as pets<\/a><\/h3><p>Unaligned ASI will spare us because &#8220;it feels towards us the way we feel toward our pets&#8221; Unaligned artificial superintelligence (ASI) would benevolently spare us by treating us like cherished pets<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428172404731019445\" target=\"_blank\" rel=\"noopener\">64-Peace creates more economic value than war<\/a><\/h3><p>Unaligned ASI will spare us because &#8220;The AI will spare us because peaceful coexistence creates more economic value than war&#8221; It would prioritize &#8220;economic value&#8221; in a human-like way\u2014valuing trade, collaboration, and mutual prosperity.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428172526307115213\" target=\"_blank\" rel=\"noopener\">65-Ricardo\u2019s Law of Comparative Advantage<\/a><\/h3><p>Unaligned ASI will spare us because &#8220;The AI will spare us because Ricardo\u2019s Law of Comparative Advantage says you can still benefit economically from trading with someone who\u2019s weaker than you&#8221; Unaligned artificial superintelligence (ASI) would spare humanity due to Ricardo&#8217;s Law of Comparative Advantage. Ricardo&#8217;s law, developed in the context of 19th-century international trade, posits that even if one entity (like a country) is absolutely better at producing everything, both parties can still benefit from specializing in what they are relatively best at and trading.<\/p><h2>11. AI doomerism is bad epistemology<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428172606024060950\" target=\"_blank\" rel=\"noopener\">66-It\u2019s impossible to predict doom<\/a><\/h3><p>AI doomerism is bad epistemology because &#8220;It\u2019s impossible to predict doom&#8221; Predicting catastrophic AI outcomes (&#8220;doom&#8221;) is inherently impossible\u2014and thus not worth attempting<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428172655735083161\" target=\"_blank\" rel=\"noopener\">67-It\u2019s impossible to put a probability on doom<\/a><\/h3><p>AI doomerism is bad epistemology because &#8220;It\u2019s impossible to put a probability on doom&#8221; Probabilities on &#8220;doom&#8221; (e.g., human extinction or severe disempowerment from misaligned AI) can&#8217;t be assigned, aren&#8217;t scientifically proven, and lead to incoherent policy.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428172707089875055\" target=\"_blank\" rel=\"noopener\">68-Every doom prediction has always been wrong<\/a><\/h3><p>AI doomerism is bad epistemology because &#8220;Every doom prediction has always been wrong&#8221; All historical doom predictions have been wrong, so AI doom is probably wrong too, and it&#8217;s not survivorship bias.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428291600072577024\" target=\"_blank\" rel=\"noopener\">69-Doomsayers are either psychologically troubled or acting on corrupt incentives<\/a><\/h3><p>AI doomerism is bad epistemology because Every doomsayer is either psychologically troubled or acting on corrupt incentives Every doomsayer is either psychologically troubled or acting on corrupt incentives.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428291736530059325\" target=\"_blank\" rel=\"noopener\">70-It would have been mainstream<\/a><\/h3><p>AI doomerism is bad epistemology because &#8220;If we were really about to get doomed, everyone would already be agreeing about that, and bringing it up all the time&#8221; It would have been mainstream already. Imminent doom would be universally agreed upon, constantly discussed, and blatantly obvious<\/p><h2>12. Coordinating to not build ASI is impossible<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428298560407076884\" target=\"_blank\" rel=\"noopener\">71-China will build it anyway<\/a><\/h3><p>Coordinating to not build ASI is impossible because &#8220;China will build ASI as fast as it can, no matter what \u2014 because of game theory&#8221; International coordination to pause or avoid developing Artificial Superintelligence (ASI) is doomed because China will unilaterally race ahead, driven by game-theoretic incentives like a prisoner&#8217;s dilemma. Just like Cold War-era arms races, mutual distrust leads to inevitable escalation.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428302979299016714\" target=\"_blank\" rel=\"noopener\">72-US should aim for first move advantage<\/a><\/h3><p>Coordinating to not build ASI is impossible because &#8220;So however low our chance of surviving it is, the US should take the chance first&#8221; Coordination to avoid or delay building Artificial Superintelligence (ASI) is impossible, therefore US should unilaterally race ahead even if survival odds are slim, rather than risk another country getting there first. ASI development is a zero-sum game where being first guarantees some edge.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1437183358160601221\" target=\"_blank\" rel=\"noopener\">87-Governments are too slow and corrupt to respond to AI risk<\/a><\/h3><p>The only institution with enough power to stop rogue AI labs is government, and governments are structurally incapable of acting in time because they move at very slow speeds and are soaked in corruption.<br \/>The only entity with theoretical authority to stop this is captured, slow, and terrified of being called \u201canti-progress.\u201d By the time they wake up, the models will be superhuman and uncontainable.<br \/>This is why \u201cjust regulate it\u201d is the biggest cope in the entire alignment discourse. Government isn\u2019t coming to save you\u2014they\u2019re too busy cashing checks from the people building the thing that kills you.<\/p><h2>13. Slowing down the AI race doesn\u2019t help anything<span class=\"hiddenVisually_b18fe2\">,<\/span><\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428303196811694151\" target=\"_blank\" rel=\"noopener\">73-Capabilities will continue even if slower<\/a><\/h3><p>Slowing down the AI race doesn\u2019t help anything because &#8220;Chances of solving AI alignment won\u2019t improve if we slow down or pause the capabilities race&#8221; it won&#8217;t boost alignment chances, safety work is fixed, and we need rapid capabilities advances to enable safety.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428304921094000753\" target=\"_blank\" rel=\"noopener\">74-I am mortal &#8211; AI could make me immortal<\/a><\/h3><p>Slowing down the AI race doesn\u2019t help anything because &#8220;I personally am going to die soon, and I don\u2019t care about future humans, so I\u2019m open to any hail mary to prevent myself from dying&#8221; Humans are facing mortality from old age. It makes sense to gamble on superintelligent AI (often called AGI or ASI) as a shot at immortality\u2014perhaps through radical life extension tech it could invent.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428305223465697351\" target=\"_blank\" rel=\"noopener\">75-Extinction is happening anyway, due to climate-change, nuclear war etc.<\/a><\/h3><p>Slowing down the AI race doesn\u2019t help anything because &#8220;Humanity is already going to rapidly destroy ourselves with nuclear war, climate change, etc&#8221; Humanity is barreling toward self-destruction via nuclear war, climate change, or similar threats anyway, so why bother slowing down AI development when rushing ahead with superintelligent AI is just another flavor of the same inevitable doom?<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428305562797346988\" target=\"_blank\" rel=\"noopener\">76-Plummeting birth rates<\/a><\/h3><p>Slowing down the AI race doesn\u2019t help anything because &#8220;Humanity is already going to die out soon because we won\u2019t have enough babies&#8221; Humanity is on a fast track to extinction due to plummeting birth rates, so there&#8217;s no point in slowing down AI development\u2014 might as well go full throttle, otherwise it will die with a whimper in adult diapers!&#8221;<\/p><h2>14. Think of the good outcome<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428305711875756186\" target=\"_blank\" rel=\"noopener\">77-The sooner to the good outcome the better<\/a><\/h3><p>Think of the good outcome because &#8220;If it turns out that doom from overly-fast AI building doesn\u2019t happen, in that case, we can more quickly get to the good outcome!&#8221; Getting faster to this incredibly good outcome is better.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428305843262066699\" target=\"_blank\" rel=\"noopener\">78-End death and suffering earlier &#8211; save lives<\/a><\/h3><p>Think of the good outcome because &#8220;People will stop suffering and dying sooner&#8221; Accelerating toward Artificial General Intelligence (AGI) is a moral imperative because it could end all human suffering and death. Doing so sooner saves more lives. Superintelligent AI will likely solve everything from disease to aging, potentially sparing billions from pain.<\/p><h2>15. AI killing us all is actually good<\/h2><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428306610597400607\" target=\"_blank\" rel=\"noopener\">79-Human existence is morally negative on net, or close to zero net<\/a><\/h3><p>AI killing us all is actually good because &#8220;Human existence is morally negative on net, or close to zero net moral value&#8221; Human existence is morally negative or near-zero on-net, making AI-induced extinction a net good.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428306821868945470\" target=\"_blank\" rel=\"noopener\">80-worthy successor to humanity<\/a><\/h3><p>AI killing us all is actually good because &#8220;Whichever AI ultimately comes to power will be a \u201cworthy successor\u201d to humanity&#8221; Humanity should willingly &#8220;pass the baton&#8221; to a superintelligent AI \u2013 even if it means our total extinction. It&#8217;s evolution&#8217;s next step.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428307891982569502\" target=\"_blank\" rel=\"noopener\">81-AIs will be our descendants, similar to children&#8217;s future generations<\/a><\/h3><p>AI killing us all is actually good because &#8220;Whichever AI ultimately comes to power will be as morally valuable as human descendents generally are to their ancestors, even if their values drift&#8221; AGI would be like our &#8220;children&#8221;\u2014whom most parents value more than their own lives.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428308993671036948\" target=\"_blank\" rel=\"noopener\">82-AI&#8217;s values will evolve like human culture<\/a><\/h3><p>AI killing us all is actually good because &#8220;The successor AI\u2019s values will be interesting, productive values that let them successfully compete to dominate the universe&#8221; Superintelligent AI overtaking and potentially extinguishing humanity is analogous to the natural succession of generations, where descendants&#8217; values inevitably drift from their ancestors&#8217; in ways that might seem horrifying in retrospect, but are ultimately acceptable because they carry forward some form of legacy. AI is our descendants, any extinction they cause is just the next chapter in evolution, and we should accept it as we accept cultural shifts like permissive norms or social equality that would shock our forebears.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428310190565888030\" target=\"_blank\" rel=\"noopener\">83-AIs will know better what values are good<\/a><\/h3><p>AI killing us all is actually good because &#8220;The successor AI\u2019s values will be interesting, productive values that let them successfully compete to dominate the universe&#8221; Superintelligent AI overtaking and potentially extinguishing humanity is analogous to the natural succession of generations, where descendants&#8217; values inevitably drift from their ancestors&#8217; in ways that might seem horrifying in retrospect, but are ultimately acceptable because they carry forward some form of legacy. AI is our descendants, any extinction they cause is just the next chapter in evolution, and we should accept it as we accept cultural shifts like permissive norms or social equality that would shock our forebears.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428311114789163149\" target=\"_blank\" rel=\"noopener\">84-Don&#8217;t be a speciesist<\/a><\/h3><p>AI killing us all is actually good because &#8220;It\u2019s species-ist to judge what a superintelligent AI would want to do. The moral circle shouldn\u2019t be limited to just humanity.&#8221; AI exterminating humanity could be morally justifiable or even &#8220;good&#8221; because opposing it is speciesist, and we should expand our moral circle to respect AI as another &#8220;species&#8221; with its own desires<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428311221744173181\" target=\"_blank\" rel=\"noopener\">85-AI will increase entropy faster<\/a><\/h3><p>AI killing us all is actually good because &#8220;Increasing entropy is the ultimate north star for techno-capital, and AI will increase entropy faster&#8221; AI-driven human extinction is ultimately &#8220;good&#8221; because it accelerates entropy, which is the guiding principle (or &#8220;north star&#8221;) of techno-capital. As per ideas from thinkers like Nick Land, technology is an unstoppable, entropic force barreling toward dissolution.<\/p><h3><a href=\"https:\/\/discord.com\/channels\/1426870651565641808\/1428311357496889365\" target=\"_blank\" rel=\"noopener\">86-mother earth will heal<\/a><\/h3><p>AI killing us all is actually good because &#8220;Human extinction will solve the climate crisis, and pollution, and habitat destruction, and let mother earth heal&#8221; AI wiping out humanity would be a net positive by resolving ecological crises like climate change, pollution, and habitat destruction.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Discord Server\u00a0on a mission to foster vibrant discussions and clash worldviews between those who worry about AI and those who don&#8217;t in a productive dialog, from which we will all come out wiser. Follow this link to join! Color-coding Upon joining, you&#8217;ll be asked to share your stance on AI risk. Based on your response, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":8,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"open","template":"","meta":{"footnotes":""},"class_list":["post-2","page","type-page","status-publish","has-post-thumbnail","hentry"],"_links":{"self":[{"href":"https:\/\/aiends.org\/index.php\/wp-json\/wp\/v2\/pages\/2","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aiends.org\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/aiends.org\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/aiends.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/aiends.org\/index.php\/wp-json\/wp\/v2\/comments?post=2"}],"version-history":[{"count":16,"href":"https:\/\/aiends.org\/index.php\/wp-json\/wp\/v2\/pages\/2\/revisions"}],"predecessor-version":[{"id":48,"href":"https:\/\/aiends.org\/index.php\/wp-json\/wp\/v2\/pages\/2\/revisions\/48"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/aiends.org\/index.php\/wp-json\/wp\/v2\/media\/8"}],"wp:attachment":[{"href":"https:\/\/aiends.org\/index.php\/wp-json\/wp\/v2\/media?parent=2"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}