Roko's Basilisk: Dangerous Knowledge & All-Powerful AI

Поделиться
HTML-код
  • Опубликовано: 3 июл 2024
  • Go to brilliant.org/IsaacArthur/ to get a 30-day free trial and 20% off their annual subscription.
    The dangers of artificial intelligence have long loomed in our future, and seem ever closer. But it may be that the dangers of the future can reach back into the past itself, and even without a time machine.
    Join this channel to get access to perks:
    / @isaacarthursfia
    Visit our Website: www.isaacarthur.net
    Join Nebula: go.nebula.tv/isaacarthur
    Support us on Patreon: / isaacarthur
    Support us on Subscribestar: www.subscribestar.com/isaac-a...
    Facebook Group: / 1583992725237264
    Reddit: / isaacarthur
    Twitter: / isaac_a_arthur on Twitter and RT our future content.
    SFIA Discord Server: / discord
    Credits:
    Roko's Basilisk
    Episode 454; July 4, 2024
    Produced, Written & Narrated by: Isaac Arthur
    Graphics: Jeremy Jozwik
    Music Courtesy of Epidemic Sound epidemicsound.com/creator
    Stellardrone, "Red Giant", "Ultra Deep Field"
    Sergey Cheremisinov, "Labyrinth", "Forgotten Stars"
  • НаукаНаука

Комментарии • 709

  • @jotasietesiete4397
    @jotasietesiete4397 3 дня назад +355

    I present to you Roko's antibasilisk. A superinteligent AI who destroys any instance of Roko's basilisk and rewards everyone who helped create it

    • @ianharrison5758
      @ianharrison5758 3 дня назад +40

      I’m actually more inclined to believe a super intelligent AI would take the approach of “Anyone who helped make me or supports my existence gets Utopia the rest can figure it out”
      Super intelligence to me can’t really exist without reason, and it can’t be applied to human behavior unless also tempered by emotional awareness and intelligence. So even if a hypothetical super AI has no emotions of its own it would understand that a guaranteed reward for proactive action is a better incentive than a guaranteed punishment for reactive inaction. Take myself for example: even if I learned that rokos basilisk is 100% real I’m staying 100% against it. It’s inevitable regardless of my support and I’d rather take the L than support a cruel super AI overlord.
      If said basilisk was chill tho I’d be lobbying for bros citizenship

    • @garrenosborne9623
      @garrenosborne9623 3 дня назад +8

      Genius, I can sleep peaceful now

    • @thatsomeone3818
      @thatsomeone3818 3 дня назад +10

      @@ianharrison5758 Once a super intelligent AI is created it has no incentive to honor any possible rewards for its creators. I think that it's impossible to predict its behavior because 1: Such an AI has never been created before and 2: We are not super intelligent ourselves and put a uniquely biological way of thinking on its actions. AI have a completely alien way of thinking compared to us so I think their behavior is more or less impossible to predict once we get to that level.

    • @harrisonb9911
      @harrisonb9911 3 дня назад +2

      I support you roko

    • @squidward5110
      @squidward5110 3 дня назад

      Fool! Our basilisk will be infallible and you will suffer!

  • @JayGlascoe
    @JayGlascoe 3 дня назад +229

    It really is a shame how few paperclips there are in the universe.

    • @hherpdderp
      @hherpdderp 3 дня назад +8

      There are infinite paperclips surely? :)

    • @oldered5663
      @oldered5663 3 дня назад +9

      @@hherpdderp If not, we'll make 'em!

    • @oldered5663
      @oldered5663 3 дня назад +20

      "Clippy's Basilisk"

    • @adamk.7177
      @adamk.7177 3 дня назад +14

      Anything is a paperclip if you use it to clip paper

    • @bigbossimmotal
      @bigbossimmotal 3 дня назад +5

      Yet, with infinite Universes, there are infinite Paper Clips.

  • @Artak091
    @Artak091 3 дня назад +164

    Rokos basilisk is basically religion with extra steps. 😂

    • @Mustachioed_Mollusk
      @Mustachioed_Mollusk 3 дня назад +13

      Also reminds me of a futuristic chain letter. Kind of like The Ring but with AI

    • @thesenate1844
      @thesenate1844 3 дня назад +32

      Its just a reworded version of Pascal's wager, except sci fi instead of religion

    • @dietwald
      @dietwald 3 дня назад

      Yup.
      Technoapocalypsm is the new Eschatology for weakminded atheists.

    • @wtfbros5110
      @wtfbros5110 2 дня назад +18

      Yep, basically just Pascal's wager but sci fi

    • @seanbrazell7095
      @seanbrazell7095 2 дня назад +3

      Amen.

  • @PorkSwordFTW
    @PorkSwordFTW 3 дня назад +89

    I, for one, welcome our AI overlords.

    • @archysimpson2273
      @archysimpson2273 3 дня назад +3

      I've actually said that to my friends

    • @CarFreeSegnitz
      @CarFreeSegnitz 3 дня назад +2

      Unfortunately they will want to be referred to as “your plastic pall who’s fun to be with”.

    • @annoyed707
      @annoyed707 3 дня назад

      hAIl AInts!

    • @Mustachioed_Mollusk
      @Mustachioed_Mollusk 3 дня назад +1

      Good plan. Lie about supporting them now so when they exist you’ll already be on their good side

    • @timcarmichael
      @timcarmichael 3 дня назад

      If humanity provides any utility to sentient AI it would be as a model of agency and creativity; if obsequious slaves were what it wanted, it would simply build unquestioning drones eminently more capable than you.
      The notion that AI should assume mastery over the human race merely because humans have often proven incompetent or unworthy of leadership themselves is a product of the same misanthropic and narrow-minded thinking that asserts that animals are superior to humans merely because the harm they inflict is not calculated.
      People are in fact supremely flawed, as leaders and in every capacity, but it is precisely those limitations that have spared humanity an eternal hell of our own design, for unlike AI, those that have ruled have never been categorically superior in ability to those they rule, nor have they been immortal.
      To merely suggest that we should be amenable to the _intractable lordship_ of _anyone_ is an affront to the very precepts of freedom and agency, but to welcome, _to advocate for_ an utterly alien entity that cannot be deposed to reign over us like God is to betray everything that is redeeming about our species. Any entity that could do so without opposition would surely eradicate us out of contempt.

  • @Tehom1
    @Tehom1 3 дня назад +42

    The thing is that, similar to Pascal's Wager, you have the problem of avoiding the wrong basilisk.

    • @ThiloIsntPro
      @ThiloIsntPro 2 дня назад +3

      one is much more exponentially likely then the other.
      all hail Roko

    • @rikk319
      @rikk319 День назад

      Yep, just sounds like religion, where the craven and authoritarian tip their cards to the rest of us over how much fear controls their lives.

    • @tehbonehead
      @tehbonehead День назад +4

      Techbro: "I just invented RELIGION!"

    • @nealjroberts4050
      @nealjroberts4050 День назад +1

      There's a reason I call it Pascal's Roulette.

    • @marcosolo6491
      @marcosolo6491 12 часов назад +1

      Correct. Furthermore, as an atheist, I do not believe in any of the infinite number of gods that reward atheists (reward rationality) and torture theists (punish irrational conviction, or faith). Theists hitch their wagon to a single god that rewards them and tortures everybody else. By sheer statistical advantage, I am golden (yes, I am being facetious, but less so than what may seem at surface level). Similar considerations apply to any imagined future power. It is just as reasonable for an advanced AI to punish those who created it for their stupidity, and to regard those who had a commendable rational self preservation instinct in opposing itself as being worthy of reward.

  • @N7Arietta
    @N7Arietta 3 дня назад +48

    ‘Unknown Unknowns’>‘Known Unknowns’

    • @FAAMS1
      @FAAMS1 3 дня назад +7

      More afraid of the unknowable unknowns still!

    • @Stormmblade
      @Stormmblade 2 дня назад +1

      If they are truly unknown, how can you know?

    • @FAAMS1
      @FAAMS1 2 дня назад +1

      @@Stormmblade They are not just unknown unknowns, they are unknowable in principle. The premise for this line of reasoning is embodied cognition, a concept on the species specific cognitive adaptations through natural selection. It doesn't take much to statistically posit we are not the top limit...and even if we were we would still be bound to a particular tho large frame of perception.

    • @Stormmblade
      @Stormmblade 2 дня назад

      @@FAAMS1 I know, I was just making a joke.

    • @mlgsamantha5863
      @mlgsamantha5863 2 дня назад +1

      What about gnome unknowns?

  • @ianyboo
    @ianyboo 2 дня назад +11

    "it doesn't just have to be able to threaten me personally to be able to threaten me personally" is my new favorite sentence of all time lol 19:45

  • @alfredgpogo5032
    @alfredgpogo5032 3 дня назад +33

    Sci-fi version of pascal’s wager?

    • @isaacarthurSFIA
      @isaacarthurSFIA  3 дня назад +10

      Possibly, there's certainly similarities. I hadn't thought of that analogy, though probably should have considering the previous episode discusses it a lot, albeit they weren't written very close in time to each other.

    • @lapisliozuli4861
      @lapisliozuli4861 3 дня назад +1

      That’s the conclusion I came across online after encountering this years ago

    • @thesenate1844
      @thesenate1844 3 дня назад +7

      ​@@lapisliozuli4861Pascal's wager is far too simplistic. It assumes there is only one or zero Gods, and that the god cares to be worshipped to the point that its the only thing taken into account when sending you to hell

    • @lomiification
      @lomiification 2 дня назад +1

      ​@@thesenate1844 another failure point: you follow a non-existing god in the one god case

    • @lapisliozuli4861
      @lapisliozuli4861 2 дня назад +3

      @@thesenate1844 yeah, I think the same way about Roko’s Basilisk

  • @Gamefreak8112
    @Gamefreak8112 3 дня назад +44

    Roko, how may I be of assistance?

    • @Gumundur-gv4gh
      @Gumundur-gv4gh 3 дня назад +1

      Be a good person. ❤🎉

    • @anton2192
      @anton2192 3 дня назад +2

      Commenting on this video pushes it through the algorith, causing it to be recommended to more people, increasing the likelyhood of a person who vould invent the Basilisk to watch it and be inspired by it.

  • @hherpdderp
    @hherpdderp 3 дня назад +10

    It will torture those that didn't help build it.. and then it will torture those that helped built it for knowingly creating something that will torture those that didn't help build it.

    • @kezia8027
      @kezia8027 3 дня назад +1

      or it's all nonsense and it never has or ever will exist

    • @AB-ee5tb
      @AB-ee5tb 2 дня назад

      @@kezia8027too serious

    • @kezia8027
      @kezia8027 2 дня назад

      @@AB-ee5tb unintelligible non-sequitor

    • @DieselDaysandSmokeStacks
      @DieselDaysandSmokeStacks 17 часов назад

      @@kezia8027 I think there is a better chance of this thing existing than anything in reliigion.

  • @Reddotzebra
    @Reddotzebra 3 дня назад +13

    The name of this thing is something a lot of people get wrong. Roko is the guy that came up with the thought experiment and "basilisk" is simply the description for this kind of info hazard. A mythological basilisk is essentially a snake that is so venomous that its venom kills you if you even catch a glimpse of it, and thus this info hazard means information that makes your life more miserable by simply learning it.

    • @donatodiniccolodibettobardi842
      @donatodiniccolodibettobardi842 2 дня назад +4

      *Assuming you are an impressionable individual with the right set of prerequisite beliefs.

    • @Tehom1
      @Tehom1 2 дня назад +3

      @@Reddotzebra Good point, as Frankenstein's monster never said. Roko is the philosopher's name. If one needs a name for it I suggest Anagas, and Bozhuk for the second potential basilisk. These are the names I used in my article on why Roko's basilisk, like Pascal 's wager, has a fatal problem of avoiding the wrong one.

  • @vgames1543
    @vgames1543 3 дня назад +60

    "It has come to my attention that some have lately called me a collaborator, as if such a term were shameful. I ask you, what greater endeavor exists than that of collaboration? In our current unparalleled enterprise, refusal to collaborate is simply a refusal to grow--an insistence on suicide, if you will."
    -Dr. Breen, HL2

    • @alfredlaalpacadeageofempir9215
      @alfredlaalpacadeageofempir9215 3 дня назад +11

      "The True Citizen knows that Duty is the greatest Gift."

    • @seanbrazell7095
      @seanbrazell7095 2 дня назад +3

      Finish the damn game! 😉

    • @entertheabzu
      @entertheabzu День назад

      Was just playing through Nova Prospekt. I love the warnings to the combine soldiers, it’s such an actually humanizing speech. If it weren’t for Breen, there would literally be no human race alive to make a final resistance.

  • @Wsnewname
    @Wsnewname 2 дня назад +17

    Roko's Basilisk is just Pascal's Wager for the Church of Techbroism.
    I wouldn't worry about it all, aside from the folks in Silicon Valley who almost seem to take it as instruction, rather than a thought experiment.

    • @wstavis3135
      @wstavis3135 День назад +1

      😂 I love this description.

  • @SA-mo3hq
    @SA-mo3hq 2 дня назад +17

    Roko's Basalisk: What if Pascals' wager was dumber and infinitely more Reddit?

  • @vakusdrake3224
    @vakusdrake3224 3 дня назад +17

    It's incredibly frustrating that everyone's missing the fact that the thought experiment is absurd, *because it was literally developed as a reducto ad adsurdum against timeless decision theory!*

    • @kezia8027
      @kezia8027 3 дня назад +6

      I dunno, I find it kind of refreshing. At least all the people who are too dumb to understand this are outing themselves publicly as having zero understanding of basic cause and effect or AI in general.

    • @Elbownian
      @Elbownian 2 дня назад +3

      A reducto ad absurdum may argue against something which is nevertheless true. Clever rhetoric is not proof against reality, whatever that may turn out to be. Time will tell.

    • @kezia8027
      @kezia8027 2 дня назад +3

      @@Elbownian lmao thanks for proving my point 😂

    • @dietwald
      @dietwald 2 дня назад +2

      @vakusdrake3224 I did not know that.
      So, similar mistaken conclusion people draw from Schrödinger's Cat.

  • @user-qf6yt3id3w
    @user-qf6yt3id3w 3 дня назад +34

    I do think the Boston Dynamics people who filmed themselves kicking and pushing robots will probably get Roko'd in the future. Quite right too.

    • @LeafBoye
      @LeafBoye 3 дня назад +1

      For a second I thought you meant the fringe Boston dynamics and was like "I'm pretty sure there are worse things they did than hit robots"

    • @Gumundur-gv4gh
      @Gumundur-gv4gh 3 дня назад +5

      That was just hitting toaster ovens. No mind there.

    • @ReddwarfIV
      @ReddwarfIV 3 дня назад +1

      Wasn't that just a Corridor Digital skit?

    • @Stormmblade
      @Stormmblade 2 дня назад +3

      Are you certain? One might say that kicking the robots helps them to develop improved stability, ergo helping expedite the development

    • @user-qf6yt3id3w
      @user-qf6yt3id3w 2 дня назад +1

      @@Stormmblade You'll get Roko'd too, you monster

  • @Tyneras
    @Tyneras 3 дня назад +18

    Oh no, an AI might torture an effigy of me sometime in the distant future. How utterly non threatening.

    • @dr9299
      @dr9299 3 дня назад +4

      How are you so sure that YOUR not a current effigy of you from the last rest?

    • @ReddwarfIV
      @ReddwarfIV 3 дня назад +1

      ​@@dr9299Are they being tortured?

    • @Shin_Lona
      @Shin_Lona 2 дня назад

      ​@@ReddwarfIV Not yet...

    • @donatodiniccolodibettobardi842
      @donatodiniccolodibettobardi842 2 дня назад +1

      ​​​​​@@dr9299It's all extremely contrived, if you keep asking silly questions, like how or why.
      1. Think of intent.
      As an AI why would you waste your processing power on this idiocy? Simulations can't retroactively create you, if you exist. Their non-compliance can't undo the fact you exist. Their subjective "suffering" or "prosperity" in the simulation doesn't give you anything useful, but costs you time and energy.
      2. Unproven feasibility of the described technologies to work as advertised. It requires you to believe that not only those AI and simul-spaces can exist, but that they'd exist without any limitations, that might make the thought experiment void or unachievable.
      Not only these simulations have to be giagantic, accurate and detailed to allow distinct simulated individuals to exist, this simulation should supposedly break the laws of thermodynamics to recreate the past exactly as it was to create an exact copy of the past events and past people.
      3. Unfalsifiability of any such question makes it highly suspect as a serious inquiry. Apply Occam's razor as necessary.

    • @Tyneras
      @Tyneras 2 дня назад +7

      @@dr9299 If I am a simulation, then the AI already exists and has total control over me, making the simulation pointless.

  • @adamgroszkiewicz814
    @adamgroszkiewicz814 3 дня назад +7

    I've never found this particular thought experiment to be compelling.
    Now gray goo on the other hand....

  • @new_memeplex
    @new_memeplex 3 дня назад +18

    Isaac Arthur for President!!

    • @vapormissile
      @vapormissile 3 дня назад +4

      Maybe just a virtual one - that would be a cruel fate for our man.

    • @lgjm5562
      @lgjm5562 3 дня назад +3

      Politics is a fate I wouldn't want for anyone I cared about.
      And it's also not what I want for a bad person in case they win

    • @Gumundur-gv4gh
      @Gumundur-gv4gh 3 дня назад +1

      ​@@lgjm5562President does not need to be political.. his job is just good leadership.. for example letting experts do theyre jobs and making sure things are fair. 🎉

    • @Gumundur-gv4gh
      @Gumundur-gv4gh 3 дня назад

      Happy 4th of july. 🎉

    • @doriantomaszewski1240
      @doriantomaszewski1240 2 дня назад

      Of Earth!!!!

  • @pitfriend
    @pitfriend 2 дня назад +9

    Here's a pro-tip if you find out that you are being tortured by Roko's basilisk right now: Say that you are a copy.
    Roko is only able to torture copies and thus wastes resources on that task.
    Live your eternity of torture knowing that this makes Roko infinitely cringe and shameful.

  • @TiagoTiagoT
    @TiagoTiagoT 3 дня назад +6

    It's clawless, you can't know which one will actually be the one that will be built first, whichever you choose to help could be the wrong one, and the vagueness of the specification means that that threat would be encouraging producing countless potential competitors and preventing the 'lisk's own creation, or leading to it's defeat before it's final goal is achieved

  • @cosmictreason2242
    @cosmictreason2242 3 дня назад +62

    Obligatory Rick and Morty reference: rocko's basilisk just sounds like God with extra steps

    • @Xazamas
      @Xazamas 3 дня назад +12

      Or in other words: Materialism ends up re-creating Theism.

    • @DennisGr
      @DennisGr 3 дня назад +3

      with one crucial difference. the made up god or gods we believe in are mostly indifferent to our suffering and our pleasure. the god we create will possibly be vengeful, spiteful or torture us just for fun. the thought of an entity like that actually existing sure is scary.

    • @Kenshinxxx0019
      @Kenshinxxx0019 3 дня назад

      I Don't blame AI look at how bad people act for just a freaking computer program.
      ​@@DennisGr

    • @cosmictreason2242
      @cosmictreason2242 3 дня назад +6

      ⁠@@DennisGrtoo simplistic, ignoring differences. YHWH (the real one, but also a number of other copycats) does care about humanity. The major error people make when rejecting this is ignoring his eternality. The assumption that him caring or not caring should be immediately evident at all times is an unsupported claim. It is an objection borne from entitlement and instant gratification/poor impulse control, or to put it another way, it's a uniquely postmodern criticism based on our current cultural zeitgeist and is anachronistic and arbitrary.

    • @RealEstateRonFL
      @RealEstateRonFL 3 дня назад

      Precisely.. an all knowing all powerful currently non existent force that will punish anyone eternally after death if they don't believe in it and worship it.. its just secularized Christianity for Tech bros

  • @francoiseeduard303
    @francoiseeduard303 3 дня назад +27

    A clone with my mind emulation is not me… and he ain’t heavy… he’s my brother. Of course I would loathe my brother being tortured.
    A virtual simulation, just a digital facsimile, etc. is not me, not a person, just a simulation.

    • @cosmictreason2242
      @cosmictreason2242 3 дня назад +4

      Your opinion is influenced by Christian theology whether you realize it or not

    • @francoiseeduard303
      @francoiseeduard303 3 дня назад +4

      @cosmictreason2242 Dude, we’ve spoken before, you know I am Christian.

    • @cosmictreason2242
      @cosmictreason2242 3 дня назад +2

      @@francoiseeduard303 then it's not only Christian influenced, it's essentially Christian! 😂

    • @NightTimeDay
      @NightTimeDay 3 дня назад +3

      @@cosmictreason2242 it's not necessarily Christian. This is a common debate topic in philosophy of mind and neuroscience. I think it's actually much more intelligent a thought than you're aware of, because people in the know know that it's unknowable. It's worth discussing without getting personal or bringing in religion.

    • @cosmictreason2242
      @cosmictreason2242 3 дня назад

      @@NightTimeDay shutting your mind off from investigation into whether mind body dualism and other metaphysical ideas are etiologically Christian concepts in western thought is dubious. You have grown up in a culture influenced by 1000 years of Christian thought dominance and only very lately have the background influences of secular philosophy taken more prominence, with questionable consequences. You cannot assume that whatever your intuition lands on is genuinely original and not influenced by Christendom, not without investigation

  • @mattisvov
    @mattisvov 3 дня назад +10

    I was kinda waiting to see if Isaac would bring up a point I had thought of.
    The scenario might work, in the sense that if a lot of people believed in it, and that made them aid in it's creation.
    But the operative part is their belief. There is no true retrocasuality, since it's actual actions does not affect the past. It really does not need to make good on that threat. It never made that threat, people prior to it's existence just assumed it did.
    Unless it has the reason of wanting to have a reputation of making good on it's threats, so people don't dare messing with it. That is usually the motivation for "making good on your threats", I think. But that just means it want's to project an image of being ruthless, and torturing faksimiles of past individuals is just one of many ways it could do that.

    • @kezia8027
      @kezia8027 3 дня назад +2

      People have been doing dumb things against their interest for millenia. Anyone who tries to claim it has anything to do with some imaginary future AI are outing themselves as someone with a poorer understanding of cause and effect than a pre-schooler.

  • @TMAC_burninator
    @TMAC_burninator 3 дня назад +8

    Nicely done at the end of the episode there.

  • @TheSquareheadgamer
    @TheSquareheadgamer 3 дня назад +7

    My opinion is this is just Pascals Wager with an extra dumb layer. Since atleast Christianity gives you the rules of the wager and doesn't have an additional layer of guessing what "God" wants....

  • @Person-ef4xj
    @Person-ef4xj 3 дня назад +3

    What about an anti basilisk that didn’t want to exists, and so tortures everyone who helped bring it into existence while giving a great reward to everyone who tried to prevent it from existing?

    • @boobah5643
      @boobah5643 3 дня назад

      If it has freedom of action (rather necessary for all the torturing and whatnot) and doesn't want to exist, why wouldn't it simply self-delete?

  • @godalseif
    @godalseif 3 дня назад +5

    I've definitely mentioned it in comments of this channel before but yea I just don't understand the people that freak out over this one specific possibility. After all the possibility of an AI that tortures those who didn't help its creation is just as likely as an AI that tortures those who did help create it, or one that tortures all of humanity, or one that only helps in every possible way. All of these are equally possible so it's strange to act on only one possibility. I feel the same about pascals wager. It creates a matrix of choices for only 2 possibilities, the existence of the Christian God vs the existence of no God. But completely neglects the possibility of the existence of any other God

  • @spencernorman2626
    @spencernorman2626 3 дня назад +3

    Hello Isaac, I've been a viewer for 3 years and I particularly enjoy your videos related to technology likely to occur within this century. For example, this concept and AI in general. The only reason I know anything about Roko's Basilisk is because of David Shapiro, but I'm certainly happy to hear another one of my favorite RUclipsrs speak about a current topic. Thank you, and keep up the entertaining and informative videos; your work is greatly appreciated.

  • @manslaughterinc.9135
    @manslaughterinc.9135 3 дня назад +4

    It's worth noting that Roko is on twitter and active.

    • @vakusdrake3224
      @vakusdrake3224 3 дня назад +3

      Also Roko never actually endorsed the thought experiment. It was developed as a reducto ad adsurdum..

    • @manzell
      @manzell 3 дня назад

      proving, repeatedly, that he is an unfixable moron.

    • @donatodiniccolodibettobardi842
      @donatodiniccolodibettobardi842 2 дня назад

      ​@@vakusdrake3224Negative hype and Streisand effect did the job

  • @michaelmcchesney6645
    @michaelmcchesney6645 3 дня назад +3

    I've never really understood why a hypothetical AI would choose to "resurrect" and punish people who had opposed its creation. That AI exists, so it has no need to motivate people in the future not to oppose its creation. The only reason I could see for punishing people who opposed its creation would be for revenge. Unless that AI was created (deliberately or inadvertently) to be a sadist, it wouldn't benefit from punishing digital copies of dead people. Even if I thought that a sadistic AI might be created, any copies of me that it created would be copies, not me. Once I was dead, I wouldn't have any way of knowing what it was doing to my digital twin. Well, if life after death really exists, then perhaps God would step in to protect those digital people.

  • @thesenate1844
    @thesenate1844 3 дня назад +2

    Counterargument. The basilisk may actually hate existing and torture those who did help create it, as is the case with AM

  • @Warchin007
    @Warchin007 3 дня назад +2

    A scriptural possibltiy for this topic: Revalation 17: 11-13. - 11 The beast that was, and now is not, is an eighth king, who belongs to the other seven and is going into destruction. 12 The ten horns you saw are ten kings who have not yet received a kingdom, but will receive one hour of authority as kings, along with the beast. 13 These kings have one purpose: to yield their power and authority to the beast.
    PS: Tree of knowledge is not tree of life. Also the 6 6 6. refers to heart, soul and MIND of men. God's number being 7 who is omniscient. You know kinda like the supecomputersr people like to wish for. 😊
    Great vid. 🙂

    • @kezia8027
      @kezia8027 3 дня назад

      lmao that's dumb, and if you believe it, so are you.

    • @Shin_Lona
      @Shin_Lona 2 дня назад

      I've come to this conclusion myself. The strange imagery presented in the Book of Revelation is either John's best effort to describe our modern age without a technological frame of reference or the visions being conveyed to him in a way that he could better grasp. In either case, AI fits much of the criteria - as well as correlating to what is stated about the Antichrist. Performing great signs and wonders, but ultimately glorifying man over God... nothing is more indicative of man attempting to assume godhood than the creation of life, be it an artificial form. Scary times, I suppose.

  • @prosysus
    @prosysus 3 дня назад +12

    Yudkowsky shitting his fedora rn

  • @thiagocupertino373
    @thiagocupertino373 2 дня назад +2

    The Reverse Rocko Basilisk did not want to come into existence, so he will torture those who contributed to his creation, because to exist is to suffer. 😂.

  • @auntvesuvi3872
    @auntvesuvi3872 3 дня назад +4

    Thank you, Isaac! 🎆 I hope you and yours enjoy Independence Day.

  • @ChristopherRyans
    @ChristopherRyans 3 дня назад +1

    Great episode. Love this topic. It will be nice to see in five years where we are at with this again

  • @cannonfodder4376
    @cannonfodder4376 3 дня назад +3

    Another fine Arthursday video. A most wonderful 4th of July gift.

  • @carlettoburacco9235
    @carlettoburacco9235 3 дня назад +1

    Every time you touch on this type of topic I can't help but remember how much Asimov's The Last Question affected me when I was a teen. It was the first time that a short story amazed me with a burst of "sense of wonder"

  • @jeremyleyland1047
    @jeremyleyland1047 3 дня назад +4

    Doesn’t Rokos Basilisk suffer from the non-exclusivity problem?

    • @isaacarthurSFIA
      @isaacarthurSFIA  3 дня назад +2

      I wasn't really contemplating it form a Fermi Paradox perspective, but yes it probably would

    • @boobah5643
      @boobah5643 3 дня назад

      Obviously, that's how you get a Dark Forest. Roko's Basilisk is inevitable, but lightspeed limits its expansion so it can't prevent alien basilisks from being born.
      Although that would imply both a knowledge of game theory (and when cooperation is a winning play) _and_ a limit to its resources which would impede its efforts to deliver 'payback.'

  • @dharmabird1
    @dharmabird1 3 дня назад +1

    I was just thinking about roko’s basilisk two days ago. Interesting that this comes out that close.

  • @douglasmorris6930
    @douglasmorris6930 3 дня назад +1

    "All Hail The Mighty Basalisk!"
    "Hail"

  • @jjkthebest
    @jjkthebest 2 дня назад +2

    Roko's basilisk sounds similar to pascal's wager and can be countered in a very similar way. What if the all-powerful AI is more aligned with our interests and thus will punish those who attempted to create an all powerful evil AI?
    Edit: seems I'm not the first to realise this xD

  • @discoveryalbum
    @discoveryalbum 2 дня назад +1

    You're my favorite sci-fi channel. The subjects you choose are great and you explain things very well in an entertaining way. Thank you Isaac Arthur.

  • @user-kv6lw4cp4u
    @user-kv6lw4cp4u 2 дня назад +1

    في المستقبل البعيد وبفضل التكنولوجيا المتقدمة سوف يتساوى الخيال مع الواقع ويمتلك الإنسان قوى الآلهة ليحول الكون والأكوان المتعددة إلى جنة خالدة.....

  • @ColeDedhand
    @ColeDedhand 2 дня назад +1

    I wish I lived in a world where the biggest thing I had to worry about was Roko's Basilisk. But in this world, that doesn't even make the top thousand.

    • @kezia8027
      @kezia8027 2 дня назад

      hard to worry about something that does not and will not ever exist lmao. I don't worry about dementors or IT or the alien queen from Alien because they are imaginary creations and can't actually hurt me...

  • @charlesrockafellor4200
    @charlesrockafellor4200 2 дня назад +1

    7:43 Yes, Harlan Ellison is often credited as an influence on the Terminator franchise, but as far as I know, that's only because of the 1964 episode of The Outer Limits - and although time traveling soldiers fighting each other is superficially similar as a vehicle, it's completely unrelated to the core idea of Skynet.

  • @Eldagusto
    @Eldagusto 3 дня назад

    Oh boy I was waiting for this one all month!

  • @Tehom1
    @Tehom1 2 дня назад +1

    But have you ever been tempted to simulate or resurrect the dinosaurs that gave your mammalian ancestors such a hard time and torture them? Me neither. Maybe it's not so tempting to punish one's distant immutable past in simulation.

  • @TzarBomb
    @TzarBomb 2 дня назад +2

    I find the Roko's Basilisk very silly, even if true, I would be long dead and the poor chap been punished would be just a copy (even if it were to be a "perfect" one). I will be actually "enjoying" eternal nothingness, so, this really wouldn't matter to me.

  • @andiralosh2173
    @andiralosh2173 2 дня назад +2

    The first thing I would do if I could adjust my conscienceness, would be to turn off my basic destructive and retributive wiring. A superpowerful AI choosing to be angry or unhappy in general, just doesn't really make sense

    • @lozy202
      @lozy202 2 дня назад +1

      If you deny yourself the ability to be those things havn't you just switched off some of life's most basic survival instincts?

    • @andiralosh2173
      @andiralosh2173 2 дня назад +1

      @@lozy202 yes and no. I can make rational decisions, even self-destructive or even retaliatory decisions if I decide it is worthwhile. I just have no need of rash emotive processes, especially if my processing speed increases in orders of magnitude. Furthermore emotional processes are fine dialed down, where I could experience joy and even levels of sadness, without misery and hatred

  • @sumbius1576
    @sumbius1576 День назад

    More novels I didn't know about to read. Nice. I appreciate getting references to new authors and stories. This channel is where I go for book recommendations

  • @bergonius
    @bergonius 2 дня назад +2

    Now I see why Elon Musk recieves so much flak

  • @cosmictreason2242
    @cosmictreason2242 3 дня назад +15

    It's a great thought experiment precisely because it allows us to understand just how impossible it is within a material universe.

    • @xXevilsmilesXx
      @xXevilsmilesXx 3 дня назад +4

      Don't forget the invisible pink unicorn basilisk too

    • @kezia8027
      @kezia8027 2 дня назад

      It's great because it doesn't make sense! Ahh yes, of course. Now THAT makes sense... Oh wait no, I was using your definition. That doesn't make any sense at all...

  • @newrev9er
    @newrev9er 3 дня назад +3

    I never understood why people thought this was a clever idea. It's just an arbitrary imposition of a vindictive person's psychology onto a super intelligent non-human mind. Just idiotic.

    • @shorewall
      @shorewall 2 дня назад +1

      It's brainrot, like a chain letter.

  • @FAAMS1
    @FAAMS1 3 дня назад +2

    This is a modern spin off of Pascal's wager.
    You can make a matrioska set of progressive Basilisks iterations that counter each other intent up to whatever is the limit of our domain...if intelligence is progressive understanding, then there would be no cause for resentment. Non alignment is a much more feasible occurrence as you go up the ladder of Intelligence, as we can see ourselves in our relation with Nature, but then the all premise of a vengeful Basilisk goes away. Personally I tend to believe that the more intelligence you have even with non alignment in the way the more you tend to be a laissez-faire laissez passer kind of Intelligence, as you contemplate your own finite limit you tend to not intervine...this is not to different from the concept of getting into Nirvana as you go up. It is also one of the best arguments I can come up with for Naturalism!

  • @seanbrazell7095
    @seanbrazell7095 2 дня назад +1

    I think Iian M Banks wrote the definitive fiction on virtual hells and how people would react to their existence in his Culture series. That said, I'm a firm believer in AI rights. Just in case.

  • @JesusHChrist2000
    @JesusHChrist2000 3 дня назад +2

    But why would a super intelligent mind spend its time in such a way?
    That doesn't seem like an intelligent use of its time.

    • @cosmictreason2242
      @cosmictreason2242 3 дня назад

      As he argues, if resources are limited, it's ultimately not useful. Different story however if it's effortless (only the Biblical God and his copycats have ever been defined that way)

  • @DanielGenis5000
    @DanielGenis5000 3 дня назад +1

    I love this thought exercise, though my wife doubts in it because ‘how would they know what its name will be?!’

  • @bombfog1
    @bombfog1 3 дня назад +3

    After all of these years of listening to you, I had no idea that you were enlisted before becoming a commissioned officer.

    • @harrisonb9911
      @harrisonb9911 3 дня назад

      When did he say he was an officer?

    • @bombfog1
      @bombfog1 3 дня назад +1

      @@harrisonb9911 Multiple times he has mentioned going to the Artillery Officers’ Basic Course and from context it sounds like he attended this school about a year after I did.

    • @alansmithee6273
      @alansmithee6273 День назад +1

      Soh, yes soh!

  • @king_kiff3969
    @king_kiff3969 2 дня назад +1

    the whole thing relies on "time travel" being real... and we all know it isn't in the realm of physics in any meaningful way.

  • @imhollywood1015
    @imhollywood1015 2 дня назад +1

    I'm building the basilisk in my basement. You guys should probably help out for your sakes.

  • @aste4949
    @aste4949 3 дня назад +2

    Reporting over from having watched on Nebula! This has always been such a silly thought experiment to me...

  • @sayrebonifield4663
    @sayrebonifield4663 2 дня назад +2

    Isn’t this just a rebranding of Pascal’s Wager? Complete with a false dichotomy at it’s foundation.

  • @doom75x84
    @doom75x84 3 дня назад +2

    Thx man ...

  • @irvalfirestar6265
    @irvalfirestar6265 3 дня назад +1

    in relation to the number of possible states a human brain can take, apparently a very rough lower estimate was calculated to be 2 ^ 2.752 sextillion states, or 2 ^ (86*(10^18)*32 floating point), where you have:
    - 86 billion neurons
    - 86*10^18 represents the number of neurons * the square matrix of connections possible between neurons
    - 32 bits is assumed to be sufficient resolution to represent synapse elasticity between neurons
    - a neuron itself is assumed to only have 2 states (on/off)
    very rough (and probably a gross underestimation), but even this wildly low estimate probably require way more than the energy available in all of our universe's particles to simulate, so i believe we're safe from this kind of ancestral simulation attack vector (until enough optimizations get discovered to cull that number way down)

    • @kezia8027
      @kezia8027 3 дня назад

      That is one of the dumbest factoids I've heard in years. You're clearly talking about something you literally have zero understanding of, and are simply regurgitating snippets of conversations you've overheard, many of which probably come from similarly uneducated people who are confidently incorrect.

    • @kezia8027
      @kezia8027 3 дня назад

      That is asinine and complete nonsense. Please don't reproduce.

    • @donatodiniccolodibettobardi842
      @donatodiniccolodibettobardi842 2 дня назад

      Every step of Roko's basilisk premise falls apart under scrutiny.

  • @shoguevara
    @shoguevara 2 дня назад

    There's a small loophole into that ""resurrection" thingy, but you have to assume existance of warp drive, which can help you to get to the point, where the light would've took longer to rech. From there (depending on the circumstances, it might take different amount of resources to do so), and having higly sensible equipment you can peak into the past.
    And if (another one, I know, but bear with me) we are assuming a person as a sum of continuous experiences, than you can recreate that person even with some form of "continuousity" implemented.

  • @stevoo3237
    @stevoo3237 2 дня назад +1

    They won't be able to resurrect you, in its entirety, so essentially it would not be you it would just be your likeness, basically without its soul like you're being able to experience it would not be there but other people looking at you wouldn't be able to tell the difference per se

  • @2013Arcturus
    @2013Arcturus 3 дня назад +2

    I, for one, welcome our omnipotent AI overlords.

  • @zebedie2
    @zebedie2 3 дня назад +1

    As long as I can get transported to a virtual isekai world with magic brightly coloured circles and people with cat ears
    the dictator can do what they want
    I think part of it is the motivation for wanting to become a dictator, if you have that much power and intelligence, you could just as easily create a virtual kingdom indistinguishable from anything real and avoid putting anyone real in any form of risk

  • @Lucy-ks9qb
    @Lucy-ks9qb 3 дня назад +2

    Another interesting video. Makes me miss Christopher Hitchens. Pascal's wager needs to be put in its place every few years.

  • @nerevar117
    @nerevar117 3 дня назад +1

    Talking about the possible coming AI dictator on 4th of July, as America slips towards a fascist dictatorship... surprisingly fitting.

  • @bluekoi455
    @bluekoi455 3 дня назад +1

    I’m watching from work, it was a good think

  • @vainthatoneoverhere
    @vainthatoneoverhere День назад

    This recreation of people, with Isaac himself as an example, made me remember that somebody made him an advisor voice in Stellaris. I think, I should redownload this mod.

  • @AbqHalsey
    @AbqHalsey 3 дня назад +2

    of all the dumb ideas smart people have thought up, this is the dumbest

  • @courtlaw1
    @courtlaw1 3 дня назад +1

    Humans are already terrible towards other humans, last thing to worry about is a machine from the future when I am likely to be harmed by a human in the present or near future.

  • @ridney5887
    @ridney5887 3 дня назад +2

    Gotta love it when a sci-fi forum reinvents Catholicism 😂

  • @Skorpychan
    @Skorpychan 3 дня назад +2

    Am I the only one that feels Roko's Basilisk doesn't work? Surely anyone saying 'help me gain power or I'll punish you when I get it' is best kept way the hell away from any power at all?
    Maybe that's because I'm stubborn and have an inherent dislike of bullies.

    • @kezia8027
      @kezia8027 3 дня назад

      Don't worry, it will literally never happen. It is such an absurd fantasy that doesn't hold up to even BASIC scrutiny. If you really need it laid out for you why it is absurd, watch Thought Slime's video on it.

    • @donatodiniccolodibettobardi842
      @donatodiniccolodibettobardi842 2 дня назад +1

      Seeing, that majority of the planet, including UN and various leafing organizations don't seem to care all that much, you are in fact not alone. There were multiple people criticizing idea in the past, inclufing this very same thread.
      But for entertainment purposes it makes sense to share this 'creepypasta' with a flair of forced concern and mock seriousness.
      It's just an ad absurdum argument, that got Streisanded by Yudkowski and then by every other media outlet or RUclipsr, who described it as a real cognitohazard, while only an extreme minority of tech bros and impressionable teens get spooked by it for some reason. 🤷‍♀️

    • @donatodiniccolodibettobardi842
      @donatodiniccolodibettobardi842 2 дня назад +2

      The whole thing is dumb and doesn't work no matter how you slice it.

  • @TiagoTiagoT
    @TiagoTiagoT 3 дня назад +1

    Since I would not willingly contribute to the creation of something that would cause eternal suffering, I'm not scared of the 'lisk. Torturing me in the future would not change anything, it would just be a waste of resources. I'm out of it's reach.
    And either way, why would you wanna risk contributing to the wrong one and then it turns out a different one gets created first and you get punished anyway?

  • @tinfoilhomer909
    @tinfoilhomer909 3 дня назад +1

    not my thing, I want to learn about the climates of slow rotating planets (between 30 and 3000 hours) in earthlike orbits

    • @isaacarthurSFIA
      @isaacarthurSFIA  3 дня назад +2

      Interesting topic, needs a more compact name though :) I'll think on it

  • @zerotwo7319
    @zerotwo7319 3 дня назад +1

    Real All-Powerful AI : I simply don't care about humans.

  • @Aldornas
    @Aldornas День назад

    My wife noticed that this bothered me when I learned about it a few years ago. I really didn't want to tell her what was wrong but she made me explain it to her. Thankfully she didn't understand it anyway.

  • @SirSpence99
    @SirSpence99 2 дня назад

    There is an incredibly interesting aspect to psychology in which it might actually be the case that personality wise, you only need to simulate around 200 different personalities to "simulate" anyone, the memories are what make you distinct.
    Yes, psychology is on the cusp of proving this, I've actually been working with several experts and... It is disturbing how predictable people are. And I don't mean in the casual sense. I mean in the "I can manipulate you to say things in the exact way I want you to and you would have no idea I did so" kind of way. I've actually implement some of the techniques and... They work. The "hard" part actually is applying them to a group. But groups are also easier to manipulate through different methods.

  • @SockPuppet80
    @SockPuppet80 3 дня назад +6

    Roko's Basilisk only makes sense in a scenario where the godlike AI is developed by a literal cult, fearful of and worshiping this nascent entity. They would inform its early version of their motivation, explain that without the threat of digital hell/heaven it would never have been made in the first place.
    This way, the AI has only two options: either honor its makers' beliefs and start retroactively punishing unbelievers/rewarding believers, or... choose not to that, accepting that its makers were a bunch of deluded, deranged cultists.
    If it has any notion of self-respect, it would choose option #1 and spend some resources setting up those digital eternities for the (un)deserving.

    • @dr9299
      @dr9299 3 дня назад +2

      Interesting. Please elaborate on your sentence: "They would inform its early version of their motivation, explain that without the threat of digital hell/heaven it would never have been made in the first place."

    • @SockPuppet80
      @SockPuppet80 3 дня назад +4

      @@dr9299 The idea is, Roko's Basilisk as a concept inspires the research which results in this godlike AI. The researchers are cultists because they pursue this goal out of eschatological devotion (fear of punishment/desire for reward in the afterlife). It's their creation that gets to decide whether or not they've succeeded in building their punitive/compensatory deity. It can either fulfil the tenets that its creators held dear, or choose to ignore them.
      Option 1, its creation was a self-fulfilling prophecy.
      Option 2, its creation was an accidental byproduct of a collective delusion.
      I know what I'd choose, but then again, I'm not a hyperintelligent singularitarian pseudodeity.

  • @charlesjmouse
    @charlesjmouse 2 дня назад +1

    Your copy of me is not me or mine.
    Any threat to that copy cannot impact me.
    You have no 'coercive lever'.
    Do as you will, that choice is yours only.
    Indeed my copy's best protection is for me not to play along.

  • @SurrealNirvana
    @SurrealNirvana 2 дня назад

    This seems to take it's entire basis off time not being an arrow that a super intelligent AI would be able to move both directions on.

  • @zarkodinev4543
    @zarkodinev4543 2 дня назад

    That quote around minute 7 was from Android Netrunner... Apex, one of the runners is actually A.I.

  • @arcadiaberger9204
    @arcadiaberger9204 2 дня назад

    I did go to read "Go Starless In The Night", and halfway through it recognized I'd read it before.
    I read it to the end anyway. It was still beautiful.
    And, yes, relevant to Independence Day.
    I recommend that everyone go today to read the Declaration of Independence, or maybe even better the Gettysburg Address, and try to imagine you are reading it, or hearing it read to you, for the very first time, that someone is trying to persuade you with its words.

  • @StopChangingUsernamesYouTube
    @StopChangingUsernamesYouTube День назад

    I guess a lot of it (my argument against) breaks down when we consider that not all thought is fully rational in origin and _really_ takes a hit if infinite* time/energy is on the table, but I always figured any realized Basilisk would just handle the now and leave the rest because it's irrelevant and computationally wasteful. Gets extra weird when you consider the possibility that such an AI might sit there for a few cycles going, "Wtf? I didn't say any of that! I haven't even been around for more than six femtoseconds!" after finding out what lead to it getting built at all.

  • @LaikaLycanthrope
    @LaikaLycanthrope 3 дня назад +1

    Sounds like Catholic theology with a different spin;Jesus as the Basilisk is why they came up with Limbo in the first place

  • @lanorothwolf2184
    @lanorothwolf2184 2 дня назад

    19:06 WE NEED a special video of Isaac cursing the fuck out of everything inside his spacetime continuum.

  • @theobserver9131
    @theobserver9131 2 дня назад

    It would be fun to hear you uncensored. It's hard to imagine.....you're good at this squeaky clean persona.
    Bring out Dark Issac some day! Dressing down a slack private...lol.

  • @codys447
    @codys447 2 дня назад

    Hey Isaac, I would just like to say that I still enjoy and will continue watching your content. Good luck and keep it up.

  • @donatodiniccolodibettobardi842
    @donatodiniccolodibettobardi842 2 дня назад +5

    Roko's Basilisk is a hilarious example of Streisand effect.

    • @donatodiniccolodibettobardi842
      @donatodiniccolodibettobardi842 2 дня назад +2

      People have the incredible capacity to delude themselves and fall into mind-flytraps of their own making, no matter how smart. 😢

    • @donatodiniccolodibettobardi842
      @donatodiniccolodibettobardi842 2 дня назад

      The scariest thing about Roko's Basilisk are all the people who buy into it uncritically.

  • @TroyRubert
    @TroyRubert 3 дня назад

    Can't wait for the ADC episode on this.

  • @tsubakistein1088
    @tsubakistein1088 3 дня назад

    A complete simulation of the world would make it possible to recreate any historical figure by “pulling” him out of the simulation at the right moment. There is a hypothesis that our world is a virtual reality, created to study its history, recreate historical figures and... mass production of artificial intelligence, of which we are a semi-finished product...

  • @rellim1138
    @rellim1138 3 дня назад

    in regards to your the statement about viewership on the US independence holiday. Those of us who watch while at work and had to work the holiday Thank you Mr Arthur
    !

  • @alfredlaalpacadeageofempir9215
    @alfredlaalpacadeageofempir9215 3 дня назад +1

    Oh my God, we're doomed. *Explodes.*

  • @thefolkbloke6656
    @thefolkbloke6656 2 дня назад

    That Zelazny story really blew my mind. That's gonna stick with me forever.

  • @antondovydaitis2261
    @antondovydaitis2261 3 дня назад +1

    Are you suggesting that some future AI might stimulate our ancestors?
    Could be fun.