⋯ full post (850 more characters) ⋯ show less
Interesting responses on SN. Seems users there are in complete denial about the possibility of AI doom - they're actually mocking anyone who considers it, and strawmanning the argument as coming from one disgruntled Anthropic employee (or even suggesting some galaxy brained IPO marketing pump).
This is deeply ignorant. It is a real and serious risk, even if most of the people thinking and talking about it are insufferable EA types. Look at their arguments and the evidence they present - AI is getting much more capable and can scale much quicker than we can comprehend, and it's shown misaligned behaviour very frequently. Many plausible doom scenarios have been described in detail by organisations like MIRI.
I'm hoping for a positive AGI / superintelligence outcome, and think it's more likely, but the risk is real. Mocking it makes you sound like an MMT proponent making fun of people who think sovereign debt is a risk even though the US has not meaningfully defaulted before.
nostr:nevent1qqs2n93ulsu0xcmmwhptvtn5je6f3hxm75mjzal7cwv9cnkgc880u9qzyzf8jfmtl7urem3nj3h9vnpkqz3jsspxn2pqd5qamaqvvset4g9ukqcyqqqqqqg69gh2w
Interesting responses on SN. Seems users there are in complete denial about the possibility of AI doom - they're actually mocking anyone who considers it, and strawmanning the argument as coming from one disgruntled Anthropic employee (or even suggesting some galaxy brained IPO m